2024-02-13T14:19:17.992 INFO:root:teuthology version: 0.0.1.dev256+gd9fdb22 2024-02-13T14:19:17.993 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_phlogistonjohn@teuthology --archive /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043 --name phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi --verbose --description orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} -- /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043/orig.config.yaml 2024-02-13T14:19:18.025 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-13T14:19:18.096 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043 branch: wip-phlogistonjohn-testing-2024-02-12-1654 description: orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} email: jmulligan@redhat.com first_in_suite: false job_id: '7558043' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-phlogistonjohn-testing-2024-02-12-1654 ceph: conf: client: debug ms: 1 global: mon election default strategy: 3 ms bind msgr2: false ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon warn on pool no app: false osd: debug ms: 1 debug osd: 20 osd class default list: '*' osd class load list: '*' osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - reached quota - but it is still running - overall HEALTH_ - \(POOL_FULL\) - \(SMALLER_PGP_NUM\) - \(CACHE_POOL_NO_HIT_SET\) - \(CACHE_POOL_NEAR_FULL\) - \(POOL_APP_NOT_ENABLED\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) mon_bind_msgr2: false sha1: e1b79d5a4193a484176863ab96c0ca28c00e1662 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} cephadm: cephadm_mode: root install: ceph: flavor: default sha1: e1b79d5a4193a484176863ab96c0ca28c00e1662 workunit: branch: wip-phlogistonjohn-testing-2024-02-12-1654 sha1: e1b79d5a4193a484176863ab96c0ca28c00e1662 owner: scheduled_phlogistonjohn@teuthology priority: 99 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.foo.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a seed: 1588 sha1: e1b79d5a4193a484176863ab96c0ca28c00e1662 sleep_before_teardown: 0 subset: 1/15 suite: orch:cephadm suite_branch: wip-phlogistonjohn-testing-2024-02-12-1654 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e1b79d5a4193a484176863ab96c0ca28c00e1662/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e1b79d5a4193a484176863ab96c0ca28c00e1662 targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ9S3+HyHAqOy4q93LWnnosln0ozDp2pOS5RHjafqcOIRB4K6BEb2XP2lcLhWYQquQIzFwdfRgfaurt4sXDBmXc= smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWLqquXXe4Inp+YteiKEZ+wOw9xEvT3M77T3JQ9mqD1TKF5Y5yNWOBVN2afP0LaARlfrJpAkOHCy39Ou4Nk4yo= tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test.sh - rados/test_pool_quota.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: d9fdb2209e15b39d9f061fd85399f352ce0f0894 timestamp: 2024-02-13_11:41:43 tube: smithi user: phlogistonjohn verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-13T14:19:18.096 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e1b79d5a4193a484176863ab96c0ca28c00e1662/qa; will attempt to use it 2024-02-13T14:19:18.096 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e1b79d5a4193a484176863ab96c0ca28c00e1662/qa/tasks 2024-02-13T14:19:18.097 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-13T14:19:18.098 INFO:teuthology.task.internal:Checking packages... 2024-02-13T14:19:18.123 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'e1b79d5a4193a484176863ab96c0ca28c00e1662' 2024-02-13T14:19:18.123 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-13T14:19:18.123 INFO:teuthology.packaging:ref: None 2024-02-13T14:19:18.123 INFO:teuthology.packaging:tag: None 2024-02-13T14:19:18.123 INFO:teuthology.packaging:branch: wip-phlogistonjohn-testing-2024-02-12-1654 2024-02-13T14:19:18.124 INFO:teuthology.packaging:sha1: e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:19:18.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-phlogistonjohn-testing-2024-02-12-1654 2024-02-13T14:19:18.264 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:19:18.266 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-13T14:19:18.272 INFO:teuthology.task.internal:no buildpackages task found 2024-02-13T14:19:18.272 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-13T14:19:18.307 INFO:teuthology.task.internal:Saving configuration 2024-02-13T14:19:18.318 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-13T14:19:18.332 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-13T14:19:18.355 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-13 14:13:11.177757', 'locked_by': 'scheduled_phlogistonjohn@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJBKZ3ib5weV6lGWAzXyOXuMeUPTRqU0HC0vTbJ0qZVG'} 2024-02-13T14:19:18.377 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-13 14:13:11.176110', 'locked_by': 'scheduled_phlogistonjohn@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJERV8b/5wH7r/HW2rv8aMdhqBKTo1YdN3UK2gJDV7Dp'} 2024-02-13T14:19:18.377 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-13T14:19:18.383 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.foo.a', 'node-exporter.a', 'alertmanager.a'] 2024-02-13T14:19:18.383 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2024-02-13T14:19:18.383 INFO:teuthology.run_tasks:Running task console_log... 2024-02-13T14:19:18.473 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f89024423a0>, signals=[15]) 2024-02-13T14:19:18.474 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-13T14:19:18.480 INFO:teuthology.task.internal:Opening connections... 2024-02-13T14:19:18.480 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-02-13T14:19:18.482 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:19:18.562 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-02-13T14:19:18.563 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:19:18.640 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-13T14:19:18.647 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-02-13T14:19:18.653 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-02-13T14:19:18.653 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-02-13T14:19:18.700 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-13T14:19:18.700 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2024-02-13T14:19:18.700 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2024-02-13T14:19:18.700 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-13T14:19:18.700 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2024-02-13T14:19:18.700 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2024-02-13T14:19:18.700 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2024-02-13T14:19:18.701 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-13T14:19:18.701 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-13T14:19:18.701 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-13T14:19:18.701 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-13T14:19:18.701 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2024-02-13T14:19:18.701 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-02-13T14:19:18.734 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-02-13T14:19:18.739 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-02-13T14:19:18.739 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-02-13T14:19:18.787 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-02-13T14:19:18.787 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="Ubuntu" 2024-02-13T14:19:18.787 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="22.04" 2024-02-13T14:19:18.787 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-02-13T14:19:18.787 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_CODENAME=jammy 2024-02-13T14:19:18.787 INFO:teuthology.orchestra.run.smithi111.stdout:ID=ubuntu 2024-02-13T14:19:18.788 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE=debian 2024-02-13T14:19:18.788 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://www.ubuntu.com/" 2024-02-13T14:19:18.788 INFO:teuthology.orchestra.run.smithi111.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-02-13T14:19:18.788 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-02-13T14:19:18.788 INFO:teuthology.orchestra.run.smithi111.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-02-13T14:19:18.788 INFO:teuthology.orchestra.run.smithi111.stdout:UBUNTU_CODENAME=jammy 2024-02-13T14:19:18.788 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-02-13T14:19:18.817 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-13T14:19:18.825 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-13T14:19:18.862 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-13T14:19:18.863 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-02-13T14:19:18.865 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-02-13T14:19:18.872 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-13T14:19:18.890 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-13T14:19:18.891 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-02-13T14:19:18.913 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-02-13T14:19:18.921 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-13T14:19:18.976 INFO:teuthology.run_tasks:Running task kernel... 2024-02-13T14:19:18.990 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-13T14:19:18.990 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-13T14:19:18.991 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-13T14:19:18.991 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-13T14:19:18.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T14:19:18.996 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T14:19:18.997 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-02-13T14:19:18.997 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-02-13T14:19:19.044 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-56-generic 2024-02-13T14:19:19.044 INFO:teuthology.task.kernel:Running kernel on smithi111: 5.15.0-56-generic 2024-02-13T14:19:19.045 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-02-13T14:19:19.046 INFO:teuthology.orchestra.run.smithi062.stdout:5.15.0-56-generic 2024-02-13T14:19:19.046 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.15.0-56-generic 2024-02-13T14:19:19.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2024-02-13T14:19:19.173 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-02-13T14:19:19.181 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-02-13T14:19:19.327 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-13T14:19:19.329 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-13T14:19:19.329 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-13T14:19:19.347 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-02-13T14:19:19.432 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-13T14:19:19.441 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-13T14:19:19.523 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-02-13T14:19:19.569 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,154 kB] 2024-02-13T14:19:19.583 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [402 kB] 2024-02-13T14:19:19.649 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,371 kB] 2024-02-13T14:19:19.691 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,154 kB] 2024-02-13T14:19:19.718 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [402 kB] 2024-02-13T14:19:19.728 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [212 kB] 2024-02-13T14:19:19.735 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-13T14:19:19.736 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,392 kB] 2024-02-13T14:19:19.780 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [212 kB] 2024-02-13T14:19:19.789 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-02-13T14:19:19.789 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-13T14:19:19.790 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,392 kB] 2024-02-13T14:19:19.791 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.2 kB] 2024-02-13T14:19:19.792 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [229 kB] 2024-02-13T14:19:19.800 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-13T14:19:19.800 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [590 kB] 2024-02-13T14:19:19.824 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [839 kB] 2024-02-13T14:19:19.838 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [160 kB] 2024-02-13T14:19:19.848 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [229 kB] 2024-02-13T14:19:19.858 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-02-13T14:19:19.874 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-13T14:19:19.874 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [569 kB] 2024-02-13T14:19:19.874 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [590 kB] 2024-02-13T14:19:19.874 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-02-13T14:19:19.875 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-13T14:19:19.876 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-13T14:19:19.877 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-13T14:19:19.878 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-13T14:19:19.882 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [839 kB] 2024-02-13T14:19:19.883 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-13T14:19:19.892 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-13T14:19:19.892 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,421 kB] 2024-02-13T14:19:19.898 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [160 kB] 2024-02-13T14:19:19.901 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-02-13T14:19:19.905 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-02-13T14:19:19.905 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-02-13T14:19:19.905 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-02-13T14:19:19.923 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-02-13T14:19:19.958 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-13T14:19:19.959 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [234 kB] 2024-02-13T14:19:19.963 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-13T14:19:19.964 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [688 kB] 2024-02-13T14:19:19.985 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,046 kB] 2024-02-13T14:19:20.004 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [236 kB] 2024-02-13T14:19:20.008 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-13T14:19:20.008 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,164 B] 2024-02-13T14:19:20.009 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-13T14:19:20.010 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-13T14:19:20.011 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-13T14:19:20.011 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,371 kB] 2024-02-13T14:19:20.028 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-13T14:19:20.029 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-13T14:19:20.030 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-13T14:19:20.050 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-13T14:19:20.051 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-13T14:19:20.051 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-13T14:19:20.052 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-13T14:19:20.052 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-13T14:19:20.303 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [569 kB] 2024-02-13T14:19:20.343 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [273 kB] 2024-02-13T14:19:20.358 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-02-13T14:19:20.359 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,421 kB] 2024-02-13T14:19:20.417 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [34.8 kB] 2024-02-13T14:19:20.417 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [234 kB] 2024-02-13T14:19:20.424 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-02-13T14:19:20.588 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,046 kB] 2024-02-13T14:19:21.216 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [688 kB] 2024-02-13T14:19:21.254 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [236 kB] 2024-02-13T14:19:21.266 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-02-13T14:19:21.267 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-02-13T14:19:21.270 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,164 B] 2024-02-13T14:19:21.270 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-02-13T14:19:21.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-02-13T14:19:21.271 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-02-13T14:19:21.272 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-02-13T14:19:21.298 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-02-13T14:19:21.462 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-02-13T14:19:21.544 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-02-13T14:19:21.649 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-02-13T14:19:21.678 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-02-13T14:19:21.727 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-02-13T14:19:25.555 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 11.5 MB in 2s (6,555 kB/s) 2024-02-13T14:19:26.010 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 11.5 MB in 2s (4,656 kB/s) 2024-02-13T14:19:26.902 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-02-13T14:19:26.920 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-13T14:19:26.981 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-02-13T14:19:27.177 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-02-13T14:19:27.177 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-02-13T14:19:27.348 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-02-13T14:19:27.348 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-13T14:19:27.348 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-13T14:19:27.349 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-13T14:19:27.349 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-13T14:19:27.349 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2024-02-13T14:19:27.349 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-13T14:19:27.350 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-02-13T14:19:27.350 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-13T14:19:27.350 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-13T14:19:27.350 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-13T14:19:27.352 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-02-13T14:19:27.352 INFO:teuthology.orchestra.run.smithi062.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-13T14:19:27.352 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-02-13T14:19:27.352 INFO:teuthology.orchestra.run.smithi062.stdout: thermald 2024-02-13T14:19:27.399 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-13T14:19:27.400 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-02-13T14:19:27.401 INFO:teuthology.orchestra.run.smithi062.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-13T14:19:27.401 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-13T14:19:27.401 INFO:teuthology.orchestra.run.smithi062.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-13T14:19:27.402 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2024-02-13T14:19:27.402 INFO:teuthology.orchestra.run.smithi062.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-13T14:19:27.417 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-13T14:19:27.478 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-13T14:19:27.582 INFO:teuthology.orchestra.run.smithi062.stdout:3 upgraded, 5 newly installed, 0 to remove and 284 not upgraded. 2024-02-13T14:19:27.583 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 113 MB of archives. 2024-02-13T14:19:27.583 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-13T14:19:27.583 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-13T14:19:27.673 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-02-13T14:19:27.674 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-02-13T14:19:27.831 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-02-13T14:19:27.831 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-13T14:19:27.832 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-13T14:19:27.832 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-13T14:19:27.832 INFO:teuthology.orchestra.run.smithi111.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-02-13T14:19:27.832 INFO:teuthology.orchestra.run.smithi111.stdout: python2.7-minimal 2024-02-13T14:19:27.832 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-13T14:19:27.833 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-02-13T14:19:27.833 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-13T14:19:27.833 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-generic linux-image-5.15.0-94-generic 2024-02-13T14:19:27.833 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-5.15.0-94-generic linux-modules-extra-5.15.0-94-generic 2024-02-13T14:19:27.835 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-02-13T14:19:27.835 INFO:teuthology.orchestra.run.smithi111.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-02-13T14:19:27.835 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-02-13T14:19:27.835 INFO:teuthology.orchestra.run.smithi111.stdout: thermald 2024-02-13T14:19:27.883 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-02-13T14:19:27.883 INFO:teuthology.orchestra.run.smithi111.stdout: linux-headers-5.15.0-94 linux-headers-5.15.0-94-generic 2024-02-13T14:19:27.883 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.15.0-94-generic linux-modules-5.15.0-94-generic 2024-02-13T14:19:27.883 INFO:teuthology.orchestra.run.smithi111.stdout: linux-modules-extra-5.15.0-94-generic 2024-02-13T14:19:27.884 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages will be upgraded: 2024-02-13T14:19:27.885 INFO:teuthology.orchestra.run.smithi111.stdout: linux-generic linux-headers-generic linux-image-generic 2024-02-13T14:19:27.971 INFO:teuthology.orchestra.run.smithi111.stdout:3 upgraded, 5 newly installed, 0 to remove and 284 not upgraded. 2024-02-13T14:19:27.971 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 113 MB of archives. 2024-02-13T14:19:27.971 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 582 MB of additional disk space will be used. 2024-02-13T14:19:27.971 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-94-generic amd64 5.15.0-94.104 [22.6 MB] 2024-02-13T14:19:28.990 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-13T14:19:29.343 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-13T14:19:29.503 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-94-generic amd64 5.15.0-94.104 [11.5 MB] 2024-02-13T14:19:29.722 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-94-generic amd64 5.15.0-94.104 [63.9 MB] 2024-02-13T14:19:31.066 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-13T14:19:31.066 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-13T14:19:31.066 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-13T14:19:31.385 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-13T14:19:31.461 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-13T14:19:31.558 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.94.91 [1,698 B] 2024-02-13T14:19:31.558 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.94.91 [2,458 B] 2024-02-13T14:19:31.559 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94 all 5.15.0-94.104 [12.4 MB] 2024-02-13T14:19:31.856 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 113 MB in 4s (31.7 MB/s) 2024-02-13T14:19:31.908 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-94-generic amd64 5.15.0-94.104 [2,877 kB] 2024-02-13T14:19:31.991 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.94.91 [2,306 B] 2024-02-13T14:19:32.031 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-13T14:19:32.405 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 113 MB in 5s (24.7 MB/s) 2024-02-13T14:19:32.574 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-5.15.0-94-generic. 2024-02-13T14:19:34.031 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-13T14:19:34.035 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-13T14:19:34.121 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:34.558 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-02-13T14:19:34.562 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../0-linux-modules-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-13T14:19:34.805 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:36.389 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-13T14:19:36.410 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-13T14:19:36.492 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:36.959 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-13T14:19:36.979 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-13T14:19:37.015 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-image-5.15.0-94-generic. 2024-02-13T14:19:37.017 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:37.036 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../1-linux-image-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-13T14:19:37.122 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:37.610 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-94-generic. 2024-02-13T14:19:37.631 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-13T14:19:37.668 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:42.710 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-13T14:19:42.829 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-13T14:19:43.137 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-13T14:19:43.241 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-13T14:19:43.518 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-13T14:19:43.529 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-13T14:19:43.568 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-13T14:19:44.196 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../3-linux-generic_5.15.0.94.91_amd64.deb ... 2024-02-13T14:19:44.314 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-13T14:19:44.631 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.94.91_amd64.deb ... 2024-02-13T14:19:44.759 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-image-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-13T14:19:45.070 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.15.0-94. 2024-02-13T14:19:45.096 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../5-linux-headers-5.15.0-94_5.15.0-94.104_all.deb ... 2024-02-13T14:19:45.145 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-13T14:19:49.242 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-13T14:19:49.260 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-13T14:19:49.300 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:50.737 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package linux-headers-5.15.0-94-generic. 2024-02-13T14:19:50.773 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../6-linux-headers-5.15.0-94-generic_5.15.0-94.104_amd64.deb ... 2024-02-13T14:19:51.038 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:51.773 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-13T14:19:51.888 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-13T14:19:52.229 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-13T14:19:52.343 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:52.469 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-13T14:19:52.588 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:53.758 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.94.91_amd64.deb ... 2024-02-13T14:19:53.883 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking linux-headers-generic (5.15.0.94.91) over (5.15.0.56.54) ... 2024-02-13T14:19:53.992 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:54.224 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.15.0-94 (5.15.0-94.104) ... 2024-02-13T14:19:54.337 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:54.463 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-headers-generic (5.15.0.94.91) ... 2024-02-13T14:19:54.583 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:55.589 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-13T14:19:55.589 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-13T14:19:55.589 INFO:teuthology.orchestra.run.smithi111.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-13T14:19:55.589 INFO:teuthology.orchestra.run.smithi111.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-13T14:19:55.718 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:56.027 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:57.111 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-13T14:19:57.229 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-13T14:19:57.338 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:57.402 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-13T14:19:57.403 INFO:teuthology.orchestra.run.smithi111.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-13T14:19:57.410 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-02-13T14:19:57.410 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-02-13T14:19:57.411 INFO:teuthology.orchestra.run.smithi062.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-94-generic 2024-02-13T14:19:57.411 INFO:teuthology.orchestra.run.smithi062.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-94-generic 2024-02-13T14:19:57.521 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-modules-extra-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:58.930 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-image-generic (5.15.0.94.91) ... 2024-02-13T14:19:59.056 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up linux-generic (5.15.0.94.91) ... 2024-02-13T14:19:59.182 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for linux-image-5.15.0-94-generic (5.15.0-94.104) ... 2024-02-13T14:19:59.247 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-02-13T14:19:59.248 INFO:teuthology.orchestra.run.smithi062.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-94-generic 2024-02-13T14:20:11.668 INFO:teuthology.orchestra.run.smithi111.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-13T14:20:11.668 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub' 2024-02-13T14:20:11.681 INFO:teuthology.orchestra.run.smithi111.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-13T14:20:11.710 INFO:teuthology.orchestra.run.smithi111.stdout:Generating grub configuration file ... 2024-02-13T14:20:11.963 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-13T14:20:11.977 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-13T14:20:12.251 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-13T14:20:12.257 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-13T14:20:12.328 INFO:teuthology.orchestra.run.smithi111.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-13T14:20:12.333 INFO:teuthology.orchestra.run.smithi111.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-13T14:20:12.487 INFO:teuthology.orchestra.run.smithi111.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-13T14:20:12.487 INFO:teuthology.orchestra.run.smithi111.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-13T14:20:12.487 INFO:teuthology.orchestra.run.smithi111.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-13T14:20:12.533 INFO:teuthology.orchestra.run.smithi111.stdout:done 2024-02-13T14:20:12.967 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.94.91 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-13T14:20:12.988 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-02-13T14:20:12.989 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-02-13T14:20:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-02-13T14:20:12.989 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-02-13T14:20:12.989 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-13T14:20:12.989 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-13T14:20:12.989 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-13T14:20:12.989 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-13T14:20:12.989 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-02-13T14:20:12.990 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get clean 2024-02-13T14:20:13.124 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-02-13T14:20:13.269 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-13T14:20:13.368 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-13T14:20:13.451 INFO:teuthology.orchestra.run.smithi062.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-02-13T14:20:13.452 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub' 2024-02-13T14:20:13.466 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-13T14:20:13.478 INFO:teuthology.orchestra.run.smithi062.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-13T14:20:13.495 INFO:teuthology.orchestra.run.smithi062.stdout:Generating grub configuration file ... 2024-02-13T14:20:13.530 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-13T14:20:13.728 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-13T14:20:13.750 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-13T14:20:14.042 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-13T14:20:14.048 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-13T14:20:14.120 INFO:teuthology.orchestra.run.smithi062.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-13T14:20:14.125 INFO:teuthology.orchestra.run.smithi062.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-13T14:20:14.281 INFO:teuthology.orchestra.run.smithi062.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-13T14:20:14.281 INFO:teuthology.orchestra.run.smithi062.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-02-13T14:20:14.281 INFO:teuthology.orchestra.run.smithi062.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-13T14:20:14.320 INFO:teuthology.orchestra.run.smithi062.stdout:done 2024-02-13T14:20:14.562 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-13T14:20:14.578 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-13T14:20:14.628 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-13T14:20:14.767 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 21 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.15.0.94.91 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-13T14:20:14.791 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2024-02-13T14:20:14.792 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2024-02-13T14:20:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2024-02-13T14:20:14.792 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2024-02-13T14:20:14.792 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-94-generic 2024-02-13T14:20:14.792 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-13T14:20:14.792 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-13T14:20:14.792 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-13T14:20:14.792 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-02-13T14:20:14.792 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get clean 2024-02-13T14:20:14.796 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-02-13T14:20:14.797 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-02-13T14:20:14.945 INFO:teuthology.orchestra.run.smithi111.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-13T14:20:14.946 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-02-13T14:20:14.946 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-13T14:20:14.946 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-13T14:20:14.946 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-13T14:20:14.946 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-13T14:20:14.946 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-13T14:20:14.946 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-13T14:20:14.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-02-13T14:20:14.981 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 0 newly installed, 0 to remove and 284 not upgraded. 2024-02-13T14:20:14.983 DEBUG:teuthology.orchestra.run.smithi111:> dpkg -s linux-image-generic 2024-02-13T14:20:15.041 INFO:teuthology.orchestra.run.smithi111.stdout:Package: linux-image-generic 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Status: install ok installed 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Priority: optional 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Section: kernel 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Installed-Size: 21 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Maintainer: Ubuntu Kernel Team 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: amd64 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Source: linux-meta 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Version: 5.15.0.94.91 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Recommends: thermald 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout:Description: Generic Linux kernel image 2024-02-13T14:20:15.042 INFO:teuthology.orchestra.run.smithi111.stdout: This package will always depend on the latest generic kernel image 2024-02-13T14:20:15.043 INFO:teuthology.orchestra.run.smithi111.stdout: available. 2024-02-13T14:20:15.044 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-02-13T14:20:15.092 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.rQ6M9vSyXW 2024-02-13T14:20:15.092 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub/grub.cfg /tmp/tmp.rQ6M9vSyXW 2024-02-13T14:20:15.143 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-13T14:20:15.146 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.rQ6M9vSyXW 2024-02-13T14:20:15.186 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-13T14:20:15.203 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-13T14:20:15.245 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-13T14:20:15.259 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.rQ6M9vSyXW is 10KB 2024-02-13T14:20:15.272 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.rQ6M9vSyXW 2024-02-13T14:20:15.278 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-13T14:20:15.331 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:20:15.331 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-13T14:20:15.331 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-13T14:20:15.398 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-13T14:20:15.398 DEBUG:teuthology.orchestra.run.smithi111:> sudo update-grub 2024-02-13T14:20:16.487 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-02-13T14:20:16.498 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub' 2024-02-13T14:20:16.499 INFO:teuthology.orchestra.run.smithi111.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-13T14:20:16.502 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-02-13T14:20:16.505 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-02-13T14:20:16.570 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-02-13T14:20:16.684 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-13T14:20:16.690 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-13T14:20:16.766 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-02-13T14:20:16.766 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-02-13T14:20:16.921 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-13T14:20:16.926 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-13T14:20:16.947 INFO:teuthology.orchestra.run.smithi062.stdout:linux-image-generic is already the newest version (5.15.0.94.91). 2024-02-13T14:20:16.947 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-02-13T14:20:16.947 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-13T14:20:16.947 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-13T14:20:16.947 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-13T14:20:16.948 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-13T14:20:16.948 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-13T14:20:16.948 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-13T14:20:16.964 INFO:teuthology.orchestra.run.smithi111.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-13T14:20:16.968 INFO:teuthology.orchestra.run.smithi111.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-13T14:20:16.992 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 0 newly installed, 0 to remove and 284 not upgraded. 2024-02-13T14:20:16.994 DEBUG:teuthology.orchestra.run.smithi062:> dpkg -s linux-image-generic 2024-02-13T14:20:17.010 INFO:teuthology.orchestra.run.smithi062.stdout:Package: linux-image-generic 2024-02-13T14:20:17.010 INFO:teuthology.orchestra.run.smithi062.stdout:Status: install ok installed 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Priority: optional 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Section: kernel 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Installed-Size: 21 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Maintainer: Ubuntu Kernel Team 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: amd64 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Source: linux-meta 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Version: 5.15.0.94.91 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-94), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Depends: linux-image-5.15.0-94-generic, linux-modules-extra-5.15.0-94-generic, linux-firmware, intel-microcode, amd64-microcode 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Recommends: thermald 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout:Description: Generic Linux kernel image 2024-02-13T14:20:17.011 INFO:teuthology.orchestra.run.smithi062.stdout: This package will always depend on the latest generic kernel image 2024-02-13T14:20:17.012 INFO:teuthology.orchestra.run.smithi062.stdout: available. 2024-02-13T14:20:17.012 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-02-13T14:20:17.059 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.MKrAlEHHGB 2024-02-13T14:20:17.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub/grub.cfg /tmp/tmp.MKrAlEHHGB 2024-02-13T14:20:17.099 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-13T14:20:17.099 INFO:teuthology.orchestra.run.smithi111.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-13T14:20:17.100 INFO:teuthology.orchestra.run.smithi111.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-13T14:20:17.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.MKrAlEHHGB 2024-02-13T14:20:17.117 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-02-13T14:20:17.125 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-02-13T14:20:17.246 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.MKrAlEHHGB is 10KB 2024-02-13T14:20:17.259 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.MKrAlEHHGB 2024-02-13T14:20:17.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-02-13T14:20:17.320 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:20:17.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-02-13T14:20:17.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-02-13T14:20:17.387 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-94-generic 2024-02-13T14:20:17.388 DEBUG:teuthology.orchestra.run.smithi062:> sudo update-grub 2024-02-13T14:20:18.560 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub' 2024-02-13T14:20:18.561 INFO:teuthology.orchestra.run.smithi062.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-02-13T14:20:18.563 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-02-13T14:20:18.729 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.15.0-94-generic 2024-02-13T14:20:18.735 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.15.0-94-generic 2024-02-13T14:20:18.940 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-02-13T14:20:18.945 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-02-13T14:20:18.986 INFO:teuthology.orchestra.run.smithi062.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-02-13T14:20:18.992 INFO:teuthology.orchestra.run.smithi062.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-02-13T14:20:19.111 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-02-13T14:20:19.111 INFO:teuthology.orchestra.run.smithi062.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-02-13T14:20:19.112 INFO:teuthology.orchestra.run.smithi062.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-02-13T14:20:19.129 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-02-13T14:20:19.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-02-13T14:20:47.140 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-13T14:20:47.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-13T14:20:47.142 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:20:49.136 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-13T14:20:49.136 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-13T14:20:49.136 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:21:21.596 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-02-13T14:21:30.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-13T14:21:30.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:21:33.664 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-02-13T14:21:45.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-13T14:21:45.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:21:49.140 DEBUG:teuthology.orchestra.remote:timed out 2024-02-13T14:21:58.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-13T14:21:58.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:21:58.147 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-02-13T14:22:04.096 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-02-13T14:22:10.153 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-13T14:22:10.154 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:22:10.367 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-02-13T14:22:10.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-13T14:22:10.973 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-94-generic"... 2024-02-13T14:22:10.973 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-02-13T14:22:11.021 INFO:teuthology.orchestra.run.smithi062.stdout:5.15.0-94-generic 2024-02-13T14:22:11.022 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-13T14:22:11.022 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-13T14:22:11.022 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-13T14:22:12.022 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-13T14:22:12.023 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-13T14:22:12.115 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-02-13T14:22:12.139 DEBUG:teuthology.parallel:result is None 2024-02-13T14:22:19.097 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-13T14:22:19.098 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:22:20.135 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-02-13T14:22:21.025 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-13T14:22:21.025 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-94-generic"... 2024-02-13T14:22:21.025 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-02-13T14:22:21.072 INFO:teuthology.orchestra.run.smithi111.stdout:5.15.0-94-generic 2024-02-13T14:22:21.073 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-94-generic vs 5.15.0-94-generic 2024-02-13T14:22:21.073 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-13T14:22:21.073 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-02-13T14:22:22.074 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-13T14:22:22.075 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-13T14:22:22.194 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-02-13T14:22:22.217 DEBUG:teuthology.parallel:result is None 2024-02-13T14:22:22.217 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-13T14:22:22.226 INFO:teuthology.task.internal:Creating test directory... 2024-02-13T14:22:22.227 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-13T14:22:22.229 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-13T14:22:22.234 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-13T14:22:22.268 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-13T14:22:22.303 INFO:teuthology.task.internal:Creating archive directory... 2024-02-13T14:22:22.303 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-13T14:22:22.305 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-13T14:22:22.356 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-13T14:22:22.362 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-13T14:22:22.363 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-13T14:22:22.365 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-13T14:22:22.383 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-13T14:22:22.391 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-13T14:22:22.414 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-13T14:22:22.421 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-13T14:22:22.423 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-13T14:22:22.429 INFO:teuthology.task.internal:Configuring sudo... 2024-02-13T14:22:22.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-13T14:22:22.439 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-13T14:22:22.479 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-13T14:22:22.488 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-13T14:22:22.488 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-13T14:22:22.495 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-13T14:22:22.527 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-13T14:22:22.546 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-13T14:22:22.596 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:22:22.596 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-13T14:22:22.657 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-13T14:22:22.662 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-13T14:22:22.708 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:22:22.708 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-13T14:22:22.782 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-02-13T14:22:22.785 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-02-13T14:22:22.921 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-13T14:22:22.932 INFO:teuthology.task.internal:Starting timer... 2024-02-13T14:22:22.933 INFO:teuthology.run_tasks:Running task pcp... 2024-02-13T14:22:22.980 INFO:teuthology.run_tasks:Running task selinux... 2024-02-13T14:22:23.013 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2024-02-13T14:22:23.013 DEBUG:teuthology.task.selinux:Excluding smithi111: OS 'ubuntu' does not support SELinux 2024-02-13T14:22:23.013 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-13T14:22:23.013 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-02-13T14:22:23.013 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-13T14:22:23.013 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-13T14:22:23.046 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-13T14:22:23.062 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-13T14:22:23.063 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi111.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-13T14:29:25.167 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi111.front.sepia.ceph.com')] 2024-02-13T14:29:25.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-13T14:29:25.170 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:29:25.253 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-02-13T14:29:25.332 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-02-13T14:29:25.333 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-13T14:29:25.333 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-13T14:29:25.413 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-02-13T14:29:25.493 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-02-13T14:29:25.493 INFO:teuthology.run_tasks:Running task clock... 2024-02-13T14:29:25.509 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-13T14:29:25.510 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-13T14:29:25.510 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-13T14:29:25.513 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-13T14:29:25.513 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-13T14:29:25.541 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-13T14:29:25.542 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Command line: ntpd -gq 2024-02-13T14:29:25.542 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: ---------------------------------------------------- 2024-02-13T14:29:25.542 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: ntp-4 is maintained by Network Time Foundation, 2024-02-13T14:29:25.542 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-13T14:29:25.542 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: corporation. Support and training for ntp-4 are 2024-02-13T14:29:25.542 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: available at https://www.nwtime.org/support 2024-02-13T14:29:25.542 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: ---------------------------------------------------- 2024-02-13T14:29:25.543 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: proto: precision = 0.061 usec (-24) 2024-02-13T14:29:25.543 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: basedate set to 2022-02-04 2024-02-13T14:29:25.543 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: gps base set to 2022-02-06 (week 2196) 2024-02-13T14:29:25.543 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-13T14:29:25.543 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-13T14:29:25.543 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: restrict ::: KOD does nothing without LIMITED. 2024-02-13T14:29:25.544 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-13T14:29:25.545 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Listen and drop on 0 v6wildcard [::]:123 2024-02-13T14:29:25.545 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-13T14:29:25.545 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Listen normally on 2 lo 127.0.0.1:123 2024-02-13T14:29:25.545 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2024-02-13T14:29:25.545 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Listen normally on 4 lo [::1]:123 2024-02-13T14:29:25.545 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2024-02-13T14:29:25.545 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:25 ntpd[17165]: Listening on routing socket on fd #22 for interface updates 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Command line: ntpd -gq 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: ---------------------------------------------------- 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: ntp-4 is maintained by Network Time Foundation, 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: corporation. Support and training for ntp-4 are 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: available at https://www.nwtime.org/support 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: ---------------------------------------------------- 2024-02-13T14:29:25.560 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: proto: precision = 0.055 usec (-24) 2024-02-13T14:29:25.561 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: basedate set to 2022-02-04 2024-02-13T14:29:25.561 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: gps base set to 2022-02-06 (week 2196) 2024-02-13T14:29:25.561 INFO:teuthology.orchestra.run.smithi111.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-13T14:29:25.561 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-02-13T14:29:25.562 INFO:teuthology.orchestra.run.smithi111.stderr:restrict ::: KOD does nothing without LIMITED. 2024-02-13T14:29:25.563 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: restrict ::: KOD does nothing without LIMITED. 2024-02-13T14:29:25.563 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Listen and drop on 0 v6wildcard [::]:123 2024-02-13T14:29:25.563 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-02-13T14:29:25.563 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Listen normally on 2 lo 127.0.0.1:123 2024-02-13T14:29:25.563 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Listen normally on 3 enp3s0f1 172.21.15.111:123 2024-02-13T14:29:25.563 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Listen normally on 4 lo [::1]:123 2024-02-13T14:29:25.563 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc2f%5]:123 2024-02-13T14:29:25.563 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:25 ntpd[17175]: Listening on routing socket on fd #22 for interface updates 2024-02-13T14:29:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:26.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:26.545 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:26.546 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:26 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:26.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:26 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:26.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:26 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:26.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:26 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:26.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:26 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:26.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:26 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:26.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:26 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:27.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:27 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:27.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:27 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:27.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:27 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:27.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:27 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:27.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:27 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:27.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:27 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:27.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:27 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:27.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:27 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:28.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:28.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:28.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:28.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:28.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:28.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:28.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:28.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:28.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:28.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:28.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:28.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:28 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:28.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:28.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:28 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:29.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:29 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:29.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:29 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:29.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:29 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:29.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:29 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:29.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:29 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:29.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:29 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:29.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:29 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:29.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:29 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:29.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:29 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:29.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:29 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:29.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:29 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:29.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:29 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:30.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:30 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:30 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:31.542 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:31 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:31.542 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:31 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:31 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:31 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:31 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:31.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:31 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:31.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:31 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:31.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:31 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:31.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:31 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:31.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:31 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:31.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:31 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:31.560 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:31 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:32.542 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stdout:13 Feb 14:29:32 ntpd[17165]: ntpd: time slew -0.001541 s 2024-02-13T14:29:32.543 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.001541s 2024-02-13T14:29:32.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-13T14:29:32.544 INFO:teuthology.orchestra.run.smithi062.stderr:13 Feb 14:29:32 ntpd[17165]: can't open /var/log/ntpstats/loopstats.20240213: Permission denied 2024-02-13T14:29:32.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:32.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:32.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:32.561 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: can't open /var/log/ntpstats/rawstats.20240213: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: can't open /var/log/ntpstats/peerstats.20240213: Permission denied 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stdout:13 Feb 14:29:32 ntpd[17175]: ntpd: time slew -0.001441 s 2024-02-13T14:29:32.562 INFO:teuthology.orchestra.run.smithi111.stdout:ntpd: time slew -0.001441s 2024-02-13T14:29:32.563 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-02-13T14:29:32.563 INFO:teuthology.orchestra.run.smithi111.stderr:13 Feb 14:29:32 ntpd[17175]: can't open /var/log/ntpstats/loopstats.20240213: Permission denied 2024-02-13T14:29:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-02-13T14:29:32.594 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-02-13T14:29:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-13T14:29:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-13T14:29:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-13T14:29:32.594 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-13T14:29:32.608 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-02-13T14:29:32.608 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-02-13T14:29:32.609 INFO:teuthology.orchestra.run.smithi111.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-13T14:29:32.609 INFO:teuthology.orchestra.run.smithi111.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-13T14:29:32.609 INFO:teuthology.orchestra.run.smithi111.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-13T14:29:32.609 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-02-13T14:29:32.609 INFO:teuthology.run_tasks:Running task install... 2024-02-13T14:29:32.618 DEBUG:teuthology.task.install:project ceph 2024-02-13T14:29:32.618 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e1b79d5a4193a484176863ab96c0ca28c00e1662'}} 2024-02-13T14:29:32.618 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'e1b79d5a4193a484176863ab96c0ca28c00e1662'} 2024-02-13T14:29:32.618 INFO:teuthology.task.install:Using flavor: default 2024-02-13T14:29:32.624 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-13T14:29:32.624 INFO:teuthology.task.install:extra packages: [] 2024-02-13T14:29:32.624 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2024-02-13T14:29:32.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-key list | grep Ceph 2024-02-13T14:29:32.691 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-13T14:29:32.711 INFO:teuthology.orchestra.run.smithi111.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-02-13T14:29:32.717 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-13T14:29:32.717 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2024-02-13T14:29:32.717 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-13T14:29:32.718 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:29:32.741 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-02-13T14:29:32.741 INFO:teuthology.orchestra.run.smithi111.stdout:uid [ unknown] Ceph.com (release key) 2024-02-13T14:29:32.741 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-02-13T14:29:32.741 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:29:32.860 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default/ 2024-02-13T14:29:32.860 INFO:teuthology.task.install.deb:Package version is 19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:29:32.956 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default/ 2024-02-13T14:29:32.956 INFO:teuthology.task.install.deb:Package version is 19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:29:33.046 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:29:33.046 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-13T14:29:33.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2024-02-13T14:29:33.149 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:29:33.149 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-02-13T14:29:33.163 DEBUG:teuthology.orchestra.run.smithi111:> sudo apt-get update 2024-02-13T14:29:33.236 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-13T14:29:33.348 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-13T14:29:33.384 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy InRelease 2024-02-13T14:29:33.396 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-02-13T14:29:33.405 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-13T14:29:33.423 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy InRelease 2024-02-13T14:29:33.427 INFO:teuthology.orchestra.run.smithi111.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-13T14:29:33.430 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-13T14:29:33.449 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,396 B] 2024-02-13T14:29:33.455 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-02-13T14:29:33.476 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-13T14:29:33.481 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-02-13T14:29:33.512 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-13T14:29:33.530 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-02-13T14:29:33.545 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy Release.gpg 2024-02-13T14:29:33.586 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-02-13T14:29:33.612 INFO:teuthology.orchestra.run.smithi111.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-02-13T14:29:33.630 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,396 B] 2024-02-13T14:29:33.708 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 28.8 kB in 0s (62.1 kB/s) 2024-02-13T14:29:33.748 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 28.8 kB in 0s (70.6 kB/s) 2024-02-13T14:29:34.650 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-02-13T14:29:34.666 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1423-ge1b79d5a-1jammy cephadm=19.0.0-1423-ge1b79d5a-1jammy ceph-mds=19.0.0-1423-ge1b79d5a-1jammy ceph-mgr=19.0.0-1423-ge1b79d5a-1jammy ceph-common=19.0.0-1423-ge1b79d5a-1jammy ceph-fuse=19.0.0-1423-ge1b79d5a-1jammy ceph-test=19.0.0-1423-ge1b79d5a-1jammy ceph-volume=19.0.0-1423-ge1b79d5a-1jammy radosgw=19.0.0-1423-ge1b79d5a-1jammy python3-rados=19.0.0-1423-ge1b79d5a-1jammy python3-rgw=19.0.0-1423-ge1b79d5a-1jammy python3-cephfs=19.0.0-1423-ge1b79d5a-1jammy python3-rbd=19.0.0-1423-ge1b79d5a-1jammy libcephfs2=19.0.0-1423-ge1b79d5a-1jammy libcephfs-dev=19.0.0-1423-ge1b79d5a-1jammy librados2=19.0.0-1423-ge1b79d5a-1jammy librbd1=19.0.0-1423-ge1b79d5a-1jammy rbd-fuse=19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:29:34.694 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-13T14:29:34.710 DEBUG:teuthology.orchestra.run.smithi111:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-1423-ge1b79d5a-1jammy cephadm=19.0.0-1423-ge1b79d5a-1jammy ceph-mds=19.0.0-1423-ge1b79d5a-1jammy ceph-mgr=19.0.0-1423-ge1b79d5a-1jammy ceph-common=19.0.0-1423-ge1b79d5a-1jammy ceph-fuse=19.0.0-1423-ge1b79d5a-1jammy ceph-test=19.0.0-1423-ge1b79d5a-1jammy ceph-volume=19.0.0-1423-ge1b79d5a-1jammy radosgw=19.0.0-1423-ge1b79d5a-1jammy python3-rados=19.0.0-1423-ge1b79d5a-1jammy python3-rgw=19.0.0-1423-ge1b79d5a-1jammy python3-cephfs=19.0.0-1423-ge1b79d5a-1jammy python3-rbd=19.0.0-1423-ge1b79d5a-1jammy libcephfs2=19.0.0-1423-ge1b79d5a-1jammy libcephfs-dev=19.0.0-1423-ge1b79d5a-1jammy librados2=19.0.0-1423-ge1b79d5a-1jammy librbd1=19.0.0-1423-ge1b79d5a-1jammy rbd-fuse=19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:29:34.730 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2024-02-13T14:29:34.769 INFO:teuthology.orchestra.run.smithi111.stdout:Reading package lists... 2024-02-13T14:29:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2024-02-13T14:29:34.923 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2024-02-13T14:29:34.959 INFO:teuthology.orchestra.run.smithi111.stdout:Building dependency tree... 2024-02-13T14:29:34.960 INFO:teuthology.orchestra.run.smithi111.stdout:Reading state information... 2024-02-13T14:29:35.113 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2024-02-13T14:29:35.113 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-13T14:29:35.114 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-13T14:29:35.115 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet zip 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2024-02-13T14:29:35.116 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2024-02-13T14:29:35.135 INFO:teuthology.orchestra.run.smithi111.stdout:The following packages were automatically installed and are no longer required: 2024-02-13T14:29:35.135 INFO:teuthology.orchestra.run.smithi111.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-02-13T14:29:35.135 INFO:teuthology.orchestra.run.smithi111.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-02-13T14:29:35.135 INFO:teuthology.orchestra.run.smithi111.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-02-13T14:29:35.135 INFO:teuthology.orchestra.run.smithi111.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-02-13T14:29:35.136 INFO:teuthology.orchestra.run.smithi111.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-02-13T14:29:35.136 INFO:teuthology.orchestra.run.smithi111.stdout:Use 'sudo apt autoremove' to remove them. 2024-02-13T14:29:35.136 INFO:teuthology.orchestra.run.smithi111.stdout:The following additional packages will be installed: 2024-02-13T14:29:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-02-13T14:29:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-02-13T14:29:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-02-13T14:29:35.137 INFO:teuthology.orchestra.run.smithi111.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-02-13T14:29:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-02-13T14:29:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-02-13T14:29:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-02-13T14:29:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-02-13T14:29:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-02-13T14:29:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-13T14:29:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-13T14:29:35.138 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-02-13T14:29:35.139 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet zip 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout:Suggested packages: 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout:Recommended packages: 2024-02-13T14:29:35.140 INFO:teuthology.orchestra.run.smithi111.stdout: btrfs-tools 2024-02-13T14:29:35.221 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2024-02-13T14:29:35.222 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-13T14:29:35.222 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-13T14:29:35.222 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-13T14:29:35.222 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-13T14:29:35.222 INFO:teuthology.orchestra.run.smithi062.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-13T14:29:35.223 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-13T14:29:35.224 INFO:teuthology.orchestra.run.smithi062.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-13T14:29:35.241 INFO:teuthology.orchestra.run.smithi111.stdout:The following NEW packages will be installed: 2024-02-13T14:29:35.241 INFO:teuthology.orchestra.run.smithi111.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-02-13T14:29:35.241 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-02-13T14:29:35.241 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-02-13T14:29:35.241 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-02-13T14:29:35.241 INFO:teuthology.orchestra.run.smithi111.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-02-13T14:29:35.241 INFO:teuthology.orchestra.run.smithi111.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-02-13T14:29:35.243 INFO:teuthology.orchestra.run.smithi111.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-02-13T14:29:35.243 INFO:teuthology.orchestra.run.smithi111.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-02-13T14:29:35.243 INFO:teuthology.orchestra.run.smithi111.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-02-13T14:29:35.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-02-13T14:29:35.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-02-13T14:29:35.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-02-13T14:29:35.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-02-13T14:29:35.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-02-13T14:29:35.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-02-13T14:29:35.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-02-13T14:29:35.244 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-02-13T14:29:35.245 INFO:teuthology.orchestra.run.smithi111.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-02-13T14:29:35.245 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-02-13T14:29:35.245 INFO:teuthology.orchestra.run.smithi111.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-02-13T14:29:35.245 INFO:teuthology.orchestra.run.smithi111.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-02-13T14:29:35.245 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-02-13T14:29:35.245 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-02-13T14:29:35.245 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-02-13T14:29:35.245 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-02-13T14:29:35.246 INFO:teuthology.orchestra.run.smithi111.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-02-13T14:29:35.384 INFO:teuthology.orchestra.run.smithi111.stdout:0 upgraded, 118 newly installed, 0 to remove and 271 not upgraded. 2024-02-13T14:29:35.384 INFO:teuthology.orchestra.run.smithi111.stdout:Need to get 176 MB of archives. 2024-02-13T14:29:35.384 INFO:teuthology.orchestra.run.smithi111.stdout:After this operation, 729 MB of additional disk space will be used. 2024-02-13T14:29:35.384 INFO:teuthology.orchestra.run.smithi111.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1423-ge1b79d5a-1jammy [3,535 kB] 2024-02-13T14:29:35.410 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 118 newly installed, 0 to remove and 271 not upgraded. 2024-02-13T14:29:35.411 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 176 MB of archives. 2024-02-13T14:29:35.411 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 729 MB of additional disk space will be used. 2024-02-13T14:29:35.411 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-13T14:29:35.427 INFO:teuthology.orchestra.run.smithi111.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-02-13T14:29:35.444 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-1423-ge1b79d5a-1jammy [3,535 kB] 2024-02-13T14:29:35.606 INFO:teuthology.orchestra.run.smithi111.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1423-ge1b79d5a-1jammy [3,211 kB] 2024-02-13T14:29:35.714 INFO:teuthology.orchestra.run.smithi111.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1423-ge1b79d5a-1jammy [708 kB] 2024-02-13T14:29:35.741 INFO:teuthology.orchestra.run.smithi111.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1423-ge1b79d5a-1jammy [356 kB] 2024-02-13T14:29:35.757 INFO:teuthology.orchestra.run.smithi111.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1423-ge1b79d5a-1jammy [32.7 kB] 2024-02-13T14:29:35.758 INFO:teuthology.orchestra.run.smithi111.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1423-ge1b79d5a-1jammy [180 kB] 2024-02-13T14:29:35.763 INFO:teuthology.orchestra.run.smithi111.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1423-ge1b79d5a-1jammy [65.5 kB] 2024-02-13T14:29:35.765 INFO:teuthology.orchestra.run.smithi111.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1423-ge1b79d5a-1jammy [330 kB] 2024-02-13T14:29:35.777 INFO:teuthology.orchestra.run.smithi111.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1423-ge1b79d5a-1jammy [6,561 kB] 2024-02-13T14:29:35.834 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-13T14:29:35.846 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-13T14:29:35.848 INFO:teuthology.orchestra.run.smithi111.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-02-13T14:29:35.861 INFO:teuthology.orchestra.run.smithi111.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-02-13T14:29:35.928 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-13T14:29:35.942 INFO:teuthology.orchestra.run.smithi111.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-02-13T14:29:36.025 INFO:teuthology.orchestra.run.smithi111.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1423-ge1b79d5a-1jammy [112 kB] 2024-02-13T14:29:36.028 INFO:teuthology.orchestra.run.smithi111.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1423-ge1b79d5a-1jammy [465 kB] 2024-02-13T14:29:36.043 INFO:teuthology.orchestra.run.smithi111.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1423-ge1b79d5a-1jammy [24.1 MB] 2024-02-13T14:29:36.158 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-13T14:29:36.169 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-13T14:29:36.171 INFO:teuthology.orchestra.run.smithi111.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-02-13T14:29:36.183 INFO:teuthology.orchestra.run.smithi111.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-02-13T14:29:36.200 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-13T14:29:36.208 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-13T14:29:36.210 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-13T14:29:36.210 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-13T14:29:36.213 INFO:teuthology.orchestra.run.smithi111.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-02-13T14:29:36.223 INFO:teuthology.orchestra.run.smithi111.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-02-13T14:29:36.223 INFO:teuthology.orchestra.run.smithi111.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-02-13T14:29:36.224 INFO:teuthology.orchestra.run.smithi111.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-02-13T14:29:36.230 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-13T14:29:36.243 INFO:teuthology.orchestra.run.smithi111.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-02-13T14:29:36.398 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-13T14:29:36.412 INFO:teuthology.orchestra.run.smithi111.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-02-13T14:29:36.417 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-1423-ge1b79d5a-1jammy [3,211 kB] 2024-02-13T14:29:36.806 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-13T14:29:36.816 INFO:teuthology.orchestra.run.smithi111.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-02-13T14:29:36.839 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-13T14:29:36.841 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-13T14:29:36.851 INFO:teuthology.orchestra.run.smithi111.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-02-13T14:29:36.853 INFO:teuthology.orchestra.run.smithi111.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-02-13T14:29:36.922 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-02-13T14:29:36.932 INFO:teuthology.orchestra.run.smithi111.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2024-02-13T14:29:36.973 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-13T14:29:36.995 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-13T14:29:37.001 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-13T14:29:37.002 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-13T14:29:37.014 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-13T14:29:37.015 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-13T14:29:37.016 INFO:teuthology.orchestra.run.smithi111.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-02-13T14:29:37.018 INFO:teuthology.orchestra.run.smithi111.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1423-ge1b79d5a-1jammy [5,073 kB] 2024-02-13T14:29:37.090 INFO:teuthology.orchestra.run.smithi111.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-02-13T14:29:37.091 INFO:teuthology.orchestra.run.smithi111.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-02-13T14:29:37.092 INFO:teuthology.orchestra.run.smithi111.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-02-13T14:29:37.094 INFO:teuthology.orchestra.run.smithi111.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-02-13T14:29:37.144 INFO:teuthology.orchestra.run.smithi111.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1423-ge1b79d5a-1jammy [243 kB] 2024-02-13T14:29:37.150 INFO:teuthology.orchestra.run.smithi111.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1423-ge1b79d5a-1jammy [124 kB] 2024-02-13T14:29:37.155 INFO:teuthology.orchestra.run.smithi111.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1423-ge1b79d5a-1jammy [1,519 kB] 2024-02-13T14:29:37.181 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-13T14:29:37.215 INFO:teuthology.orchestra.run.smithi111.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1423-ge1b79d5a-1jammy [6,240 kB] 2024-02-13T14:29:37.220 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-1423-ge1b79d5a-1jammy [708 kB] 2024-02-13T14:29:37.259 INFO:teuthology.orchestra.run.smithi111.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-02-13T14:29:37.260 INFO:teuthology.orchestra.run.smithi111.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-02-13T14:29:37.264 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-13T14:29:37.293 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-13T14:29:37.309 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-13T14:29:37.354 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-13T14:29:37.363 INFO:teuthology.orchestra.run.smithi111.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-02-13T14:29:37.386 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-1423-ge1b79d5a-1jammy [356 kB] 2024-02-13T14:29:37.392 INFO:teuthology.orchestra.run.smithi111.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-02-13T14:29:37.425 INFO:teuthology.orchestra.run.smithi111.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-02-13T14:29:37.446 INFO:teuthology.orchestra.run.smithi111.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-02-13T14:29:37.449 INFO:teuthology.orchestra.run.smithi111.stdout:Get:45 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1423-ge1b79d5a-1jammy [22.7 MB] 2024-02-13T14:29:37.481 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-1423-ge1b79d5a-1jammy [32.7 kB] 2024-02-13T14:29:37.486 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-1423-ge1b79d5a-1jammy [180 kB] 2024-02-13T14:29:37.535 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-1423-ge1b79d5a-1jammy [65.5 kB] 2024-02-13T14:29:37.547 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-1423-ge1b79d5a-1jammy [330 kB] 2024-02-13T14:29:37.569 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-13T14:29:37.584 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-13T14:29:37.591 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-13T14:29:37.597 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-13T14:29:37.618 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-13T14:29:37.621 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-13T14:29:37.628 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-1423-ge1b79d5a-1jammy [6,561 kB] 2024-02-13T14:29:37.646 INFO:teuthology.orchestra.run.smithi111.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-02-13T14:29:37.659 INFO:teuthology.orchestra.run.smithi111.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-02-13T14:29:37.665 INFO:teuthology.orchestra.run.smithi111.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-02-13T14:29:37.671 INFO:teuthology.orchestra.run.smithi111.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-02-13T14:29:37.690 INFO:teuthology.orchestra.run.smithi111.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-02-13T14:29:37.787 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-13T14:29:37.857 INFO:teuthology.orchestra.run.smithi111.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-02-13T14:29:37.940 INFO:teuthology.orchestra.run.smithi111.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-02-13T14:29:38.119 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-13T14:29:38.127 INFO:teuthology.orchestra.run.smithi111.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-02-13T14:29:38.150 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-13T14:29:38.161 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-13T14:29:38.183 INFO:teuthology.orchestra.run.smithi111.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-02-13T14:29:38.196 INFO:teuthology.orchestra.run.smithi111.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-02-13T14:29:38.366 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-13T14:29:38.369 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-13T14:29:38.371 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-13T14:29:38.378 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-13T14:29:38.392 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-13T14:29:38.393 INFO:teuthology.orchestra.run.smithi111.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-02-13T14:29:38.393 INFO:teuthology.orchestra.run.smithi111.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-02-13T14:29:38.394 INFO:teuthology.orchestra.run.smithi111.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1423-ge1b79d5a-1jammy [14.0 kB] 2024-02-13T14:29:38.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-02-13T14:29:38.395 INFO:teuthology.orchestra.run.smithi111.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1423-ge1b79d5a-1jammy [865 kB] 2024-02-13T14:29:38.396 INFO:teuthology.orchestra.run.smithi111.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-02-13T14:29:38.412 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-13T14:29:38.418 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-13T14:29:38.436 INFO:teuthology.orchestra.run.smithi111.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1423-ge1b79d5a-1jammy [2,185 kB] 2024-02-13T14:29:38.436 INFO:teuthology.orchestra.run.smithi111.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-02-13T14:29:38.439 INFO:teuthology.orchestra.run.smithi111.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-02-13T14:29:38.476 INFO:teuthology.orchestra.run.smithi111.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1423-ge1b79d5a-1jammy [788 kB] 2024-02-13T14:29:38.487 INFO:teuthology.orchestra.run.smithi111.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1423-ge1b79d5a-1jammy [145 kB] 2024-02-13T14:29:38.489 INFO:teuthology.orchestra.run.smithi111.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1423-ge1b79d5a-1jammy [1,899 kB] 2024-02-13T14:29:38.530 INFO:teuthology.orchestra.run.smithi111.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1423-ge1b79d5a-1jammy [8,625 kB] 2024-02-13T14:29:38.594 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-13T14:29:38.605 INFO:teuthology.orchestra.run.smithi111.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-02-13T14:29:38.858 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-13T14:29:38.860 INFO:teuthology.orchestra.run.smithi111.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1423-ge1b79d5a-1jammy [14.2 kB] 2024-02-13T14:29:38.861 INFO:teuthology.orchestra.run.smithi111.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1423-ge1b79d5a-1jammy [49.8 MB] 2024-02-13T14:29:38.951 INFO:teuthology.orchestra.run.smithi111.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-02-13T14:29:38.981 INFO:teuthology.orchestra.run.smithi111.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-02-13T14:29:39.036 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-13T14:29:39.050 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-13T14:29:39.070 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-13T14:29:39.101 INFO:teuthology.orchestra.run.smithi111.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-02-13T14:29:39.117 INFO:teuthology.orchestra.run.smithi111.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-02-13T14:29:39.128 INFO:teuthology.orchestra.run.smithi111.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-02-13T14:29:39.134 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-13T14:29:39.175 INFO:teuthology.orchestra.run.smithi111.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-02-13T14:29:39.230 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-1423-ge1b79d5a-1jammy [112 kB] 2024-02-13T14:29:39.254 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-1423-ge1b79d5a-1jammy [465 kB] 2024-02-13T14:29:39.365 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-1423-ge1b79d5a-1jammy [24.1 MB] 2024-02-13T14:29:39.423 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-13T14:29:39.425 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-13T14:29:39.428 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-13T14:29:39.428 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-13T14:29:39.430 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-13T14:29:39.452 INFO:teuthology.orchestra.run.smithi111.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-02-13T14:29:39.456 INFO:teuthology.orchestra.run.smithi111.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-02-13T14:29:39.459 INFO:teuthology.orchestra.run.smithi111.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-02-13T14:29:39.459 INFO:teuthology.orchestra.run.smithi111.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-02-13T14:29:39.626 INFO:teuthology.orchestra.run.smithi111.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-02-13T14:29:39.652 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-13T14:29:40.084 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-13T14:29:40.089 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-13T14:29:40.336 INFO:teuthology.orchestra.run.smithi111.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-02-13T14:29:40.341 INFO:teuthology.orchestra.run.smithi111.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-02-13T14:29:40.342 INFO:teuthology.orchestra.run.smithi111.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-02-13T14:29:40.380 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-13T14:29:40.381 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-13T14:29:40.383 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-13T14:29:40.384 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-13T14:29:40.386 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-13T14:29:40.388 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-13T14:29:40.389 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-13T14:29:40.391 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-13T14:29:40.419 INFO:teuthology.orchestra.run.smithi111.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-02-13T14:29:40.419 INFO:teuthology.orchestra.run.smithi111.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-02-13T14:29:40.420 INFO:teuthology.orchestra.run.smithi111.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-02-13T14:29:40.421 INFO:teuthology.orchestra.run.smithi111.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-02-13T14:29:40.423 INFO:teuthology.orchestra.run.smithi111.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-02-13T14:29:40.424 INFO:teuthology.orchestra.run.smithi111.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-02-13T14:29:40.573 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-13T14:29:40.590 INFO:teuthology.orchestra.run.smithi111.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-02-13T14:29:40.723 INFO:teuthology.orchestra.run.smithi111.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-02-13T14:29:40.963 INFO:teuthology.orchestra.run.smithi111.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1423-ge1b79d5a-1jammy [121 kB] 2024-02-13T14:29:40.965 INFO:teuthology.orchestra.run.smithi111.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1423-ge1b79d5a-1jammy [38.4 kB] 2024-02-13T14:29:40.966 INFO:teuthology.orchestra.run.smithi111.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1423-ge1b79d5a-1jammy [13.0 MB] 2024-02-13T14:29:40.979 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-13T14:29:41.022 INFO:teuthology.orchestra.run.smithi111.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-02-13T14:29:41.025 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-13T14:29:41.045 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-13T14:29:41.067 INFO:teuthology.orchestra.run.smithi111.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-02-13T14:29:41.092 INFO:teuthology.orchestra.run.smithi111.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-02-13T14:29:41.101 INFO:teuthology.orchestra.run.smithi111.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-02-13T14:29:41.146 INFO:teuthology.orchestra.run.smithi111.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-13T14:29:41.156 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-02-13T14:29:41.171 INFO:teuthology.orchestra.run.smithi111.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-13T14:29:41.178 INFO:teuthology.orchestra.run.smithi111.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-13T14:29:41.181 INFO:teuthology.orchestra.run.smithi111.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-13T14:29:41.197 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-02-13T14:29:41.208 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-02-13T14:29:41.213 INFO:teuthology.orchestra.run.smithi111.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-13T14:29:41.213 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-02-13T14:29:41.261 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-02-13T14:29:41.264 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-13T14:29:41.286 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-13T14:29:41.333 INFO:teuthology.orchestra.run.smithi111.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1423-ge1b79d5a-1jammy [91.5 kB] 2024-02-13T14:29:41.380 INFO:teuthology.orchestra.run.smithi111.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-02-13T14:29:41.450 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-13T14:29:41.726 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-13T14:29:41.743 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-13T14:29:41.862 INFO:teuthology.orchestra.run.smithi111.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-02-13T14:29:41.862 INFO:teuthology.orchestra.run.smithi111.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-02-13T14:29:41.875 INFO:teuthology.orchestra.run.smithi111.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-02-13T14:29:41.876 INFO:teuthology.orchestra.run.smithi111.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-02-13T14:29:41.896 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-13T14:29:41.907 INFO:teuthology.orchestra.run.smithi111.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-02-13T14:29:41.921 INFO:teuthology.orchestra.run.smithi111.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-13T14:29:41.925 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-02-13T14:29:42.047 INFO:teuthology.orchestra.run.smithi111.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-13T14:29:42.049 INFO:teuthology.orchestra.run.smithi111.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-13T14:29:42.050 INFO:teuthology.orchestra.run.smithi111.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-13T14:29:42.068 INFO:teuthology.orchestra.run.smithi111.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-13T14:29:42.083 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-02-13T14:29:42.086 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-02-13T14:29:42.087 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-02-13T14:29:42.110 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-02-13T14:29:42.115 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-13T14:29:42.237 INFO:teuthology.orchestra.run.smithi111.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-02-13T14:29:43.425 INFO:teuthology.orchestra.run.smithi111.stdout:Fetched 176 MB in 8s (23.1 MB/s) 2024-02-13T14:29:43.588 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-13T14:29:43.689 INFO:teuthology.orchestra.run.smithi111.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-13T14:29:43.695 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-13T14:29:43.778 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-13T14:29:44.123 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-13T14:29:44.150 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-13T14:29:44.190 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-13T14:29:44.534 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-13T14:29:44.561 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-13T14:29:44.601 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-13T14:29:44.971 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-13T14:29:44.998 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-13T14:29:45.046 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:29:45.433 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-13T14:29:45.459 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-13T14:29:45.499 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:29:45.568 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-1423-ge1b79d5a-1jammy [5,073 kB] 2024-02-13T14:29:45.844 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-13T14:29:45.871 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-13T14:29:45.910 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:29:46.222 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-13T14:29:46.237 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-13T14:29:46.272 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-13T14:29:46.591 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librados2. 2024-02-13T14:29:46.618 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../007-librados2_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:46.658 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librados2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:47.111 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librbd1. 2024-02-13T14:29:47.137 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../008-librbd1_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:47.177 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librbd1 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:47.189 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-1423-ge1b79d5a-1jammy [243 kB] 2024-02-13T14:29:47.250 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-1423-ge1b79d5a-1jammy [124 kB] 2024-02-13T14:29:47.294 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-1423-ge1b79d5a-1jammy [1,519 kB] 2024-02-13T14:29:47.622 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs2. 2024-02-13T14:29:47.648 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:47.688 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:47.718 INFO:teuthology.orchestra.run.smithi062.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-1423-ge1b79d5a-1jammy [6,240 kB] 2024-02-13T14:29:47.941 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rados. 2024-02-13T14:29:47.967 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:48.007 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rados (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:48.327 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-13T14:29:48.353 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:29:48.393 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-argparse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:48.645 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cephfs. 2024-02-13T14:29:48.661 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:48.704 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cephfs (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:49.015 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-13T14:29:49.042 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:29:49.081 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-ceph-common (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:49.108 INFO:teuthology.orchestra.run.smithi062.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-1423-ge1b79d5a-1jammy [22.7 MB] 2024-02-13T14:29:49.410 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-13T14:29:49.436 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-13T14:29:49.468 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-13T14:29:49.779 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-prettytable. 2024-02-13T14:29:49.806 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-13T14:29:49.845 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-13T14:29:50.098 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rbd. 2024-02-13T14:29:50.113 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:50.156 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rbd (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:50.501 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-13T14:29:50.527 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-13T14:29:50.567 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-13T14:29:50.837 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-13T14:29:50.852 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-13T14:29:50.886 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-13T14:29:51.189 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-13T14:29:51.205 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-13T14:29:51.273 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-13T14:29:51.601 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua5.1. 2024-02-13T14:29:51.628 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-13T14:29:51.667 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-13T14:29:51.979 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-any. 2024-02-13T14:29:51.994 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-13T14:29:52.037 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-13T14:29:52.273 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package zip. 2024-02-13T14:29:52.299 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-13T14:29:52.339 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking zip (3.0-12build2) ... 2024-02-13T14:29:52.660 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package unzip. 2024-02-13T14:29:52.686 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-02-13T14:29:52.726 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-02-13T14:29:53.113 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package luarocks. 2024-02-13T14:29:53.139 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-13T14:29:53.180 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-13T14:29:53.562 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package librgw2. 2024-02-13T14:29:53.589 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../025-librgw2_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:53.628 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking librgw2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:54.140 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rgw. 2024-02-13T14:29:54.155 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:54.198 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rgw (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:54.526 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-13T14:29:54.553 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-13T14:29:54.592 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-13T14:29:54.684 INFO:teuthology.orchestra.run.smithi062.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-1423-ge1b79d5a-1jammy [14.0 kB] 2024-02-13T14:29:54.685 INFO:teuthology.orchestra.run.smithi062.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-1423-ge1b79d5a-1jammy [865 kB] 2024-02-13T14:29:54.762 INFO:teuthology.orchestra.run.smithi062.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-1423-ge1b79d5a-1jammy [2,185 kB] 2024-02-13T14:29:54.912 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libradosstriper1. 2024-02-13T14:29:54.938 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:54.978 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libradosstriper1 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:55.119 INFO:teuthology.orchestra.run.smithi062.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-1423-ge1b79d5a-1jammy [788 kB] 2024-02-13T14:29:55.256 INFO:teuthology.orchestra.run.smithi062.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-1423-ge1b79d5a-1jammy [145 kB] 2024-02-13T14:29:55.262 INFO:teuthology.orchestra.run.smithi062.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-1423-ge1b79d5a-1jammy [1,899 kB] 2024-02-13T14:29:55.332 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-common. 2024-02-13T14:29:55.359 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:55.390 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-common (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:55.553 INFO:teuthology.orchestra.run.smithi062.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-1423-ge1b79d5a-1jammy [8,625 kB] 2024-02-13T14:29:56.678 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-base. 2024-02-13T14:29:56.705 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:29:56.754 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-base (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:29:56.947 INFO:teuthology.orchestra.run.smithi062.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-1423-ge1b79d5a-1jammy [14.2 kB] 2024-02-13T14:29:56.948 INFO:teuthology.orchestra.run.smithi062.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-1423-ge1b79d5a-1jammy [49.8 MB] 2024-02-13T14:29:57.291 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-13T14:29:57.318 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-13T14:29:57.357 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-13T14:29:57.745 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cheroot. 2024-02-13T14:29:57.772 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-13T14:29:57.901 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-13T14:29:58.238 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-13T14:29:58.264 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-13T14:29:58.304 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-13T14:29:58.624 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-13T14:29:58.651 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-13T14:29:58.690 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-13T14:29:58.993 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-13T14:29:59.020 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-13T14:29:59.060 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-13T14:29:59.304 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempora. 2024-02-13T14:29:59.319 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-13T14:29:59.354 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-13T14:29:59.665 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-portend. 2024-02-13T14:29:59.692 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-13T14:29:59.732 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-13T14:30:00.035 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-13T14:30:00.061 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-13T14:30:00.101 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-13T14:30:00.379 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-13T14:30:00.406 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-13T14:30:00.445 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-13T14:30:00.791 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-natsort. 2024-02-13T14:30:00.818 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-13T14:30:00.857 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-13T14:30:01.169 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-logutils. 2024-02-13T14:30:01.195 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-13T14:30:01.235 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-13T14:30:01.513 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-13T14:30:01.540 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-13T14:30:01.571 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-13T14:30:01.858 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-mako. 2024-02-13T14:30:01.884 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-13T14:30:01.924 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-13T14:30:02.286 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-13T14:30:02.312 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-13T14:30:02.352 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-13T14:30:02.654 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-13T14:30:02.682 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-13T14:30:02.721 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-13T14:30:03.024 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webob. 2024-02-13T14:30:03.051 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-13T14:30:03.082 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-13T14:30:03.393 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-waitress. 2024-02-13T14:30:03.420 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-13T14:30:03.463 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-13T14:30:03.755 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-tempita. 2024-02-13T14:30:03.782 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-13T14:30:03.821 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-13T14:30:04.099 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-paste. 2024-02-13T14:30:04.126 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-13T14:30:04.166 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-13T14:30:04.469 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-13T14:30:04.496 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-13T14:30:04.535 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-13T14:30:04.838 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-13T14:30:04.865 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-13T14:30:04.904 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-13T14:30:05.191 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-webtest. 2024-02-13T14:30:05.207 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-13T14:30:05.241 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-13T14:30:05.518 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pecan. 2024-02-13T14:30:05.545 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-13T14:30:05.602 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-13T14:30:05.957 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-certifi. 2024-02-13T14:30:05.980 INFO:teuthology.orchestra.run.smithi062.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-1423-ge1b79d5a-1jammy [121 kB] 2024-02-13T14:30:05.983 INFO:teuthology.orchestra.run.smithi062.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-1423-ge1b79d5a-1jammy [38.4 kB] 2024-02-13T14:30:05.984 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-13T14:30:05.984 INFO:teuthology.orchestra.run.smithi062.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-1423-ge1b79d5a-1jammy [13.0 MB] 2024-02-13T14:30:06.023 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-13T14:30:06.343 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-idna. 2024-02-13T14:30:06.369 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-13T14:30:06.409 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-13T14:30:06.737 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-urllib3. 2024-02-13T14:30:06.764 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-13T14:30:06.803 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-13T14:30:07.140 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests. 2024-02-13T14:30:07.167 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-13T14:30:07.206 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-13T14:30:07.518 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-13T14:30:07.545 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-13T14:30:07.584 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-13T14:30:07.871 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-13T14:30:07.897 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:07.937 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:08.155 INFO:teuthology.orchestra.run.smithi062.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-1423-ge1b79d5a-1jammy [91.5 kB] 2024-02-13T14:30:08.776 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 176 MB in 33s (5,337 kB/s) 2024-02-13T14:30:09.168 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-13T14:30:09.195 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:09.234 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:09.351 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-02-13T14:30:09.455 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165994 files and directories currently installed.) 2024-02-13T14:30:09.461 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-02-13T14:30:09.532 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-13T14:30:09.545 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-13T14:30:09.572 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-13T14:30:09.611 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-13T14:30:09.844 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-02-13T14:30:09.871 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-02-13T14:30:09.902 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-13T14:30:09.915 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-openssl. 2024-02-13T14:30:09.941 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-13T14:30:09.983 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-13T14:30:10.239 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-02-13T14:30:10.253 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-02-13T14:30:10.286 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr. 2024-02-13T14:30:10.297 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-13T14:30:10.313 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:10.352 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:10.739 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mon. 2024-02-13T14:30:10.751 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-02-13T14:30:10.766 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:10.777 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-13T14:30:10.805 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mon (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:10.826 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:30:11.179 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-02-13T14:30:11.206 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-13T14:30:11.246 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:30:11.418 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-osd. 2024-02-13T14:30:11.444 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:11.484 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-osd (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:11.716 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-02-13T14:30:11.742 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-02-13T14:30:11.782 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:30:12.143 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-02-13T14:30:12.170 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-02-13T14:30:12.210 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-13T14:30:12.454 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph. 2024-02-13T14:30:12.470 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../066-ceph_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:12.497 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librados2. 2024-02-13T14:30:12.512 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:12.523 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-librados2_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:12.555 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:12.857 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-fuse. 2024-02-13T14:30:12.884 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:12.923 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-fuse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:12.983 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librbd1. 2024-02-13T14:30:13.009 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-librbd1_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:13.049 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:13.293 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mds. 2024-02-13T14:30:13.320 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:13.359 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mds (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:13.677 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2024-02-13T14:30:13.704 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:13.712 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package cephadm. 2024-02-13T14:30:13.728 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../069-cephadm_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:13.744 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:13.762 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking cephadm (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:14.030 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2024-02-13T14:30:14.045 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-python3-rados_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:14.065 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-13T14:30:14.079 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:14.092 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-13T14:30:14.131 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-13T14:30:14.349 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-02-13T14:30:14.376 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:14.416 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:14.443 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-13T14:30:14.459 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-13T14:30:14.493 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-13T14:30:14.651 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2024-02-13T14:30:14.667 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:14.735 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:15.063 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2024-02-13T14:30:15.090 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:15.129 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:15.458 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2024-02-13T14:30:15.484 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-02-13T14:30:15.524 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-13T14:30:15.556 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-babel. 2024-02-13T14:30:15.584 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-13T14:30:15.622 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-13T14:30:15.802 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2024-02-13T14:30:15.818 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-02-13T14:30:15.852 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-02-13T14:30:15.934 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-jinja2. 2024-02-13T14:30:15.961 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-13T14:30:16.000 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-13T14:30:16.113 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2024-02-13T14:30:16.129 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:16.171 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:16.354 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-13T14:30:16.380 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:16.420 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:16.524 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-02-13T14:30:16.551 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-02-13T14:30:16.591 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-13T14:30:16.773 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-13T14:30:16.801 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-13T14:30:16.840 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-13T14:30:16.860 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-02-13T14:30:16.884 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-02-13T14:30:16.918 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-02-13T14:30:17.110 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-routes. 2024-02-13T14:30:17.137 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-13T14:30:17.168 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-13T14:30:17.215 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-02-13T14:30:17.231 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-02-13T14:30:17.273 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-13T14:30:17.479 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-13T14:30:17.495 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:17.529 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:17.593 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua5.1. 2024-02-13T14:30:17.620 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-02-13T14:30:17.660 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-02-13T14:30:17.899 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-13T14:30:17.915 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-13T14:30:17.957 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-13T14:30:17.962 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-any. 2024-02-13T14:30:17.978 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-02-13T14:30:18.012 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-any (27ubuntu1) ... 2024-02-13T14:30:18.232 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package zip. 2024-02-13T14:30:18.248 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-02-13T14:30:18.290 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking zip (3.0-12build2) ... 2024-02-13T14:30:18.411 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-joblib. 2024-02-13T14:30:18.427 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-13T14:30:18.461 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-13T14:30:18.626 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package unzip. 2024-02-13T14:30:18.653 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.1_amd64.deb ... 2024-02-13T14:30:18.693 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2024-02-13T14:30:18.781 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-13T14:30:18.808 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-13T14:30:18.847 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-13T14:30:19.138 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package luarocks. 2024-02-13T14:30:19.151 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-sklearn. 2024-02-13T14:30:19.165 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-02-13T14:30:19.177 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-13T14:30:19.213 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-02-13T14:30:19.217 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-13T14:30:19.654 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2024-02-13T14:30:19.681 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-librgw2_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:19.729 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:19.918 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-13T14:30:19.945 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:20.069 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:20.298 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2024-02-13T14:30:20.313 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:20.356 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:20.692 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0:amd64. 2024-02-13T14:30:20.719 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-02-13T14:30:20.759 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-02-13T14:30:21.006 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-cachetools. 2024-02-13T14:30:21.033 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-13T14:30:21.072 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-13T14:30:21.120 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2024-02-13T14:30:21.147 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:21.195 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:21.376 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-13T14:30:21.403 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-13T14:30:21.442 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-13T14:30:21.715 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2024-02-13T14:30:21.741 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-ceph-common_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:21.779 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-13T14:30:21.790 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:21.794 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-13T14:30:21.837 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-13T14:30:22.149 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-rsa. 2024-02-13T14:30:22.175 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-13T14:30:22.215 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-13T14:30:22.486 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-google-auth. 2024-02-13T14:30:22.501 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-13T14:30:22.535 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-13T14:30:22.864 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-13T14:30:22.891 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-13T14:30:22.930 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-13T14:30:23.187 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2024-02-13T14:30:23.213 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-ceph-base_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:23.242 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-websocket. 2024-02-13T14:30:23.263 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:23.269 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-13T14:30:23.308 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-13T14:30:23.637 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-13T14:30:23.664 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-13T14:30:23.703 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-13T14:30:23.782 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-02-13T14:30:23.809 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-02-13T14:30:23.841 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-02-13T14:30:24.302 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cheroot. 2024-02-13T14:30:24.329 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-02-13T14:30:24.367 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-13T14:30:24.368 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-13T14:30:24.383 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:24.425 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:24.696 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-02-13T14:30:24.720 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-13T14:30:24.723 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-02-13T14:30:24.747 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-13T14:30:24.762 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-02-13T14:30:24.786 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-13T14:30:25.074 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.text. 2024-02-13T14:30:25.101 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-02-13T14:30:25.123 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-13T14:30:25.140 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-02-13T14:30:25.150 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-13T14:30:25.189 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-13T14:30:25.426 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-02-13T14:30:25.450 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package jq. 2024-02-13T14:30:25.453 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-02-13T14:30:25.478 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-13T14:30:25.484 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-02-13T14:30:25.517 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-13T14:30:25.753 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package socat. 2024-02-13T14:30:25.771 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempora. 2024-02-13T14:30:25.780 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-13T14:30:25.798 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-02-13T14:30:25.811 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-13T14:30:25.837 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-02-13T14:30:26.115 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package xmlstarlet. 2024-02-13T14:30:26.140 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-portend. 2024-02-13T14:30:26.142 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-13T14:30:26.167 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-02-13T14:30:26.181 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-13T14:30:26.240 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-02-13T14:30:26.543 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-02-13T14:30:26.543 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-test. 2024-02-13T14:30:26.560 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:26.570 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-02-13T14:30:26.593 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-test (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:26.609 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-02-13T14:30:26.879 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2024-02-13T14:30:26.906 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-02-13T14:30:26.937 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-02-13T14:30:27.265 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-natsort. 2024-02-13T14:30:27.292 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-02-13T14:30:27.340 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-02-13T14:30:27.635 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2024-02-13T14:30:27.651 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-02-13T14:30:27.685 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-02-13T14:30:27.946 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2024-02-13T14:30:27.973 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-02-13T14:30:28.004 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-02-13T14:30:28.307 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2024-02-13T14:30:28.334 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-02-13T14:30:28.373 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-13T14:30:28.685 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2024-02-13T14:30:28.712 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-02-13T14:30:28.751 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-02-13T14:30:29.054 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2024-02-13T14:30:29.081 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-02-13T14:30:29.098 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package ceph-volume. 2024-02-13T14:30:29.121 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-02-13T14:30:29.126 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:29.165 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking ceph-volume (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:29.407 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2024-02-13T14:30:29.422 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-02-13T14:30:29.456 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-02-13T14:30:29.468 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-13T14:30:29.485 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:29.527 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking libcephfs-dev (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:29.777 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2024-02-13T14:30:29.803 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-02-13T14:30:29.846 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-13T14:30:29.874 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-13T14:30:29.938 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-13T14:30:30.013 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-13T14:30:30.263 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2024-02-13T14:30:30.290 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-02-13T14:30:30.326 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-13T14:30:30.329 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-02-13T14:30:30.342 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-13T14:30:30.384 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-13T14:30:30.632 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2024-02-13T14:30:30.659 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-02-13T14:30:30.698 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-02-13T14:30:30.772 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package nvme-cli. 2024-02-13T14:30:30.799 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-13T14:30:30.838 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-13T14:30:31.035 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-02-13T14:30:31.051 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-02-13T14:30:31.093 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-02-13T14:30:31.260 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package pkg-config. 2024-02-13T14:30:31.287 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-13T14:30:31.326 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-13T14:30:31.396 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2024-02-13T14:30:31.423 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-02-13T14:30:31.462 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-02-13T14:30:31.563 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-13T14:30:31.578 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-13T14:30:31.621 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-13T14:30:31.765 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2024-02-13T14:30:31.792 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-02-13T14:30:31.832 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-02-13T14:30:31.999 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-13T14:30:32.026 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-13T14:30:32.057 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-13T14:30:32.118 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2024-02-13T14:30:32.134 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-02-13T14:30:32.176 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-02-13T14:30:32.319 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pastescript. 2024-02-13T14:30:32.346 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-13T14:30:32.385 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-13T14:30:32.522 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-certifi. 2024-02-13T14:30:32.550 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-02-13T14:30:32.589 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-02-13T14:30:32.722 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pluggy. 2024-02-13T14:30:32.750 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-13T14:30:32.788 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-13T14:30:32.900 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-idna. 2024-02-13T14:30:32.927 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-02-13T14:30:32.967 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-idna (3.3-1) ... 2024-02-13T14:30:33.099 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-psutil. 2024-02-13T14:30:33.127 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-13T14:30:33.166 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-13T14:30:33.270 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-urllib3. 2024-02-13T14:30:33.297 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-02-13T14:30:33.336 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-13T14:30:33.503 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-py. 2024-02-13T14:30:33.531 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-13T14:30:33.569 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-13T14:30:33.664 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests. 2024-02-13T14:30:33.691 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-02-13T14:30:33.731 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-13T14:30:33.881 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pygments. 2024-02-13T14:30:33.909 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-13T14:30:33.947 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-13T14:30:34.067 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2024-02-13T14:30:34.094 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-02-13T14:30:34.133 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-13T14:30:34.435 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-13T14:30:34.436 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-02-13T14:30:34.460 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:34.462 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-13T14:30:34.501 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-13T14:30:34.502 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:34.804 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-toml. 2024-02-13T14:30:34.831 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-13T14:30:34.870 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-13T14:30:34.907 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-02-13T14:30:34.935 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:34.974 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:35.173 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-pytest. 2024-02-13T14:30:35.201 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-13T14:30:35.239 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-13T14:30:35.252 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2024-02-13T14:30:35.279 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-02-13T14:30:35.318 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-02-13T14:30:35.577 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package python3-simplejson. 2024-02-13T14:30:35.605 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-13T14:30:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2024-02-13T14:30:35.643 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-13T14:30:35.648 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-02-13T14:30:35.687 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-02-13T14:30:35.921 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-13T14:30:35.949 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-13T14:30:35.987 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-13T14:30:36.074 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2024-02-13T14:30:36.101 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:36.140 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:36.511 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2024-02-13T14:30:36.537 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:36.568 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:36.733 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package radosgw. 2024-02-13T14:30:36.761 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../116-radosgw_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:36.799 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking radosgw (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:37.272 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2024-02-13T14:30:37.299 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:37.338 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:37.602 INFO:teuthology.orchestra.run.smithi111.stdout:Selecting previously unselected package rbd-fuse. 2024-02-13T14:30:37.619 INFO:teuthology.orchestra.run.smithi111.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:37.661 INFO:teuthology.orchestra.run.smithi111.stdout:Unpacking rbd-fuse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:37.981 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-13T14:30:38.241 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-13T14:30:38.367 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-13T14:30:38.416 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2024-02-13T14:30:38.440 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-ceph_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:38.483 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:38.644 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-13T14:30:38.811 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2024-02-13T14:30:38.837 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:38.877 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:38.973 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-13T14:30:39.188 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2024-02-13T14:30:39.204 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:39.238 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:39.417 INFO:teuthology.orchestra.run.smithi111.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-13T14:30:39.485 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up cephadm (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:39.616 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2024-02-13T14:30:39.643 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-cephadm_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:39.682 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:40.002 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-asyncssh. 2024-02-13T14:30:40.020 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user cephadm....done 2024-02-13T14:30:40.029 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-02-13T14:30:40.077 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-02-13T14:30:40.142 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-13T14:30:40.404 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-babel-localedata. 2024-02-13T14:30:40.418 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-13T14:30:40.420 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-02-13T14:30:40.462 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-13T14:30:40.661 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-13T14:30:40.779 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-13T14:30:41.030 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-13T14:30:41.290 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-13T14:30:41.432 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-13T14:30:41.542 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-babel. 2024-02-13T14:30:41.570 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-02-13T14:30:41.626 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-02-13T14:30:41.734 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-13T14:30:41.937 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2024-02-13T14:30:41.964 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-02-13T14:30:42.003 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-13T14:30:42.086 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-13T14:30:42.346 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-13T14:30:42.356 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-02-13T14:30:42.383 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:42.422 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:42.622 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-02-13T14:30:42.784 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2024-02-13T14:30:42.811 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-02-13T14:30:42.851 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-02-13T14:30:42.923 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-13T14:30:43.104 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2024-02-13T14:30:43.120 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-02-13T14:30:43.161 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-02-13T14:30:43.183 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-13T14:30:43.434 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-13T14:30:43.456 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-02-13T14:30:43.473 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:43.506 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:43.708 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-argparse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:43.943 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-02-13T14:30:43.971 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-02-13T14:30:44.009 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-13T14:30:44.069 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-13T14:30:44.212 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-13T14:30:44.338 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-13T14:30:44.464 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-13T14:30:44.521 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2024-02-13T14:30:44.549 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-02-13T14:30:44.587 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-02-13T14:30:44.723 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-13T14:30:45.130 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-13T14:30:45.183 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-02-13T14:30:45.188 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-13T14:30:45.210 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-02-13T14:30:45.249 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-02-13T14:30:45.260 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-13T14:30:45.386 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-13T14:30:45.594 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2024-02-13T14:30:45.622 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-02-13T14:30:45.660 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-13T14:30:45.746 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-13T14:30:45.872 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-13T14:30:46.148 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-13T14:30:46.369 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-02-13T14:30:46.397 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:46.424 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-13T14:30:46.529 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:46.733 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up zip (3.0-12build2) ... 2024-02-13T14:30:46.851 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-13T14:30:47.465 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2024-02-13T14:30:47.482 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-02-13T14:30:47.486 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-13T14:30:47.523 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-02-13T14:30:47.738 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-13T14:30:47.835 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2024-02-13T14:30:47.863 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-02-13T14:30:47.863 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-13T14:30:47.901 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-02-13T14:30:47.990 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-13T14:30:48.238 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-02-13T14:30:48.266 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-02-13T14:30:48.299 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-13T14:30:48.304 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-02-13T14:30:48.616 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2024-02-13T14:30:48.643 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-02-13T14:30:48.675 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-13T14:30:48.682 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.8-1) ... 2024-02-13T14:30:48.918 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-13T14:30:48.961 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2024-02-13T14:30:48.988 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-02-13T14:30:49.019 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-02-13T14:30:49.295 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-13T14:30:49.330 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-02-13T14:30:49.358 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-02-13T14:30:49.396 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-13T14:30:49.596 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-13T14:30:49.708 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2024-02-13T14:30:49.735 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-02-13T14:30:49.774 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-02-13T14:30:49.939 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-13T14:30:50.086 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2024-02-13T14:30:50.114 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-02-13T14:30:50.152 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-13T14:30:50.190 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-13T14:30:50.316 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-ceph-common (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:50.626 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-idna (3.3-1) ... 2024-02-13T14:30:50.816 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-02-13T14:30:50.844 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:50.882 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:50.935 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-13T14:30:51.160 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2024-02-13T14:30:51.176 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-02-13T14:30:51.218 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-13T14:30:51.546 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2024-02-13T14:30:51.574 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-02-13T14:30:51.613 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-13T14:30:51.890 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2024-02-13T14:30:51.918 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-02-13T14:30:51.957 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-02-13T14:30:52.033 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-13T14:30:52.201 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2024-02-13T14:30:52.217 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-02-13T14:30:52.251 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-02-13T14:30:52.285 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:30:52.419 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-13T14:30:52.512 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2024-02-13T14:30:52.529 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-02-13T14:30:52.562 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-02-13T14:30:52.678 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-13T14:30:52.804 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-13T14:30:52.930 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-13T14:30:52.933 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2024-02-13T14:30:52.949 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-ceph-test_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:52.991 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:53.232 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-13T14:30:53.491 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-13T14:30:53.734 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:30:53.862 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-13T14:30:54.180 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-13T14:30:54.440 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-13T14:30:54.699 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-13T14:30:54.950 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-13T14:30:55.201 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-13T14:30:55.362 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-volume. 2024-02-13T14:30:55.378 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-1423-ge1b79d5a-1jammy_all.deb ... 2024-02-13T14:30:55.428 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-volume (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:55.460 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-13T14:30:55.595 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-13T14:30:55.699 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2024-02-13T14:30:55.712 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:30:55.749 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:30:55.871 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-13T14:30:55.997 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-13T14:30:56.054 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-socket:amd64. 2024-02-13T14:30:56.081 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-02-13T14:30:56.120 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-13T14:30:56.290 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-13T14:30:56.458 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package lua-sec:amd64. 2024-02-13T14:30:56.486 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-02-13T14:30:56.524 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-02-13T14:30:56.591 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-13T14:30:56.826 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-13T14:30:56.903 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2024-02-13T14:30:56.931 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-02-13T14:30:56.951 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-13T14:30:56.977 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-02-13T14:30:57.069 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-13T14:30:57.159 INFO:teuthology.orchestra.run.smithi111.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-13T14:30:57.374 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pkg-config. 2024-02-13T14:30:57.396 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-13T14:30:57.403 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-02-13T14:30:57.432 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-02-13T14:30:57.522 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-13T14:30:57.618 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-02-13T14:30:57.635 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-02-13T14:30:57.677 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-02-13T14:30:57.915 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-13T14:30:58.063 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-iniconfig. 2024-02-13T14:30:58.091 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-02-13T14:30:58.121 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-02-13T14:30:58.166 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-13T14:30:58.292 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-13T14:30:58.374 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2024-02-13T14:30:58.402 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-02-13T14:30:58.440 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-02-13T14:30:58.552 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:30:58.670 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-13T14:30:58.752 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2024-02-13T14:30:58.780 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-02-13T14:30:58.818 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-02-13T14:30:58.988 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-13T14:30:59.113 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2024-02-13T14:30:59.141 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-02-13T14:30:59.180 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-02-13T14:30:59.339 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-13T14:30:59.524 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2024-02-13T14:30:59.552 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-02-13T14:30:59.591 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.10.0-1) ... 2024-02-13T14:30:59.865 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-13T14:30:59.902 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pygments. 2024-02-13T14:30:59.916 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-02-13T14:30:59.960 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-02-13T14:31:00.066 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-13T14:31:00.333 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-13T14:31:00.431 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2024-02-13T14:31:00.460 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-02-13T14:31:00.489 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-02-13T14:31:00.601 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-13T14:31:00.817 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-toml. 2024-02-13T14:31:00.845 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-02-13T14:31:00.875 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-02-13T14:31:00.938 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-13T14:31:01.161 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2024-02-13T14:31:01.189 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-02-13T14:31:01.227 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-02-13T14:31:01.306 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-13T14:31:01.590 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2024-02-13T14:31:01.600 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-13T14:31:01.618 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-02-13T14:31:01.656 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-02-13T14:31:01.925 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-02-13T14:31:01.927 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-13T14:31:01.953 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-02-13T14:31:01.991 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-02-13T14:31:02.062 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librados2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:02.188 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:02.314 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-13T14:31:02.642 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:02.746 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2024-02-13T14:31:02.751 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libradosstriper1 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:02.774 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../116-radosgw_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:31:02.812 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:02.877 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-13T14:31:03.187 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librbd1 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:03.313 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-modules-core (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:03.439 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-fuse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:03.640 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2024-02-13T14:31:03.653 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-13T14:31:03.653 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-13T14:31:03.656 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-1423-ge1b79d5a-1jammy_amd64.deb ... 2024-02-13T14:31:03.689 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:03.986 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-02-13T14:31:04.132 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up libcephfs-dev (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:04.258 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rados (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:04.319 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-02-13T14:31:04.359 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up librgw2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:04.454 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-02-13T14:31:04.485 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-13T14:31:04.724 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-02-13T14:31:05.037 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-02-13T14:31:05.445 INFO:teuthology.orchestra.run.smithi062.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-02-13T14:31:05.505 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:05.697 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rbd (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:05.823 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up rbd-fuse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:05.949 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-rgw (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:05.974 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2024-02-13T14:31:06.059 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up python3-cephfs (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:06.128 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-02-13T14:31:06.168 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-common (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:06.412 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-02-13T14:31:06.689 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-02-13T14:31:06.728 INFO:teuthology.orchestra.run.smithi111.stdout:Adding group ceph....done 2024-02-13T14:31:06.815 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-02-13T14:31:07.057 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-02-13T14:31:07.095 INFO:teuthology.orchestra.run.smithi111.stdout:Adding system user ceph....done 2024-02-13T14:31:07.272 INFO:teuthology.orchestra.run.smithi111.stdout:Setting system user ceph properties....done 2024-02-13T14:31:07.289 INFO:teuthology.orchestra.run.smithi111.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-13T14:31:07.308 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-02-13T14:31:07.425 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-13T14:31:07.434 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.10.0-1) ... 2024-02-13T14:31:07.744 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-02-13T14:31:07.753 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-13T14:31:08.146 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-02-13T14:31:08.219 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-test (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:08.345 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up radosgw (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:08.414 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-02-13T14:31:08.724 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2024-02-13T14:31:08.830 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-13T14:31:08.830 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-13T14:31:08.975 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-02-13T14:31:09.243 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-02-13T14:31:09.339 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-base (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:09.519 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-02-13T14:31:09.677 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-13T14:31:09.795 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:10.138 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-02-13T14:31:10.166 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mds (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:10.272 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-02-13T14:31:10.390 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-02-13T14:31:10.390 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-13T14:31:10.390 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-13T14:31:10.491 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-02-13T14:31:10.733 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-02-13T14:31:10.884 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:11.101 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-13T14:31:11.101 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-13T14:31:11.102 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-02-13T14:31:11.132 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-02-13T14:31:11.211 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-02-13T14:31:11.362 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-02-13T14:31:11.577 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-osd (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:11.772 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-02-13T14:31:11.839 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-13T14:31:11.839 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-13T14:31:11.923 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-02-13T14:31:12.182 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-02-13T14:31:12.354 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:12.450 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-02-13T14:31:12.480 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:12.623 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mon (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:12.768 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up zip (3.0-12build2) ... 2024-02-13T14:31:12.816 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-13T14:31:12.816 INFO:teuthology.orchestra.run.smithi111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-13T14:31:12.894 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-02-13T14:31:13.392 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-cephadm (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:13.579 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-02-13T14:31:13.605 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:13.834 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-mgr-dashboard (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:13.863 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-02-13T14:31:14.015 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-02-13T14:31:14.085 INFO:teuthology.orchestra.run.smithi111.stdout:Setting up ceph-volume (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:14.141 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-02-13T14:31:14.441 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-02-13T14:31:14.574 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-13T14:31:14.682 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-13T14:31:14.835 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-13T14:31:14.851 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-02-13T14:31:15.102 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-02-13T14:31:15.569 INFO:teuthology.orchestra.run.smithi111.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-13T14:31:15.721 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-02-13T14:31:16.047 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-02-13T14:31:16.193 INFO:teuthology.orchestra.run.smithi111.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-13T14:31:16.199 DEBUG:teuthology.parallel:result is None 2024-02-13T14:31:16.448 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-02-13T14:31:16.708 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-02-13T14:31:16.817 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:17.109 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-idna (3.3-1) ... 2024-02-13T14:31:17.453 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-02-13T14:31:18.691 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-02-13T14:31:18.943 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:31:19.094 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-toml (0.10.2-1) ... 2024-02-13T14:31:19.395 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-02-13T14:31:19.546 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-02-13T14:31:19.697 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-02-13T14:31:20.023 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-02-13T14:31:20.283 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-02-13T14:31:20.534 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:31:20.660 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-02-13T14:31:21.003 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-02-13T14:31:21.279 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-02-13T14:31:21.547 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-02-13T14:31:21.831 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-02-13T14:31:22.099 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-02-13T14:31:22.358 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-02-13T14:31:22.484 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-02-13T14:31:22.769 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-02-13T14:31:22.895 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-02-13T14:31:23.221 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-02-13T14:31:23.572 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-02-13T14:31:23.865 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-02-13T14:31:23.965 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-02-13T14:31:24.075 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-02-13T14:31:24.164 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-02-13T14:31:24.418 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-02-13T14:31:24.544 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-02-13T14:31:24.971 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-02-13T14:31:25.263 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up lua-any (27ubuntu1) ... 2024-02-13T14:31:25.414 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-portend (3.0.0-1) ... 2024-02-13T14:31:25.674 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-02-13T14:31:25.775 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-02-13T14:31:26.101 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-02-13T14:31:26.410 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-02-13T14:31:26.703 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-02-13T14:31:26.854 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.8-1) ... 2024-02-13T14:31:27.147 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-02-13T14:31:27.415 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-02-13T14:31:27.785 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-02-13T14:31:28.178 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-02-13T14:31:28.471 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-02-13T14:31:28.823 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-02-13T14:31:28.949 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:29.075 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-mod-ceph (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:29.201 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-02-13T14:31:29.596 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:29.747 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:29.898 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-02-13T14:31:30.174 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:30.300 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:30.426 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:30.643 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-13T14:31:30.643 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-02-13T14:31:31.086 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:31.237 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:31.388 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:31.564 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-02-13T14:31:32.859 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:32.994 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:33.145 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:33.296 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:33.447 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:34.039 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2024-02-13T14:31:34.374 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2024-02-13T14:31:34.585 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2024-02-13T14:31:34.605 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-02-13T14:31:34.747 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-02-13T14:31:35.095 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-02-13T14:31:35.774 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:36.075 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:36.556 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-13T14:31:36.556 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-02-13T14:31:37.014 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:37.380 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-02-13T14:31:37.841 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:38.092 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-13T14:31:38.092 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-02-13T14:31:38.543 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:38.770 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-13T14:31:38.770 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-02-13T14:31:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:39.574 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-13T14:31:39.574 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-02-13T14:31:40.046 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:40.197 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:40.373 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-13T14:31:40.599 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-02-13T14:31:41.041 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:41.183 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:41.309 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:41.460 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-volume (19.0.0-1423-ge1b79d5a-1jammy) ... 2024-02-13T14:31:41.997 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-02-13T14:31:42.106 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-02-13T14:31:42.250 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-02-13T14:31:43.425 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-02-13T14:31:44.089 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-02-13T14:31:44.095 DEBUG:teuthology.parallel:result is None 2024-02-13T14:31:44.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:31:44.314 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2024-02-13T14:31:44.334 INFO:teuthology.orchestra.run.smithi062.stdout:19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:31:44.334 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:31:44.334 INFO:teuthology.task.install:The correct ceph version 19.0.0-1423-ge1b79d5a-1jammy is installed. 2024-02-13T14:31:44.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:31:44.555 DEBUG:teuthology.orchestra.run.smithi111:> dpkg-query -W -f '${Version}' ceph 2024-02-13T14:31:44.575 INFO:teuthology.orchestra.run.smithi111.stdout:19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:31:44.575 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1423-ge1b79d5a-1jammy 2024-02-13T14:31:44.576 INFO:teuthology.task.install:The correct ceph version 19.0.0-1423-ge1b79d5a-1jammy is installed. 2024-02-13T14:31:44.577 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-13T14:31:44.578 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:31:44.578 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-13T14:31:44.592 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:31:44.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-13T14:31:44.631 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-13T14:31:44.632 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:31:44.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-02-13T14:31:44.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-13T14:31:44.706 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:31:44.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-02-13T14:31:44.720 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-13T14:31:44.773 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-13T14:31:44.773 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:31:44.774 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-13T14:31:44.787 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-13T14:31:44.843 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:31:44.843 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-13T14:31:44.857 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-13T14:31:44.910 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-13T14:31:44.910 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:31:44.911 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-02-13T14:31:44.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-13T14:31:44.978 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:31:44.979 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-02-13T14:31:44.992 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-13T14:31:45.046 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-13T14:31:45.142 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'client': {'debug ms': 1}, 'global': {'mon election default strategy': 3, 'ms bind msgr2': False, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon warn on pool no app': False}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd class default list': '*', 'osd class load list': '*', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'reached quota', 'but it is still running', 'overall HEALTH_', '\\(POOL_FULL\\)', '\\(SMALLER_PGP_NUM\\)', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(POOL_APP_NOT_ENABLED\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)'], 'mon_bind_msgr2': False, 'sha1': 'e1b79d5a4193a484176863ab96c0ca28c00e1662', 'cephadm_mode': 'root'} 2024-02-13T14:31:45.142 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:31:45.143 INFO:tasks.cephadm:Cluster fsid is 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:31:45.143 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-13T14:31:45.143 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '[v1:172.21.15.62:6789]', 'mon.c': '[v1:172.21.15.62:6790]', 'mon.b': '[v1:172.21.15.111:6789]'} 2024-02-13T14:31:45.143 INFO:tasks.cephadm:First mon is mon.a on smithi062 2024-02-13T14:31:45.143 INFO:tasks.cephadm:First mgr is y 2024-02-13T14:31:45.143 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-13T14:31:45.143 DEBUG:teuthology.orchestra.run.smithi062:> sudo hostname $(hostname -s) 2024-02-13T14:31:45.157 DEBUG:teuthology.orchestra.run.smithi111:> sudo hostname $(hostname -s) 2024-02-13T14:31:45.171 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-02-13T14:31:45.171 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:31:45.320 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e1b79d5a4193a484176863ab96c0ca28c00e1662', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic/76678/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1423-ge1b79d5a', 'node_name': '172.21.5.38+adami08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=jammy,DIST=jammy,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1423-ge1b79d5a-1jammy'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default/', 'distro_codename': 'jammy', 'modified': '2024-02-13 00:20:06.712484', 'distro_version': '22.04', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-phlogistonjohn-testing-2024-02-12-1654', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/flavors/default/', 'archs': ['x86_64'], 'distro': 'ubuntu'}] 2024-02-13T14:31:45.543 INFO:tasks.util.chacra:got chacra host 2.chacra.ceph.com, ref wip-phlogistonjohn-testing-2024-02-12-1654, sha1 e1b79d5a4193a484176863ab96c0ca28c00e1662 from https://shaman.ceph.com/api/search/?project=ceph&distros=ubuntu%2F22.04%2Fx86_64&flavor=default&sha1=e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:31:45.545 INFO:tasks.cephadm:Discovered cachra url: https://2.chacra.ceph.com/binaries/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/x86_64/flavors/default/cephadm 2024-02-13T14:31:45.546 DEBUG:teuthology.orchestra.run.smithi062:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-13T14:31:46.025 INFO:teuthology.orchestra.run.smithi062.stdout:-rw-rw-r-- 1 ubuntu ubuntu 786442 Feb 13 14:31 /home/ubuntu/cephtest/cephadm 2024-02-13T14:31:46.025 DEBUG:teuthology.orchestra.run.smithi111:> curl --silent -L https://2.chacra.ceph.com/binaries/ceph/wip-phlogistonjohn-testing-2024-02-12-1654/e1b79d5a4193a484176863ab96c0ca28c00e1662/ubuntu/jammy/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-13T14:31:46.484 INFO:teuthology.orchestra.run.smithi111.stdout:-rw-rw-r-- 1 ubuntu ubuntu 786442 Feb 13 14:31 /home/ubuntu/cephtest/cephadm 2024-02-13T14:31:46.484 DEBUG:teuthology.orchestra.run.smithi062:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-13T14:31:46.492 DEBUG:teuthology.orchestra.run.smithi111:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-13T14:31:46.512 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 on all hosts... 2024-02-13T14:31:46.512 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 pull 2024-02-13T14:31:46.536 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 pull 2024-02-13T14:31:46.706 INFO:teuthology.orchestra.run.smithi062.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662... 2024-02-13T14:31:46.707 INFO:teuthology.orchestra.run.smithi111.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662... 2024-02-13T14:33:03.593 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-02-13T14:33:03.594 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph_version": "ceph version 19.0.0-1423-ge1b79d5a (e1b79d5a4193a484176863ab96c0ca28c00e1662) squid (dev)", 2024-02-13T14:33:03.594 INFO:teuthology.orchestra.run.smithi111.stdout: "image_id": "28480620e5edd298d55c0e6673dcbad9ed23edd37269028a11063c1b8925676a", 2024-02-13T14:33:03.594 INFO:teuthology.orchestra.run.smithi111.stdout: "repo_digests": [ 2024-02-13T14:33:03.594 INFO:teuthology.orchestra.run.smithi111.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:48116d68f53d3a2ae4d119fcfc94a11cef23cee69b8a381eaa5186380a06fd9f" 2024-02-13T14:33:03.594 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-02-13T14:33:03.594 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-02-13T14:33:03.843 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-02-13T14:33:03.843 INFO:teuthology.orchestra.run.smithi062.stdout: "ceph_version": "ceph version 19.0.0-1423-ge1b79d5a (e1b79d5a4193a484176863ab96c0ca28c00e1662) squid (dev)", 2024-02-13T14:33:03.843 INFO:teuthology.orchestra.run.smithi062.stdout: "image_id": "28480620e5edd298d55c0e6673dcbad9ed23edd37269028a11063c1b8925676a", 2024-02-13T14:33:03.843 INFO:teuthology.orchestra.run.smithi062.stdout: "repo_digests": [ 2024-02-13T14:33:03.843 INFO:teuthology.orchestra.run.smithi062.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:48116d68f53d3a2ae4d119fcfc94a11cef23cee69b8a381eaa5186380a06fd9f" 2024-02-13T14:33:03.843 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2024-02-13T14:33:03.844 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-02-13T14:33:03.892 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph 2024-02-13T14:33:03.907 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph 2024-02-13T14:33:03.923 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /etc/ceph 2024-02-13T14:33:03.966 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /etc/ceph 2024-02-13T14:33:03.979 INFO:tasks.cephadm:Writing seed config... 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [global] ms bind msgr2 = False 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [global] ms type = async 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-13T14:33:03.980 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-02-13T14:33:03.981 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-13T14:33:03.981 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-13T14:33:03.981 INFO:tasks.cephadm: override: [osd] osd class default list = * 2024-02-13T14:33:03.981 INFO:tasks.cephadm: override: [osd] osd class load list = * 2024-02-13T14:33:03.981 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-02-13T14:33:03.982 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:33:03.982 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-13T14:33:04.015 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9cdb3692-ca7c-11ee-95b9-87774f69a715 mon election default strategy = 3 ms bind msgr2 = False ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd class default list = * osd class load list = * [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] debug ms = 1 2024-02-13T14:33:04.015 DEBUG:teuthology.orchestra.run.smithi062:mon.a> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.a.service 2024-02-13T14:33:04.060 DEBUG:teuthology.orchestra.run.smithi062:mgr.y> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.y.service 2024-02-13T14:33:04.103 INFO:tasks.cephadm:Bootstrapping... 2024-02-13T14:33:04.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 -v bootstrap --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-addrv '[v1:172.21.15.62:6789]' --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-13T14:33:04.316 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-02-13T14:33:04.317 INFO:teuthology.orchestra.run.smithi062.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662', '-v', 'bootstrap', '--fsid', '9cdb3692-ca7c-11ee-95b9-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-addrv', '[v1:172.21.15.62:6789]', '--skip-admin-label'] 2024-02-13T14:33:04.317 INFO:teuthology.orchestra.run.smithi062.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-13T14:33:04.318 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying podman|docker is present... 2024-02-13T14:33:04.318 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying lvm2 is present... 2024-02-13T14:33:04.318 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying time synchronization is in place... 2024-02-13T14:33:04.322 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-13T14:33:04.322 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-13T14:33:04.326 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-13T14:33:04.326 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-02-13T14:33:04.329 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-02-13T14:33:04.329 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-02-13T14:33:04.333 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-02-13T14:33:04.333 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-02-13T14:33:04.337 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-02-13T14:33:04.337 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout masked 2024-02-13T14:33:04.340 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-02-13T14:33:04.340 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-02-13T14:33:04.344 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-02-13T14:33:04.344 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-02-13T14:33:04.348 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-02-13T14:33:04.348 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-02-13T14:33:04.352 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout enabled 2024-02-13T14:33:04.356 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout active 2024-02-13T14:33:04.357 INFO:teuthology.orchestra.run.smithi062.stdout:Unit ntp.service is enabled and running 2024-02-13T14:33:04.357 INFO:teuthology.orchestra.run.smithi062.stdout:Repeating the final host check... 2024-02-13T14:33:04.357 INFO:teuthology.orchestra.run.smithi062.stdout:docker (/usr/bin/docker) is present 2024-02-13T14:33:04.357 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl is present 2024-02-13T14:33:04.357 INFO:teuthology.orchestra.run.smithi062.stdout:lvcreate is present 2024-02-13T14:33:04.360 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-13T14:33:04.360 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-13T14:33:04.364 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-13T14:33:04.364 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-02-13T14:33:04.367 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled chronyd.service 2024-02-13T14:33:04.367 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for chronyd.service: No such file or directory 2024-02-13T14:33:04.371 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active chronyd.service 2024-02-13T14:33:04.371 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-02-13T14:33:04.374 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled systemd-timesyncd.service 2024-02-13T14:33:04.374 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout masked 2024-02-13T14:33:04.378 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active systemd-timesyncd.service 2024-02-13T14:33:04.378 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-02-13T14:33:04.381 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl is-enabled ntpd.service 2024-02-13T14:33:04.381 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to get unit file state for ntpd.service: No such file or directory 2024-02-13T14:33:04.385 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 3 from systemctl is-active ntpd.service 2024-02-13T14:33:04.385 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout inactive 2024-02-13T14:33:04.389 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout enabled 2024-02-13T14:33:04.393 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stdout active 2024-02-13T14:33:04.394 INFO:teuthology.orchestra.run.smithi062.stdout:Unit ntp.service is enabled and running 2024-02-13T14:33:04.394 INFO:teuthology.orchestra.run.smithi062.stdout:Host looks OK 2024-02-13T14:33:04.394 INFO:teuthology.orchestra.run.smithi062.stdout:Cluster fsid: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:04.394 INFO:teuthology.orchestra.run.smithi062.stdout:Acquiring lock 139633292995520 on /run/cephadm/9cdb3692-ca7c-11ee-95b9-87774f69a715.lock 2024-02-13T14:33:04.394 INFO:teuthology.orchestra.run.smithi062.stdout:Lock 139633292995520 acquired on /run/cephadm/9cdb3692-ca7c-11ee-95b9-87774f69a715.lock 2024-02-13T14:33:04.394 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying IP 172.21.15.62 port 6789 ... 2024-02-13T14:33:04.395 INFO:teuthology.orchestra.run.smithi062.stdout:Base mon IP(s) is [172.21.15.62:6789], mon addrv is [v1:172.21.15.62:6789] 2024-02-13T14:33:04.397 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 2024-02-13T14:33:04.397 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.62 metric 100 2024-02-13T14:33:04.397 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2024-02-13T14:33:04.397 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.62 metric 100 2024-02-13T14:33:04.397 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout 172.21.0.1 dev enp3s0f1 proto dhcp scope link src 172.21.15.62 metric 100 2024-02-13T14:33:04.397 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout 172.21.0.2 dev enp3s0f1 proto dhcp scope link src 172.21.15.62 metric 100 2024-02-13T14:33:04.398 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.62 metric 100 2024-02-13T14:33:04.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-13T14:33:04.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-13T14:33:04.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1790sec pref medium 2024-02-13T14:33:04.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-13T14:33:04.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-13T14:33:04.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-13T14:33:04.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-13T14:33:04.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout inet6 fe80::ec4:7aff:febb:d1c3/64 scope link 2024-02-13T14:33:04.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-13T14:33:04.403 INFO:teuthology.orchestra.run.smithi062.stdout:Mon IP `172.21.15.62` is in CIDR network `172.21.0.0/20` 2024-02-13T14:33:04.403 INFO:teuthology.orchestra.run.smithi062.stdout:Mon IP `172.21.15.62` is in CIDR network `172.21.0.1/32` 2024-02-13T14:33:04.403 INFO:teuthology.orchestra.run.smithi062.stdout:Mon IP `172.21.15.62` is in CIDR network `172.21.0.2/32` 2024-02-13T14:33:04.403 INFO:teuthology.orchestra.run.smithi062.stdout:Mon IP `172.21.15.62` is in CIDR network `172.21.15.254/32` 2024-02-13T14:33:04.404 INFO:teuthology.orchestra.run.smithi062.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.1/32', '172.21.0.2/32', '172.21.15.254/32'] 2024-02-13T14:33:04.404 INFO:teuthology.orchestra.run.smithi062.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-13T14:33:04.404 INFO:teuthology.orchestra.run.smithi062.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662... 2024-02-13T14:33:04.665 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/docker: stdout e1b79d5a4193a484176863ab96c0ca28c00e1662: Pulling from ceph-ci/ceph 2024-02-13T14:33:04.665 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/docker: stdout Digest: sha256:48116d68f53d3a2ae4d119fcfc94a11cef23cee69b8a381eaa5186380a06fd9f 2024-02-13T14:33:04.665 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/docker: stdout Status: Image is up to date for quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:33:04.666 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/docker: stdout quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:33:05.923 INFO:teuthology.orchestra.run.smithi062.stdout:ceph: stdout ceph version 19.0.0-1423-ge1b79d5a (e1b79d5a4193a484176863ab96c0ca28c00e1662) squid (dev) 2024-02-13T14:33:05.923 INFO:teuthology.orchestra.run.smithi062.stdout:Ceph version: ceph version 19.0.0-1423-ge1b79d5a (e1b79d5a4193a484176863ab96c0ca28c00e1662) squid (dev) 2024-02-13T14:33:05.923 INFO:teuthology.orchestra.run.smithi062.stdout:Extracting ceph user uid/gid from container image... 2024-02-13T14:33:07.144 INFO:teuthology.orchestra.run.smithi062.stdout:stat: stdout 167 167 2024-02-13T14:33:07.144 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial keys... 2024-02-13T14:33:08.306 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQCjfctlzcP7MBAAMW4slTkPey9ZUAN5Bx2oNA== 2024-02-13T14:33:09.594 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQClfctl1kFUBhAAJNnFmjje/fNgDfd53tHnaA== 2024-02-13T14:33:10.615 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-authtool: stdout AQCmfctlbaSsCRAAuV1AAQFpLd18vmOLjM1AXQ== 2024-02-13T14:33:10.616 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial monmap... 2024-02-13T14:33:11.679 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-13T14:33:11.679 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-02-13T14:33:11.679 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:11.680 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-13T14:33:11.680 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool for a [v1:172.21.15.62:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-13T14:33:11.680 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = quincy 2024-02-13T14:33:11.680 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: set fsid to 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:11.680 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-13T14:33:11.680 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:33:11.680 INFO:teuthology.orchestra.run.smithi062.stdout:Creating mon... 2024-02-13T14:33:12.848 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 1 imported monmap: 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr epoch 0 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr last_changed 2024-02-13T14:33:11.220516+0000 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr created 2024-02-13T14:33:11.220516+0000 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr min_mon_release 17 (quincy) 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr election_strategy: 1 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 0: v1:172.21.15.62:6789/0 mon.a 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 0 /usr/bin/ceph-mon: set fsid to 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:12.849 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: RocksDB version: 7.9.2 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Git sha 0 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Compile date 2024-02-12 22:40:01 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: DB SUMMARY 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: DB Session ID: BXULQHHIE75WOIGH86OQ 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.error_if_exists: 0 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.create_if_missing: 1 2024-02-13T14:33:12.850 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.paranoid_checks: 1 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.env: 0x562d9b23eae0 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.fs: PosixFileSystem 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.info_log: 0x562d9ccb0b20 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.statistics: (nil) 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.use_fsync: 0 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_log_file_size: 0 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-13T14:33:12.851 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.allow_fallocate: 1 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.use_direct_reads: 0 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.create_missing_column_families: 0 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.db_log_dir: 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.wal_dir: 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-13T14:33:12.852 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.advise_random_on_open: 1 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.write_buffer_manager: 0x562d9cc85360 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.rate_limiter: (nil) 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-13T14:33:12.853 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.unordered_write: 0 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.row_cache: None 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.wal_filter: None 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.two_write_queues: 0 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.manual_wal_flush: 0 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.wal_compression: 0 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.atomic_flush: 0 2024-02-13T14:33:12.854 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.log_readahead_size: 0 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.best_efforts_recovery: 0 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.allow_data_in_errors: 0 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.db_host_id: __hostname__ 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_background_jobs: 2 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_background_compactions: -1 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_subcompactions: 1 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-13T14:33:12.855 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_total_wal_size: 0 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_open_files: -1 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.bytes_per_sync: 0 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Options.max_background_flushes: -1 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Compression algorithms supported: 2024-02-13T14:33:12.856 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: kZSTD supported: 0 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: kXpressCompression supported: 0 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: kZlibCompression supported: 1 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: kSnappyCompression supported: 1 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: kLZ4Compression supported: 1 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: kBZip2Compression supported: 0 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.320+0000 7f85cdb7fc80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: [db/db_impl/db_impl_open.cc:317] Creating manifest 1 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-13T14:33:12.857 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.merge_operator: 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_filter: None 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_filter_factory: None 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.sst_partitioner_factory: None 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562d9ccb0c40) 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks: 1 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr cache_index_and_filter_blocks_with_high_priority: 0 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr pin_top_level_index_and_filter: 1 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr index_type: 0 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr data_block_index_type: 0 2024-02-13T14:33:12.858 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr index_shortening: 1 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr data_block_hash_table_util_ratio: 0.750000 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr checksum: 4 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr no_block_cache: 0 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr block_cache: 0x562d9ccb5090 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr block_cache_name: BinnedLRUCache 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr block_cache_options: 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr capacity : 536870912 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr num_shard_bits : 4 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr strict_capacity_limit : 0 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr high_pri_pool_ratio: 0.000 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr block_cache_compressed: (nil) 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr persistent_cache: (nil) 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr block_size: 4096 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr block_size_deviation: 10 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr block_restart_interval: 16 2024-02-13T14:33:12.859 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr index_block_restart_interval: 1 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr metadata_block_size: 4096 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr partition_filters: 0 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr use_delta_encoding: 1 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr filter_policy: bloomfilter 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr whole_key_filtering: 1 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr verify_compression: 0 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr read_amp_bytes_per_bit: 0 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr format_version: 5 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr enable_index_compression: 1 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr block_align: 0 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr max_auto_readahead_size: 262144 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr prepopulate_block_cache: 0 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr initial_auto_readahead_size: 8192 2024-02-13T14:33:12.860 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr num_file_reads_for_auto_readahead: 2 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression: NoCompression 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.num_levels: 7 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-13T14:33:12.861 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.level: 32767 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.enabled: false 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-13T14:33:12.862 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-13T14:33:12.863 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.arena_block_size: 1048576 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-13T14:33:12.864 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.table_properties_collectors: 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.inplace_update_support: 0 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-13T14:33:12.865 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.bloom_locality: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.max_successive_merges: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.force_consistency_checks: 1 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.ttl: 2592000 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.enable_blob_files: false 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.min_blob_size: 0 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.blob_file_size: 268435456 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-02-13T14:33:12.866 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.blob_file_starting_level: 0 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca5dfbee-1d8d-4fae-bcdd-5b4ca46862c7 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 5 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562d9cd80000 2024-02-13T14:33:12.867 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85cdb7fc80 4 rocksdb: DB pointer 0x562d9cd70000 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85bdcf6700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.324+0000 7f85bdcf6700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr ** DB Stats ** 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-02-13T14:33:12.868 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr ** Compaction Stats [default] ** 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr AddFile(Keys): cumulative 0, interval 0 2024-02-13T14:33:12.869 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Block cache BinnedLRUCache@0x562d9ccb5090#7 capacity: 512.00 MB usage: 0.00 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.7e-05 secs_since: 0 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr Block cache entry stats(count,size,portion): Misc(1,0.00 KB,0%) 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr ** File Read Latency Histogram By Level [default] ** 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.328+0000 7f85cdb7fc80 4 rocksdb: [db/db_impl/db_impl.cc:496] Shutdown: canceling all background work 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.328+0000 7f85cdb7fc80 4 rocksdb: [db/db_impl/db_impl.cc:704] Shutdown complete 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph-mon: stderr debug 2024-02-13T14:33:12.328+0000 7f85cdb7fc80 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-02-13T14:33:12.870 INFO:teuthology.orchestra.run.smithi062.stdout:create mon.a on 2024-02-13T14:33:13.091 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-02-13T14:33:13.286 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2024-02-13T14:33:13.508 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715.target -> /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715.target. 2024-02-13T14:33:13.508 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715.target -> /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715.target. 2024-02-13T14:33:13.787 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.a 2024-02-13T14:33:13.787 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.a.service: Unit ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.a.service not loaded. 2024-02-13T14:33:13.978 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715.target.wants/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.a.service -> /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service. 2024-02-13T14:33:13.988 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld does not appear to be present 2024-02-13T14:33:13.988 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to enable service . firewalld.service is not available 2024-02-13T14:33:13.988 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mon to start... 2024-02-13T14:33:13.988 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mon... 2024-02-13T14:33:15.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:15 smithi062 bash[20998]: cluster 2024-02-13T14:33:15.377078+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-02-13T14:33:16.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout cluster: 2024-02-13T14:33:16.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout id: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:16.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-13T14:33:16.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:16.266 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout services: 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.281195s) 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout data: 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout pgs: 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31e4f9c700 1 Processor -- start 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31e4f9c700 1 -- start start 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31e4f9c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f31e007a390 con 0x7f31e007b790 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31de59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f31e007b790 0x7f31e0079bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48088/0 (socket says 172.21.15.62:48088) 2024-02-13T14:33:16.267 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31de59c700 1 -- 172.21.15.62:0/2672543691 learned_addr learned my addr 172.21.15.62:0/2672543691 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31dd59a700 1 -- 172.21.15.62:0/2672543691 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1202165988 0 0) 0x7f31e007a390 con 0x7f31e007b790 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31dd59a700 1 -- 172.21.15.62:0/2672543691 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c80035b0 con 0x7f31e007b790 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31dd59a700 1 -- 172.21.15.62:0/2672543691 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714814170 0 0) 0x7f31c80035b0 con 0x7f31e007b790 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31dd59a700 1 -- 172.21.15.62:0/2672543691 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e007a520 con 0x7f31e007b790 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31dd59a700 1 -- 172.21.15.62:0/2672543691 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f31d0001580 con 0x7f31e007b790 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31dd59a700 1 -- 172.21.15.62:0/2672543691 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f31d00018e0 con 0x7f31e007b790 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31dd59a700 1 -- 172.21.15.62:0/2672543691 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f31d0001c20 con 0x7f31e007b790 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2672543691 >> v1:172.21.15.62:6789/0 conn(0x7f31e007b790 legacy=0x7f31e0079bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2672543691 shutdown_connections 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2672543691 >> 172.21.15.62:0/2672543691 conn(0x7f31e01010b0 msgr2=0x7f31e01034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2672543691 shutdown_connections 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.516+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2672543691 wait complete. 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31e4f9c700 1 Processor -- start 2024-02-13T14:33:16.268 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31e4f9c700 1 -- start start 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31e4f9c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f31e019b560 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31de59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f31e007b790 0x7f31e019ae50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48092/0 (socket says 172.21.15.62:48092) 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31de59c700 1 -- 172.21.15.62:0/2972715435 learned_addr learned my addr 172.21.15.62:0/2972715435 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2531765035 0 0) 0x7f31e019b560 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c80031f0 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2575306724 0 0) 0x7f31c80031f0 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f31e019b560 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f31d0001540 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2721455626 0 0) 0x7f31e019b560 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e019b6f0 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e019b9a0 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e019f4f0 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7f31d0004b20 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f31d0004e20 con 0x7f31e007b790 2024-02-13T14:33:16.269 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f31d00053d0 con 0x7f31e007b790 2024-02-13T14:33:16.270 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7f31d0006650 con 0x7f31e007b790 2024-02-13T14:33:16.270 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.520+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c0005150 con 0x7f31e007b790 2024-02-13T14:33:16.270 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.524+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f31d0005810 con 0x7f31e007b790 2024-02-13T14:33:16.270 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.656+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f31c0005c10 con 0x7f31e007b790 2024-02-13T14:33:16.270 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.656+0000 7f31cf7fe700 1 -- 172.21.15.62:0/2972715435 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (unknown 1155462804 0 4132933237) 0x7f31d0005a30 con 0x7f31e007b790 2024-02-13T14:33:16.271 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.660+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 >> v1:172.21.15.62:6789/0 conn(0x7f31e007b790 legacy=0x7f31e019ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:16.271 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.660+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 shutdown_connections 2024-02-13T14:33:16.271 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.660+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 >> 172.21.15.62:0/2972715435 conn(0x7f31e01010b0 msgr2=0x7f31e010aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:16.271 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.660+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 shutdown_connections 2024-02-13T14:33:16.271 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:15.660+0000 7f31e4f9c700 1 -- 172.21.15.62:0/2972715435 wait complete. 2024-02-13T14:33:16.271 INFO:teuthology.orchestra.run.smithi062.stdout:mon is available 2024-02-13T14:33:16.271 INFO:teuthology.orchestra.run.smithi062.stdout:Assimilating anything we can from ceph.conf... 2024-02-13T14:33:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:16 smithi062 bash[20998]: cluster 2024-02-13T14:33:15.380902+0000 mon.a (mon.0) 2 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-02-13T14:33:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:16 smithi062 bash[20998]: cluster 2024-02-13T14:33:15.381102+0000 mon.a (mon.0) 3 : cluster 0 monmap e1: 1 mons at {a=v1:172.21.15.62:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:33:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:16 smithi062 bash[20998]: cluster 2024-02-13T14:33:15.383206+0000 mon.a (mon.0) 4 : cluster 0 fsmap 2024-02-13T14:33:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:16 smithi062 bash[20998]: cluster 2024-02-13T14:33:15.385633+0000 mon.a (mon.0) 5 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-02-13T14:33:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:16 smithi062 bash[20998]: cluster 2024-02-13T14:33:15.386180+0000 mon.a (mon.0) 6 : cluster 0 mgrmap e1: no daemons active 2024-02-13T14:33:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:16 smithi062 bash[20998]: audit 2024-02-13T14:33:15.662033+0000 mon.a (mon.0) 7 : audit 0 from='client.? v1:172.21.15.62:0/2972715435' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-13T14:33:17.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:17 smithi062 bash[20998]: audit 2024-02-13T14:33:17.181981+0000 mon.a (mon.0) 8 : audit 1 from='client.? v1:172.21.15.62:0/1887145706' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-13T14:33:17.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:17 smithi062 bash[20998]: audit 2024-02-13T14:33:17.186425+0000 mon.a (mon.0) 9 : audit 1 from='client.? v1:172.21.15.62:0/1887145706' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-13T14:33:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [global] 2024-02-13T14:33:17.759 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout fsid = 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_host = [v1:172.21.15.62:6789] 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [osd] 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-13T14:33:17.760 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 Processor -- start 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- start start 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd35407a330 con 0x7fd35407b730 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd353fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd35407b730 0x7fd354079b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48102/0 (socket says 172.21.15.62:48102) 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd353fff700 1 -- 172.21.15.62:0/2881222195 learned_addr learned my addr 172.21.15.62:0/2881222195 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd352ffd700 1 -- 172.21.15.62:0/2881222195 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603710249 0 0) 0x7fd35407a330 con 0x7fd35407b730 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd352ffd700 1 -- 172.21.15.62:0/2881222195 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3400035b0 con 0x7fd35407b730 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd352ffd700 1 -- 172.21.15.62:0/2881222195 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2643151996 0 0) 0x7fd3400035b0 con 0x7fd35407b730 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd352ffd700 1 -- 172.21.15.62:0/2881222195 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35407a4c0 con 0x7fd35407b730 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd352ffd700 1 -- 172.21.15.62:0/2881222195 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fd344001580 con 0x7fd35407b730 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd352ffd700 1 -- 172.21.15.62:0/2881222195 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd344001810 con 0x7fd35407b730 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd352ffd700 1 -- 172.21.15.62:0/2881222195 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fd344001b50 con 0x7fd35407b730 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- 172.21.15.62:0/2881222195 >> v1:172.21.15.62:6789/0 conn(0x7fd35407b730 legacy=0x7fd354079b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:17.761 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- 172.21.15.62:0/2881222195 shutdown_connections 2024-02-13T14:33:17.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- 172.21.15.62:0/2881222195 >> 172.21.15.62:0/2881222195 conn(0x7fd3541010b0 msgr2=0x7fd3541034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:17.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- 172.21.15.62:0/2881222195 shutdown_connections 2024-02-13T14:33:17.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- 172.21.15.62:0/2881222195 wait complete. 2024-02-13T14:33:17.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 Processor -- start 2024-02-13T14:33:17.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- start start 2024-02-13T14:33:17.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.040+0000 7fd35a4e0700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fd35419b5a0 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd353fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd35407b730 0x7fd35419ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48104/0 (socket says 172.21.15.62:48104) 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd353fff700 1 -- 172.21.15.62:0/1887145706 learned_addr learned my addr 172.21.15.62:0/1887145706 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 316921786 0 0) 0x7fd35419b5a0 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3400031f0 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1883542701 0 0) 0x7fd3400031f0 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fd35419b5a0 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fd344001540 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2909534611 0 0) 0x7fd35419b5a0 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35419b730 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35419b9e0 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35419f530 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(0 keys) v1 ==== 4+0+0 (unknown 0 0 0) 0x7fd344004b20 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fd344004e20 con 0x7fd35407b730 2024-02-13T14:33:17.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7fd344005390 con 0x7fd35407b730 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7fd344006660 con 0x7fd35407b730 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.044+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd334005150 con 0x7fd35407b730 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.048+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7fd344005870 con 0x7fd35407b730 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.176+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fd334005980 con 0x7fd35407b730 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.184+0000 7fd3517fa700 1 -- 172.21.15.62:0/1887145706 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+317 (unknown 1213389831 0 649390004) 0x7fd344005b40 con 0x7fd35407b730 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.184+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 >> v1:172.21.15.62:6789/0 conn(0x7fd35407b730 legacy=0x7fd35419ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.184+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 shutdown_connections 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.184+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 >> 172.21.15.62:0/1887145706 conn(0x7fd3541010b0 msgr2=0x7fd35410aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.184+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 shutdown_connections 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:17.184+0000 7fd35a4e0700 1 -- 172.21.15.62:0/1887145706 wait complete. 2024-02-13T14:33:17.764 INFO:teuthology.orchestra.run.smithi062.stdout:Generating new minimal ceph.conf... 2024-02-13T14:33:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:18 smithi062 bash[20998]: audit 2024-02-13T14:33:18.651422+0000 mon.a (mon.0) 10 : audit 0 from='client.? v1:172.21.15.62:0/1658509679' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:33:19.160 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 Processor -- start 2024-02-13T14:33:19.160 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- start start 2024-02-13T14:33:19.160 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f427007a310 con 0x7f427007b710 2024-02-13T14:33:19.160 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426e59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f427007b710 0x7f4270079b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48106/0 (socket says 172.21.15.62:48106) 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426e59c700 1 -- 172.21.15.62:0/3958043148 learned_addr learned my addr 172.21.15.62:0/3958043148 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426d59a700 1 -- 172.21.15.62:0/3958043148 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3423252379 0 0) 0x7f427007a310 con 0x7f427007b710 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426d59a700 1 -- 172.21.15.62:0/3958043148 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42580035b0 con 0x7f427007b710 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426d59a700 1 -- 172.21.15.62:0/3958043148 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1656165332 0 0) 0x7f42580035b0 con 0x7f427007b710 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426d59a700 1 -- 172.21.15.62:0/3958043148 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427007a4a0 con 0x7f427007b710 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426d59a700 1 -- 172.21.15.62:0/3958043148 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4260001580 con 0x7f427007b710 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426d59a700 1 -- 172.21.15.62:0/3958043148 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f4260001c10 con 0x7f427007b710 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f426d59a700 1 -- 172.21.15.62:0/3958043148 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f42600057b0 con 0x7f427007b710 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- 172.21.15.62:0/3958043148 >> v1:172.21.15.62:6789/0 conn(0x7f427007b710 legacy=0x7f4270079b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- 172.21.15.62:0/3958043148 shutdown_connections 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- 172.21.15.62:0/3958043148 >> 172.21.15.62:0/3958043148 conn(0x7f42701010b0 msgr2=0x7f42701034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- 172.21.15.62:0/3958043148 shutdown_connections 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- 172.21.15.62:0/3958043148 wait complete. 2024-02-13T14:33:19.161 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 Processor -- start 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- start start 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.508+0000 7f4274cda700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f427019bd70 con 0x7f427007b710 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f426e59c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f427007b710 0x7f427019b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48118/0 (socket says 172.21.15.62:48118) 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f426e59c700 1 -- 172.21.15.62:0/1658509679 learned_addr learned my addr 172.21.15.62:0/1658509679 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696897198 0 0) 0x7f427019bd70 con 0x7f427007b710 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4258005540 con 0x7f427007b710 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3840191555 0 0) 0x7f4258005540 con 0x7f427007b710 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f427019bd70 con 0x7f427007b710 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4260001080 con 0x7f427007b710 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2879992510 0 0) 0x7f427019bd70 con 0x7f427007b710 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427019bf00 con 0x7f427007b710 2024-02-13T14:33:19.162 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427019c1b0 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f427019fd00 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f42600049d0 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4260006130 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f4260006720 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7f4260007d80 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.512+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427010cf80 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.516+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f4260004e70 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.648+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f42701a01d0 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.648+0000 7f425f7fe700 1 -- 172.21.15.62:0/1658509679 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+147 (unknown 1452402520 0 1756454989) 0x7f4260005b10 con 0x7f427007b710 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.648+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 >> v1:172.21.15.62:6789/0 conn(0x7f427007b710 legacy=0x7f427019b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.648+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 shutdown_connections 2024-02-13T14:33:19.163 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.648+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 >> 172.21.15.62:0/1658509679 conn(0x7f42701010b0 msgr2=0x7f427010a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:19.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.648+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 shutdown_connections 2024-02-13T14:33:19.164 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:18.648+0000 7f4274cda700 1 -- 172.21.15.62:0/1658509679 wait complete. 2024-02-13T14:33:19.164 INFO:teuthology.orchestra.run.smithi062.stdout:Restarting the monitor... 2024-02-13T14:33:19.478 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:19 smithi062 systemd[1]: Stopping Ceph mon.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T14:33:19.478 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:19 smithi062 bash[20998]: debug 2024-02-13T14:33:19.276+0000 7f570bc3d700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-13T14:33:19.479 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:19 smithi062 bash[20998]: debug 2024-02-13T14:33:19.276+0000 7f570bc3d700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-13T14:33:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:19 smithi062 bash[21383]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-mon-a 2024-02-13T14:33:19.875 INFO:teuthology.orchestra.run.smithi062.stdout:Setting public_network to 172.21.0.0/20,172.21.0.1/32,172.21.15.254/32,172.21.0.2/32 in mon config section 2024-02-13T14:33:20.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:19 smithi062 bash[21443]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-mon-a 2024-02-13T14:33:20.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:19 smithi062 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.a.service: Deactivated successfully. 2024-02-13T14:33:20.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:19 smithi062 systemd[1]: Stopped Ceph mon.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:33:20.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:19 smithi062 systemd[1]: Started Ceph mon.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.016+0000 7f2596753c80 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.016+0000 7f2596753c80 0 ceph version 19.0.0-1423-ge1b79d5a (e1b79d5a4193a484176863ab96c0ca28c00e1662) squid (dev), process ceph-mon, pid 7 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.016+0000 7f2596753c80 0 pidfile_write: ignore empty --pid-file 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 0 load: jerasure load: lrc 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: RocksDB version: 7.9.2 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Git sha 0 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Compile date 2024-02-12 22:40:01 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: DB SUMMARY 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: DB Session ID: CC5Q33DHSTTAGIYR0ODC 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: CURRENT file: CURRENT 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: IDENTITY file: IDENTITY 2024-02-13T14:33:21.110 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 85538 ; 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.error_if_exists: 0 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.create_if_missing: 0 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.paranoid_checks: 1 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.flush_verify_memtable_count: 1 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.env: 0x55a323921ae0 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.fs: PosixFileSystem 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.info_log: 0x55a3241a7940 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.statistics: (nil) 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.use_fsync: 0 2024-02-13T14:33:21.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_log_file_size: 0 2024-02-13T14:33:21.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-13T14:33:21.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-13T14:33:21.112 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.allow_fallocate: 1 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.use_direct_reads: 0 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.create_missing_column_families: 0 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.db_log_dir: 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.wal_dir: 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-13T14:33:21.113 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.advise_random_on_open: 1 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.write_buffer_manager: 0x55a32417b400 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.rate_limiter: (nil) 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.unordered_write: 0 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-13T14:33:21.114 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.row_cache: None 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.wal_filter: None 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.two_write_queues: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.manual_wal_flush: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.wal_compression: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.atomic_flush: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.log_readahead_size: 0 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-13T14:33:21.115 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.best_efforts_recovery: 0 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.allow_data_in_errors: 0 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.db_host_id: __hostname__ 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.enforce_single_del_contracts: true 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_background_jobs: 2 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_background_compactions: -1 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_subcompactions: 1 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_total_wal_size: 0 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-13T14:33:21.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_open_files: -1 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bytes_per_sync: 0 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_background_flushes: -1 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Compression algorithms supported: 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: kZSTD supported: 0 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: kXpressCompression supported: 0 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: kZlibCompression supported: 1 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: kSnappyCompression supported: 1 2024-02-13T14:33:21.117 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: kLZ4Compression supported: 1 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: kBZip2Compression supported: 0 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: DMutex implementation: pthread_mutex_t 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.merge_operator: 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_filter: None 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_filter_factory: None 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.sst_partitioner_factory: None 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a3241a7a40) 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: cache_index_and_filter_blocks: 1 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-13T14:33:21.118 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: pin_top_level_index_and_filter: 1 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: index_type: 0 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: data_block_index_type: 0 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: index_shortening: 1 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: data_block_hash_table_util_ratio: 0.750000 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: checksum: 4 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: no_block_cache: 0 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: block_cache: 0x55a3241a9090 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: block_cache_name: BinnedLRUCache 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: block_cache_options: 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: capacity : 536870912 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: num_shard_bits : 4 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: strict_capacity_limit : 0 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: high_pri_pool_ratio: 0.000 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: block_cache_compressed: (nil) 2024-02-13T14:33:21.119 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: persistent_cache: (nil) 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: block_size: 4096 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: block_size_deviation: 10 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: block_restart_interval: 16 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: index_block_restart_interval: 1 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: metadata_block_size: 4096 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: partition_filters: 0 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: use_delta_encoding: 1 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: filter_policy: bloomfilter 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: whole_key_filtering: 1 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: verify_compression: 0 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: read_amp_bytes_per_bit: 0 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: format_version: 5 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: enable_index_compression: 1 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: block_align: 0 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: max_auto_readahead_size: 262144 2024-02-13T14:33:21.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: prepopulate_block_cache: 0 2024-02-13T14:33:21.121 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: initial_auto_readahead_size: 8192 2024-02-13T14:33:21.121 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: num_file_reads_for_auto_readahead: 2 2024-02-13T14:33:21.121 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-13T14:33:21.121 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression: NoCompression 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.num_levels: 7 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-13T14:33:21.122 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.level: 32767 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-13T14:33:21.123 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.enabled: false 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-13T14:33:21.124 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.arena_block_size: 1048576 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-13T14:33:21.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.table_properties_collectors: 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.inplace_update_support: 0 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.bloom_locality: 0 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.max_successive_merges: 0 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.force_consistency_checks: 1 2024-02-13T14:33:21.126 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.ttl: 2592000 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.enable_blob_files: false 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.min_blob_size: 0 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.blob_file_size: 268435456 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.blob_compression_type: NoCompression 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.enable_blob_garbage_collection: false 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.blob_file_starting_level: 0 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-13T14:33:21.127 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ca5dfbee-1d8d-4fae-bcdd-5b4ca46862c7 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707834801026063, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.020+0000 7f2596753c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.024+0000 7f2596753c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707834801027316, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 81872, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 264, "table_properties": {"data_size": 80071, "index_size": 211, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10703, "raw_average_key_size": 47, "raw_value_size": 74046, "raw_average_value_size": 332, "num_data_blocks": 10, "num_entries": 223, "num_filter_entries": 223, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1707834801, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ca5dfbee-1d8d-4fae-bcdd-5b4ca46862c7", "db_session_id": "CC5Q33DHSTTAGIYR0ODC", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.024+0000 7f2596753c80 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1707834801027416, "job": 1, "event": "recovery_finished"} 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.024+0000 7f2596753c80 4 rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 4 rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 4 rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a32429e000 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 4 rocksdb: DB pointer 0x55a324288000 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2584ec2700 4 rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2584ec2700 4 rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: ** DB Stats ** 2024-02-13T14:33:21.128 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: ** Compaction Stats [default] ** 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: L0 2/0 81.75 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Sum 2/0 81.75 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: ** Compaction Stats [default] ** 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-13T14:33:21.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: AddFile(Total Files): cumulative 0, interval 0 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: AddFile(Keys): cumulative 0, interval 0 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Cumulative compaction: 0.00 GB write, 11.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Interval compaction: 0.00 GB write, 11.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Block cache BinnedLRUCache@0x55a3241a9090#7 capacity: 512.00 MB usage: 1.17 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.41 KB,7.7486e-05%) Misc(1,0.00 KB,0%) 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: ** File Read Latency Histogram By Level [default] ** 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 0 starting mon.a rank 0 at public addrs v1:172.21.15.62:6789/0 at bind addrs v1:172.21.15.62:6789/0 mon_data /var/lib/ceph/mon/ceph-a fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:21.130 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 1 mon.a@-1(???) e1 preinit fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 0 mon.a@-1(???).mds e1 new map 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 0 mon.a@-1(???).mds e1 print_map 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: e1 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: legacy client fscid: -1 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: No filesystems configured 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: debug 2024-02-13T14:33:21.028+0000 7f2596753c80 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: cluster 2024-02-13T14:33:21.054880+0000 mon.a (mon.0) 1 : cluster 1 mon.a is new leader, mons a in quorum (ranks 0) 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: cluster 2024-02-13T14:33:21.054959+0000 mon.a (mon.0) 2 : cluster 0 monmap e1: 1 mons at {a=v1:172.21.15.62:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:33:21.131 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: cluster 2024-02-13T14:33:21.055341+0000 mon.a (mon.0) 3 : cluster 0 fsmap 2024-02-13T14:33:21.132 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: cluster 2024-02-13T14:33:21.055377+0000 mon.a (mon.0) 4 : cluster 0 osdmap e1: 0 total, 0 up, 0 in 2024-02-13T14:33:21.132 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:21 smithi062 bash[21479]: cluster 2024-02-13T14:33:21.055801+0000 mon.a (mon.0) 5 : cluster 0 mgrmap e1: no daemons active 2024-02-13T14:33:21.753 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1503d59700 1 Processor -- start 2024-02-13T14:33:21.753 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1503d59700 1 -- start start 2024-02-13T14:33:21.753 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1503d59700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f14fc078ed0 con 0x7f14fc106570 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1501af5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f14fc106570 0x7f14fc108960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48128/0 (socket says 172.21.15.62:48128) 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1501af5700 1 -- 172.21.15.62:0/55628967 learned_addr learned my addr 172.21.15.62:0/55628967 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1500af3700 1 -- 172.21.15.62:0/55628967 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341564263 0 0) 0x7f14fc078ed0 con 0x7f14fc106570 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1500af3700 1 -- 172.21.15.62:0/55628967 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14e40035b0 con 0x7f14fc106570 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1500af3700 1 -- 172.21.15.62:0/55628967 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168646990 0 0) 0x7f14e40035b0 con 0x7f14fc106570 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1500af3700 1 -- 172.21.15.62:0/55628967 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc10b090 con 0x7f14fc106570 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1500af3700 1 -- 172.21.15.62:0/55628967 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f14f4001900 con 0x7f14fc106570 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1500af3700 1 -- 172.21.15.62:0/55628967 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f14f4002060 con 0x7f14fc106570 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1500af3700 1 -- 172.21.15.62:0/55628967 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f14f4005ce0 con 0x7f14fc106570 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1503d59700 1 -- 172.21.15.62:0/55628967 >> v1:172.21.15.62:6789/0 conn(0x7f14fc106570 legacy=0x7f14fc108960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1503d59700 1 -- 172.21.15.62:0/55628967 shutdown_connections 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.056+0000 7f1503d59700 1 -- 172.21.15.62:0/55628967 >> 172.21.15.62:0/55628967 conn(0x7f14fc0fff80 msgr2=0x7f14fc1023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:21.754 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1503d59700 1 -- 172.21.15.62:0/55628967 shutdown_connections 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1503d59700 1 -- 172.21.15.62:0/55628967 wait complete. 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1503d59700 1 Processor -- start 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1503d59700 1 -- start start 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1503d59700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f14fc199b30 con 0x7f14fc106570 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1501af5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f14fc106570 0x7f14fc199420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48138/0 (socket says 172.21.15.62:48138) 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1501af5700 1 -- 172.21.15.62:0/2195160420 learned_addr learned my addr 172.21.15.62:0/2195160420 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953211576 0 0) 0x7f14fc199b30 con 0x7f14fc106570 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14e40054f0 con 0x7f14fc106570 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 106403072 0 0) 0x7f14e40054f0 con 0x7f14fc106570 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f14fc199b30 con 0x7f14fc106570 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f14f4004bf0 con 0x7f14fc106570 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3536922377 0 0) 0x7f14fc199b30 con 0x7f14fc106570 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc199cc0 con 0x7f14fc106570 2024-02-13T14:33:21.755 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc199f70 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc19dac0 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f14f4001510 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f14f40064b0 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f14f4006aa0 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7f14f40080d0 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.060+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e8005150 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.064+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f14f4004dc0 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.192+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 --> v1:172.21.15.62:6789/0 -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f14e8005400 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.200+0000 7f14faffd700 1 -- 172.21.15.62:0/2195160420 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 169+0+0 (unknown 4121244885 0 0) 0x7f14f4005000 con 0x7f14fc106570 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.200+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 >> v1:172.21.15.62:6789/0 conn(0x7f14fc106570 legacy=0x7f14fc199420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.200+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 shutdown_connections 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.200+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 >> 172.21.15.62:0/2195160420 conn(0x7f14fc0fff80 msgr2=0x7f14fc190250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.200+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 shutdown_connections 2024-02-13T14:33:21.756 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:21.200+0000 7f1503d59700 1 -- 172.21.15.62:0/2195160420 wait complete. 2024-02-13T14:33:21.757 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-13T14:33:21.783 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-13T14:33:21.783 INFO:teuthology.orchestra.run.smithi062.stdout:Creating mgr... 2024-02-13T14:33:21.784 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying port 0.0.0.0:9283 ... 2024-02-13T14:33:21.784 INFO:teuthology.orchestra.run.smithi062.stdout:Verifying port 0.0.0.0:8765 ... 2024-02-13T14:33:22.129 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:33:22.138 INFO:teuthology.orchestra.run.smithi062.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.y 2024-02-13T14:33:22.139 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Failed to reset failed state of unit ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.y.service: Unit ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.y.service not loaded. 2024-02-13T14:33:22.330 INFO:teuthology.orchestra.run.smithi062.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715.target.wants/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.y.service -> /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service. 2024-02-13T14:33:22.338 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld does not appear to be present 2024-02-13T14:33:22.338 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to enable service . firewalld.service is not available 2024-02-13T14:33:22.338 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld does not appear to be present 2024-02-13T14:33:22.338 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-02-13T14:33:22.338 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr to start... 2024-02-13T14:33:22.338 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr... 2024-02-13T14:33:22.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:22 smithi062 bash[21479]: audit 2024-02-13T14:33:21.202963+0000 mon.a (mon.0) 6 : audit 1 from='client.? v1:172.21.15.62:0/2195160420' entity='client.admin' 2024-02-13T14:33:22.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:33:23.920 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:23 smithi062 bash[21479]: audit 2024-02-13T14:33:23.715007+0000 mon.a (mon.0) 7 : audit 0 from='client.? v1:172.21.15.62:0/3006944181' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-13T14:33:23.921 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:23 smithi062 bash[21731]: debug 2024-02-13T14:33:23.584+0000 7f2dddaca200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-13T14:33:24.313 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:24.313 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-02-13T14:33:24.313 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "9cdb3692-ca7c-11ee-95b9-87774f69a715", 2024-02-13T14:33:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-02-13T14:33:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-13T14:33:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-13T14:33:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-13T14:33:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-13T14:33:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-13T14:33:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "a" 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-13T14:33:24.315 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-13T14:33:24.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-13T14:33:24.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-13T14:33:24.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-13T14:33:24.323 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-13T14:33:24.324 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-02-13T14:33:15.382250+0000", 2024-02-13T14:33:24.325 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53b243b700 1 Processor -- start 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53b243b700 1 -- start start 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53b243b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f53ac078e90 con 0x7f53ac1065b0 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53abfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f53ac1065b0 0x7f53ac1089a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50078/0 (socket says 172.21.15.62:50078) 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53abfff700 1 -- 172.21.15.62:0/1773106592 learned_addr learned my addr 172.21.15.62:0/1773106592 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53aaffd700 1 -- 172.21.15.62:0/1773106592 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072100124 0 0) 0x7f53ac078e90 con 0x7f53ac1065b0 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53aaffd700 1 -- 172.21.15.62:0/1773106592 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53940035b0 con 0x7f53ac1065b0 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53aaffd700 1 -- 172.21.15.62:0/1773106592 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2497688751 0 0) 0x7f53940035b0 con 0x7f53ac1065b0 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53aaffd700 1 -- 172.21.15.62:0/1773106592 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac10b0d0 con 0x7f53ac1065b0 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53aaffd700 1 -- 172.21.15.62:0/1773106592 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f539c001580 con 0x7f53ac1065b0 2024-02-13T14:33:24.326 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53aaffd700 1 -- 172.21.15.62:0/1773106592 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f539c001c10 con 0x7f53ac1065b0 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.564+0000 7f53aaffd700 1 -- 172.21.15.62:0/1773106592 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f539c0057b0 con 0x7f53ac1065b0 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- 172.21.15.62:0/1773106592 >> v1:172.21.15.62:6789/0 conn(0x7f53ac1065b0 legacy=0x7f53ac1089a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- 172.21.15.62:0/1773106592 shutdown_connections 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- 172.21.15.62:0/1773106592 >> 172.21.15.62:0/1773106592 conn(0x7f53ac0fff80 msgr2=0x7f53ac1023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- 172.21.15.62:0/1773106592 shutdown_connections 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- 172.21.15.62:0/1773106592 wait complete. 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 Processor -- start 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- start start 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f53ac19f490 con 0x7f53ac1065b0 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53abfff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f53ac1065b0 0x7f53ac105e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50088/0 (socket says 172.21.15.62:50088) 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53abfff700 1 -- 172.21.15.62:0/3006944181 learned_addr learned my addr 172.21.15.62:0/3006944181 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321257212 0 0) 0x7f53ac19f490 con 0x7f53ac1065b0 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5394005540 con 0x7f53ac1065b0 2024-02-13T14:33:24.327 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1776944721 0 0) 0x7f5394005540 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f53ac19f490 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f539c001080 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3641772830 0 0) 0x7f53ac19f490 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac1a0630 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac19f680 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f53ac19fb80 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f539c004900 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f539c0061d0 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f539c0067c0 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7f539c007e70 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.568+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5398005120 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.576+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f539c004eb0 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.712+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f53980053d0 con 0x7f53ac1065b0 2024-02-13T14:33:24.328 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.712+0000 7f53a97fa700 1 -- 172.21.15.62:0/3006944181 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 435015724) 0x7f539c005b10 con 0x7f53ac1065b0 2024-02-13T14:33:24.329 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.712+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 >> v1:172.21.15.62:6789/0 conn(0x7f53ac1065b0 legacy=0x7f53ac105e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:24.329 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.712+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 shutdown_connections 2024-02-13T14:33:24.329 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.712+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 >> 172.21.15.62:0/3006944181 conn(0x7f53ac0fff80 msgr2=0x7f53ac190250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:24.329 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.712+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 shutdown_connections 2024-02-13T14:33:24.329 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:23.712+0000 7f53b243b700 1 -- 172.21.15.62:0/3006944181 wait complete. 2024-02-13T14:33:24.329 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (1/15)... 2024-02-13T14:33:25.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:25 smithi062 bash[21731]: debug 2024-02-13T14:33:25.220+0000 7f2dddaca200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T14:33:25.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:25 smithi062 bash[21731]: debug 2024-02-13T14:33:25.320+0000 7f2dddaca200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T14:33:26.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:25 smithi062 bash[21731]: debug 2024-02-13T14:33:25.576+0000 7f2dddaca200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T14:33:26.620 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:26 smithi062 bash[21731]: debug 2024-02-13T14:33:26.396+0000 7f2dddaca200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T14:33:26.620 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:26 smithi062 bash[21731]: debug 2024-02-13T14:33:26.512+0000 7f2dddaca200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T14:33:26.620 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:26 smithi062 bash[21731]: debug 2024-02-13T14:33:26.616+0000 7f2dddaca200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T14:33:27.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:26 smithi062 bash[21731]: debug 2024-02-13T14:33:26.980+0000 7f2dddaca200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-13T14:33:27.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:27 smithi062 bash[21731]: debug 2024-02-13T14:33:27.096+0000 7f2dddaca200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T14:33:27.313 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:27 smithi062 bash[21731]: debug 2024-02-13T14:33:27.204+0000 7f2dddaca200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T14:33:27.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:27 smithi062 bash[21731]: debug 2024-02-13T14:33:27.572+0000 7f2dddaca200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T14:33:27.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:27 smithi062 bash[21479]: audit 2024-02-13T14:33:27.381571+0000 mon.a (mon.0) 8 : audit 0 from='client.? v1:172.21.15.62:0/1414293818' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-13T14:33:27.891 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "9cdb3692-ca7c-11ee-95b9-87774f69a715", 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:27.892 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "a" 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-13T14:33:27.893 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-13T14:33:27.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-13T14:33:27.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-13T14:33:27.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-13T14:33:27.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:27.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-13T14:33:27.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-13T14:33:27.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-13T14:33:27.901 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-13T14:33:27.902 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-02-13T14:33:15.382250+0000", 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f6277136700 1 Processor -- start 2024-02-13T14:33:27.903 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f6277136700 1 -- start start 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f6277136700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f62700796e0 con 0x7f6270104400 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f6274ed2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6270104400 0x7f6270104820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50096/0 (socket says 172.21.15.62:50096) 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f6274ed2700 1 -- 172.21.15.62:0/69090195 learned_addr learned my addr 172.21.15.62:0/69090195 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f626f7fe700 1 -- 172.21.15.62:0/69090195 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2936555742 0 0) 0x7f62700796e0 con 0x7f6270104400 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f626f7fe700 1 -- 172.21.15.62:0/69090195 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62580035b0 con 0x7f6270104400 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f626f7fe700 1 -- 172.21.15.62:0/69090195 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2016574938 0 0) 0x7f62580035b0 con 0x7f6270104400 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f626f7fe700 1 -- 172.21.15.62:0/69090195 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270105f40 con 0x7f6270104400 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f626f7fe700 1 -- 172.21.15.62:0/69090195 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f6260001580 con 0x7f6270104400 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f626f7fe700 1 -- 172.21.15.62:0/69090195 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f6260001ce0 con 0x7f6270104400 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.236+0000 7f626f7fe700 1 -- 172.21.15.62:0/69090195 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f6260005960 con 0x7f6270104400 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- 172.21.15.62:0/69090195 >> v1:172.21.15.62:6789/0 conn(0x7f6270104400 legacy=0x7f6270104820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- 172.21.15.62:0/69090195 shutdown_connections 2024-02-13T14:33:27.904 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- 172.21.15.62:0/69090195 >> 172.21.15.62:0/69090195 conn(0x7f62700fffa0 msgr2=0x7f6270102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- 172.21.15.62:0/69090195 shutdown_connections 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- 172.21.15.62:0/69090195 wait complete. 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 Processor -- start 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- start start 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f627019bd30 con 0x7f6270104400 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6274ed2700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6270104400 0x7f627019b620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50104/0 (socket says 172.21.15.62:50104) 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6274ed2700 1 -- 172.21.15.62:0/1414293818 learned_addr learned my addr 172.21.15.62:0/1414293818 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1583536158 0 0) 0x7f627019bd30 con 0x7f6270104400 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62580054f0 con 0x7f6270104400 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3042384382 0 0) 0x7f62580054f0 con 0x7f6270104400 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f627019bd30 con 0x7f6270104400 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f6260004870 con 0x7f6270104400 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 949285713 0 0) 0x7f627019bd30 con 0x7f6270104400 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627019bec0 con 0x7f6270104400 2024-02-13T14:33:27.905 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627019c170 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f627019fcc0 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f6260004a40 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f6260006070 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f6260006640 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7f6260007cc0 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.240+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c005150 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.244+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f6260005640 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.376+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f625c005400 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.376+0000 7f626dffb700 1 -- 172.21.15.62:0/1414293818 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 664933423) 0x7f62600058c0 con 0x7f6270104400 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.380+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 >> v1:172.21.15.62:6789/0 conn(0x7f6270104400 legacy=0x7f627019b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.380+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 shutdown_connections 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.380+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 >> 172.21.15.62:0/1414293818 conn(0x7f62700fffa0 msgr2=0x7f6270102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.380+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 shutdown_connections 2024-02-13T14:33:27.906 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:27.380+0000 7f6277136700 1 -- 172.21.15.62:0/1414293818 wait complete. 2024-02-13T14:33:27.907 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (2/15)... 2024-02-13T14:33:28.087 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:27 smithi062 bash[21731]: debug 2024-02-13T14:33:27.816+0000 7f2dddaca200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T14:33:28.481 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:28 smithi062 bash[21731]: debug 2024-02-13T14:33:28.084+0000 7f2dddaca200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T14:33:28.482 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:28 smithi062 bash[21731]: debug 2024-02-13T14:33:28.196+0000 7f2dddaca200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T14:33:28.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:28 smithi062 bash[21731]: debug 2024-02-13T14:33:28.476+0000 7f2dddaca200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T14:33:28.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:28 smithi062 bash[21731]: debug 2024-02-13T14:33:28.724+0000 7f2dddaca200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:33:29.522 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:29 smithi062 bash[21731]: debug 2024-02-13T14:33:29.140+0000 7f2dddaca200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T14:33:29.522 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:29 smithi062 bash[21731]: debug 2024-02-13T14:33:29.260+0000 7f2dddaca200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T14:33:29.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:29 smithi062 bash[21731]: debug 2024-02-13T14:33:29.516+0000 7f2dddaca200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:33:30.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:30 smithi062 bash[21731]: debug 2024-02-13T14:33:30.552+0000 7f2dddaca200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T14:33:30.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:30 smithi062 bash[21731]: debug 2024-02-13T14:33:30.672+0000 7f2dddaca200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T14:33:31.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:30 smithi062 bash[21479]: audit 2024-02-13T14:33:30.931129+0000 mon.a (mon.0) 9 : audit 0 from='client.? v1:172.21.15.62:0/2295887666' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-13T14:33:31.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:30 smithi062 bash[21731]: debug 2024-02-13T14:33:30.980+0000 7f2dddaca200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T14:33:31.313 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21731]: debug 2024-02-13T14:33:31.096+0000 7f2dddaca200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-13T14:33:31.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:31.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-02-13T14:33:31.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "9cdb3692-ca7c-11ee-95b9-87774f69a715", 2024-02-13T14:33:31.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-02-13T14:33:31.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-13T14:33:31.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-13T14:33:31.530 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "a" 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:31.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-13T14:33:31.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:31.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-13T14:33:31.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-13T14:33:31.532 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-13T14:33:31.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-13T14:33:31.541 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-13T14:33:31.542 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-02-13T14:33:15.382250+0000", 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61d1d26700 1 Processor -- start 2024-02-13T14:33:31.543 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61d1d26700 1 -- start start 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61d1d26700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f61cc107d60 con 0x7f61cc103df0 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61cb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f61cc103df0 0x7f61cc104210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50120/0 (socket says 172.21.15.62:50120) 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61cb7fe700 1 -- 172.21.15.62:0/2161520334 learned_addr learned my addr 172.21.15.62:0/2161520334 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61ca7fc700 1 -- 172.21.15.62:0/2161520334 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 714678591 0 0) 0x7f61cc107d60 con 0x7f61cc103df0 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61ca7fc700 1 -- 172.21.15.62:0/2161520334 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b80035b0 con 0x7f61cc103df0 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61ca7fc700 1 -- 172.21.15.62:0/2161520334 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3972291806 0 0) 0x7f61b80035b0 con 0x7f61cc103df0 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61ca7fc700 1 -- 172.21.15.62:0/2161520334 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc108f00 con 0x7f61cc103df0 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61ca7fc700 1 -- 172.21.15.62:0/2161520334 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f61bc001580 con 0x7f61cc103df0 2024-02-13T14:33:31.544 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61ca7fc700 1 -- 172.21.15.62:0/2161520334 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f61bc001c10 con 0x7f61cc103df0 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.784+0000 7f61ca7fc700 1 -- 172.21.15.62:0/2161520334 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f61bc0057b0 con 0x7f61cc103df0 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- 172.21.15.62:0/2161520334 >> v1:172.21.15.62:6789/0 conn(0x7f61cc103df0 legacy=0x7f61cc104210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- 172.21.15.62:0/2161520334 shutdown_connections 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- 172.21.15.62:0/2161520334 >> 172.21.15.62:0/2161520334 conn(0x7f61cc0ff700 msgr2=0x7f61cc101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- 172.21.15.62:0/2161520334 shutdown_connections 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- 172.21.15.62:0/2161520334 wait complete. 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 Processor -- start 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- start start 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f61cc1a0100 con 0x7f61cc103df0 2024-02-13T14:33:31.545 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61cb7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f61cc103df0 0x7f61cc19f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50128/0 (socket says 172.21.15.62:50128) 2024-02-13T14:33:31.546 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61cb7fe700 1 -- 172.21.15.62:0/2295887666 learned_addr learned my addr 172.21.15.62:0/2295887666 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:31.546 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709279788 0 0) 0x7f61cc1a0100 con 0x7f61cc103df0 2024-02-13T14:33:31.546 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61b8005540 con 0x7f61cc103df0 2024-02-13T14:33:31.546 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1051193733 0 0) 0x7f61b8005540 con 0x7f61cc103df0 2024-02-13T14:33:31.546 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61cc1a0100 con 0x7f61cc103df0 2024-02-13T14:33:31.546 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f61bc001080 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3910899101 0 0) 0x7f61cc1a0100 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc1a0290 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc1a0540 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc1a4090 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f61bc0049b0 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f61bc0060d0 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 1) v1 ==== 807+0+0 (unknown 3189685207 0 0) 0x7f61bc006700 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7f61bc007dd0 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.788+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac005150 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.792+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f61bc004ef0 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.928+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f61ac005400 con 0x7f61cc103df0 2024-02-13T14:33:31.547 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.928+0000 7f61c8ff9700 1 -- 172.21.15.62:0/2295887666 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 884823703) 0x7f61bc0013b0 con 0x7f61cc103df0 2024-02-13T14:33:31.548 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.928+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 >> v1:172.21.15.62:6789/0 conn(0x7f61cc103df0 legacy=0x7f61cc19f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:31.548 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.928+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 shutdown_connections 2024-02-13T14:33:31.548 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.928+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 >> 172.21.15.62:0/2295887666 conn(0x7f61cc0ff700 msgr2=0x7f61cc101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:31.548 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.928+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 shutdown_connections 2024-02-13T14:33:31.548 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:30.928+0000 7f61d1d26700 1 -- 172.21.15.62:0/2295887666 wait complete. 2024-02-13T14:33:31.548 INFO:teuthology.orchestra.run.smithi062.stdout:mgr not available, waiting (3/15)... 2024-02-13T14:33:31.984 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21731]: debug 2024-02-13T14:33:31.560+0000 7f2dddaca200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T14:33:31.984 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21731]: debug 2024-02-13T14:33:31.684+0000 7f2dddaca200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T14:33:32.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: cluster 2024-02-13T14:33:31.708550+0000 mon.a (mon.0) 10 : cluster 1 Activating manager daemon y 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: cluster 2024-02-13T14:33:31.712180+0000 mon.a (mon.0) 11 : cluster 0 mgrmap e2: y(active, starting, since 0.00380256s) 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.716679+0000 mon.a (mon.0) 12 : audit 0 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.717018+0000 mon.a (mon.0) 13 : audit 0 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.717573+0000 mon.a (mon.0) 14 : audit 0 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.718172+0000 mon.a (mon.0) 15 : audit 0 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.718751+0000 mon.a (mon.0) 16 : audit 0 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.719144+0000 mon.a (mon.0) 17 : audit 0 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.719552+0000 mon.a (mon.0) 18 : audit 0 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.719953+0000 mon.a (mon.0) 19 : audit 0 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: cluster 2024-02-13T14:33:31.725200+0000 mon.a (mon.0) 20 : cluster 1 Manager daemon y is now available 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.736899+0000 mon.a (mon.0) 21 : audit 1 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.738904+0000 mon.a (mon.0) 22 : audit 1 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.742916+0000 mon.a (mon.0) 23 : audit 1 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' 2024-02-13T14:33:32.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.744682+0000 mon.a (mon.0) 24 : audit 1 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' 2024-02-13T14:33:32.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:31 smithi062 bash[21479]: audit 2024-02-13T14:33:31.746379+0000 mon.a (mon.0) 25 : audit 1 from='mgr.14100 v1:172.21.15.62:0/3177379349' entity='mgr.y' 2024-02-13T14:33:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:33 smithi062 bash[21479]: cluster 2024-02-13T14:33:32.721644+0000 mon.a (mon.0) 26 : cluster 0 mgrmap e3: y(active, since 1.01325s) 2024-02-13T14:33:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-02-13T14:33:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsid": "9cdb3692-ca7c-11ee-95b9-87774f69a715", 2024-02-13T14:33:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "health": { 2024-02-13T14:33:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-13T14:33:35.604 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 0 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "a" 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "quorum_age": 13, 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-13T14:33:35.605 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-13T14:33:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-13T14:33:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-13T14:33:35.606 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-13T14:33:35.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-13T14:33:35.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-13T14:33:35.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-13T14:33:35.616 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-13T14:33:35.617 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "restful" 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ], 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "modified": "2024-02-13T14:33:15.382250+0000", 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-13T14:33:35.618 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout }, 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.480+0000 7fcb7d68a700 1 Processor -- start 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.480+0000 7fcb7d68a700 1 -- start start 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.480+0000 7fcb7d68a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcb78078ed0 con 0x7fcb78106570 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.480+0000 7fcb76ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcb78106570 0x7fcb78108960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51550/0 (socket says 172.21.15.62:51550) 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.480+0000 7fcb76ffd700 1 -- 172.21.15.62:0/1644604940 learned_addr learned my addr 172.21.15.62:0/1644604940 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.480+0000 7fcb75ffb700 1 -- 172.21.15.62:0/1644604940 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527752485 0 0) 0x7fcb78078ed0 con 0x7fcb78106570 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.480+0000 7fcb75ffb700 1 -- 172.21.15.62:0/1644604940 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb600035b0 con 0x7fcb78106570 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb75ffb700 1 -- 172.21.15.62:0/1644604940 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3190544493 0 0) 0x7fcb600035b0 con 0x7fcb78106570 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb75ffb700 1 -- 172.21.15.62:0/1644604940 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7810b090 con 0x7fcb78106570 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb75ffb700 1 -- 172.21.15.62:0/1644604940 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fcb70001900 con 0x7fcb78106570 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb75ffb700 1 -- 172.21.15.62:0/1644604940 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7fcb70001f90 con 0x7fcb78106570 2024-02-13T14:33:35.619 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb75ffb700 1 -- 172.21.15.62:0/1644604940 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fcb70005b30 con 0x7fcb78106570 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- 172.21.15.62:0/1644604940 >> v1:172.21.15.62:6789/0 conn(0x7fcb78106570 legacy=0x7fcb78108960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- 172.21.15.62:0/1644604940 shutdown_connections 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- 172.21.15.62:0/1644604940 >> 172.21.15.62:0/1644604940 conn(0x7fcb780fff80 msgr2=0x7fcb781023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- 172.21.15.62:0/1644604940 shutdown_connections 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- 172.21.15.62:0/1644604940 wait complete. 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 Processor -- start 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- start start 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcb7819a020 con 0x7fcb781994f0 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb76ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcb781994f0 0x7fcb78199910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51558/0 (socket says 172.21.15.62:51558) 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb76ffd700 1 -- 172.21.15.62:0/82917269 learned_addr learned my addr 172.21.15.62:0/82917269 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974764184 0 0) 0x7fcb7819a020 con 0x7fcb781994f0 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb60005540 con 0x7fcb781994f0 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 305298180 0 0) 0x7fcb60005540 con 0x7fcb781994f0 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb7819a020 con 0x7fcb781994f0 2024-02-13T14:33:35.620 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fcb70001400 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2194535398 0 0) 0x7fcb7819a020 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7819ea10 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7819da00 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7819df00 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7fcb70004cf0 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.484+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fcb700063f0 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.488+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 3) v1 ==== 45952+0+0 (unknown 1620087359 0 0) 0x7fcb700118e0 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.488+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb64005120 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.488+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7fcb70047600 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.492+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fcb70013100 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:34.716+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mgrmap(e 4) v1 ==== 46058+0+0 (unknown 2253071442 0 0) 0x7fcb70046220 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:35.036+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fcb640053d0 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:35.040+0000 7fcb5ffff700 1 -- 172.21.15.62:0/82917269 <== mon.0 v1:172.21.15.62:6789/0 11 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (unknown 4201413639 0 4012222346) 0x7fcb70013100 con 0x7fcb781994f0 2024-02-13T14:33:35.621 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:35.040+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 >> v1:172.21.15.62:6800/3755300204 conn(0x7fcb6003a1f0 legacy=0x7fcb6003c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:35.040+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 >> v1:172.21.15.62:6789/0 conn(0x7fcb781994f0 legacy=0x7fcb78199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:35.040+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 shutdown_connections 2024-02-13T14:33:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:35.040+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 >> 172.21.15.62:0/82917269 conn(0x7fcb780fff80 msgr2=0x7fcb78190250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:35.040+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 shutdown_connections 2024-02-13T14:33:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:35.040+0000 7fcb7d68a700 1 -- 172.21.15.62:0/82917269 wait complete. 2024-02-13T14:33:35.622 INFO:teuthology.orchestra.run.smithi062.stdout:mgr is available 2024-02-13T14:33:36.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:35 smithi062 bash[21479]: cluster 2024-02-13T14:33:34.721810+0000 mon.a (mon.0) 27 : cluster 0 mgrmap e4: y(active, since 3s) 2024-02-13T14:33:36.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:35 smithi062 bash[21479]: audit 2024-02-13T14:33:35.042478+0000 mon.a (mon.0) 28 : audit 0 from='client.? v1:172.21.15.62:0/82917269' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-13T14:33:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:36 smithi062 bash[21479]: audit 2024-02-13T14:33:36.802293+0000 mon.a (mon.0) 29 : audit 1 from='client.? v1:172.21.15.62:0/2174639920' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-13T14:33:37.392 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:37.392 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [global] 2024-02-13T14:33:37.392 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout fsid = 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:37.392 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-13T14:33:37.393 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-13T14:33:37.393 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-13T14:33:37.394 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-13T14:33:37.394 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:37.394 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-13T14:33:37.394 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-13T14:33:37.394 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 2024-02-13T14:33:37.395 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout [osd] 2024-02-13T14:33:37.395 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-13T14:33:37.395 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-13T14:33:37.395 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.412+0000 7faa85ce2700 1 Processor -- start 2024-02-13T14:33:37.395 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.412+0000 7faa85ce2700 1 -- start start 2024-02-13T14:33:37.395 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7faa8007e5a0 con 0x7faa8007c110 2024-02-13T14:33:37.395 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faa8007c110 0x7faa8007c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51574/0 (socket says 172.21.15.62:51574) 2024-02-13T14:33:37.398 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7f7fe700 1 -- 172.21.15.62:0/772645473 learned_addr learned my addr 172.21.15.62:0/772645473 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:37.398 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7e7fc700 1 -- 172.21.15.62:0/772645473 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699593692 0 0) 0x7faa8007e5a0 con 0x7faa8007c110 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7e7fc700 1 -- 172.21.15.62:0/772645473 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa680035b0 con 0x7faa8007c110 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7e7fc700 1 -- 172.21.15.62:0/772645473 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3306330905 0 0) 0x7faa680035b0 con 0x7faa8007c110 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7e7fc700 1 -- 172.21.15.62:0/772645473 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8007f740 con 0x7faa8007c110 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7e7fc700 1 -- 172.21.15.62:0/772645473 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7faa70001580 con 0x7faa8007c110 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7e7fc700 1 -- 172.21.15.62:0/772645473 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7faa70001c10 con 0x7faa8007c110 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7e7fc700 1 -- 172.21.15.62:0/772645473 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7faa700057b0 con 0x7faa8007c110 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 -- 172.21.15.62:0/772645473 >> v1:172.21.15.62:6789/0 conn(0x7faa8007c110 legacy=0x7faa8007c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 -- 172.21.15.62:0/772645473 shutdown_connections 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 -- 172.21.15.62:0/772645473 >> 172.21.15.62:0/772645473 conn(0x7faa8007b0e0 msgr2=0x7faa80105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 -- 172.21.15.62:0/772645473 shutdown_connections 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 -- 172.21.15.62:0/772645473 wait complete. 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 Processor -- start 2024-02-13T14:33:37.399 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 -- start start 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa85ce2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7faa801a0160 con 0x7faa8007c110 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7faa8007c110 0x7faa8019fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51584/0 (socket says 172.21.15.62:51584) 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7f7fe700 1 -- 172.21.15.62:0/2174639920 learned_addr learned my addr 172.21.15.62:0/2174639920 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828756244 0 0) 0x7faa801a0160 con 0x7faa8007c110 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa68005540 con 0x7faa8007c110 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2915095296 0 0) 0x7faa68005540 con 0x7faa8007c110 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7faa801a0160 con 0x7faa8007c110 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.416+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7faa70001080 con 0x7faa8007c110 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3393495715 0 0) 0x7faa801a0160 con 0x7faa8007c110 2024-02-13T14:33:37.400 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa801a02f0 con 0x7faa8007c110 2024-02-13T14:33:37.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa801a05a0 con 0x7faa8007c110 2024-02-13T14:33:37.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7faa801a40f0 con 0x7faa8007c110 2024-02-13T14:33:37.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7faa700049d0 con 0x7faa8007c110 2024-02-13T14:33:37.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7faa700061a0 con 0x7faa8007c110 2024-02-13T14:33:37.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 4) v1 ==== 46058+0+0 (unknown 2253071442 0 0) 0x7faa70011720 con 0x7faa8007c110 2024-02-13T14:33:37.402 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6c005150 con 0x7faa8007c110 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.420+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7faa70047590 con 0x7faa8007c110 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.424+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7faa70012f30 con 0x7faa8007c110 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.796+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7faa6c005980 con 0x7faa8007c110 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.800+0000 7faa7cff9700 1 -- 172.21.15.62:0/2174639920 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+282 (unknown 1187553405 0 2731577280) 0x7faa70015010 con 0x7faa8007c110 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.800+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 >> v1:172.21.15.62:6800/3755300204 conn(0x7faa6803a310 legacy=0x7faa6803c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.800+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 >> v1:172.21.15.62:6789/0 conn(0x7faa8007c110 legacy=0x7faa8019fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.800+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 shutdown_connections 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.800+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 >> 172.21.15.62:0/2174639920 conn(0x7faa8007b0e0 msgr2=0x7faa801062c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.800+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 shutdown_connections 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:36.800+0000 7faa85ce2700 1 -- 172.21.15.62:0/2174639920 wait complete. 2024-02-13T14:33:37.403 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling cephadm module... 2024-02-13T14:33:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:38 smithi062 bash[21479]: audit 2024-02-13T14:33:38.679198+0000 mon.a (mon.0) 30 : audit 1 from='client.? v1:172.21.15.62:0/1099170331' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-13T14:33:39.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:38 smithi062 bash[21731]: ignoring --setuser ceph since I am not root 2024-02-13T14:33:39.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:38 smithi062 bash[21731]: ignoring --setgroup ceph since I am not root 2024-02-13T14:33:39.063 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:38 smithi062 bash[21731]: debug 2024-02-13T14:33:38.912+0000 7fc5609aa200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-13T14:33:39.258 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.172+0000 7f48a8a24700 1 Processor -- start 2024-02-13T14:33:39.258 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.172+0000 7f48a8a24700 1 -- start start 2024-02-13T14:33:39.258 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f48a407e5a0 con 0x7f48a407c110 2024-02-13T14:33:39.258 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f48a407c110 0x7f48a407c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51590/0 (socket says 172.21.15.62:51590) 2024-02-13T14:33:39.258 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a259c700 1 -- 172.21.15.62:0/764712658 learned_addr learned my addr 172.21.15.62:0/764712658 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:39.258 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a1d9b700 1 -- 172.21.15.62:0/764712658 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565198509 0 0) 0x7f48a407e5a0 con 0x7f48a407c110 2024-02-13T14:33:39.258 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a1d9b700 1 -- 172.21.15.62:0/764712658 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48900035b0 con 0x7f48a407c110 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a1d9b700 1 -- 172.21.15.62:0/764712658 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2360452244 0 0) 0x7f48900035b0 con 0x7f48a407c110 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a1d9b700 1 -- 172.21.15.62:0/764712658 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a407f740 con 0x7f48a407c110 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a1d9b700 1 -- 172.21.15.62:0/764712658 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4894001580 con 0x7f48a407c110 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a1d9b700 1 -- 172.21.15.62:0/764712658 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f4894001ce0 con 0x7f48a407c110 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a1d9b700 1 -- 172.21.15.62:0/764712658 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4894005960 con 0x7f48a407c110 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 -- 172.21.15.62:0/764712658 >> v1:172.21.15.62:6789/0 conn(0x7f48a407c110 legacy=0x7f48a407c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 -- 172.21.15.62:0/764712658 shutdown_connections 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 -- 172.21.15.62:0/764712658 >> 172.21.15.62:0/764712658 conn(0x7f48a407b0e0 msgr2=0x7f48a4105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 -- 172.21.15.62:0/764712658 shutdown_connections 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 -- 172.21.15.62:0/764712658 wait complete. 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 Processor -- start 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 -- start start 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a8a24700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f48a41a0120 con 0x7f48a407c110 2024-02-13T14:33:39.259 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a259c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f48a407c110 0x7f48a419fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51596/0 (socket says 172.21.15.62:51596) 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f48a259c700 1 -- 172.21.15.62:0/1099170331 learned_addr learned my addr 172.21.15.62:0/1099170331 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995815302 0 0) 0x7f48a41a0120 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.176+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48900054f0 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1233012985 0 0) 0x7f48900054f0 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f48a41a0120 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4894004870 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1227294314 0 0) 0x7f48a41a0120 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a41a02b0 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a41a0560 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a41a40b0 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f4894001190 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4894006120 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 4) v1 ==== 46058+0+0 (unknown 2253071442 0 0) 0x7f48940116a0 con 0x7f48a407c110 2024-02-13T14:33:39.260 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4884005150 con 0x7f48a407c110 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.180+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7f4894047560 con 0x7f48a407c110 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.184+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f4894012eb0 con 0x7f48a407c110 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.676+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f4884005400 con 0x7f48a407c110 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.728+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (unknown 2263024820 0 0) 0x7f4894014f90 con 0x7f48a407c110 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.732+0000 7f489b7fe700 1 -- 172.21.15.62:0/1099170331 <== mon.0 v1:172.21.15.62:6789/0 11 ==== mgrmap(e 5) v1 ==== 46069+0+0 (unknown 3132525430 0 0) 0x7f4894045f50 con 0x7f48a407c110 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.732+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 >> v1:172.21.15.62:6800/3755300204 conn(0x7f489003a370 legacy=0x7f489003c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.732+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 >> v1:172.21.15.62:6789/0 conn(0x7f48a407c110 legacy=0x7f48a419fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.732+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 shutdown_connections 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.732+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 >> 172.21.15.62:0/1099170331 conn(0x7f48a407b0e0 msgr2=0x7f48a4105ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.732+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 shutdown_connections 2024-02-13T14:33:39.261 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:38.732+0000 7f48a8a24700 1 -- 172.21.15.62:0/1099170331 wait complete. 2024-02-13T14:33:40.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:39 smithi062 bash[21479]: audit 2024-02-13T14:33:38.731104+0000 mon.a (mon.0) 31 : audit 1 from='client.? v1:172.21.15.62:0/1099170331' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-13T14:33:40.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:39 smithi062 bash[21479]: cluster 2024-02-13T14:33:38.736930+0000 mon.a (mon.0) 32 : cluster 0 mgrmap e5: y(active, since 7s) 2024-02-13T14:33:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:40 smithi062 bash[21479]: audit 2024-02-13T14:33:40.568017+0000 mon.a (mon.0) 33 : audit 0 from='client.? v1:172.21.15.62:0/3425546501' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-13T14:33:40.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:40 smithi062 bash[21731]: debug 2024-02-13T14:33:40.536+0000 7fc5609aa200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T14:33:40.813 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:40 smithi062 bash[21731]: debug 2024-02-13T14:33:40.640+0000 7fc5609aa200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T14:33:41.105 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 Processor -- start 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- start start 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff454109f40 con 0x7ff454105b10 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff458c5e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff454105b10 0x7ff454105f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51614/0 (socket says 172.21.15.62:51614) 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff458c5e700 1 -- 172.21.15.62:0/4271377555 learned_addr learned my addr 172.21.15.62:0/4271377555 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:41.106 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff4537fe700 1 -- 172.21.15.62:0/4271377555 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1120940570 0 0) 0x7ff454109f40 con 0x7ff454105b10 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff4537fe700 1 -- 172.21.15.62:0/4271377555 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4440035b0 con 0x7ff454105b10 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff4537fe700 1 -- 172.21.15.62:0/4271377555 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3785345040 0 0) 0x7ff4440035b0 con 0x7ff454105b10 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff4537fe700 1 -- 172.21.15.62:0/4271377555 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff45410b0e0 con 0x7ff454105b10 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff4537fe700 1 -- 172.21.15.62:0/4271377555 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7ff448001580 con 0x7ff454105b10 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff4537fe700 1 -- 172.21.15.62:0/4271377555 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7ff448001c10 con 0x7ff454105b10 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff4537fe700 1 -- 172.21.15.62:0/4271377555 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7ff448005780 con 0x7ff454105b10 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- 172.21.15.62:0/4271377555 >> v1:172.21.15.62:6789/0 conn(0x7ff454105b10 legacy=0x7ff454105f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- 172.21.15.62:0/4271377555 shutdown_connections 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- 172.21.15.62:0/4271377555 >> 172.21.15.62:0/4271377555 conn(0x7ff4541010d0 msgr2=0x7ff4541034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- 172.21.15.62:0/4271377555 shutdown_connections 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- 172.21.15.62:0/4271377555 wait complete. 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 Processor -- start 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- start start 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff45aec2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff454199bb0 con 0x7ff454105b10 2024-02-13T14:33:41.107 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff458c5e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff454105b10 0x7ff4541994a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:51618/0 (socket says 172.21.15.62:51618) 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff458c5e700 1 -- 172.21.15.62:0/3425546501 learned_addr learned my addr 172.21.15.62:0/3425546501 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 467697476 0 0) 0x7ff454199bb0 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.060+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff444005540 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3135546070 0 0) 0x7ff444005540 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff454199bb0 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7ff448001080 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1166278578 0 0) 0x7ff454199bb0 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff454199d40 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff454199ff0 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45419db40 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7ff448005550 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7ff4480060b0 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 5) v1 ==== 46069+0+0 (unknown 3132525430 0 0) 0x7ff448011750 con 0x7ff454105b10 2024-02-13T14:33:41.108 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff438005150 con 0x7ff454105b10 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7ff448048270 con 0x7ff454105b10 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.064+0000 7ff453fff700 1 -- 172.21.15.62:0/3425546501 >> v1:172.21.15.62:6800/3755300204 conn(0x7ff44403a000 legacy=0x7ff44403c4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/3755300204 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.068+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7ff448013270 con 0x7ff454105b10 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.268+0000 7ff453fff700 1 -- 172.21.15.62:0/3425546501 >> v1:172.21.15.62:6800/3755300204 conn(0x7ff44403a000 legacy=0x7ff44403c4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/3755300204 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.564+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7ff438005c10 con 0x7ff454105b10 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.564+0000 7ff451ffb700 1 -- 172.21.15.62:0/3425546501 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (unknown 3768197548 0 15966916) 0x7ff4480151a0 con 0x7ff454105b10 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.568+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 >> v1:172.21.15.62:6800/3755300204 conn(0x7ff44403a000 legacy=0x7ff44403c4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.568+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 >> v1:172.21.15.62:6789/0 conn(0x7ff454105b10 legacy=0x7ff4541994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.568+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 shutdown_connections 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.568+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 >> 172.21.15.62:0/3425546501 conn(0x7ff4541010d0 msgr2=0x7ff4541034c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.568+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 shutdown_connections 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:40.568+0000 7ff45aec2700 1 -- 172.21.15.62:0/3425546501 wait complete. 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for the mgr to restart... 2024-02-13T14:33:41.109 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr epoch 5... 2024-02-13T14:33:41.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:40 smithi062 bash[21731]: debug 2024-02-13T14:33:40.892+0000 7fc5609aa200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T14:33:42.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:41 smithi062 bash[21731]: debug 2024-02-13T14:33:41.720+0000 7fc5609aa200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T14:33:42.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:41 smithi062 bash[21731]: debug 2024-02-13T14:33:41.836+0000 7fc5609aa200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T14:33:42.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:41 smithi062 bash[21731]: debug 2024-02-13T14:33:41.940+0000 7fc5609aa200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T14:33:42.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:42 smithi062 bash[21731]: debug 2024-02-13T14:33:42.304+0000 7fc5609aa200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-13T14:33:42.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:42 smithi062 bash[21731]: debug 2024-02-13T14:33:42.420+0000 7fc5609aa200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T14:33:42.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:42 smithi062 bash[21731]: debug 2024-02-13T14:33:42.528+0000 7fc5609aa200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T14:33:43.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:42 smithi062 bash[21731]: debug 2024-02-13T14:33:42.896+0000 7fc5609aa200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T14:33:43.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:43 smithi062 bash[21731]: debug 2024-02-13T14:33:43.140+0000 7fc5609aa200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T14:33:43.810 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:43 smithi062 bash[21731]: debug 2024-02-13T14:33:43.412+0000 7fc5609aa200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T14:33:43.810 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:43 smithi062 bash[21731]: debug 2024-02-13T14:33:43.524+0000 7fc5609aa200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T14:33:44.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:43 smithi062 bash[21731]: debug 2024-02-13T14:33:43.804+0000 7fc5609aa200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T14:33:44.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:44 smithi062 bash[21731]: debug 2024-02-13T14:33:44.056+0000 7fc5609aa200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:33:44.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:44 smithi062 bash[21731]: debug 2024-02-13T14:33:44.472+0000 7fc5609aa200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T14:33:44.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:44 smithi062 bash[21731]: debug 2024-02-13T14:33:44.592+0000 7fc5609aa200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T14:33:45.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:44 smithi062 bash[21731]: debug 2024-02-13T14:33:44.852+0000 7fc5609aa200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:33:46.311 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:45 smithi062 bash[21731]: debug 2024-02-13T14:33:45.884+0000 7fc5609aa200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T14:33:46.311 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:46 smithi062 bash[21731]: debug 2024-02-13T14:33:46.004+0000 7fc5609aa200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T14:33:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:46 smithi062 bash[21731]: debug 2024-02-13T14:33:46.308+0000 7fc5609aa200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T14:33:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:46 smithi062 bash[21731]: debug 2024-02-13T14:33:46.424+0000 7fc5609aa200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-13T14:33:47.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:46 smithi062 bash[21731]: debug 2024-02-13T14:33:46.892+0000 7fc5609aa200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T14:33:47.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21731]: debug 2024-02-13T14:33:47.016+0000 7fc5609aa200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T14:33:47.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: cluster 2024-02-13T14:33:47.040592+0000 mon.a (mon.0) 34 : cluster 1 Active manager daemon y restarted 2024-02-13T14:33:47.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: cluster 2024-02-13T14:33:47.041215+0000 mon.a (mon.0) 35 : cluster 1 Activating manager daemon y 2024-02-13T14:33:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: cluster 2024-02-13T14:33:47.044945+0000 mon.a (mon.0) 36 : cluster 0 osdmap e2: 0 total, 0 up, 0 in 2024-02-13T14:33:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: cluster 2024-02-13T14:33:47.045071+0000 mon.a (mon.0) 37 : cluster 0 mgrmap e6: y(active, starting, since 0.00407974s) 2024-02-13T14:33:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: audit 2024-02-13T14:33:47.049087+0000 mon.a (mon.0) 38 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:33:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: audit 2024-02-13T14:33:47.051111+0000 mon.a (mon.0) 39 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T14:33:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: audit 2024-02-13T14:33:47.052032+0000 mon.a (mon.0) 40 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T14:33:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: audit 2024-02-13T14:33:47.052180+0000 mon.a (mon.0) 41 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T14:33:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: audit 2024-02-13T14:33:47.052323+0000 mon.a (mon.0) 42 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T14:33:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:47 smithi062 bash[21479]: cluster 2024-02-13T14:33:47.076253+0000 mon.a (mon.0) 43 : cluster 1 Manager daemon y is now available 2024-02-13T14:33:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: cephadm 2024-02-13T14:33:47.094883+0000 mgr.y (mgr.14120) 1 : cephadm 1 Found migration_current of "None". Setting to last migration. 2024-02-13T14:33:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.098219+0000 mon.a (mon.0) 44 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:33:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.101317+0000 mon.a (mon.0) 45 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:33:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.104846+0000 mon.a (mon.0) 46 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:33:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.106253+0000 mon.a (mon.0) 47 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:33:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.110407+0000 mon.a (mon.0) 48 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:33:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.121153+0000 mon.a (mon.0) 49 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:33:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.124525+0000 mon.a (mon.0) 50 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:33:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.549796+0000 mon.a (mon.0) 51 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:33:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: audit 2024-02-13T14:33:47.553023+0000 mon.a (mon.0) 52 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:33:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:48 smithi062 bash[21479]: cluster 2024-02-13T14:33:48.052189+0000 mon.a (mon.0) 53 : cluster 0 mgrmap e7: y(active, since 1.01117s) 2024-02-13T14:33:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-02-13T14:33:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-13T14:33:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-13T14:33:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-02-13T14:33:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7fecac271700 1 Processor -- start 2024-02-13T14:33:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7fecac271700 1 -- start start 2024-02-13T14:33:48.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7fecac271700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7feca410c140 con 0x7feca4107d10 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7fecaa00d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7feca4107d10 0x7feca4108130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46140/0 (socket says 172.21.15.62:46140) 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7fecaa00d700 1 -- 172.21.15.62:0/4161587200 learned_addr learned my addr 172.21.15.62:0/4161587200 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7feca900b700 1 -- 172.21.15.62:0/4161587200 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3711593406 0 0) 0x7feca410c140 con 0x7feca4107d10 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7feca900b700 1 -- 172.21.15.62:0/4161587200 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec900035b0 con 0x7feca4107d10 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7feca900b700 1 -- 172.21.15.62:0/4161587200 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3614832115 0 0) 0x7fec900035b0 con 0x7feca4107d10 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7feca900b700 1 -- 172.21.15.62:0/4161587200 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca410d2e0 con 0x7feca4107d10 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7feca900b700 1 -- 172.21.15.62:0/4161587200 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7feca0001580 con 0x7feca4107d10 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7feca900b700 1 -- 172.21.15.62:0/4161587200 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7feca0001ce0 con 0x7feca4107d10 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.888+0000 7feca900b700 1 -- 172.21.15.62:0/4161587200 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7feca0005960 con 0x7feca4107d10 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- 172.21.15.62:0/4161587200 >> v1:172.21.15.62:6789/0 conn(0x7feca4107d10 legacy=0x7feca4108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- 172.21.15.62:0/4161587200 shutdown_connections 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- 172.21.15.62:0/4161587200 >> 172.21.15.62:0/4161587200 conn(0x7feca407b150 msgr2=0x7feca4105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- 172.21.15.62:0/4161587200 shutdown_connections 2024-02-13T14:33:48.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- 172.21.15.62:0/4161587200 wait complete. 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 Processor -- start 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- start start 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7feca419bd90 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecaa00d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7feca4107d10 0x7feca419b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46142/0 (socket says 172.21.15.62:46142) 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecaa00d700 1 -- 172.21.15.62:0/2311347168 learned_addr learned my addr 172.21.15.62:0/2311347168 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653192122 0 0) 0x7feca419bd90 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec900054f0 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1999819276 0 0) 0x7fec900054f0 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7feca419bd90 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7feca0005940 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 304176152 0 0) 0x7feca419bd90 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca419bf20 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca419c1d0 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7feca419fd20 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7feca0001080 con 0x7feca4107d10 2024-02-13T14:33:48.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7feca0005ff0 con 0x7feca4107d10 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 5) v1 ==== 46069+0+0 (unknown 3132525430 0 0) 0x7feca0011630 con 0x7feca4107d10 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 --> v1:172.21.15.62:6800/3755300204 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec9003e090 con 0x7fec9003a3c0 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (unknown 2643124521 0 0) 0x7feca0001870 con 0x7feca4107d10 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:41.892+0000 7feca980c700 1 -- 172.21.15.62:0/2311347168 >> v1:172.21.15.62:6800/3755300204 conn(0x7fec9003a3c0 legacy=0x7fec9003c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/3755300204 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:42.096+0000 7feca980c700 1 -- 172.21.15.62:0/2311347168 >> v1:172.21.15.62:6800/3755300204 conn(0x7fec9003a3c0 legacy=0x7fec9003c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/3755300204 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:42.500+0000 7feca980c700 1 -- 172.21.15.62:0/2311347168 >> v1:172.21.15.62:6800/3755300204 conn(0x7fec9003a3c0 legacy=0x7fec9003c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/3755300204 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:43.304+0000 7feca980c700 1 -- 172.21.15.62:0/2311347168 >> v1:172.21.15.62:6800/3755300204 conn(0x7fec9003a3c0 legacy=0x7fec9003c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/3755300204 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:44.908+0000 7feca980c700 1 -- 172.21.15.62:0/2311347168 >> v1:172.21.15.62:6800/3755300204 conn(0x7fec9003a3c0 legacy=0x7fec9003c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/3755300204 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:47.040+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mgrmap(e 6) v1 ==== 45871+0+0 (unknown 4111418118 0 0) 0x7feca0004ec0 con 0x7feca4107d10 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:47.040+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 >> v1:172.21.15.62:6800/3755300204 conn(0x7fec9003a3c0 legacy=0x7fec9003c880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.044+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mgrmap(e 7) v1 ==== 45963+0+0 (unknown 3710088885 0 0) 0x7feca001bcd0 con 0x7feca4107d10 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.044+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 --> v1:172.21.15.62:6800/70089425 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fec9003e090 con 0x7fec9003ede0 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.048+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mgr.14120 v1:172.21.15.62:6800/70089425 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (unknown 0 0 4109177037) 0x7fec9003e090 con 0x7fec9003ede0 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.060+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 --> v1:172.21.15.62:6800/70089425 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fec88002600 con 0x7fec9003ede0 2024-02-13T14:33:48.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.060+0000 7fec977fe700 1 -- 172.21.15.62:0/2311347168 <== mgr.14120 v1:172.21.15.62:6800/70089425 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (unknown 0 0 96372106) 0x7fec88002600 con 0x7fec9003ede0 2024-02-13T14:33:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.064+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 >> v1:172.21.15.62:6800/70089425 conn(0x7fec9003ede0 legacy=0x7fec900411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.064+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 >> v1:172.21.15.62:6789/0 conn(0x7feca4107d10 legacy=0x7feca419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.064+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 shutdown_connections 2024-02-13T14:33:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.064+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 >> 172.21.15.62:0/2311347168 conn(0x7feca407b150 msgr2=0x7feca41924a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.064+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 shutdown_connections 2024-02-13T14:33:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:48.064+0000 7fecac271700 1 -- 172.21.15.62:0/2311347168 wait complete. 2024-02-13T14:33:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:mgr epoch 5 is available 2024-02-13T14:33:48.663 INFO:teuthology.orchestra.run.smithi062.stdout:Setting orchestrator backend to cephadm... 2024-02-13T14:33:49.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:49 smithi062 bash[21479]: audit 2024-02-13T14:33:48.050126+0000 mgr.y (mgr.14120) 2 : audit 0 from='client.14124 v1:172.21.15.62:0/2311347168' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-13T14:33:49.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:49 smithi062 bash[21479]: audit 2024-02-13T14:33:48.065741+0000 mgr.y (mgr.14120) 3 : audit 0 from='client.14124 v1:172.21.15.62:0/2311347168' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-13T14:33:49.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:49 smithi062 bash[21479]: cephadm 2024-02-13T14:33:48.613719+0000 mgr.y (mgr.14120) 4 : cephadm 1 [13/Feb/2024:14:33:48] ENGINE Bus STARTING 2024-02-13T14:33:49.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:49 smithi062 bash[21479]: cephadm 2024-02-13T14:33:48.715861+0000 mgr.y (mgr.14120) 5 : cephadm 1 [13/Feb/2024:14:33:48] ENGINE Serving on http://172.21.15.62:8765 2024-02-13T14:33:49.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:49 smithi062 bash[21479]: audit 2024-02-13T14:33:48.881230+0000 mon.a (mon.0) 54 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:33:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:50 smithi062 bash[21479]: cephadm 2024-02-13T14:33:48.835405+0000 mgr.y (mgr.14120) 6 : cephadm 1 [13/Feb/2024:14:33:48] ENGINE Serving on https://172.21.15.62:7150 2024-02-13T14:33:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:50 smithi062 bash[21479]: cephadm 2024-02-13T14:33:48.835585+0000 mgr.y (mgr.14120) 7 : cephadm 1 [13/Feb/2024:14:33:48] ENGINE Bus STARTED 2024-02-13T14:33:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:50 smithi062 bash[21479]: cluster 2024-02-13T14:33:49.105809+0000 mon.a (mon.0) 55 : cluster 0 mgrmap e8: y(active, since 2s) 2024-02-13T14:33:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:50 smithi062 bash[21479]: audit 2024-02-13T14:33:49.916155+0000 mon.a (mon.0) 56 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:33:50.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:50 smithi062 bash[21479]: audit 2024-02-13T14:33:49.950814+0000 mon.a (mon.0) 57 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:33:50.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 Processor -- start 2024-02-13T14:33:50.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- start start 2024-02-13T14:33:50.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f793c109f20 con 0x7f793c105af0 2024-02-13T14:33:50.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794142b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f793c105af0 0x7f793c105f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46202/0 (socket says 172.21.15.62:46202) 2024-02-13T14:33:50.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794142b700 1 -- 172.21.15.62:0/3214668195 learned_addr learned my addr 172.21.15.62:0/3214668195 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:50.531 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f7933fff700 1 -- 172.21.15.62:0/3214668195 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137732253 0 0) 0x7f793c109f20 con 0x7f793c105af0 2024-02-13T14:33:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f7933fff700 1 -- 172.21.15.62:0/3214668195 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79280035b0 con 0x7f793c105af0 2024-02-13T14:33:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f7933fff700 1 -- 172.21.15.62:0/3214668195 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 904512410 0 0) 0x7f79280035b0 con 0x7f793c105af0 2024-02-13T14:33:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f7933fff700 1 -- 172.21.15.62:0/3214668195 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c10b0c0 con 0x7f793c105af0 2024-02-13T14:33:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f7933fff700 1 -- 172.21.15.62:0/3214668195 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f7938001580 con 0x7f793c105af0 2024-02-13T14:33:50.533 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f7933fff700 1 -- 172.21.15.62:0/3214668195 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f7938001ce0 con 0x7f793c105af0 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f7933fff700 1 -- 172.21.15.62:0/3214668195 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f7938005960 con 0x7f793c105af0 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- 172.21.15.62:0/3214668195 >> v1:172.21.15.62:6789/0 conn(0x7f793c105af0 legacy=0x7f793c105f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- 172.21.15.62:0/3214668195 shutdown_connections 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- 172.21.15.62:0/3214668195 >> 172.21.15.62:0/3214668195 conn(0x7f793c101050 msgr2=0x7f793c1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- 172.21.15.62:0/3214668195 shutdown_connections 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- 172.21.15.62:0/3214668195 wait complete. 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 Processor -- start 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- start start 2024-02-13T14:33:50.534 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794368f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f793c199b00 con 0x7f793c105af0 2024-02-13T14:33:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794142b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f793c105af0 0x7f793c1993f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46204/0 (socket says 172.21.15.62:46204) 2024-02-13T14:33:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f794142b700 1 -- 172.21.15.62:0/1978782407 learned_addr learned my addr 172.21.15.62:0/1978782407 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271755960 0 0) 0x7f793c199b00 con 0x7f793c105af0 2024-02-13T14:33:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.488+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79280054f0 con 0x7f793c105af0 2024-02-13T14:33:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1563553198 0 0) 0x7f79280054f0 con 0x7f793c105af0 2024-02-13T14:33:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f793c199b00 con 0x7f793c105af0 2024-02-13T14:33:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f7938005940 con 0x7f793c105af0 2024-02-13T14:33:50.537 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 381116163 0 0) 0x7f793c199b00 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c199c90 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f793c199f40 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f793c19da90 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f7938001080 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f7938005ff0 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7f7938011570 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7920005150 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.492+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f7938047470 con 0x7f793c105af0 2024-02-13T14:33:50.538 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.496+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f7938012a50 con 0x7f793c105af0 2024-02-13T14:33:50.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.900+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 --> v1:172.21.15.62:6800/70089425 -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f7920000bc0 con 0x7f792803a410 2024-02-13T14:33:50.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.912+0000 7f79327fc700 1 -- 172.21.15.62:0/1978782407 <== mgr.14120 v1:172.21.15.62:6800/70089425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7f7920000bc0 con 0x7f792803a410 2024-02-13T14:33:50.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.916+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 >> v1:172.21.15.62:6800/70089425 conn(0x7f792803a410 legacy=0x7f792803c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:50.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.916+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 >> v1:172.21.15.62:6789/0 conn(0x7f793c105af0 legacy=0x7f793c1993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:50.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.916+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 shutdown_connections 2024-02-13T14:33:50.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.916+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 >> 172.21.15.62:0/1978782407 conn(0x7f793c101050 msgr2=0x7f793c1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:50.539 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.916+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 shutdown_connections 2024-02-13T14:33:50.540 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:49.916+0000 7f794368f700 1 -- 172.21.15.62:0/1978782407 wait complete. 2024-02-13T14:33:51.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:51 smithi062 bash[21479]: audit 2024-02-13T14:33:49.908046+0000 mgr.y (mgr.14120) 8 : audit 0 from='client.14132 v1:172.21.15.62:0/1978782407' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:33:52.381 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-13T14:33:52.381 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb833b7e700 1 Processor -- start 2024-02-13T14:33:52.381 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb833b7e700 1 -- start start 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb833b7e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb82c0796e0 con 0x7fb82c1043f0 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb83191a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb82c1043f0 0x7fb82c104810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46220/0 (socket says 172.21.15.62:46220) 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb83191a700 1 -- 172.21.15.62:0/2177842971 learned_addr learned my addr 172.21.15.62:0/2177842971 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb830918700 1 -- 172.21.15.62:0/2177842971 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779931811 0 0) 0x7fb82c0796e0 con 0x7fb82c1043f0 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb830918700 1 -- 172.21.15.62:0/2177842971 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8180035b0 con 0x7fb82c1043f0 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb830918700 1 -- 172.21.15.62:0/2177842971 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3376695700 0 0) 0x7fb8180035b0 con 0x7fb82c1043f0 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb830918700 1 -- 172.21.15.62:0/2177842971 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c105f30 con 0x7fb82c1043f0 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb830918700 1 -- 172.21.15.62:0/2177842971 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fb828001580 con 0x7fb82c1043f0 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb830918700 1 -- 172.21.15.62:0/2177842971 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7fb828001c10 con 0x7fb82c1043f0 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.420+0000 7fb830918700 1 -- 172.21.15.62:0/2177842971 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fb8280057b0 con 0x7fb82c1043f0 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- 172.21.15.62:0/2177842971 >> v1:172.21.15.62:6789/0 conn(0x7fb82c1043f0 legacy=0x7fb82c104810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- 172.21.15.62:0/2177842971 shutdown_connections 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- 172.21.15.62:0/2177842971 >> 172.21.15.62:0/2177842971 conn(0x7fb82c0fffd0 msgr2=0x7fb82c1023f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:52.382 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- 172.21.15.62:0/2177842971 shutdown_connections 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- 172.21.15.62:0/2177842971 wait complete. 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 Processor -- start 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- start start 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb82c19bd40 con 0x7fb82c1043f0 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb83191a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb82c1043f0 0x7fb82c19b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46234/0 (socket says 172.21.15.62:46234) 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb83191a700 1 -- 172.21.15.62:0/1081056476 learned_addr learned my addr 172.21.15.62:0/1081056476 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214696723 0 0) 0x7fb82c19bd40 con 0x7fb82c1043f0 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb818005540 con 0x7fb82c1043f0 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2660346928 0 0) 0x7fb818005540 con 0x7fb82c1043f0 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb82c19bd40 con 0x7fb82c1043f0 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fb828001080 con 0x7fb82c1043f0 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3706819690 0 0) 0x7fb82c19bd40 con 0x7fb82c1043f0 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82c19bed0 con 0x7fb82c1043f0 2024-02-13T14:33:52.383 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82c19c180 con 0x7fb82c1043f0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c19fcd0 con 0x7fb82c1043f0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7fb828004900 con 0x7fb82c1043f0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fb828006250 con 0x7fb82c1043f0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7fb828011920 con 0x7fb82c1043f0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb810005150 con 0x7fb82c1043f0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.424+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7fb828047870 con 0x7fb82c1043f0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.432+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fb828016e10 con 0x7fb82c1043f0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.800+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 --> v1:172.21.15.62:6800/70089425 -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fb810000bc0 con 0x7fb81803a2c0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.804+0000 7fb822ffd700 1 -- 172.21.15.62:0/1081056476 <== mgr.14120 v1:172.21.15.62:6800/70089425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (unknown 0 0 2070689548) 0x7fb810000bc0 con 0x7fb81803a2c0 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.804+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 >> v1:172.21.15.62:6800/70089425 conn(0x7fb81803a2c0 legacy=0x7fb81803c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.804+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 >> v1:172.21.15.62:6789/0 conn(0x7fb82c1043f0 legacy=0x7fb82c19b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.804+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 shutdown_connections 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.804+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 >> 172.21.15.62:0/1081056476 conn(0x7fb82c0fffd0 msgr2=0x7fb82c1023c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:52.384 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.808+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 shutdown_connections 2024-02-13T14:33:52.385 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:51.808+0000 7fb833b7e700 1 -- 172.21.15.62:0/1081056476 wait complete. 2024-02-13T14:33:52.385 INFO:teuthology.orchestra.run.smithi062.stdout:Generating ssh key... 2024-02-13T14:33:52.983 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:52 smithi062 bash[21479]: audit 2024-02-13T14:33:51.807190+0000 mgr.y (mgr.14120) 9 : audit 0 from='client.14134 v1:172.21.15.62:0/1081056476' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:33:54.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:53 smithi062 bash[21479]: audit 2024-02-13T14:33:53.554961+0000 mgr.y (mgr.14120) 10 : audit 0 from='client.14136 v1:172.21.15.62:0/3194756582' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:33:54.111 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:53 smithi062 bash[21479]: cephadm 2024-02-13T14:33:53.555220+0000 mgr.y (mgr.14120) 11 : cephadm 1 Generating ssh key... 2024-02-13T14:33:54.111 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: Generating public/private rsa key pair. 2024-02-13T14:33:54.111 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: Your identification has been saved in /tmp/tmpopa0q7zb/key. 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: Your public key has been saved in /tmp/tmpopa0q7zb/key.pub. 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: The key fingerprint is: 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: SHA256:VdVwVxFsVCZw4ciHJt7Se0jJgaguIWbBixhWJRXthqQ ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: The key's randomart image is: 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: +---[RSA 3072]----+ 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: | oo+o ooOB@| 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: | .. .. . . + = *o| 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: |..o o o . + * + | 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: |oo E . + o * + | 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: |o = . o S o * | 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: | o . o o o | 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: | . . o . | 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: | . . | 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: | | 2024-02-13T14:33:54.112 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:33:54 smithi062 bash[21731]: +----[SHA256]-----+ 2024-02-13T14:33:54.571 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f0845ca8700 1 Processor -- start 2024-02-13T14:33:54.571 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f0845ca8700 1 -- start start 2024-02-13T14:33:54.571 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f0845ca8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f084007a310 con 0x7f084007b710 2024-02-13T14:33:54.571 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f084007b710 0x7f0840079b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40490/0 (socket says 172.21.15.62:40490) 2024-02-13T14:33:54.571 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083f7fe700 1 -- 172.21.15.62:0/4138450447 learned_addr learned my addr 172.21.15.62:0/4138450447 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:54.571 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083e7fc700 1 -- 172.21.15.62:0/4138450447 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2335413345 0 0) 0x7f084007a310 con 0x7f084007b710 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083e7fc700 1 -- 172.21.15.62:0/4138450447 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08280035b0 con 0x7f084007b710 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083e7fc700 1 -- 172.21.15.62:0/4138450447 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1715713022 0 0) 0x7f08280035b0 con 0x7f084007b710 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083e7fc700 1 -- 172.21.15.62:0/4138450447 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084007a4a0 con 0x7f084007b710 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083e7fc700 1 -- 172.21.15.62:0/4138450447 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0830001580 con 0x7f084007b710 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083e7fc700 1 -- 172.21.15.62:0/4138450447 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f0830001c10 con 0x7f084007b710 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f083e7fc700 1 -- 172.21.15.62:0/4138450447 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f08300057b0 con 0x7f084007b710 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f0845ca8700 1 -- 172.21.15.62:0/4138450447 >> v1:172.21.15.62:6789/0 conn(0x7f084007b710 legacy=0x7f0840079b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f0845ca8700 1 -- 172.21.15.62:0/4138450447 shutdown_connections 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f0845ca8700 1 -- 172.21.15.62:0/4138450447 >> 172.21.15.62:0/4138450447 conn(0x7f08401010b0 msgr2=0x7f08401034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f0845ca8700 1 -- 172.21.15.62:0/4138450447 shutdown_connections 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.160+0000 7f0845ca8700 1 -- 172.21.15.62:0/4138450447 wait complete. 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f0845ca8700 1 Processor -- start 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f0845ca8700 1 -- start start 2024-02-13T14:33:54.572 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f0845ca8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f084019bd40 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f084007b710 0x7f084019b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40492/0 (socket says 172.21.15.62:40492) 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083f7fe700 1 -- 172.21.15.62:0/3194756582 learned_addr learned my addr 172.21.15.62:0/3194756582 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1274667001 0 0) 0x7f084019bd40 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0828005540 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3952840295 0 0) 0x7f0828005540 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f084019bd40 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0830001080 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2436847808 0 0) 0x7f084019bd40 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084019bed0 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f084019c180 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f084019fcd0 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f08300049d0 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0830006130 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7f0830011770 con 0x7f084007b710 2024-02-13T14:33:54.573 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f082c005150 con 0x7f084007b710 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.164+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f0830047750 con 0x7f084007b710 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.168+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f0830012fe0 con 0x7f084007b710 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:53.552+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 --> v1:172.21.15.62:6800/70089425 -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f082c000bc0 con 0x7f082803a360 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:54.040+0000 7f083cff9700 1 -- 172.21.15.62:0/3194756582 <== mgr.14120 v1:172.21.15.62:6800/70089425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7f082c000bc0 con 0x7f082803a360 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:54.044+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 >> v1:172.21.15.62:6800/70089425 conn(0x7f082803a360 legacy=0x7f082803c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:54.044+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 >> v1:172.21.15.62:6789/0 conn(0x7f084007b710 legacy=0x7f084019b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:54.044+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 shutdown_connections 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:54.044+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 >> 172.21.15.62:0/3194756582 conn(0x7f08401010b0 msgr2=0x7f0840109fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:54.044+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 shutdown_connections 2024-02-13T14:33:54.574 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:54.044+0000 7f0845ca8700 1 -- 172.21.15.62:0/3194756582 wait complete. 2024-02-13T14:33:55.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:55 smithi062 bash[21479]: audit 2024-02-13T14:33:54.037620+0000 mon.a (mon.0) 58 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:33:55.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:55 smithi062 bash[21479]: audit 2024-02-13T14:33:54.042297+0000 mon.a (mon.0) 59 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:33:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDamK3DJwVx5tq6uUg4uIsBzlndkHKOzizTAycPvWQMlaFYFAPhXV+CcCOjZ7CGfFzOshrlN9GH/xoofu6LgkT7Ye7vXTp5tgDCFnIfZrCui+cugePlDiX/po4OWtcFGDfd14egRWUjlS0oFdWtXId6I13mU7IyX4E2AJfM7vaUVHpZ1fLaI7jPKMsRGQ0mqTOTF0c1PL90IKOaEUWTb78cfc1GzOePk/z5TZr+Ex7fmlHFmIT89DyRmrt/WJ9CVpH6HxeQTyUq+8VoWyP2r0IumCxFGuk3Sjell/mxNBIi03mCtgiQkiV0jsfXZf0Tj/EvnuTHAkmcEtbNLv5LKeonDPTsA1hbBfyZhlkn1lmII7jEwYh1phKbajRD3MyuYmuOwhMtkJ8qKGHRgsNCK/LMEkNLLWwKf7dlUdqmogHjOfBngqbFbmJWt79GD6uixV4NyvhG16L6RG2iy0czHcc5xjL19JjQirr6vMaxa6kLaH/IWBZJbLJWKCoHAdl9j4U= ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:33:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 Processor -- start 2024-02-13T14:33:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- start start 2024-02-13T14:33:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f40ec10c140 con 0x7f40ec107d10 2024-02-13T14:33:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40eaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f40ec107d10 0x7f40ec108130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40498/0 (socket says 172.21.15.62:40498) 2024-02-13T14:33:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40eaffd700 1 -- 172.21.15.62:0/3815512914 learned_addr learned my addr 172.21.15.62:0/3815512914 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:56.285 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40e9ffb700 1 -- 172.21.15.62:0/3815512914 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961827853 0 0) 0x7f40ec10c140 con 0x7f40ec107d10 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40e9ffb700 1 -- 172.21.15.62:0/3815512914 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d40035b0 con 0x7f40ec107d10 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40e9ffb700 1 -- 172.21.15.62:0/3815512914 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4249897210 0 0) 0x7f40d40035b0 con 0x7f40ec107d10 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40e9ffb700 1 -- 172.21.15.62:0/3815512914 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec10d2e0 con 0x7f40ec107d10 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40e9ffb700 1 -- 172.21.15.62:0/3815512914 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f40dc001580 con 0x7f40ec107d10 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40e9ffb700 1 -- 172.21.15.62:0/3815512914 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f40dc001ce0 con 0x7f40ec107d10 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40e9ffb700 1 -- 172.21.15.62:0/3815512914 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f40dc005960 con 0x7f40ec107d10 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- 172.21.15.62:0/3815512914 >> v1:172.21.15.62:6789/0 conn(0x7f40ec107d10 legacy=0x7f40ec108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- 172.21.15.62:0/3815512914 shutdown_connections 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- 172.21.15.62:0/3815512914 >> 172.21.15.62:0/3815512914 conn(0x7f40ec07b0e0 msgr2=0x7f40ec105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- 172.21.15.62:0/3815512914 shutdown_connections 2024-02-13T14:33:56.286 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- 172.21.15.62:0/3815512914 wait complete. 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 Processor -- start 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- start start 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f1911700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f40ec19bd70 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40eaffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f40ec107d10 0x7f40ec19b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40512/0 (socket says 172.21.15.62:40512) 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40eaffd700 1 -- 172.21.15.62:0/2981137394 learned_addr learned my addr 172.21.15.62:0/2981137394 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352663911 0 0) 0x7f40ec19bd70 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40d40054f0 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3468062016 0 0) 0x7f40d40054f0 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f40ec19bd70 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.340+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f40dc005940 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 151042700 0 0) 0x7f40ec19bd70 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ec19bf00 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40ec19c1b0 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f40ec19fd00 con 0x7f40ec107d10 2024-02-13T14:33:56.287 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f40dc001080 con 0x7f40ec107d10 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f40dc005ff0 con 0x7f40ec107d10 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7f40dc011630 con 0x7f40ec107d10 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f40dc048480 con 0x7f40ec107d10 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.344+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d8005120 con 0x7f40ec107d10 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.348+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f40dc012ea0 con 0x7f40ec107d10 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.724+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 --> v1:172.21.15.62:6800/70089425 -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f40d8000b90 con 0x7f40d403a410 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.724+0000 7f40f090f700 1 -- 172.21.15.62:0/2981137394 <== mgr.14120 v1:172.21.15.62:6800/70089425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (unknown 0 0 1660070222) 0x7f40d8000b90 con 0x7f40d403a410 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.728+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 >> v1:172.21.15.62:6800/70089425 conn(0x7f40d403a410 legacy=0x7f40d403c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:56.288 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.728+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 >> v1:172.21.15.62:6789/0 conn(0x7f40ec107d10 legacy=0x7f40ec19b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:33:56.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.728+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 shutdown_connections 2024-02-13T14:33:56.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.728+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 >> 172.21.15.62:0/2981137394 conn(0x7f40ec07b0e0 msgr2=0x7f40ec1924a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:33:56.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.728+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 shutdown_connections 2024-02-13T14:33:56.289 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:55.728+0000 7f40f1911700 1 -- 172.21.15.62:0/2981137394 wait complete. 2024-02-13T14:33:56.289 INFO:teuthology.orchestra.run.smithi062.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-13T14:33:56.289 INFO:teuthology.orchestra.run.smithi062.stdout:Adding key to root@localhost authorized_keys... 2024-02-13T14:33:56.289 INFO:teuthology.orchestra.run.smithi062.stdout:Adding host smithi062... 2024-02-13T14:33:56.308 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:56 smithi062 bash[21479]: audit 2024-02-13T14:33:55.729999+0000 mgr.y (mgr.14120) 12 : audit 0 from='client.14138 v1:172.21.15.62:0/2981137394' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:33:58.090 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:57 smithi062 bash[21479]: audit 2024-02-13T14:33:57.533394+0000 mgr.y (mgr.14120) 13 : audit 0 from='client.14140 v1:172.21.15.62:0/257616458' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi062", "addr": "172.21.15.62", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:33:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:33:58 smithi062 bash[21479]: cephadm 2024-02-13T14:33:58.177726+0000 mgr.y (mgr.14120) 14 : cephadm 1 Deploying cephadm binary to smithi062 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Added host 'smithi062' with addr '172.21.15.62' 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 Processor -- start 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 -- start start 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f068807a390 con 0x7f068807b790 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068ddd5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f068807b790 0x7f0688079bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40516/0 (socket says 172.21.15.62:40516) 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068ddd5700 1 -- 172.21.15.62:0/649499542 learned_addr learned my addr 172.21.15.62:0/649499542 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068cdd3700 1 -- 172.21.15.62:0/649499542 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511020074 0 0) 0x7f068807a390 con 0x7f068807b790 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068cdd3700 1 -- 172.21.15.62:0/649499542 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06740035b0 con 0x7f068807b790 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068cdd3700 1 -- 172.21.15.62:0/649499542 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073854373 0 0) 0x7f06740035b0 con 0x7f068807b790 2024-02-13T14:34:04.075 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068cdd3700 1 -- 172.21.15.62:0/649499542 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068807a520 con 0x7f068807b790 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068cdd3700 1 -- 172.21.15.62:0/649499542 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0684001580 con 0x7f068807b790 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068cdd3700 1 -- 172.21.15.62:0/649499542 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f0684001c10 con 0x7f068807b790 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f068cdd3700 1 -- 172.21.15.62:0/649499542 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f06840057b0 con 0x7f068807b790 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 -- 172.21.15.62:0/649499542 >> v1:172.21.15.62:6789/0 conn(0x7f068807b790 legacy=0x7f0688079bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 -- 172.21.15.62:0/649499542 shutdown_connections 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 -- 172.21.15.62:0/649499542 >> 172.21.15.62:0/649499542 conn(0x7f06881010b0 msgr2=0x7f06881034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 -- 172.21.15.62:0/649499542 shutdown_connections 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 -- 172.21.15.62:0/649499542 wait complete. 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 Processor -- start 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.140+0000 7f0690039700 1 -- start start 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f0690039700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f068819c240 con 0x7f068819b710 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f068ddd5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f068819b710 0x7f068819bb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40518/0 (socket says 172.21.15.62:40518) 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f068ddd5700 1 -- 172.21.15.62:0/257616458 learned_addr learned my addr 172.21.15.62:0/257616458 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:04.076 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587212817 0 0) 0x7f068819c240 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0674005540 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2098706174 0 0) 0x7f0674005540 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f068819c240 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0684001080 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 571209482 0 0) 0x7f068819c240 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06881a0c30 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068819fc20 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f06881a0120 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7f0684005600 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0684006090 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7f06840115f0 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f066c005150 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.144+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f06840475c0 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.148+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f0684012e10 con 0x7f068819b710 2024-02-13T14:34:04.077 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:33:57.528+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 --> v1:172.21.15.62:6800/70089425 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi062", "addr": "172.21.15.62", "target": ["mon-mgr", ""]}) v1 -- 0x7f066c000bc0 con 0x7f067403a400 2024-02-13T14:34:04.078 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:03.264+0000 7f067effd700 1 -- 172.21.15.62:0/257616458 <== mgr.14120 v1:172.21.15.62:6800/70089425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (unknown 0 0 1132987903) 0x7f066c000bc0 con 0x7f067403a400 2024-02-13T14:34:04.078 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:03.268+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 >> v1:172.21.15.62:6800/70089425 conn(0x7f067403a400 legacy=0x7f067403c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:04.078 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:03.268+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 >> v1:172.21.15.62:6789/0 conn(0x7f068819b710 legacy=0x7f068819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:04.078 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:03.268+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 shutdown_connections 2024-02-13T14:34:04.078 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:03.268+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 >> 172.21.15.62:0/257616458 conn(0x7f06881010b0 msgr2=0x7f068810a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:04.078 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:03.268+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 shutdown_connections 2024-02-13T14:34:04.078 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:03.268+0000 7f0690039700 1 -- 172.21.15.62:0/257616458 wait complete. 2024-02-13T14:34:04.078 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying unmanaged mon service... 2024-02-13T14:34:04.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:04 smithi062 bash[21479]: audit 2024-02-13T14:34:03.269152+0000 mon.a (mon.0) 60 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:34:04.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:04 smithi062 bash[21479]: cephadm 2024-02-13T14:34:03.269677+0000 mgr.y (mgr.14120) 15 : cephadm 1 Added host smithi062 2024-02-13T14:34:04.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:04 smithi062 bash[21479]: audit 2024-02-13T14:34:03.316945+0000 mon.a (mon.0) 61 : audit 0 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:34:06.598 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa675e99700 1 Processor -- start 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa675e99700 1 -- start start 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa675e99700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa670078e10 con 0x7fa670106630 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa670106630 0x7fa670108a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59786/0 (socket says 172.21.15.62:59786) 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66f7fe700 1 -- 172.21.15.62:0/2789457076 learned_addr learned my addr 172.21.15.62:0/2789457076 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66e7fc700 1 -- 172.21.15.62:0/2789457076 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832135428 0 0) 0x7fa670078e10 con 0x7fa670106630 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66e7fc700 1 -- 172.21.15.62:0/2789457076 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6580035b0 con 0x7fa670106630 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66e7fc700 1 -- 172.21.15.62:0/2789457076 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3970739964 0 0) 0x7fa6580035b0 con 0x7fa670106630 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66e7fc700 1 -- 172.21.15.62:0/2789457076 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67010b150 con 0x7fa670106630 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66e7fc700 1 -- 172.21.15.62:0/2789457076 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fa664001580 con 0x7fa670106630 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66e7fc700 1 -- 172.21.15.62:0/2789457076 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7fa664001c10 con 0x7fa670106630 2024-02-13T14:34:06.599 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.504+0000 7fa66e7fc700 1 -- 172.21.15.62:0/2789457076 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fa6640057b0 con 0x7fa670106630 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- 172.21.15.62:0/2789457076 >> v1:172.21.15.62:6789/0 conn(0x7fa670106630 legacy=0x7fa670108a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- 172.21.15.62:0/2789457076 shutdown_connections 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- 172.21.15.62:0/2789457076 >> 172.21.15.62:0/2789457076 conn(0x7fa6700fff80 msgr2=0x7fa6701023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- 172.21.15.62:0/2789457076 shutdown_connections 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- 172.21.15.62:0/2789457076 wait complete. 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 Processor -- start 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- start start 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa670199b60 con 0x7fa670106630 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa670106630 0x7fa670199450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59800/0 (socket says 172.21.15.62:59800) 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66f7fe700 1 -- 172.21.15.62:0/1994106150 learned_addr learned my addr 172.21.15.62:0/1994106150 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766613931 0 0) 0x7fa670199b60 con 0x7fa670106630 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa658005540 con 0x7fa670106630 2024-02-13T14:34:06.600 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 17199130 0 0) 0x7fa658005540 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa670199b60 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fa664001080 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3800454257 0 0) 0x7fa670199b60 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670199cf0 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa670199fa0 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa67019daf0 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1037+0+0 (unknown 978550493 0 0) 0x7fa664004900 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fa664006240 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7fa664011880 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c005120 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.508+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7fa664047a30 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.516+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fa6640130f0 con 0x7fa670106630 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.924+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 --> v1:172.21.15.62:6800/70089425 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fa65c000b90 con 0x7fa65803a2c0 2024-02-13T14:34:06.601 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.932+0000 7fa66cff9700 1 -- 172.21.15.62:0/1994106150 <== mgr.14120 v1:172.21.15.62:6800/70089425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 3265049985) 0x7fa65c000b90 con 0x7fa65803a2c0 2024-02-13T14:34:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.936+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 >> v1:172.21.15.62:6800/70089425 conn(0x7fa65803a2c0 legacy=0x7fa65803c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.936+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 >> v1:172.21.15.62:6789/0 conn(0x7fa670106630 legacy=0x7fa670199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.936+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 shutdown_connections 2024-02-13T14:34:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.936+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 >> 172.21.15.62:0/1994106150 conn(0x7fa6700fff80 msgr2=0x7fa670190250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.936+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 shutdown_connections 2024-02-13T14:34:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:05.936+0000 7fa675e99700 1 -- 172.21.15.62:0/1994106150 wait complete. 2024-02-13T14:34:06.602 INFO:teuthology.orchestra.run.smithi062.stdout:Deploying unmanaged mgr service... 2024-02-13T14:34:07.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:06 smithi062 bash[21479]: audit 2024-02-13T14:34:05.928829+0000 mgr.y (mgr.14120) 16 : audit 0 from='client.14142 v1:172.21.15.62:0/1994106150' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:34:07.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:06 smithi062 bash[21479]: cephadm 2024-02-13T14:34:05.932156+0000 mgr.y (mgr.14120) 17 : cephadm 1 Saving service mon spec with placement count:5 2024-02-13T14:34:07.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:06 smithi062 bash[21479]: audit 2024-02-13T14:34:05.935271+0000 mon.a (mon.0) 62 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:34:07.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:06 smithi062 bash[21479]: audit 2024-02-13T14:34:06.295762+0000 mon.a (mon.0) 63 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:34:07.235 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:06 smithi062 bash[21479]: audit 2024-02-13T14:34:06.837347+0000 mon.a (mon.0) 64 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:34:08.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:08 smithi062 bash[21479]: cluster 2024-02-13T14:34:07.053706+0000 mgr.y (mgr.14120) 18 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:08.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:08 smithi062 bash[21479]: audit 2024-02-13T14:34:07.858905+0000 mon.a (mon.0) 65 : audit 1 from='mgr.14120 v1:172.21.15.62:0/51446272' entity='mgr.y' 2024-02-13T14:34:08.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-13T14:34:08.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.436+0000 7f49275d3700 1 Processor -- start 2024-02-13T14:34:08.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.436+0000 7f49275d3700 1 -- start start 2024-02-13T14:34:08.465 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.436+0000 7f49275d3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f492007a390 con 0x7f492007b790 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.436+0000 7f492536f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f492007b790 0x7f4920079bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59816/0 (socket says 172.21.15.62:59816) 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.436+0000 7f492536f700 1 -- 172.21.15.62:0/1880597011 learned_addr learned my addr 172.21.15.62:0/1880597011 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.436+0000 7f4917fff700 1 -- 172.21.15.62:0/1880597011 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1434614300 0 0) 0x7f492007a390 con 0x7f492007b790 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.436+0000 7f4917fff700 1 -- 172.21.15.62:0/1880597011 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f490c0035b0 con 0x7f492007b790 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f4917fff700 1 -- 172.21.15.62:0/1880597011 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362113925 0 0) 0x7f490c0035b0 con 0x7f492007b790 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f4917fff700 1 -- 172.21.15.62:0/1880597011 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4920109500 con 0x7f492007b790 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f4917fff700 1 -- 172.21.15.62:0/1880597011 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f491c001580 con 0x7f492007b790 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f4917fff700 1 -- 172.21.15.62:0/1880597011 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f491c001d00 con 0x7f492007b790 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f4917fff700 1 -- 172.21.15.62:0/1880597011 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f491c005960 con 0x7f492007b790 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- 172.21.15.62:0/1880597011 >> v1:172.21.15.62:6789/0 conn(0x7f492007b790 legacy=0x7f4920079bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- 172.21.15.62:0/1880597011 shutdown_connections 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- 172.21.15.62:0/1880597011 >> 172.21.15.62:0/1880597011 conn(0x7f49201010b0 msgr2=0x7f49201034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- 172.21.15.62:0/1880597011 shutdown_connections 2024-02-13T14:34:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- 172.21.15.62:0/1880597011 wait complete. 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 Processor -- start 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- start start 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f49201a0170 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f492536f700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f492007b790 0x7f492019fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59828/0 (socket says 172.21.15.62:59828) 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f492536f700 1 -- 172.21.15.62:0/319664710 learned_addr learned my addr 172.21.15.62:0/319664710 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330802589 0 0) 0x7f49201a0170 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f490c0054f0 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2455352841 0 0) 0x7f490c0054f0 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f49201a0170 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f491c001080 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 186380543 0 0) 0x7f49201a0170 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49201a0300 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49201a05b0 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f49201a4100 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f491c004a60 con 0x7f492007b790 2024-02-13T14:34:08.467 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.440+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f491c006210 con 0x7f492007b790 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.444+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7f491c011790 con 0x7f492007b790 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.444+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f491c047990 con 0x7f492007b790 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.444+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4904005150 con 0x7f492007b790 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.448+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f491c012ff0 con 0x7f492007b790 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.848+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 --> v1:172.21.15.62:6800/70089425 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f4904000bc0 con 0x7f490c03a370 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.856+0000 7f49167fc700 1 -- 172.21.15.62:0/319664710 <== mgr.14120 v1:172.21.15.62:6800/70089425 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 325935098) 0x7f4904000bc0 con 0x7f490c03a370 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.860+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 >> v1:172.21.15.62:6800/70089425 conn(0x7f490c03a370 legacy=0x7f490c03c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.860+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 >> v1:172.21.15.62:6789/0 conn(0x7f492007b790 legacy=0x7f492019fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.860+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 shutdown_connections 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.860+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 >> 172.21.15.62:0/319664710 conn(0x7f49201010b0 msgr2=0x7f4920107860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.860+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 shutdown_connections 2024-02-13T14:34:08.468 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:07.860+0000 7f49275d3700 1 -- 172.21.15.62:0/319664710 wait complete. 2024-02-13T14:34:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:09 smithi062 bash[21479]: audit 2024-02-13T14:34:07.853041+0000 mgr.y (mgr.14120) 19 : audit 0 from='client.14144 v1:172.21.15.62:0/319664710' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:34:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:09 smithi062 bash[21479]: cephadm 2024-02-13T14:34:07.854567+0000 mgr.y (mgr.14120) 20 : cephadm 1 Saving service mgr spec with placement count:2 2024-02-13T14:34:10.359 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 Processor -- start 2024-02-13T14:34:10.359 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- start start 2024-02-13T14:34:10.359 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbb0807a330 con 0x7fbb0807b730 2024-02-13T14:34:10.359 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0cfa8700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbb0807b730 0x7fbb08079b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59832/0 (socket says 172.21.15.62:59832) 2024-02-13T14:34:10.359 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0cfa8700 1 -- 172.21.15.62:0/2152632251 learned_addr learned my addr 172.21.15.62:0/2152632251 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:10.359 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb077fe700 1 -- 172.21.15.62:0/2152632251 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388209823 0 0) 0x7fbb0807a330 con 0x7fbb0807b730 2024-02-13T14:34:10.359 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb077fe700 1 -- 172.21.15.62:0/2152632251 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf00035b0 con 0x7fbb0807b730 2024-02-13T14:34:10.360 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb077fe700 1 -- 172.21.15.62:0/2152632251 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1370937292 0 0) 0x7fbaf00035b0 con 0x7fbb0807b730 2024-02-13T14:34:10.360 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb077fe700 1 -- 172.21.15.62:0/2152632251 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0807a4c0 con 0x7fbb0807b730 2024-02-13T14:34:10.361 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb077fe700 1 -- 172.21.15.62:0/2152632251 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fbafc001580 con 0x7fbb0807b730 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb077fe700 1 -- 172.21.15.62:0/2152632251 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fbafc001c30 con 0x7fbb0807b730 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb077fe700 1 -- 172.21.15.62:0/2152632251 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fbafc0057e0 con 0x7fbb0807b730 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- 172.21.15.62:0/2152632251 >> v1:172.21.15.62:6789/0 conn(0x7fbb0807b730 legacy=0x7fbb08079b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- 172.21.15.62:0/2152632251 shutdown_connections 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- 172.21.15.62:0/2152632251 >> 172.21.15.62:0/2152632251 conn(0x7fbb081010b0 msgr2=0x7fbb081034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- 172.21.15.62:0/2152632251 shutdown_connections 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- 172.21.15.62:0/2152632251 wait complete. 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 Processor -- start 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- start start 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0f20c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbb0819bd80 con 0x7fbb0807b730 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0cfa8700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbb0807b730 0x7fbb0819b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59836/0 (socket says 172.21.15.62:59836) 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb0cfa8700 1 -- 172.21.15.62:0/108754392 learned_addr learned my addr 172.21.15.62:0/108754392 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759257302 0 0) 0x7fbb0819bd80 con 0x7fbb0807b730 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.320+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0005540 con 0x7fbb0807b730 2024-02-13T14:34:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1161898055 0 0) 0x7fbaf0005540 con 0x7fbb0807b730 2024-02-13T14:34:10.363 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbb0819bd80 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fbafc000ed0 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1310789949 0 0) 0x7fbb0819bd80 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0819bf10 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb0819c1c0 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0819fd10 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fbafc001a50 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fbafc006250 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7fbafc0074e0 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7fbafc0485d0 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.324+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaf4005150 con 0x7fbb0807b730 2024-02-13T14:34:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.328+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fbafc0082d0 con 0x7fbb0807b730 2024-02-13T14:34:10.366 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.700+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 --> v1:172.21.15.62:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fbaf4005400 con 0x7fbb0807b730 2024-02-13T14:34:10.366 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.704+0000 7fbb05ffb700 1 -- 172.21.15.62:0/108754392 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (unknown 2684808024 0 0) 0x7fbafc016950 con 0x7fbb0807b730 2024-02-13T14:34:10.366 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.708+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 >> v1:172.21.15.62:6800/70089425 conn(0x7fbaf003a360 legacy=0x7fbaf003c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:10.366 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.708+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 >> v1:172.21.15.62:6789/0 conn(0x7fbb0807b730 legacy=0x7fbb0819b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:10.366 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.708+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 shutdown_connections 2024-02-13T14:34:10.366 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.708+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 >> 172.21.15.62:0/108754392 conn(0x7fbb081010b0 msgr2=0x7fbb0810a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:10.366 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.708+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 shutdown_connections 2024-02-13T14:34:10.366 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:09.708+0000 7fbb0f20c700 1 -- 172.21.15.62:0/108754392 wait complete. 2024-02-13T14:34:10.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:10 smithi062 bash[21479]: cluster 2024-02-13T14:34:09.054235+0000 mgr.y (mgr.14120) 21 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:10.963 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:10 smithi062 bash[21479]: audit 2024-02-13T14:34:09.710251+0000 mon.a (mon.0) 66 : audit 1 from='client.? v1:172.21.15.62:0/108754392' entity='client.admin' 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2cecb02700 1 Processor -- start 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2cecb02700 1 -- start start 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2cecb02700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2ce8108ea0 con 0x7f2ce8106090 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2ce8106090 0x7f2ce81064b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59844/0 (socket says 172.21.15.62:59844) 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce659c700 1 -- 172.21.15.62:0/2386242220 learned_addr learned my addr 172.21.15.62:0/2386242220 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce559a700 1 -- 172.21.15.62:0/2386242220 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095713071 0 0) 0x7f2ce8108ea0 con 0x7f2ce8106090 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce559a700 1 -- 172.21.15.62:0/2386242220 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd40057c0 con 0x7f2ce8106090 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce559a700 1 -- 172.21.15.62:0/2386242220 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 875067827 0 0) 0x7f2cd40057c0 con 0x7f2ce8106090 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce559a700 1 -- 172.21.15.62:0/2386242220 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce810a040 con 0x7f2ce8106090 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce559a700 1 -- 172.21.15.62:0/2386242220 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f2cd8001580 con 0x7f2ce8106090 2024-02-13T14:34:12.186 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce559a700 1 -- 172.21.15.62:0/2386242220 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f2cd8001d00 con 0x7f2ce8106090 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2ce559a700 1 -- 172.21.15.62:0/2386242220 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f2cd8005960 con 0x7f2ce8106090 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2cecb02700 1 -- 172.21.15.62:0/2386242220 >> v1:172.21.15.62:6789/0 conn(0x7f2ce8106090 legacy=0x7f2ce81064b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2cecb02700 1 -- 172.21.15.62:0/2386242220 shutdown_connections 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2cecb02700 1 -- 172.21.15.62:0/2386242220 >> 172.21.15.62:0/2386242220 conn(0x7f2ce80ff730 msgr2=0x7f2ce8101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2cecb02700 1 -- 172.21.15.62:0/2386242220 shutdown_connections 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.172+0000 7f2cecb02700 1 -- 172.21.15.62:0/2386242220 wait complete. 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cecb02700 1 Processor -- start 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cecb02700 1 -- start start 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cecb02700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2ce8197940 con 0x7f2ce8106090 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2ce659c700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2ce8106090 0x7f2ce8197230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59846/0 (socket says 172.21.15.62:59846) 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2ce659c700 1 -- 172.21.15.62:0/2457605057 learned_addr learned my addr 172.21.15.62:0/2457605057 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725705733 0 0) 0x7f2ce8197940 con 0x7f2ce8106090 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cd4007700 con 0x7f2ce8106090 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 114498579 0 0) 0x7f2cd4007700 con 0x7f2ce8106090 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2ce8197940 con 0x7f2ce8106090 2024-02-13T14:34:12.187 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f2cd8001080 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2067305569 0 0) 0x7f2ce8197940 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8197ad0 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce8197d80 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce819b8d0 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f2cd80059b0 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f2cd8006260 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7f2cd80063c0 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cc8005150 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.176+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f2cd8047730 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.184+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f2cd8006c20 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.560+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 --> v1:172.21.15.62:6789/0 -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f2cc8005980 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.564+0000 7f2cdf7fe700 1 -- 172.21.15.62:0/2457605057 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (unknown 1496729260 0 0) 0x7f2cd8015100 con 0x7f2ce8106090 2024-02-13T14:34:12.188 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.564+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 >> v1:172.21.15.62:6800/70089425 conn(0x7f2cd403c580 legacy=0x7f2cd403ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:12.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.564+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 >> v1:172.21.15.62:6789/0 conn(0x7f2ce8106090 legacy=0x7f2ce8197230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:12.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.568+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 shutdown_connections 2024-02-13T14:34:12.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.568+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 >> 172.21.15.62:0/2457605057 conn(0x7f2ce80ff730 msgr2=0x7f2ce8101b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:12.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.568+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 shutdown_connections 2024-02-13T14:34:12.189 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:11.568+0000 7f2cecb02700 1 -- 172.21.15.62:0/2457605057 wait complete. 2024-02-13T14:34:12.189 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling the dashboard module... 2024-02-13T14:34:12.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:12 smithi062 bash[21479]: cluster 2024-02-13T14:34:11.054583+0000 mgr.y (mgr.14120) 22 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:12.887 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:12 smithi062 bash[21479]: audit 2024-02-13T14:34:11.567373+0000 mon.a (mon.0) 67 : audit 1 from='client.? v1:172.21.15.62:0/2457605057' entity='client.admin' 2024-02-13T14:34:14.928 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:14 smithi062 bash[21479]: cluster 2024-02-13T14:34:13.054893+0000 mgr.y (mgr.14120) 23 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:14.928 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:14 smithi062 bash[21479]: audit 2024-02-13T14:34:13.597003+0000 mon.a (mon.0) 68 : audit 1 from='client.? v1:172.21.15.62:0/3561380798' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-13T14:34:14.929 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:14 smithi062 bash[21731]: ignoring --setuser ceph since I am not root 2024-02-13T14:34:14.929 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:14 smithi062 bash[21731]: ignoring --setgroup ceph since I am not root 2024-02-13T14:34:14.929 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:14 smithi062 bash[21731]: debug 2024-02-13T14:34:14.788+0000 7fc850066200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.092+0000 7f213a680700 1 Processor -- start 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.092+0000 7f213a680700 1 -- start start 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.092+0000 7f213a680700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f213410c140 con 0x7f2134107d10 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.092+0000 7f2133fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2134107d10 0x7f2134108130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42118/0 (socket says 172.21.15.62:42118) 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.092+0000 7f2133fff700 1 -- 172.21.15.62:0/1101720031 learned_addr learned my addr 172.21.15.62:0/1101720031 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2132ffd700 1 -- 172.21.15.62:0/1101720031 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733856593 0 0) 0x7f213410c140 con 0x7f2134107d10 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2132ffd700 1 -- 172.21.15.62:0/1101720031 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21200035b0 con 0x7f2134107d10 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2132ffd700 1 -- 172.21.15.62:0/1101720031 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2168898649 0 0) 0x7f21200035b0 con 0x7f2134107d10 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2132ffd700 1 -- 172.21.15.62:0/1101720031 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213410d2e0 con 0x7f2134107d10 2024-02-13T14:34:15.272 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2132ffd700 1 -- 172.21.15.62:0/1101720031 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f2124001580 con 0x7f2134107d10 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2132ffd700 1 -- 172.21.15.62:0/1101720031 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f2124001d00 con 0x7f2134107d10 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2132ffd700 1 -- 172.21.15.62:0/1101720031 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f2124005960 con 0x7f2134107d10 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- 172.21.15.62:0/1101720031 >> v1:172.21.15.62:6789/0 conn(0x7f2134107d10 legacy=0x7f2134108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- 172.21.15.62:0/1101720031 shutdown_connections 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- 172.21.15.62:0/1101720031 >> 172.21.15.62:0/1101720031 conn(0x7f213407b0e0 msgr2=0x7f2134105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- 172.21.15.62:0/1101720031 shutdown_connections 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- 172.21.15.62:0/1101720031 wait complete. 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 Processor -- start 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- start start 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f213419bd60 con 0x7f2134107d10 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2133fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f2134107d10 0x7f213419b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42130/0 (socket says 172.21.15.62:42130) 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f2133fff700 1 -- 172.21.15.62:0/3561380798 learned_addr learned my addr 172.21.15.62:0/3561380798 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664475644 0 0) 0x7f213419bd60 con 0x7f2134107d10 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21200054f0 con 0x7f2134107d10 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1343473172 0 0) 0x7f21200054f0 con 0x7f2134107d10 2024-02-13T14:34:15.273 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f213419bd60 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f2124001080 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1599479557 0 0) 0x7f213419bd60 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f213419bef0 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213419c1a0 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f213419fcf0 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f21240049f0 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.096+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f2124006130 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.100+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 8) v1 ==== 46069+0+0 (unknown 1034045737 0 0) 0x7f21240116b0 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.100+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2114005120 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.100+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f2124047860 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.104+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f2124016c20 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:13.592+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f21140053d0 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:14.572+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (unknown 1498667528 0 0) 0x7f2124014ff0 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:14.576+0000 7f21317fa700 1 -- 172.21.15.62:0/3561380798 <== mon.0 v1:172.21.15.62:6789/0 11 ==== mgrmap(e 9) v1 ==== 46082+0+0 (unknown 2084490633 0 0) 0x7f21240461a0 con 0x7f2134107d10 2024-02-13T14:34:15.274 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:14.576+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 >> v1:172.21.15.62:6800/70089425 conn(0x7f212003a410 legacy=0x7f212003c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:15.275 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:14.576+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 >> v1:172.21.15.62:6789/0 conn(0x7f2134107d10 legacy=0x7f213419b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:15.275 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:14.576+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 shutdown_connections 2024-02-13T14:34:15.275 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:14.576+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 >> 172.21.15.62:0/3561380798 conn(0x7f213407b0e0 msgr2=0x7f21341924c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:15.275 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:14.576+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 shutdown_connections 2024-02-13T14:34:15.275 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:14.576+0000 7f213a680700 1 -- 172.21.15.62:0/3561380798 wait complete. 2024-02-13T14:34:15.902 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:15 smithi062 bash[21479]: audit 2024-02-13T14:34:14.574655+0000 mon.a (mon.0) 69 : audit 1 from='client.? v1:172.21.15.62:0/3561380798' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-13T14:34:15.902 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:15 smithi062 bash[21479]: cluster 2024-02-13T14:34:14.580353+0000 mon.a (mon.0) 70 : cluster 0 mgrmap e9: y(active, since 27s) 2024-02-13T14:34:16.794 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:16 smithi062 bash[21479]: audit 2024-02-13T14:34:16.600128+0000 mon.a (mon.0) 71 : audit 0 from='client.? v1:172.21.15.62:0/2042185753' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-13T14:34:16.794 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:16 smithi062 bash[21731]: debug 2024-02-13T14:34:16.432+0000 7fc850066200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T14:34:16.794 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:16 smithi062 bash[21731]: debug 2024-02-13T14:34:16.532+0000 7fc850066200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T14:34:16.795 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:16 smithi062 bash[21731]: debug 2024-02-13T14:34:16.788+0000 7fc850066200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "active_name": "y", 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 Processor -- start 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- start start 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4b84078e90 con 0x7f4b841043a0 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b83fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4b841043a0 0x7f4b841047c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42164/0 (socket says 172.21.15.62:42164) 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b83fff700 1 -- 172.21.15.62:0/3371499864 learned_addr learned my addr 172.21.15.62:0/3371499864 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b82ffd700 1 -- 172.21.15.62:0/3371499864 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417447697 0 0) 0x7f4b84078e90 con 0x7f4b841043a0 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b82ffd700 1 -- 172.21.15.62:0/3371499864 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b6c0035b0 con 0x7f4b841043a0 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b82ffd700 1 -- 172.21.15.62:0/3371499864 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2746550307 0 0) 0x7f4b6c0035b0 con 0x7f4b841043a0 2024-02-13T14:34:17.145 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b82ffd700 1 -- 172.21.15.62:0/3371499864 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b84105ee0 con 0x7f4b841043a0 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b82ffd700 1 -- 172.21.15.62:0/3371499864 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4b74001580 con 0x7f4b841043a0 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b82ffd700 1 -- 172.21.15.62:0/3371499864 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f4b74001d00 con 0x7f4b841043a0 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b82ffd700 1 -- 172.21.15.62:0/3371499864 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4b74005960 con 0x7f4b841043a0 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- 172.21.15.62:0/3371499864 >> v1:172.21.15.62:6789/0 conn(0x7f4b841043a0 legacy=0x7f4b841047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- 172.21.15.62:0/3371499864 shutdown_connections 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- 172.21.15.62:0/3371499864 >> 172.21.15.62:0/3371499864 conn(0x7f4b840fff80 msgr2=0x7f4b841023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- 172.21.15.62:0/3371499864 shutdown_connections 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- 172.21.15.62:0/3371499864 wait complete. 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 Processor -- start 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- start start 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b8a75f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4b8419bd70 con 0x7f4b841043a0 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b83fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4b841043a0 0x7f4b8419b660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42178/0 (socket says 172.21.15.62:42178) 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b83fff700 1 -- 172.21.15.62:0/2042185753 learned_addr learned my addr 172.21.15.62:0/2042185753 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392272085 0 0) 0x7f4b8419bd70 con 0x7f4b841043a0 2024-02-13T14:34:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b6c0054f0 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.096+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3260867691 0 0) 0x7f4b6c0054f0 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4b8419bd70 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4b74001080 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 97106893 0 0) 0x7f4b8419bd70 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8419bf00 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b8419c1b0 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b8419fd00 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f4b74004a60 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4b740062a0 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 9) v1 ==== 46082+0+0 (unknown 2084490633 0 0) 0x7f4b74006420 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f4b74048520 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b837fe700 1 -- 172.21.15.62:0/2042185753 >> v1:172.21.15.62:6800/70089425 conn(0x7f4b6c03a420 legacy=0x7f4b6c03c8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/70089425 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.100+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b70005120 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.104+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f4b74007cd0 con 0x7f4b841043a0 2024-02-13T14:34:17.147 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.304+0000 7f4b837fe700 1 -- 172.21.15.62:0/2042185753 >> v1:172.21.15.62:6800/70089425 conn(0x7f4b6c03a420 legacy=0x7f4b6c03c8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/70089425 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.596+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f4b70005be0 con 0x7f4b841043a0 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.596+0000 7f4b817fa700 1 -- 172.21.15.62:0/2042185753 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (unknown 2005831594 0 1748205903) 0x7f4b740168a0 con 0x7f4b841043a0 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.600+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 >> v1:172.21.15.62:6800/70089425 conn(0x7f4b6c03a420 legacy=0x7f4b6c03c8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.600+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 >> v1:172.21.15.62:6789/0 conn(0x7f4b841043a0 legacy=0x7f4b8419b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.600+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 shutdown_connections 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.600+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 >> 172.21.15.62:0/2042185753 conn(0x7f4b840fff80 msgr2=0x7f4b841023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.600+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 shutdown_connections 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:16.600+0000 7f4b8a75f700 1 -- 172.21.15.62:0/2042185753 wait complete. 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for the mgr to restart... 2024-02-13T14:34:17.148 INFO:teuthology.orchestra.run.smithi062.stdout:Waiting for mgr epoch 9... 2024-02-13T14:34:18.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:17 smithi062 bash[21731]: debug 2024-02-13T14:34:17.620+0000 7fc850066200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T14:34:18.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:17 smithi062 bash[21731]: debug 2024-02-13T14:34:17.736+0000 7fc850066200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T14:34:18.062 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:17 smithi062 bash[21731]: debug 2024-02-13T14:34:17.844+0000 7fc850066200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T14:34:18.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:18 smithi062 bash[21731]: debug 2024-02-13T14:34:18.216+0000 7fc850066200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-13T14:34:18.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:18 smithi062 bash[21731]: debug 2024-02-13T14:34:18.332+0000 7fc850066200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T14:34:18.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:18 smithi062 bash[21731]: debug 2024-02-13T14:34:18.440+0000 7fc850066200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T14:34:19.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:18 smithi062 bash[21731]: debug 2024-02-13T14:34:18.812+0000 7fc850066200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T14:34:19.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:19 smithi062 bash[21731]: debug 2024-02-13T14:34:19.056+0000 7fc850066200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T14:34:19.735 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:19 smithi062 bash[21731]: debug 2024-02-13T14:34:19.328+0000 7fc850066200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T14:34:19.735 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:19 smithi062 bash[21731]: debug 2024-02-13T14:34:19.448+0000 7fc850066200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T14:34:20.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:19 smithi062 bash[21731]: debug 2024-02-13T14:34:19.732+0000 7fc850066200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T14:34:20.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:19 smithi062 bash[21731]: debug 2024-02-13T14:34:19.984+0000 7fc850066200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:34:20.795 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:20 smithi062 bash[21731]: debug 2024-02-13T14:34:20.408+0000 7fc850066200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T14:34:20.795 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:20 smithi062 bash[21731]: debug 2024-02-13T14:34:20.532+0000 7fc850066200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T14:34:22.266 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:20 smithi062 bash[21731]: debug 2024-02-13T14:34:20.792+0000 7fc850066200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:34:22.266 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:21 smithi062 bash[21731]: debug 2024-02-13T14:34:21.836+0000 7fc850066200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T14:34:22.266 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:21 smithi062 bash[21731]: debug 2024-02-13T14:34:21.956+0000 7fc850066200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T14:34:22.266 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:22 smithi062 bash[21731]: debug 2024-02-13T14:34:22.260+0000 7fc850066200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T14:34:22.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:22 smithi062 bash[21731]: debug 2024-02-13T14:34:22.380+0000 7fc850066200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-13T14:34:23.119 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:22 smithi062 bash[21731]: debug 2024-02-13T14:34:22.852+0000 7fc850066200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:34:22 smithi062 bash[21731]: debug 2024-02-13T14:34:22.976+0000 7fc850066200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: cluster 2024-02-13T14:34:23.004233+0000 mon.a (mon.0) 72 : cluster 1 Active manager daemon y restarted 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: cluster 2024-02-13T14:34:23.004837+0000 mon.a (mon.0) 73 : cluster 1 Activating manager daemon y 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: cluster 2024-02-13T14:34:23.008431+0000 mon.a (mon.0) 74 : cluster 0 osdmap e3: 0 total, 0 up, 0 in 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: cluster 2024-02-13T14:34:23.008621+0000 mon.a (mon.0) 75 : cluster 0 mgrmap e10: y(active, starting, since 0.00400049s) 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: audit 2024-02-13T14:34:23.012465+0000 mon.a (mon.0) 76 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: audit 2024-02-13T14:34:23.013947+0000 mon.a (mon.0) 77 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: audit 2024-02-13T14:34:23.015231+0000 mon.a (mon.0) 78 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T14:34:23.120 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: audit 2024-02-13T14:34:23.015644+0000 mon.a (mon.0) 79 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T14:34:23.121 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: audit 2024-02-13T14:34:23.015834+0000 mon.a (mon.0) 80 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T14:34:23.121 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:23 smithi062 bash[21479]: cluster 2024-02-13T14:34:23.040919+0000 mon.a (mon.0) 81 : cluster 1 Manager daemon y is now available 2024-02-13T14:34:24.327 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: audit 2024-02-13T14:34:23.068329+0000 mon.a (mon.0) 82 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:34:24.327 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: audit 2024-02-13T14:34:23.070642+0000 mon.a (mon.0) 83 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:34:24.327 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: audit 2024-02-13T14:34:23.087520+0000 mon.a (mon.0) 84 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:34:24.327 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: audit 2024-02-13T14:34:23.090463+0000 mon.a (mon.0) 85 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:34:24.327 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: cephadm 2024-02-13T14:34:23.395631+0000 mgr.y (mgr.14152) 1 : cephadm 1 [13/Feb/2024:14:34:23] ENGINE Bus STARTING 2024-02-13T14:34:24.328 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: cephadm 2024-02-13T14:34:23.519229+0000 mgr.y (mgr.14152) 2 : cephadm 1 [13/Feb/2024:14:34:23] ENGINE Serving on https://172.21.15.62:7150 2024-02-13T14:34:24.328 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: cephadm 2024-02-13T14:34:23.620606+0000 mgr.y (mgr.14152) 3 : cephadm 1 [13/Feb/2024:14:34:23] ENGINE Serving on http://172.21.15.62:8765 2024-02-13T14:34:24.328 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: cephadm 2024-02-13T14:34:23.620713+0000 mgr.y (mgr.14152) 4 : cephadm 1 [13/Feb/2024:14:34:23] ENGINE Bus STARTED 2024-02-13T14:34:24.328 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:24 smithi062 bash[21479]: cluster 2024-02-13T14:34:24.017878+0000 mon.a (mon.0) 86 : cluster 0 mgrmap e11: y(active, since 1.01324s) 2024-02-13T14:34:24.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout { 2024-02-13T14:34:24.741 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout } 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a9587700 1 Processor -- start 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a9587700 1 -- start start 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a9587700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f87a4078ed0 con 0x7f87a4104360 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a2ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f87a4104360 0x7f87a4104780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42182/0 (socket says 172.21.15.62:42182) 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a2ffd700 1 -- 172.21.15.62:0/1053960644 learned_addr learned my addr 172.21.15.62:0/1053960644 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a1ffb700 1 -- 172.21.15.62:0/1053960644 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594560639 0 0) 0x7f87a4078ed0 con 0x7f87a4104360 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a1ffb700 1 -- 172.21.15.62:0/1053960644 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f878c0035b0 con 0x7f87a4104360 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a1ffb700 1 -- 172.21.15.62:0/1053960644 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 963687161 0 0) 0x7f878c0035b0 con 0x7f87a4104360 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a1ffb700 1 -- 172.21.15.62:0/1053960644 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a4105ea0 con 0x7f87a4104360 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a1ffb700 1 -- 172.21.15.62:0/1053960644 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f8798001580 con 0x7f87a4104360 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a1ffb700 1 -- 172.21.15.62:0/1053960644 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f8798001c30 con 0x7f87a4104360 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.960+0000 7f87a1ffb700 1 -- 172.21.15.62:0/1053960644 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f87980057e0 con 0x7f87a4104360 2024-02-13T14:34:24.742 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- 172.21.15.62:0/1053960644 >> v1:172.21.15.62:6789/0 conn(0x7f87a4104360 legacy=0x7f87a4104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- 172.21.15.62:0/1053960644 shutdown_connections 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- 172.21.15.62:0/1053960644 >> 172.21.15.62:0/1053960644 conn(0x7f87a40fff80 msgr2=0x7f87a41023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- 172.21.15.62:0/1053960644 shutdown_connections 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- 172.21.15.62:0/1053960644 wait complete. 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 Processor -- start 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- start start 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f87a419bd90 con 0x7f87a4104360 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a2ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f87a4104360 0x7f87a419b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42198/0 (socket says 172.21.15.62:42198) 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a2ffd700 1 -- 172.21.15.62:0/3391942470 learned_addr learned my addr 172.21.15.62:0/3391942470 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599374465 0 0) 0x7f87a419bd90 con 0x7f87a4104360 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f878c005540 con 0x7f87a4104360 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1276235175 0 0) 0x7f878c005540 con 0x7f87a4104360 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f87a419bd90 con 0x7f87a4104360 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f8798001080 con 0x7f87a4104360 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1477255066 0 0) 0x7f87a419bd90 con 0x7f87a4104360 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a419bf20 con 0x7f87a4104360 2024-02-13T14:34:24.743 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a419c1d0 con 0x7f87a4104360 2024-02-13T14:34:24.744 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a419fd20 con 0x7f87a4104360 2024-02-13T14:34:24.744 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f8798001a90 con 0x7f87a4104360 2024-02-13T14:34:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f87980062a0 con 0x7f87a4104360 2024-02-13T14:34:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 9) v1 ==== 46082+0+0 (unknown 2084490633 0 0) 0x7f87980118f0 con 0x7f87a4104360 2024-02-13T14:34:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 --> v1:172.21.15.62:6800/70089425 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8798001a90 con 0x7f878c039fc0 2024-02-13T14:34:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(2..2 src has 1..2) v4 ==== 897+0+0 (unknown 95550437 0 0) 0x7f87980477d0 con 0x7f87a4104360 2024-02-13T14:34:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:17.964+0000 7f87a27fc700 1 -- 172.21.15.62:0/3391942470 >> v1:172.21.15.62:6800/70089425 conn(0x7f878c039fc0 legacy=0x7f878c03c480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/70089425 2024-02-13T14:34:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:18.168+0000 7f87a27fc700 1 -- 172.21.15.62:0/3391942470 >> v1:172.21.15.62:6800/70089425 conn(0x7f878c039fc0 legacy=0x7f878c03c480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/70089425 2024-02-13T14:34:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:18.572+0000 7f87a27fc700 1 -- 172.21.15.62:0/3391942470 >> v1:172.21.15.62:6800/70089425 conn(0x7f878c039fc0 legacy=0x7f878c03c480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/70089425 2024-02-13T14:34:24.746 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:19.376+0000 7f87a27fc700 1 -- 172.21.15.62:0/3391942470 >> v1:172.21.15.62:6800/70089425 conn(0x7f878c039fc0 legacy=0x7f878c03c480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/70089425 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:20.980+0000 7f87a27fc700 1 -- 172.21.15.62:0/3391942470 >> v1:172.21.15.62:6800/70089425 conn(0x7f878c039fc0 legacy=0x7f878c03c480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/70089425 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:23.004+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mgrmap(e 10) v1 ==== 45884+0+0 (unknown 534298693 0 0) 0x7f8798012e20 con 0x7f87a4104360 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:23.004+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 >> v1:172.21.15.62:6800/70089425 conn(0x7f878c039fc0 legacy=0x7f878c03c480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.008+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mgrmap(e 11) v1 ==== 45976+0+0 (unknown 4221185215 0 0) 0x7f8798048b20 con 0x7f87a4104360 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.008+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 --> v1:172.21.15.62:6800/1926838190 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8798001a90 con 0x7f878c03ea30 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.012+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (unknown 0 0 4109177037) 0x7f8798001a90 con 0x7f878c03ea30 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.024+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 --> v1:172.21.15.62:6800/1926838190 -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f8790002630 con 0x7f878c03ea30 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.024+0000 7f878bfff700 1 -- 172.21.15.62:0/3391942470 <== mgr.14152 v1:172.21.15.62:6800/1926838190 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (unknown 0 0 3086460295) 0x7f8790002630 con 0x7f878c03ea30 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.024+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 >> v1:172.21.15.62:6800/1926838190 conn(0x7f878c03ea30 legacy=0x7f878c040e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.024+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 >> v1:172.21.15.62:6789/0 conn(0x7f87a4104360 legacy=0x7f87a419b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.024+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 shutdown_connections 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.024+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 >> 172.21.15.62:0/3391942470 conn(0x7f87a40fff80 msgr2=0x7f87a41023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.024+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 shutdown_connections 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:24.024+0000 7f87a9587700 1 -- 172.21.15.62:0/3391942470 wait complete. 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:mgr epoch 9 is available 2024-02-13T14:34:24.747 INFO:teuthology.orchestra.run.smithi062.stdout:Generating a dashboard self-signed certificate... 2024-02-13T14:34:25.319 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:25 smithi062 bash[21479]: audit 2024-02-13T14:34:24.015152+0000 mgr.y (mgr.14152) 5 : audit 0 from='client.14156 v1:172.21.15.62:0/3391942470' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-13T14:34:25.319 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:25 smithi062 bash[21479]: audit 2024-02-13T14:34:24.028493+0000 mgr.y (mgr.14152) 6 : audit 0 from='client.14156 v1:172.21.15.62:0/3391942470' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-13T14:34:26.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:26 smithi062 bash[21479]: cluster 2024-02-13T14:34:25.063940+0000 mon.a (mon.0) 87 : cluster 0 mgrmap e12: y(active, since 2s) 2024-02-13T14:34:26.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:26 smithi062 bash[21479]: audit 2024-02-13T14:34:26.011852+0000 mon.a (mon.0) 88 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:26.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:26 smithi062 bash[21479]: audit 2024-02-13T14:34:26.015385+0000 mon.a (mon.0) 89 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:26.630 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f03a2abc700 1 Processor -- start 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f03a2abc700 1 -- start start 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f03a2abc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f039c109f20 con 0x7f039c105af0 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f03a0858700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f039c105af0 0x7f039c105f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42742/0 (socket says 172.21.15.62:42742) 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f03a0858700 1 -- 172.21.15.62:0/2746153462 learned_addr learned my addr 172.21.15.62:0/2746153462 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f039b7fe700 1 -- 172.21.15.62:0/2746153462 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346110283 0 0) 0x7f039c109f20 con 0x7f039c105af0 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f039b7fe700 1 -- 172.21.15.62:0/2746153462 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c0035b0 con 0x7f039c105af0 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f039b7fe700 1 -- 172.21.15.62:0/2746153462 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2291751265 0 0) 0x7f038c0035b0 con 0x7f039c105af0 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f039b7fe700 1 -- 172.21.15.62:0/2746153462 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c10b0c0 con 0x7f039c105af0 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f039b7fe700 1 -- 172.21.15.62:0/2746153462 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0390001580 con 0x7f039c105af0 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f039b7fe700 1 -- 172.21.15.62:0/2746153462 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f0390001d00 con 0x7f039c105af0 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f039b7fe700 1 -- 172.21.15.62:0/2746153462 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0390005960 con 0x7f039c105af0 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.520+0000 7f03a2abc700 1 -- 172.21.15.62:0/2746153462 >> v1:172.21.15.62:6789/0 conn(0x7f039c105af0 legacy=0x7f039c105f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:26.631 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- 172.21.15.62:0/2746153462 shutdown_connections 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- 172.21.15.62:0/2746153462 >> 172.21.15.62:0/2746153462 conn(0x7f039c101070 msgr2=0x7f039c1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- 172.21.15.62:0/2746153462 shutdown_connections 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- 172.21.15.62:0/2746153462 wait complete. 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 Processor -- start 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- start start 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f039c199ae0 con 0x7f039c105af0 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a0858700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f039c105af0 0x7f039c1993d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42758/0 (socket says 172.21.15.62:42758) 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a0858700 1 -- 172.21.15.62:0/873324397 learned_addr learned my addr 172.21.15.62:0/873324397 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1208099524 0 0) 0x7f039c199ae0 con 0x7f039c105af0 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c0054f0 con 0x7f039c105af0 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1873055977 0 0) 0x7f038c0054f0 con 0x7f039c105af0 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f039c199ae0 con 0x7f039c105af0 2024-02-13T14:34:26.632 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0390001080 con 0x7f039c105af0 2024-02-13T14:34:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3515751169 0 0) 0x7f039c199ae0 con 0x7f039c105af0 2024-02-13T14:34:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c199c70 con 0x7f039c105af0 2024-02-13T14:34:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039c199f20 con 0x7f039c105af0 2024-02-13T14:34:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f039c19da70 con 0x7f039c105af0 2024-02-13T14:34:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f03900049f0 con 0x7f039c105af0 2024-02-13T14:34:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0390006130 con 0x7f039c105af0 2024-02-13T14:34:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 12) v1 ==== 46082+0+0 (unknown 969868272 0 0) 0x7f03900116c0 con 0x7f039c105af0 2024-02-13T14:34:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0380005150 con 0x7f039c105af0 2024-02-13T14:34:26.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.524+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7f0390047720 con 0x7f039c105af0 2024-02-13T14:34:26.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.532+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f0390012f70 con 0x7f039c105af0 2024-02-13T14:34:26.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:25.920+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f0380000bc0 con 0x7f038c03a410 2024-02-13T14:34:26.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:26.012+0000 7f0399ffb700 1 -- 172.21.15.62:0/873324397 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (unknown 0 0 3317752739) 0x7f0380000bc0 con 0x7f038c03a410 2024-02-13T14:34:26.634 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:26.016+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 >> v1:172.21.15.62:6800/1926838190 conn(0x7f038c03a410 legacy=0x7f038c03c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:26.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:26.016+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 >> v1:172.21.15.62:6789/0 conn(0x7f039c105af0 legacy=0x7f039c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:26.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:26.016+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 shutdown_connections 2024-02-13T14:34:26.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:26.016+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 >> 172.21.15.62:0/873324397 conn(0x7f039c101070 msgr2=0x7f039c1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:26.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:26.016+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 shutdown_connections 2024-02-13T14:34:26.635 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:26.016+0000 7f03a2abc700 1 -- 172.21.15.62:0/873324397 wait complete. 2024-02-13T14:34:26.635 INFO:teuthology.orchestra.run.smithi062.stdout:Creating initial admin user... 2024-02-13T14:34:27.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:27 smithi062 bash[21479]: audit 2024-02-13T14:34:25.924984+0000 mgr.y (mgr.14152) 7 : audit 0 from='client.14164 v1:172.21.15.62:0/873324397' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$4j.0QTEo8pgcAofTF6tYwe//C2fkJ0YWIunBRswHAL9d8IZ0CcLDe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1707834868, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.476+0000 7f03ac450700 1 Processor -- start 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.476+0000 7f03ac450700 1 -- start start 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.476+0000 7f03ac450700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f03a407a330 con 0x7f03a407b730 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.476+0000 7f03aa1ec700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f03a407b730 0x7f03a4079b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42772/0 (socket says 172.21.15.62:42772) 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.476+0000 7f03aa1ec700 1 -- 172.21.15.62:0/963012038 learned_addr learned my addr 172.21.15.62:0/963012038 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.476+0000 7f03a91ea700 1 -- 172.21.15.62:0/963012038 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983773737 0 0) 0x7f03a407a330 con 0x7f03a407b730 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.476+0000 7f03a91ea700 1 -- 172.21.15.62:0/963012038 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c0035b0 con 0x7f03a407b730 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a91ea700 1 -- 172.21.15.62:0/963012038 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140460281 0 0) 0x7f038c0035b0 con 0x7f03a407b730 2024-02-13T14:34:28.762 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a91ea700 1 -- 172.21.15.62:0/963012038 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a407a4c0 con 0x7f03a407b730 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a91ea700 1 -- 172.21.15.62:0/963012038 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0394001900 con 0x7f03a407b730 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a91ea700 1 -- 172.21.15.62:0/963012038 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f0394001fb0 con 0x7f03a407b730 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a91ea700 1 -- 172.21.15.62:0/963012038 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0394005b60 con 0x7f03a407b730 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- 172.21.15.62:0/963012038 >> v1:172.21.15.62:6789/0 conn(0x7f03a407b730 legacy=0x7f03a4079b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- 172.21.15.62:0/963012038 shutdown_connections 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- 172.21.15.62:0/963012038 >> 172.21.15.62:0/963012038 conn(0x7f03a41010b0 msgr2=0x7f03a41034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- 172.21.15.62:0/963012038 shutdown_connections 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- 172.21.15.62:0/963012038 wait complete. 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 Processor -- start 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- start start 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f03a419bd80 con 0x7f03a407b730 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03aa1ec700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f03a407b730 0x7f03a419b670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42786/0 (socket says 172.21.15.62:42786) 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03aa1ec700 1 -- 172.21.15.62:0/3687344638 learned_addr learned my addr 172.21.15.62:0/3687344638 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579341850 0 0) 0x7f03a419bd80 con 0x7f03a407b730 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f038c005540 con 0x7f03a407b730 2024-02-13T14:34:28.763 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1529790172 0 0) 0x7f038c005540 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f03a419bd80 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0394001400 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2103561671 0 0) 0x7f03a419bd80 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a419bf10 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a419c1c0 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a419fd10 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f0394001e10 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.480+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f0394006620 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.484+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 12) v1 ==== 46082+0+0 (unknown 969868272 0 0) 0x7f0394011c90 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.484+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0390005150 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.484+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7f0394048a80 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.488+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f0394013460 con 0x7f03a407b730 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:27.892+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0390002430 con 0x7f038c03a360 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:28.180+0000 7f03a37fe700 1 -- 172.21.15.62:0/3687344638 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (unknown 0 0 3138181949) 0x7f0390002430 con 0x7f038c03a360 2024-02-13T14:34:28.764 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:28.184+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 >> v1:172.21.15.62:6800/1926838190 conn(0x7f038c03a360 legacy=0x7f038c03c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:28.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:28.184+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 >> v1:172.21.15.62:6789/0 conn(0x7f03a407b730 legacy=0x7f03a419b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:28.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:28.184+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 shutdown_connections 2024-02-13T14:34:28.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:28.184+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 >> 172.21.15.62:0/3687344638 conn(0x7f03a41010b0 msgr2=0x7f03a410a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:28.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:28.184+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 shutdown_connections 2024-02-13T14:34:28.765 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:28.184+0000 7f03ac450700 1 -- 172.21.15.62:0/3687344638 wait complete. 2024-02-13T14:34:28.765 INFO:teuthology.orchestra.run.smithi062.stdout:Fetching dashboard port number... 2024-02-13T14:34:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:29 smithi062 bash[21479]: audit 2024-02-13T14:34:27.897845+0000 mgr.y (mgr.14152) 8 : audit 0 from='client.14166 v1:172.21.15.62:0/3687344638' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:34:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:29 smithi062 bash[21479]: audit 2024-02-13T14:34:28.183101+0000 mon.a (mon.0) 90 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:30.289 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:30 smithi062 bash[21479]: cluster 2024-02-13T14:34:29.189659+0000 mon.a (mon.0) 91 : cluster 0 mgrmap e13: y(active, since 6s) 2024-02-13T14:34:30.289 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:30 smithi062 bash[21479]: audit 2024-02-13T14:34:29.880731+0000 mon.a (mon.0) 92 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:30.289 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:30 smithi062 bash[21479]: audit 2024-02-13T14:34:29.995461+0000 mon.a (mon.0) 93 : audit 0 from='client.? v1:172.21.15.62:0/1530510271' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-13T14:34:30.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stdout 8443 2024-02-13T14:34:30.659 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 Processor -- start 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- start start 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3f1810c140 con 0x7f3f18107d10 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1e309700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3f18107d10 0x7f3f18108130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42800/0 (socket says 172.21.15.62:42800) 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1e309700 1 -- 172.21.15.62:0/3304214049 learned_addr learned my addr 172.21.15.62:0/3304214049 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1d307700 1 -- 172.21.15.62:0/3304214049 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1673328381 0 0) 0x7f3f1810c140 con 0x7f3f18107d10 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1d307700 1 -- 172.21.15.62:0/3304214049 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f040035b0 con 0x7f3f18107d10 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1d307700 1 -- 172.21.15.62:0/3304214049 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1788237506 0 0) 0x7f3f040035b0 con 0x7f3f18107d10 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1d307700 1 -- 172.21.15.62:0/3304214049 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1810d2e0 con 0x7f3f18107d10 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1d307700 1 -- 172.21.15.62:0/3304214049 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f3f14001580 con 0x7f3f18107d10 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1d307700 1 -- 172.21.15.62:0/3304214049 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f3f14001c30 con 0x7f3f18107d10 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1d307700 1 -- 172.21.15.62:0/3304214049 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f3f14005770 con 0x7f3f18107d10 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- 172.21.15.62:0/3304214049 >> v1:172.21.15.62:6789/0 conn(0x7f3f18107d10 legacy=0x7f3f18108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:30.660 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- 172.21.15.62:0/3304214049 shutdown_connections 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- 172.21.15.62:0/3304214049 >> 172.21.15.62:0/3304214049 conn(0x7f3f1807b0e0 msgr2=0x7f3f18105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- 172.21.15.62:0/3304214049 shutdown_connections 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- 172.21.15.62:0/3304214049 wait complete. 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 Processor -- start 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- start start 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f2056d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3f1819bdb0 con 0x7f3f18107d10 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1e309700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f3f18107d10 0x7f3f1819b6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42808/0 (socket says 172.21.15.62:42808) 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.588+0000 7f3f1e309700 1 -- 172.21.15.62:0/1530510271 learned_addr learned my addr 172.21.15.62:0/1530510271 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991348036 0 0) 0x7f3f1819bdb0 con 0x7f3f18107d10 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f04005540 con 0x7f3f18107d10 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1435470849 0 0) 0x7f3f04005540 con 0x7f3f18107d10 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3f1819bdb0 con 0x7f3f18107d10 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f3f14001080 con 0x7f3f18107d10 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3670247899 0 0) 0x7f3f1819bdb0 con 0x7f3f18107d10 2024-02-13T14:34:30.661 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1819bf40 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1819c1f0 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1819fd40 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f3f14004870 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f3f14006120 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7f3f140117a0 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7f3f140478f0 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.592+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc005120 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.596+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f3f140130f0 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.992+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f3efc005950 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.992+0000 7f3f0f7fe700 1 -- 172.21.15.62:0/1530510271 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (unknown 3713421687 0 83753974) 0x7f3f140151d0 con 0x7f3f18107d10 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.992+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 >> v1:172.21.15.62:6800/1926838190 conn(0x7f3f0403a1a0 legacy=0x7f3f0403c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.992+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 >> v1:172.21.15.62:6789/0 conn(0x7f3f18107d10 legacy=0x7f3f1819b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.992+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 shutdown_connections 2024-02-13T14:34:30.662 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.992+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 >> 172.21.15.62:0/1530510271 conn(0x7f3f1807b0e0 msgr2=0x7f3f181924c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.996+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 shutdown_connections 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:29.996+0000 7f3f2056d700 1 -- 172.21.15.62:0/1530510271 wait complete. 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout:firewalld does not appear to be present 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout:Ceph Dashboard is now available at: 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout: URL: https://smithi062.front.sepia.ceph.com:8443/ 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout: User: admin 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout: Password: d9pwk7zja1 2024-02-13T14:34:30.663 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:30.664 INFO:teuthology.orchestra.run.smithi062.stdout:Saving cluster configuration to /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config directory 2024-02-13T14:34:30.664 INFO:teuthology.orchestra.run.smithi062.stdout:Enabling autotune for osd_memory_target 2024-02-13T14:34:32.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:32 smithi062 bash[21479]: audit 2024-02-13T14:34:31.133797+0000 mon.a (mon.0) 94 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 Processor -- start 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 -- start start 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa00c109f20 con 0x7fa00c105af0 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01203a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa00c105af0 0x7fa00c105f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58240/0 (socket says 172.21.15.62:58240) 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01203a700 1 -- 172.21.15.62:0/3673614666 learned_addr learned my addr 172.21.15.62:0/3673614666 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa011038700 1 -- 172.21.15.62:0/3673614666 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091112811 0 0) 0x7fa00c109f20 con 0x7fa00c105af0 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa011038700 1 -- 172.21.15.62:0/3673614666 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff80035b0 con 0x7fa00c105af0 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa011038700 1 -- 172.21.15.62:0/3673614666 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851242071 0 0) 0x7f9ff80035b0 con 0x7fa00c105af0 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa011038700 1 -- 172.21.15.62:0/3673614666 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c10b0c0 con 0x7fa00c105af0 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa011038700 1 -- 172.21.15.62:0/3673614666 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fa008001580 con 0x7fa00c105af0 2024-02-13T14:34:32.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa011038700 1 -- 172.21.15.62:0/3673614666 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fa008001c30 con 0x7fa00c105af0 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa011038700 1 -- 172.21.15.62:0/3673614666 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fa008005770 con 0x7fa00c105af0 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 -- 172.21.15.62:0/3673614666 >> v1:172.21.15.62:6789/0 conn(0x7fa00c105af0 legacy=0x7fa00c105f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 -- 172.21.15.62:0/3673614666 shutdown_connections 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 -- 172.21.15.62:0/3673614666 >> 172.21.15.62:0/3673614666 conn(0x7fa00c101050 msgr2=0x7fa00c1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 -- 172.21.15.62:0/3673614666 shutdown_connections 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 -- 172.21.15.62:0/3673614666 wait complete. 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.532+0000 7fa01429e700 1 Processor -- start 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa01429e700 1 -- start start 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa01429e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa00c199b70 con 0x7fa00c105af0 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa01203a700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa00c105af0 0x7fa00c199460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58254/0 (socket says 172.21.15.62:58254) 2024-02-13T14:34:32.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa01203a700 1 -- 172.21.15.62:0/1744011705 learned_addr learned my addr 172.21.15.62:0/1744011705 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298341676 0 0) 0x7fa00c199b70 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ff8005540 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3414619045 0 0) 0x7f9ff8005540 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa00c199b70 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fa008001080 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4070234748 0 0) 0x7fa00c199b70 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00c199d00 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00c199fb0 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00c19db00 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fa0080048b0 con 0x7fa00c105af0 2024-02-13T14:34:32.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fa008006150 con 0x7fa00c105af0 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7fa0080117f0 con 0x7fa00c105af0 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff0005150 con 0x7fa00c105af0 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.536+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7fa0080486e0 con 0x7fa00c105af0 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.544+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fa008013060 con 0x7fa00c105af0 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.920+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 --> v1:172.21.15.62:6789/0 -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f9ff0005980 con 0x7fa00c105af0 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.920+0000 7fa0037fe700 1 -- 172.21.15.62:0/1744011705 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (unknown 689008156 0 0) 0x7fa008015140 con 0x7fa00c105af0 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.924+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 >> v1:172.21.15.62:6800/1926838190 conn(0x7f9ff803a4f0 legacy=0x7f9ff803c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.924+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 >> v1:172.21.15.62:6789/0 conn(0x7fa00c105af0 legacy=0x7fa00c199460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.924+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 shutdown_connections 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.924+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 >> 172.21.15.62:0/1744011705 conn(0x7fa00c101050 msgr2=0x7fa00c1034d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.924+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 shutdown_connections 2024-02-13T14:34:32.492 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:31.924+0000 7fa01429e700 1 -- 172.21.15.62:0/1744011705 wait complete. 2024-02-13T14:34:34.482 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.364+0000 7febb4039700 1 Processor -- start 2024-02-13T14:34:34.482 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.364+0000 7febb4039700 1 -- start start 2024-02-13T14:34:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.364+0000 7febb4039700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7febac07a330 con 0x7febac07b730 2024-02-13T14:34:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.364+0000 7febb1dd5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7febac07b730 0x7febac079b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58270/0 (socket says 172.21.15.62:58270) 2024-02-13T14:34:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.364+0000 7febb1dd5700 1 -- 172.21.15.62:0/225502194 learned_addr learned my addr 172.21.15.62:0/225502194 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.364+0000 7febb0dd3700 1 -- 172.21.15.62:0/225502194 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597485640 0 0) 0x7febac07a330 con 0x7febac07b730 2024-02-13T14:34:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.364+0000 7febb0dd3700 1 -- 172.21.15.62:0/225502194 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb980035b0 con 0x7febac07b730 2024-02-13T14:34:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb0dd3700 1 -- 172.21.15.62:0/225502194 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 471130350 0 0) 0x7feb980035b0 con 0x7febac07b730 2024-02-13T14:34:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb0dd3700 1 -- 172.21.15.62:0/225502194 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac07a4c0 con 0x7febac07b730 2024-02-13T14:34:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb0dd3700 1 -- 172.21.15.62:0/225502194 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7feba8001580 con 0x7febac07b730 2024-02-13T14:34:34.484 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb0dd3700 1 -- 172.21.15.62:0/225502194 <== mon.0 v1:172.21.15.62:6789/0 4 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7feba8001c30 con 0x7febac07b730 2024-02-13T14:34:34.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb0dd3700 1 -- 172.21.15.62:0/225502194 <== mon.0 v1:172.21.15.62:6789/0 5 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7feba80057e0 con 0x7febac07b730 2024-02-13T14:34:34.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- 172.21.15.62:0/225502194 >> v1:172.21.15.62:6789/0 conn(0x7febac07b730 legacy=0x7febac079b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:34.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- 172.21.15.62:0/225502194 shutdown_connections 2024-02-13T14:34:34.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- 172.21.15.62:0/225502194 >> 172.21.15.62:0/225502194 conn(0x7febac1010b0 msgr2=0x7febac1034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:34.485 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- 172.21.15.62:0/225502194 shutdown_connections 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- 172.21.15.62:0/225502194 wait complete. 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 Processor -- start 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- start start 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7febac19bd90 con 0x7febac07b730 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb1dd5700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7febac07b730 0x7febac19b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58278/0 (socket says 172.21.15.62:58278) 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb1dd5700 1 -- 172.21.15.62:0/804409544 learned_addr learned my addr 172.21.15.62:0/804409544 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826913483 0 0) 0x7febac19bd90 con 0x7febac07b730 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb98005540 con 0x7febac07b730 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2293968102 0 0) 0x7feb98005540 con 0x7febac07b730 2024-02-13T14:34:34.487 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7febac19bd90 con 0x7febac07b730 2024-02-13T14:34:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7feba8000ed0 con 0x7febac07b730 2024-02-13T14:34:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3842665933 0 0) 0x7febac19bd90 con 0x7febac07b730 2024-02-13T14:34:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febac19bf20 con 0x7febac07b730 2024-02-13T14:34:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febac19c1d0 con 0x7febac07b730 2024-02-13T14:34:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7febac19fd20 con 0x7febac07b730 2024-02-13T14:34:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7feba80049d0 con 0x7febac07b730 2024-02-13T14:34:34.488 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.368+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7feba8006160 con 0x7febac07b730 2024-02-13T14:34:34.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.372+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7feba8011720 con 0x7febac07b730 2024-02-13T14:34:34.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.372+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb90005150 con 0x7febac07b730 2024-02-13T14:34:34.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.372+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7feba8047880 con 0x7febac07b730 2024-02-13T14:34:34.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.376+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7feba8016dd0 con 0x7febac07b730 2024-02-13T14:34:34.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.968+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 --> v1:172.21.15.62:6789/0 -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7feb90005980 con 0x7febac07b730 2024-02-13T14:34:34.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.972+0000 7feb9effd700 1 -- 172.21.15.62:0/804409544 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) v1 ==== 153+0+0 (unknown 1951093493 0 0) 0x7feba80151a0 con 0x7febac07b730 2024-02-13T14:34:34.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.972+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 >> v1:172.21.15.62:6800/1926838190 conn(0x7feb9803a4f0 legacy=0x7feb9803c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:34.490 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.972+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 >> v1:172.21.15.62:6789/0 conn(0x7febac07b730 legacy=0x7febac19b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.972+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 shutdown_connections 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.972+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 >> 172.21.15.62:0/804409544 conn(0x7febac1010b0 msgr2=0x7febac109fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.972+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 shutdown_connections 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr 2024-02-13T14:34:33.972+0000 7febb4039700 1 -- 172.21.15.62:0/804409544 wait complete. 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Or, if you are only running a single cluster on this host: 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:34.491 INFO:teuthology.orchestra.run.smithi062.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-13T14:34:34.492 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:34.492 INFO:teuthology.orchestra.run.smithi062.stdout: ceph telemetry on 2024-02-13T14:34:34.492 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:For more information see: 2024-02-13T14:34:34.492 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:34.492 INFO:teuthology.orchestra.run.smithi062.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-02-13T14:34:34.492 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:34:34.492 INFO:teuthology.orchestra.run.smithi062.stdout:Bootstrap complete. 2024-02-13T14:34:34.549 INFO:tasks.cephadm:Fetching config... 2024-02-13T14:34:34.549 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:34:34.549 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-13T14:34:34.556 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-13T14:34:34.556 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:34:34.556 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-13T14:34:34.602 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-13T14:34:34.603 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:34:34.603 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-13T14:34:34.659 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-13T14:34:34.659 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:34:34.659 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-13T14:34:34.706 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-13T14:34:34.706 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDamK3DJwVx5tq6uUg4uIsBzlndkHKOzizTAycPvWQMlaFYFAPhXV+CcCOjZ7CGfFzOshrlN9GH/xoofu6LgkT7Ye7vXTp5tgDCFnIfZrCui+cugePlDiX/po4OWtcFGDfd14egRWUjlS0oFdWtXId6I13mU7IyX4E2AJfM7vaUVHpZ1fLaI7jPKMsRGQ0mqTOTF0c1PL90IKOaEUWTb78cfc1GzOePk/z5TZr+Ex7fmlHFmIT89DyRmrt/WJ9CVpH6HxeQTyUq+8VoWyP2r0IumCxFGuk3Sjell/mxNBIi03mCtgiQkiV0jsfXZf0Tj/EvnuTHAkmcEtbNLv5LKeonDPTsA1hbBfyZhlkn1lmII7jEwYh1phKbajRD3MyuYmuOwhMtkJ8qKGHRgsNCK/LMEkNLLWwKf7dlUdqmogHjOfBngqbFbmJWt79GD6uixV4NyvhG16L6RG2iy0czHcc5xjL19JjQirr6vMaxa6kLaH/IWBZJbLJWKCoHAdl9j4U= ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-13T14:34:34.770 INFO:teuthology.orchestra.run.smithi062.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDamK3DJwVx5tq6uUg4uIsBzlndkHKOzizTAycPvWQMlaFYFAPhXV+CcCOjZ7CGfFzOshrlN9GH/xoofu6LgkT7Ye7vXTp5tgDCFnIfZrCui+cugePlDiX/po4OWtcFGDfd14egRWUjlS0oFdWtXId6I13mU7IyX4E2AJfM7vaUVHpZ1fLaI7jPKMsRGQ0mqTOTF0c1PL90IKOaEUWTb78cfc1GzOePk/z5TZr+Ex7fmlHFmIT89DyRmrt/WJ9CVpH6HxeQTyUq+8VoWyP2r0IumCxFGuk3Sjell/mxNBIi03mCtgiQkiV0jsfXZf0Tj/EvnuTHAkmcEtbNLv5LKeonDPTsA1hbBfyZhlkn1lmII7jEwYh1phKbajRD3MyuYmuOwhMtkJ8qKGHRgsNCK/LMEkNLLWwKf7dlUdqmogHjOfBngqbFbmJWt79GD6uixV4NyvhG16L6RG2iy0czHcc5xjL19JjQirr6vMaxa6kLaH/IWBZJbLJWKCoHAdl9j4U= ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:34:34.780 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDamK3DJwVx5tq6uUg4uIsBzlndkHKOzizTAycPvWQMlaFYFAPhXV+CcCOjZ7CGfFzOshrlN9GH/xoofu6LgkT7Ye7vXTp5tgDCFnIfZrCui+cugePlDiX/po4OWtcFGDfd14egRWUjlS0oFdWtXId6I13mU7IyX4E2AJfM7vaUVHpZ1fLaI7jPKMsRGQ0mqTOTF0c1PL90IKOaEUWTb78cfc1GzOePk/z5TZr+Ex7fmlHFmIT89DyRmrt/WJ9CVpH6HxeQTyUq+8VoWyP2r0IumCxFGuk3Sjell/mxNBIi03mCtgiQkiV0jsfXZf0Tj/EvnuTHAkmcEtbNLv5LKeonDPTsA1hbBfyZhlkn1lmII7jEwYh1phKbajRD3MyuYmuOwhMtkJ8qKGHRgsNCK/LMEkNLLWwKf7dlUdqmogHjOfBngqbFbmJWt79GD6uixV4NyvhG16L6RG2iy0czHcc5xjL19JjQirr6vMaxa6kLaH/IWBZJbLJWKCoHAdl9j4U= ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-13T14:34:34.805 INFO:teuthology.orchestra.run.smithi111.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDamK3DJwVx5tq6uUg4uIsBzlndkHKOzizTAycPvWQMlaFYFAPhXV+CcCOjZ7CGfFzOshrlN9GH/xoofu6LgkT7Ye7vXTp5tgDCFnIfZrCui+cugePlDiX/po4OWtcFGDfd14egRWUjlS0oFdWtXId6I13mU7IyX4E2AJfM7vaUVHpZ1fLaI7jPKMsRGQ0mqTOTF0c1PL90IKOaEUWTb78cfc1GzOePk/z5TZr+Ex7fmlHFmIT89DyRmrt/WJ9CVpH6HxeQTyUq+8VoWyP2r0IumCxFGuk3Sjell/mxNBIi03mCtgiQkiV0jsfXZf0Tj/EvnuTHAkmcEtbNLv5LKeonDPTsA1hbBfyZhlkn1lmII7jEwYh1phKbajRD3MyuYmuOwhMtkJ8qKGHRgsNCK/LMEkNLLWwKf7dlUdqmogHjOfBngqbFbmJWt79GD6uixV4NyvhG16L6RG2iy0czHcc5xjL19JjQirr6vMaxa6kLaH/IWBZJbLJWKCoHAdl9j4U= ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:34:34.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-13T14:34:35.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:34 smithi062 bash[21479]: audit 2024-02-13T14:34:33.974324+0000 mon.a (mon.0) 95 : audit 1 from='client.? v1:172.21.15.62:0/804409544' entity='client.admin' 2024-02-13T14:34:39.473 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:34:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- 172.21.15.62:0/3555933578 >> v1:172.21.15.62:6789/0 conn(0x7fadf41015e0 legacy=0x7fadf4101a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- 172.21.15.62:0/3555933578 shutdown_connections 2024-02-13T14:34:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- 172.21.15.62:0/3555933578 >> 172.21.15.62:0/3555933578 conn(0x7fadf40fcbc0 msgr2=0x7fadf40fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- 172.21.15.62:0/3555933578 shutdown_connections 2024-02-13T14:34:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- 172.21.15.62:0/3555933578 wait complete. 2024-02-13T14:34:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 Processor -- start 2024-02-13T14:34:42.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- start start 2024-02-13T14:34:42.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fadf419be70 con 0x7fadf41015e0 2024-02-13T14:34:42.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf2ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fadf41015e0 0x7fadf4075930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45562/0 (socket says 172.21.15.62:45562) 2024-02-13T14:34:42.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf2ffd700 1 -- 172.21.15.62:0/1330559532 learned_addr learned my addr 172.21.15.62:0/1330559532 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564823751 0 0) 0x7fadf419be70 con 0x7fadf41015e0 2024-02-13T14:34:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadd40054f0 con 0x7fadf41015e0 2024-02-13T14:34:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3379074370 0 0) 0x7fadd40054f0 con 0x7fadf41015e0 2024-02-13T14:34:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fadf419be70 con 0x7fadf41015e0 2024-02-13T14:34:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7faddc004440 con 0x7fadf41015e0 2024-02-13T14:34:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 93382512 0 0) 0x7fadf419be70 con 0x7fadf41015e0 2024-02-13T14:34:42.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf419d010 con 0x7fadf41015e0 2024-02-13T14:34:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf419c060 con 0x7fadf41015e0 2024-02-13T14:34:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf419c560 con 0x7fadf41015e0 2024-02-13T14:34:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7faddc001190 con 0x7fadf41015e0 2024-02-13T14:34:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.480+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7faddc004dc0 con 0x7fadf41015e0 2024-02-13T14:34:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.484+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7faddc004f40 con 0x7fadf41015e0 2024-02-13T14:34:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.484+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd8005150 con 0x7fadf41015e0 2024-02-13T14:34:42.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.484+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7faddc047640 con 0x7fadf41015e0 2024-02-13T14:34:42.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.488+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7faddc016940 con 0x7fadf41015e0 2024-02-13T14:34:42.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.696+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 --> v1:172.21.15.62:6789/0 -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fadd8005980 con 0x7fadf41015e0 2024-02-13T14:34:42.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.700+0000 7fadebfff700 1 -- 172.21.15.62:0/1330559532 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (unknown 3028693289 0 0) 0x7faddc014f40 con 0x7fadf41015e0 2024-02-13T14:34:42.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.704+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 >> v1:172.21.15.62:6800/1926838190 conn(0x7fadd403a4e0 legacy=0x7fadd403c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.704+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 >> v1:172.21.15.62:6789/0 conn(0x7fadf41015e0 legacy=0x7fadf4075930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.704+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 shutdown_connections 2024-02-13T14:34:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.704+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 >> 172.21.15.62:0/1330559532 conn(0x7fadf40fcbc0 msgr2=0x7fadf40fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.704+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 shutdown_connections 2024-02-13T14:34:42.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:42.704+0000 7fadf933e700 1 -- 172.21.15.62:0/1330559532 wait complete. 2024-02-13T14:34:43.415 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-13T14:34:43.415 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-13T14:34:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.282726+0000 mon.a (mon.0) 96 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.289173+0000 mon.a (mon.0) 97 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.290619+0000 mon.a (mon.0) 98 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi062", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:34:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.298744+0000 mon.a (mon.0) 99 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.317260+0000 mon.a (mon.0) 100 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:34:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.321951+0000 mon.a (mon.0) 101 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.705778+0000 mon.a (mon.0) 102 : audit 1 from='client.? v1:172.21.15.62:0/1330559532' entity='client.admin' 2024-02-13T14:34:43.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.753438+0000 mon.a (mon.0) 103 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:34:43.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:43 smithi062 bash[21479]: audit 2024-02-13T14:34:42.757518+0000 mon.a (mon.0) 104 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:44 smithi062 bash[21479]: cluster 2024-02-13T14:34:43.016847+0000 mgr.y (mgr.14152) 9 : cluster 0 pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:46 smithi062 bash[21479]: cluster 2024-02-13T14:34:45.017261+0000 mgr.y (mgr.14152) 10 : cluster 0 pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:48.130 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:34:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:48 smithi062 bash[21479]: cluster 2024-02-13T14:34:47.017686+0000 mgr.y (mgr.14152) 11 : cluster 0 pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:50.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- 172.21.15.62:0/820388526 >> v1:172.21.15.62:6789/0 conn(0x7f363c1015e0 legacy=0x7f363c101a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- 172.21.15.62:0/820388526 shutdown_connections 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- 172.21.15.62:0/820388526 >> 172.21.15.62:0/820388526 conn(0x7f363c0fcbc0 msgr2=0x7f363c0fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- 172.21.15.62:0/820388526 shutdown_connections 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- 172.21.15.62:0/820388526 wait complete. 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 Processor -- start 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- start start 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f363c19be70 con 0x7f363c1015e0 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f363ad9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f363c1015e0 0x7f363c075930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:45572/0 (socket says 172.21.15.62:45572) 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f363ad9d700 1 -- 172.21.15.62:0/2580587832 learned_addr learned my addr 172.21.15.62:0/2580587832 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:50.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013484064 0 0) 0x7f363c19be70 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36280054f0 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2259856012 0 0) 0x7f36280054f0 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f363c19be70 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f362c004440 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2743494670 0 0) 0x7f363c19be70 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c19d010 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c19c060 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c19c560 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f362c001620 con 0x7f363c1015e0 2024-02-13T14:34:50.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.480+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f362c004e80 con 0x7f363c1015e0 2024-02-13T14:34:50.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.484+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7f362c005000 con 0x7f363c1015e0 2024-02-13T14:34:50.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.484+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f361c005150 con 0x7f363c1015e0 2024-02-13T14:34:50.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.484+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7f362c047830 con 0x7f363c1015e0 2024-02-13T14:34:50.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.488+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f362c005440 con 0x7f363c1015e0 2024-02-13T14:34:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:50 smithi062 bash[21479]: cluster 2024-02-13T14:34:49.018023+0000 mgr.y (mgr.14152) 12 : cluster 0 pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:50.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.704+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f361c000bc0 con 0x7f362803a490 2024-02-13T14:34:50.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.712+0000 7f3633fff700 1 -- 172.21.15.62:0/2580587832 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (unknown 0 0 0) 0x7f361c000bc0 con 0x7f362803a490 2024-02-13T14:34:50.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.716+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 >> v1:172.21.15.62:6800/1926838190 conn(0x7f362803a490 legacy=0x7f362803c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:50.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.716+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 >> v1:172.21.15.62:6789/0 conn(0x7f363c1015e0 legacy=0x7f363c075930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:50.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.716+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 shutdown_connections 2024-02-13T14:34:50.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.716+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 >> 172.21.15.62:0/2580587832 conn(0x7f363c0fcbc0 msgr2=0x7f363c0fefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:50.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.716+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 shutdown_connections 2024-02-13T14:34:50.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:50.716+0000 7f36410b3700 1 -- 172.21.15.62:0/2580587832 wait complete. 2024-02-13T14:34:51.434 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi111 2024-02-13T14:34:51.435 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:34:51.435 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/etc/ceph/ceph.conf 2024-02-13T14:34:51.441 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:34:51.441 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:34:51.487 INFO:tasks.cephadm:Adding host smithi111 to orchestrator... 2024-02-13T14:34:51.488 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch host add smithi111 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: audit 2024-02-13T14:34:50.710650+0000 mgr.y (mgr.14152) 13 : audit 0 from='client.14176 v1:172.21.15.62:0/2580587832' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: audit 2024-02-13T14:34:50.717270+0000 mon.a (mon.0) 105 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: audit 2024-02-13T14:34:50.756829+0000 mon.a (mon.0) 106 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: audit 2024-02-13T14:34:50.758381+0000 mon.a (mon.0) 107 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: audit 2024-02-13T14:34:50.759393+0000 mon.a (mon.0) 108 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: cephadm 2024-02-13T14:34:50.760501+0000 mgr.y (mgr.14152) 14 : cephadm 1 Updating smithi062:/etc/ceph/ceph.conf 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: cephadm 2024-02-13T14:34:50.874594+0000 mgr.y (mgr.14152) 15 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: cluster 2024-02-13T14:34:51.018476+0000 mgr.y (mgr.14152) 16 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: cephadm 2024-02-13T14:34:51.039261+0000 mgr.y (mgr.14152) 17 : cephadm 1 Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:34:52.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: cephadm 2024-02-13T14:34:51.203690+0000 mgr.y (mgr.14152) 18 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:34:52.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: audit 2024-02-13T14:34:51.373043+0000 mon.a (mon.0) 109 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:52.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: audit 2024-02-13T14:34:51.377790+0000 mon.a (mon.0) 110 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:52.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:51 smithi062 bash[21479]: audit 2024-02-13T14:34:51.383082+0000 mon.a (mon.0) 111 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:34:54.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:54 smithi062 bash[21479]: cluster 2024-02-13T14:34:53.018790+0000 mgr.y (mgr.14152) 19 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:56.194 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:34:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:56 smithi062 bash[21479]: cluster 2024-02-13T14:34:55.019150+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:58.384 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:34:58 smithi062 bash[21479]: cluster 2024-02-13T14:34:57.019529+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:34:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f736450b700 1 -- 172.21.15.62:0/4259479931 >> v1:172.21.15.62:6789/0 conn(0x7f735c107630 legacy=0x7f735c107a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:34:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f736450b700 1 -- 172.21.15.62:0/4259479931 shutdown_connections 2024-02-13T14:34:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f736450b700 1 -- 172.21.15.62:0/4259479931 >> 172.21.15.62:0/4259479931 conn(0x7f735c0fd070 msgr2=0x7f735c0ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:34:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f736450b700 1 -- 172.21.15.62:0/4259479931 shutdown_connections 2024-02-13T14:34:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f736450b700 1 -- 172.21.15.62:0/4259479931 wait complete. 2024-02-13T14:34:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f736450b700 1 Processor -- start 2024-02-13T14:34:58.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f736450b700 1 -- start start 2024-02-13T14:34:58.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f736450b700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f735c1967a0 con 0x7f735c107630 2024-02-13T14:34:58.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f73622a7700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f735c107630 0x7f735c196090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:50382/0 (socket says 172.21.15.62:50382) 2024-02-13T14:34:58.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f73622a7700 1 -- 172.21.15.62:0/3487753127 learned_addr learned my addr 172.21.15.62:0/3487753127 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:34:58.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079331000 0 0) 0x7f735c1967a0 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7348005540 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3525664537 0 0) 0x7f7348005540 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f735c1967a0 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f73580014c0 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.540+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 518757879 0 0) 0x7f735c1967a0 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.544+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c196930 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.544+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f735c196be0 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.544+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f735c19ee40 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.544+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f7358003b10 con 0x7f735c107630 2024-02-13T14:34:58.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.544+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f7358004e30 con 0x7f735c107630 2024-02-13T14:34:58.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.544+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7340005120 con 0x7f735c107630 2024-02-13T14:34:58.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.544+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7f7358004fb0 con 0x7f735c107630 2024-02-13T14:34:58.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.544+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7f7358047710 con 0x7f735c107630 2024-02-13T14:34:58.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.548+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f7358012ee0 con 0x7f735c107630 2024-02-13T14:34:58.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:34:58.760+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi111", "target": ["mon-mgr", ""]}) v1 -- 0x7f7340000b90 con 0x7f734803a490 2024-02-13T14:35:00.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:00 smithi062 bash[21479]: audit 2024-02-13T14:34:58.766882+0000 mgr.y (mgr.14152) 22 : audit 0 from='client.14178 v1:172.21.15.62:0/3487753127' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi111", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:35:00.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:00 smithi062 bash[21479]: cluster 2024-02-13T14:34:59.019941+0000 mgr.y (mgr.14152) 23 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:00.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:00 smithi062 bash[21479]: cephadm 2024-02-13T14:34:59.460502+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi111 2024-02-13T14:35:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:02 smithi062 bash[21479]: cluster 2024-02-13T14:35:01.020407+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:04.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:04 smithi062 bash[21479]: cluster 2024-02-13T14:35:03.020750+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:05.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:05.084+0000 7f73537fe700 1 -- 172.21.15.62:0/3487753127 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (unknown 0 0 522955441) 0x7f7340000b90 con 0x7f734803a490 2024-02-13T14:35:05.089 INFO:teuthology.orchestra.run.smithi062.stdout:Added host 'smithi111' with addr '172.21.15.111' 2024-02-13T14:35:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:05.088+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 >> v1:172.21.15.62:6800/1926838190 conn(0x7f734803a490 legacy=0x7f734803c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:05.088+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 >> v1:172.21.15.62:6789/0 conn(0x7f735c107630 legacy=0x7f735c196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:05.088+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 shutdown_connections 2024-02-13T14:35:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:05.088+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 >> 172.21.15.62:0/3487753127 conn(0x7f735c0fd070 msgr2=0x7f735c0ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:05.088+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 shutdown_connections 2024-02-13T14:35:05.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:05.088+0000 7f736450b700 1 -- 172.21.15.62:0/3487753127 wait complete. 2024-02-13T14:35:05.794 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch host ls --format=json 2024-02-13T14:35:06.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:06 smithi062 bash[21479]: cluster 2024-02-13T14:35:05.021161+0000 mgr.y (mgr.14152) 27 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:06 smithi062 bash[21479]: audit 2024-02-13T14:35:05.088620+0000 mon.a (mon.0) 112 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:06 smithi062 bash[21479]: cephadm 2024-02-13T14:35:05.089489+0000 mgr.y (mgr.14152) 28 : cephadm 1 Added host smithi111 2024-02-13T14:35:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:06 smithi062 bash[21479]: audit 2024-02-13T14:35:05.107818+0000 mon.a (mon.0) 113 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:06 smithi062 bash[21479]: audit 2024-02-13T14:35:05.580241+0000 mon.a (mon.0) 114 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:08.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:08 smithi062 bash[21479]: cluster 2024-02-13T14:35:07.021580+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:08.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:08 smithi062 bash[21479]: audit 2024-02-13T14:35:07.054319+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:09.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:09 smithi062 bash[21479]: audit 2024-02-13T14:35:08.204389+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:10.513 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:35:10.534 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:10 smithi062 bash[21479]: cluster 2024-02-13T14:35:09.021939+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:12 smithi062 bash[21479]: cluster 2024-02-13T14:35:11.022357+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- 172.21.15.62:0/96041422 >> v1:172.21.15.62:6789/0 conn(0x7f61e8109770 legacy=0x7f61e8109b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- 172.21.15.62:0/96041422 shutdown_connections 2024-02-13T14:35:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- 172.21.15.62:0/96041422 >> 172.21.15.62:0/96041422 conn(0x7f61e80ff280 msgr2=0x7f61e81016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- 172.21.15.62:0/96041422 shutdown_connections 2024-02-13T14:35:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- 172.21.15.62:0/96041422 wait complete. 2024-02-13T14:35:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 Processor -- start 2024-02-13T14:35:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- start start 2024-02-13T14:35:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f61e807a0e0 con 0x7f61e8109770 2024-02-13T14:35:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ed10b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f61e8109770 0x7f61e8076180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56076/0 (socket says 172.21.15.62:56076) 2024-02-13T14:35:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ed10b700 1 -- 172.21.15.62:0/1747904057 learned_addr learned my addr 172.21.15.62:0/1747904057 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460670977 0 0) 0x7f61e807a0e0 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d00054f0 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2757727412 0 0) 0x7f61d00054f0 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61e807a0e0 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f61e0001d00 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1827056723 0 0) 0x7f61e807a0e0 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e807a270 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e8076890 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e8076d10 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f61e0001580 con 0x7f61e8109770 2024-02-13T14:35:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f61e0005210 con 0x7f61e8109770 2024-02-13T14:35:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.804+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7f61e0005390 con 0x7f61e8109770 2024-02-13T14:35:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.808+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d4005120 con 0x7f61e8109770 2024-02-13T14:35:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.808+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7f61e0047af0 con 0x7f61e8109770 2024-02-13T14:35:12.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:12.812+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f61e0005780 con 0x7f61e8109770 2024-02-13T14:35:13.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:13.024+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61d4000b90 con 0x7f61d003a490 2024-02-13T14:35:13.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:13.028+0000 7f61e67fc700 1 -- 172.21.15.62:0/1747904057 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (unknown 0 0 3442253830) 0x7f61d4000b90 con 0x7f61d003a490 2024-02-13T14:35:13.030 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:35:13.030 INFO:teuthology.orchestra.run.smithi062.stdout:[{"addr": "172.21.15.62", "hostname": "smithi062", "labels": [], "status": ""}, {"addr": "172.21.15.111", "hostname": "smithi111", "labels": [], "status": ""}] 2024-02-13T14:35:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:13.028+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 >> v1:172.21.15.62:6800/1926838190 conn(0x7f61d003a490 legacy=0x7f61d003c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:13.028+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 >> v1:172.21.15.62:6789/0 conn(0x7f61e8109770 legacy=0x7f61e8076180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:13.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:13.028+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 shutdown_connections 2024-02-13T14:35:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:13.028+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 >> 172.21.15.62:0/1747904057 conn(0x7f61e80ff280 msgr2=0x7f61e80ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:13.028+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 shutdown_connections 2024-02-13T14:35:13.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:13.028+0000 7f61ef36f700 1 -- 172.21.15.62:0/1747904057 wait complete. 2024-02-13T14:35:13.653 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-13T14:35:13.653 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd crush tunables default 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: cluster 2024-02-13T14:35:13.022682+0000 mgr.y (mgr.14152) 32 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.030589+0000 mgr.y (mgr.14152) 33 : audit 0 from='client.14180 v1:172.21.15.62:0/1747904057' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.187845+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.193509+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.199376+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.206877+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.208086+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.209505+0000 mon.a (mon.0) 122 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.213599+0000 mon.a (mon.0) 123 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: cephadm 2024-02-13T14:35:13.216047+0000 mgr.y (mgr.14152) 34 : cephadm 1 Updating smithi111:/etc/ceph/ceph.conf 2024-02-13T14:35:14.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: cephadm 2024-02-13T14:35:13.431577+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:14.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: cephadm 2024-02-13T14:35:13.596372+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:35:14.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.931210+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:14.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.936225+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:14.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:14 smithi062 bash[21479]: audit 2024-02-13T14:35:13.944371+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:15.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:15 smithi062 bash[21479]: cephadm 2024-02-13T14:35:13.761230+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:35:16.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:16 smithi062 bash[21479]: cluster 2024-02-13T14:35:15.023041+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:18.366 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:35:18.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:18 smithi062 bash[21479]: cluster 2024-02-13T14:35:17.023399+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:20.555 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:20 smithi062 bash[21479]: cluster 2024-02-13T14:35:19.023754+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:20.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- 172.21.15.62:0/610972952 >> v1:172.21.15.62:6789/0 conn(0x7fdf94109770 legacy=0x7fdf94109b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:20.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- 172.21.15.62:0/610972952 shutdown_connections 2024-02-13T14:35:20.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- 172.21.15.62:0/610972952 >> 172.21.15.62:0/610972952 conn(0x7fdf940ff280 msgr2=0x7fdf941016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:20.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- 172.21.15.62:0/610972952 shutdown_connections 2024-02-13T14:35:20.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- 172.21.15.62:0/610972952 wait complete. 2024-02-13T14:35:20.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 Processor -- start 2024-02-13T14:35:20.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- start start 2024-02-13T14:35:20.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fdf94198a10 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf937fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdf94109770 0x7fdf94198300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:56096/0 (socket says 172.21.15.62:56096) 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf937fe700 1 -- 172.21.15.62:0/961992515 learned_addr learned my addr 172.21.15.62:0/961992515 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955065653 0 0) 0x7fdf94198a10 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf800054f0 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3172011908 0 0) 0x7fdf800054f0 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdf94198a10 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fdf84001d00 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2143627456 0 0) 0x7fdf94198a10 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94198ba0 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf94198e50 con 0x7fdf94109770 2024-02-13T14:35:20.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf941a1030 con 0x7fdf94109770 2024-02-13T14:35:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fdf84001580 con 0x7fdf94109770 2024-02-13T14:35:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7fdf84005210 con 0x7fdf94109770 2024-02-13T14:35:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf74005120 con 0x7fdf94109770 2024-02-13T14:35:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7fdf84005390 con 0x7fdf94109770 2024-02-13T14:35:20.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.715+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(3..3 src has 1..3) v4 ==== 1069+0+0 (unknown 2814317136 0 0) 0x7fdf84047c60 con 0x7fdf94109770 2024-02-13T14:35:20.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.723+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fdf84005780 con 0x7fdf94109770 2024-02-13T14:35:20.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:20.935+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fdf740053d0 con 0x7fdf94109770 2024-02-13T14:35:21.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:21.199+0000 7fdf917fa700 1 -- 172.21.15.62:0/961992515 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (unknown 3126668360 0 0) 0x7fdf84015330 con 0x7fdf94109770 2024-02-13T14:35:21.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:21.199+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 >> v1:172.21.15.62:6800/1926838190 conn(0x7fdf8003a490 legacy=0x7fdf8003c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:21.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:21.199+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 >> v1:172.21.15.62:6789/0 conn(0x7fdf94109770 legacy=0x7fdf94198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:21.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:21.199+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 shutdown_connections 2024-02-13T14:35:21.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:21.199+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 >> 172.21.15.62:0/961992515 conn(0x7fdf940ff280 msgr2=0x7fdf940ff660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:21.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:21.199+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 shutdown_connections 2024-02-13T14:35:21.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:21.199+0000 7fdf9a14e700 1 -- 172.21.15.62:0/961992515 wait complete. 2024-02-13T14:35:21.206 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-02-13T14:35:21.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:21 smithi062 bash[21479]: audit 2024-02-13T14:35:20.939488+0000 mon.a (mon.0) 127 : audit 1 from='client.? v1:172.21.15.62:0/961992515' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-13T14:35:21.830 INFO:tasks.cephadm:Adding mon.a on smithi062 2024-02-13T14:35:21.830 INFO:tasks.cephadm:Adding mon.c on smithi062 2024-02-13T14:35:21.830 INFO:tasks.cephadm:Adding mon.b on smithi111 2024-02-13T14:35:21.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch apply mon '3;smithi062:[v1:172.21.15.62:6789]=a;smithi062:[v1:172.21.15.62:6790]=c;smithi111:[v1:172.21.15.111:6789]=b' 2024-02-13T14:35:22.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:22 smithi062 bash[21479]: cluster 2024-02-13T14:35:21.024163+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:22.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:22 smithi062 bash[21479]: audit 2024-02-13T14:35:21.202339+0000 mon.a (mon.0) 128 : audit 1 from='client.? v1:172.21.15.62:0/961992515' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-13T14:35:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:22 smithi062 bash[21479]: cluster 2024-02-13T14:35:21.207263+0000 mon.a (mon.0) 129 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:23.035 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:24.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:24 smithi062 bash[21479]: cluster 2024-02-13T14:35:23.024552+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:25.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f45685b7700 1 -- 172.21.15.111:0/1092985327 >> v1:172.21.15.62:6789/0 conn(0x7f45601064f0 legacy=0x7f45601068d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f45685b7700 1 -- 172.21.15.111:0/1092985327 shutdown_connections 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f45685b7700 1 -- 172.21.15.111:0/1092985327 >> 172.21.15.111:0/1092985327 conn(0x7f45600fbf30 msgr2=0x7f45600fe350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f45685b7700 1 -- 172.21.15.111:0/1092985327 shutdown_connections 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f45685b7700 1 -- 172.21.15.111:0/1092985327 wait complete. 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f45685b7700 1 Processor -- start 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f45685b7700 1 -- start start 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f45685b7700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4560197670 con 0x7f45601064f0 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f4566353700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f45601064f0 0x7f4560196f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.111:60592/0 (socket says 172.21.15.111:60592) 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.339+0000 7f4566353700 1 -- 172.21.15.111:0/1398158116 learned_addr learned my addr 172.21.15.111:0/1398158116 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440182849 0 0) 0x7f4560197670 con 0x7f45601064f0 2024-02-13T14:35:25.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f454c005540 con 0x7f45601064f0 2024-02-13T14:35:25.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 495775179 0 0) 0x7f454c005540 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4560197670 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f4558001840 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2480638789 0 0) 0x7f4560197670 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560197800 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4560197ab0 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f456019efd0 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f4558003e90 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f45580051b0 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4544005120 con 0x7f45601064f0 2024-02-13T14:35:25.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7f4558003a00 con 0x7f45601064f0 2024-02-13T14:35:25.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.343+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 3053702292 0 0) 0x7f45580479b0 con 0x7f45601064f0 2024-02-13T14:35:25.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.359+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f4558005330 con 0x7f45601064f0 2024-02-13T14:35:25.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.579+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi062:[v1:172.21.15.62:6789]=a;smithi062:[v1:172.21.15.62:6790]=c;smithi111:[v1:172.21.15.111:6789]=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f4544000c60 con 0x7f454c03a490 2024-02-13T14:35:25.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.599+0000 7f45577fe700 1 -- 172.21.15.111:0/1398158116 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 3265049985) 0x7f4544000c60 con 0x7f454c03a490 2024-02-13T14:35:25.601 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled mon update... 2024-02-13T14:35:25.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.599+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 >> v1:172.21.15.62:6800/1926838190 conn(0x7f454c03a490 legacy=0x7f454c03c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:25.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.599+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 >> v1:172.21.15.62:6789/0 conn(0x7f45601064f0 legacy=0x7f4560196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:25.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.599+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 shutdown_connections 2024-02-13T14:35:25.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.599+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 >> 172.21.15.111:0/1398158116 conn(0x7f45600fbf30 msgr2=0x7f45601072e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:25.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.599+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 shutdown_connections 2024-02-13T14:35:25.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:25.599+0000 7f45685b7700 1 -- 172.21.15.111:0/1398158116 wait complete. 2024-02-13T14:35:26.282 DEBUG:teuthology.orchestra.run.smithi062:mon.c> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.c.service 2024-02-13T14:35:26.285 DEBUG:teuthology.orchestra.run.smithi111:mon.b> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.b.service 2024-02-13T14:35:26.287 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-13T14:35:26.287 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph mon dump -f json 2024-02-13T14:35:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: cluster 2024-02-13T14:35:25.024998+0000 mgr.y (mgr.14152) 43 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: audit 2024-02-13T14:35:25.589217+0000 mgr.y (mgr.14152) 44 : audit 0 from='client.14184 v1:172.21.15.111:0/1398158116' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi062:[v1:172.21.15.62:6789]=a;smithi062:[v1:172.21.15.62:6790]=c;smithi111:[v1:172.21.15.111:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: cephadm 2024-02-13T14:35:25.595228+0000 mgr.y (mgr.14152) 45 : cephadm 1 Saving service mon spec with placement smithi062:[v1:172.21.15.62:6789]=a;smithi062:[v1:172.21.15.62:6790]=c;smithi111:[v1:172.21.15.111:6789]=b;count:3 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: audit 2024-02-13T14:35:25.601037+0000 mon.a (mon.0) 130 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: audit 2024-02-13T14:35:25.604453+0000 mon.a (mon.0) 131 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: audit 2024-02-13T14:35:25.608114+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: audit 2024-02-13T14:35:25.609957+0000 mon.a (mon.0) 133 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: audit 2024-02-13T14:35:25.617706+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: audit 2024-02-13T14:35:25.621891+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: audit 2024-02-13T14:35:25.623568+0000 mon.a (mon.0) 136 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:26 smithi062 bash[21479]: cephadm 2024-02-13T14:35:25.625495+0000 mgr.y (mgr.14152) 46 : cephadm 1 Deploying daemon mon.b on smithi111 2024-02-13T14:35:28.008 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:28 smithi062 bash[21479]: cluster 2024-02-13T14:35:27.025373+0000 mgr.y (mgr.14152) 47 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:30.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f81a1ea3700 1 -- 172.21.15.111:0/1627244104 >> v1:172.21.15.62:6789/0 conn(0x7f819c107640 legacy=0x7f819c107a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:30.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f81a1ea3700 1 -- 172.21.15.111:0/1627244104 shutdown_connections 2024-02-13T14:35:30.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f81a1ea3700 1 -- 172.21.15.111:0/1627244104 >> 172.21.15.111:0/1627244104 conn(0x7f819c0fd0a0 msgr2=0x7f819c0ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:30.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f81a1ea3700 1 -- 172.21.15.111:0/1627244104 shutdown_connections 2024-02-13T14:35:30.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f81a1ea3700 1 -- 172.21.15.111:0/1627244104 wait complete. 2024-02-13T14:35:30.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f81a1ea3700 1 Processor -- start 2024-02-13T14:35:30.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f81a1ea3700 1 -- start start 2024-02-13T14:35:30.809 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f81a1ea3700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f819c196800 con 0x7f819c107640 2024-02-13T14:35:30.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f819b7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f819c107640 0x7f819c1960f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.111:59208/0 (socket says 172.21.15.111:59208) 2024-02-13T14:35:30.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f819b7fe700 1 -- 172.21.15.111:0/3903665950 learned_addr learned my addr 172.21.15.111:0/3903665950 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:35:30.810 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016379326 0 0) 0x7f819c196800 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8184005540 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 198426976 0 0) 0x7f8184005540 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f819c196800 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f818c0014c0 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2036564142 0 0) 0x7f819c196800 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.803+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c196990 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.807+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c196c40 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.807+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c19eea0 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.807+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f818c003b10 con 0x7f819c107640 2024-02-13T14:35:30.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.807+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 170+0+0 (unknown 2176485395 0 0) 0x7f818c004d70 con 0x7f819c107640 2024-02-13T14:35:30.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.807+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8188005120 con 0x7f819c107640 2024-02-13T14:35:30.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.807+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7f818c003680 con 0x7f819c107640 2024-02-13T14:35:30.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.807+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 3053702292 0 0) 0x7f818c047550 con 0x7f819c107640 2024-02-13T14:35:30.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:30.819+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f818c015950 con 0x7f819c107640 2024-02-13T14:35:31.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:30 smithi062 bash[21479]: cluster 2024-02-13T14:35:29.025765+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:31.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:31.135+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f81880053d0 con 0x7f819c107640 2024-02-13T14:35:31.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:31.135+0000 7f8198ff9700 1 -- 172.21.15.111:0/3903665950 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+694 (unknown 2237029548 0 616732364) 0x7f818c015770 con 0x7f819c107640 2024-02-13T14:35:31.141 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-02-13T14:35:31.141 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":1,"fsid":"9cdb3692-ca7c-11ee-95b9-87774f69a715","modified":"2024-02-13T14:33:11.220516Z","created":"2024-02-13T14:33:11.220516Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-13T14:35:31.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:31.139+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 >> v1:172.21.15.62:6800/1926838190 conn(0x7f818403a4e0 legacy=0x7f818403c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:31.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:31.139+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 >> v1:172.21.15.62:6789/0 conn(0x7f819c107640 legacy=0x7f819c1960f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:31.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:31.139+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 shutdown_connections 2024-02-13T14:35:31.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:31.139+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 >> 172.21.15.111:0/3903665950 conn(0x7f819c0fd0a0 msgr2=0x7f819c108570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:31.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:31.139+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 shutdown_connections 2024-02-13T14:35:31.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:31.139+0000 7f81a1ea3700 1 -- 172.21.15.111:0/3903665950 wait complete. 2024-02-13T14:35:31.144 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 1 2024-02-13T14:35:32.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.195+0000 7fc04de3ac80 1 mon.b@-1(???) e0 preinit fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:35:32.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 0 mon.b@-1(synchronizing).mds e1 new map 2024-02-13T14:35:32.220 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-02-13T14:35:32.221 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: e1 2024-02-13T14:35:32.294 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:31 smithi062 bash[21479]: audit 2024-02-13T14:35:30.973785+0000 mon.a (mon.0) 137 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.294 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:31 smithi062 bash[21479]: audit 2024-02-13T14:35:30.979664+0000 mon.a (mon.0) 138 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.294 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:31 smithi062 bash[21479]: audit 2024-02-13T14:35:31.011706+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.294 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:31 smithi062 bash[21479]: audit 2024-02-13T14:35:31.013122+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:32.295 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:31 smithi062 bash[21479]: audit 2024-02-13T14:35:31.014853+0000 mon.a (mon.0) 141 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:32.295 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:31 smithi062 bash[21479]: cephadm 2024-02-13T14:35:31.016893+0000 mgr.y (mgr.14152) 49 : cephadm 1 Deploying daemon mon.c on smithi062 2024-02-13T14:35:32.295 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:31 smithi062 bash[21479]: cluster 2024-02-13T14:35:31.026133+0000 mgr.y (mgr.14152) 50 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.295 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:31 smithi062 bash[21479]: audit 2024-02-13T14:35:31.141694+0000 mon.a (mon.0) 142 : audit 0 from='client.? v1:172.21.15.111:0/3903665950' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: enable_multiple, ever_enabled_multiple: 1,1 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: legacy client fscid: -1 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: No filesystems configured 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-13T14:35:32.597 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.215+0000 7fc03f5af700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:50.710650+0000 mgr.y (mgr.14152) 13 : audit 0 from='client.14176 v1:172.21.15.62:0/2580587832' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:50.717270+0000 mon.a (mon.0) 105 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:50.756829+0000 mon.a (mon.0) 106 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:50.758381+0000 mon.a (mon.0) 107 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:50.759393+0000 mon.a (mon.0) 108 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:34:50.760501+0000 mgr.y (mgr.14152) 14 : cephadm 1 Updating smithi062:/etc/ceph/ceph.conf 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:34:50.874594+0000 mgr.y (mgr.14152) 15 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:32.598 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:34:51.018476+0000 mgr.y (mgr.14152) 16 : cluster 0 pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.599 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:34:51.039261+0000 mgr.y (mgr.14152) 17 : cephadm 1 Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:35:32.599 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:34:51.203690+0000 mgr.y (mgr.14152) 18 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:35:32.599 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:51.373043+0000 mon.a (mon.0) 109 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:51.377790+0000 mon.a (mon.0) 110 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:51.383082+0000 mon.a (mon.0) 111 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:34:53.018790+0000 mgr.y (mgr.14152) 19 : cluster 0 pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:34:55.019150+0000 mgr.y (mgr.14152) 20 : cluster 0 pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:34:57.019529+0000 mgr.y (mgr.14152) 21 : cluster 0 pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:34:58.766882+0000 mgr.y (mgr.14152) 22 : audit 0 from='client.14178 v1:172.21.15.62:0/3487753127' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi111", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:34:59.019941+0000 mgr.y (mgr.14152) 23 : cluster 0 pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:34:59.460502+0000 mgr.y (mgr.14152) 24 : cephadm 1 Deploying cephadm binary to smithi111 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:01.020407+0000 mgr.y (mgr.14152) 25 : cluster 0 pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:03.020750+0000 mgr.y (mgr.14152) 26 : cluster 0 pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:05.021161+0000 mgr.y (mgr.14152) 27 : cluster 0 pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.600 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:05.088620+0000 mon.a (mon.0) 112 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:35:05.089489+0000 mgr.y (mgr.14152) 28 : cephadm 1 Added host smithi111 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:05.107818+0000 mon.a (mon.0) 113 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:05.580241+0000 mon.a (mon.0) 114 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:07.021580+0000 mgr.y (mgr.14152) 29 : cluster 0 pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:07.054319+0000 mon.a (mon.0) 115 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:08.204389+0000 mon.a (mon.0) 116 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:09.021939+0000 mgr.y (mgr.14152) 30 : cluster 0 pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:11.022357+0000 mgr.y (mgr.14152) 31 : cluster 0 pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:13.022682+0000 mgr.y (mgr.14152) 32 : cluster 0 pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.030589+0000 mgr.y (mgr.14152) 33 : audit 0 from='client.14180 v1:172.21.15.62:0/1747904057' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.187845+0000 mon.a (mon.0) 117 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.193509+0000 mon.a (mon.0) 118 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.199376+0000 mon.a (mon.0) 119 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.206877+0000 mon.a (mon.0) 120 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.601 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.208086+0000 mon.a (mon.0) 121 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi111", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.209505+0000 mon.a (mon.0) 122 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.213599+0000 mon.a (mon.0) 123 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:35:13.216047+0000 mgr.y (mgr.14152) 34 : cephadm 1 Updating smithi111:/etc/ceph/ceph.conf 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:35:13.431577+0000 mgr.y (mgr.14152) 35 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:35:13.596372+0000 mgr.y (mgr.14152) 36 : cephadm 1 Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.931210+0000 mon.a (mon.0) 124 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.936225+0000 mon.a (mon.0) 125 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:13.944371+0000 mon.a (mon.0) 126 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:35:13.761230+0000 mgr.y (mgr.14152) 37 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:15.023041+0000 mgr.y (mgr.14152) 38 : cluster 0 pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:17.023399+0000 mgr.y (mgr.14152) 39 : cluster 0 pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:19.023754+0000 mgr.y (mgr.14152) 40 : cluster 0 pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:20.939488+0000 mon.a (mon.0) 127 : audit 1 from='client.? v1:172.21.15.62:0/961992515' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:21.024163+0000 mgr.y (mgr.14152) 41 : cluster 0 pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.602 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:21.202339+0000 mon.a (mon.0) 128 : audit 1 from='client.? v1:172.21.15.62:0/961992515' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:21.207263+0000 mon.a (mon.0) 129 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:23.024552+0000 mgr.y (mgr.14152) 42 : cluster 0 pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:25.024998+0000 mgr.y (mgr.14152) 43 : cluster 0 pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:25.589217+0000 mgr.y (mgr.14152) 44 : audit 0 from='client.14184 v1:172.21.15.111:0/1398158116' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi062:[v1:172.21.15.62:6789]=a;smithi062:[v1:172.21.15.62:6790]=c;smithi111:[v1:172.21.15.111:6789]=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:35:25.595228+0000 mgr.y (mgr.14152) 45 : cephadm 1 Saving service mon spec with placement smithi062:[v1:172.21.15.62:6789]=a;smithi062:[v1:172.21.15.62:6790]=c;smithi111:[v1:172.21.15.111:6789]=b;count:3 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:25.601037+0000 mon.a (mon.0) 130 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:25.604453+0000 mon.a (mon.0) 131 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:25.608114+0000 mon.a (mon.0) 132 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:25.609957+0000 mon.a (mon.0) 133 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:25.617706+0000 mon.a (mon.0) 134 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:25.621891+0000 mon.a (mon.0) 135 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:25.623568+0000 mon.a (mon.0) 136 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:35:25.625495+0000 mgr.y (mgr.14152) 46 : cephadm 1 Deploying daemon mon.b on smithi111 2024-02-13T14:35:32.603 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:27.025373+0000 mgr.y (mgr.14152) 47 : cluster 0 pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:29.025765+0000 mgr.y (mgr.14152) 48 : cluster 0 pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:30.973785+0000 mon.a (mon.0) 137 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:30.979664+0000 mon.a (mon.0) 138 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:31.011706+0000 mon.a (mon.0) 139 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:31.013122+0000 mon.a (mon.0) 140 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:31.014853+0000 mon.a (mon.0) 141 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cephadm 2024-02-13T14:35:31.016893+0000 mgr.y (mgr.14152) 49 : cephadm 1 Deploying daemon mon.c on smithi062 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: cluster 2024-02-13T14:35:31.026133+0000 mgr.y (mgr.14152) 50 : cluster 0 pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: audit 2024-02-13T14:35:31.141694+0000 mon.a (mon.0) 142 : audit 0 from='client.? v1:172.21.15.111:0/3903665950' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T14:35:32.604 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:32 smithi111 bash[23388]: debug 2024-02-13T14:35:32.219+0000 7fc03f5af700 1 mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-13T14:35:32.966 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-13T14:35:32.967 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph mon dump -f json 2024-02-13T14:35:34.786 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:34 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:35:34.786 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:35:34 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:35:35.061 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:35:34 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:35:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:34 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:35:36.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:35 smithi062 bash[28859]: debug 2024-02-13T14:35:35.723+0000 7ff13f36f700 1 mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-02-13T14:35:36.667 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:32.236711+0000 mon.a (mon.0) 144 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:32.236971+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:32.237140+0000 mon.a (mon.0) 146 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:33.026533+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:33.228874+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:34.229157+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:34.229613+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:35.026937+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:35.229220+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:35.732910+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:36.229411+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.631 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:36.733336+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:37.229442+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:37.277935+0000 mon.a (mon.0) 154 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:37.288825+0000 mon.a (mon.0) 155 : cluster 0 monmap e2: 2 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:37.307342+0000 mon.a (mon.0) 156 : cluster 0 fsmap 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:37.307435+0000 mon.a (mon.0) 157 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:37.307784+0000 mon.a (mon.0) 158 : cluster 0 mgrmap e13: y(active, since 74s) 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: cluster 2024-02-13T14:35:37.308122+0000 mon.a (mon.0) 159 : cluster 1 overall HEALTH_OK 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:37.316810+0000 mon.a (mon.0) 160 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:37.324783+0000 mon.a (mon.0) 161 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:37.632 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:37 smithi111 bash[23388]: audit 2024-02-13T14:35:37.351553+0000 mon.a (mon.0) 162 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:37.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:32.236711+0000 mon.a (mon.0) 144 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:32.236971+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:32.237140+0000 mon.a (mon.0) 146 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:33.026533+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:33.228874+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:34.229157+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:34.229613+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:35.026937+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:35.229220+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:35.732910+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:36.229411+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:36.733336+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:37.229442+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:37.277935+0000 mon.a (mon.0) 154 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T14:35:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:37.288825+0000 mon.a (mon.0) 155 : cluster 0 monmap e2: 2 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:37.307342+0000 mon.a (mon.0) 156 : cluster 0 fsmap 2024-02-13T14:35:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:37.307435+0000 mon.a (mon.0) 157 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:37.307784+0000 mon.a (mon.0) 158 : cluster 0 mgrmap e13: y(active, since 74s) 2024-02-13T14:35:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: cluster 2024-02-13T14:35:37.308122+0000 mon.a (mon.0) 159 : cluster 1 overall HEALTH_OK 2024-02-13T14:35:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:37.316810+0000 mon.a (mon.0) 160 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:37.324783+0000 mon.a (mon.0) 161 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:37 smithi062 bash[21479]: audit 2024-02-13T14:35:37.351553+0000 mon.a (mon.0) 162 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:38.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:35:38 smithi062 bash[21731]: debug 2024-02-13T14:35:38.223+0000 7fc80e7dd700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-13T14:35:42.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1083607571 >> v1:172.21.15.62:6789/0 conn(0x7fe2cc0035f0 legacy=0x7fe2cc005a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:42.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1083607571 shutdown_connections 2024-02-13T14:35:42.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1083607571 >> 172.21.15.111:0/1083607571 conn(0x7fe2ec0fd170 msgr2=0x7fe2ec0ff590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:42.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1083607571 shutdown_connections 2024-02-13T14:35:42.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1083607571 wait complete. 2024-02-13T14:35:42.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 Processor -- start 2024-02-13T14:35:42.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- start start 2024-02-13T14:35:42.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe2ec1a6200 con 0x7fe2ec1969b0 2024-02-13T14:35:42.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe2ec1a73e0 con 0x7fe2cc0035f0 2024-02-13T14:35:42.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2f0e72700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe2ec1a85e0 con 0x7fe2ec1a2530 2024-02-13T14:35:42.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2ea59c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fe2cc0035f0 0x7fe2ec1962a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55020/0 (socket says 172.21.15.111:55020) 2024-02-13T14:35:42.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.787+0000 7fe2ea59c700 1 -- 172.21.15.111:0/1088288460 learned_addr learned my addr 172.21.15.111:0/1088288460 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:35:42.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.791+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325329380 0 0) 0x7fe2ec1a6200 con 0x7fe2ec1969b0 2024-02-13T14:35:42.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.791+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4003bb0 con 0x7fe2ec1969b0 2024-02-13T14:35:42.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.795+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2903362051 0 0) 0x7fe2d4003bb0 con 0x7fe2ec1969b0 2024-02-13T14:35:42.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.795+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2ec1a6200 con 0x7fe2ec1969b0 2024-02-13T14:35:42.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.795+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe2e0001830 con 0x7fe2ec1969b0 2024-02-13T14:35:42.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.799+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456165801 0 0) 0x7fe2ec1a73e0 con 0x7fe2cc0035f0 2024-02-13T14:35:42.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.799+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4003bb0 con 0x7fe2cc0035f0 2024-02-13T14:35:42.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.799+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2587873094 0 0) 0x7fe2d4003bb0 con 0x7fe2cc0035f0 2024-02-13T14:35:42.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.799+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2ec1a73e0 con 0x7fe2cc0035f0 2024-02-13T14:35:42.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.799+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe2dc004430 con 0x7fe2cc0035f0 2024-02-13T14:35:42.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.803+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 178353532 0 0) 0x7fe2ec1a6200 con 0x7fe2ec1969b0 2024-02-13T14:35:42.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.803+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 >> v1:172.21.15.62:6790/0 conn(0x7fe2ec1a2530 legacy=0x7fe2ec1a4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:42.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.803+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 >> v1:172.21.15.111:6789/0 conn(0x7fe2cc0035f0 legacy=0x7fe2ec1962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:42.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.803+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec1a97e0 con 0x7fe2ec1969b0 2024-02-13T14:35:42.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.803+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2ec1a63f0 con 0x7fe2ec1969b0 2024-02-13T14:35:42.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.803+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2ec1a6870 con 0x7fe2ec1969b0 2024-02-13T14:35:42.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.803+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2ec0632a0 con 0x7fe2ec1969b0 2024-02-13T14:35:42.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.807+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fe2e0001990 con 0x7fe2ec1969b0 2024-02-13T14:35:42.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.807+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe2e0004900 con 0x7fe2ec1969b0 2024-02-13T14:35:42.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.807+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7fe2e000fee0 con 0x7fe2ec1969b0 2024-02-13T14:35:42.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.807+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 3053702292 0 0) 0x7fe2e0046130 con 0x7fe2ec1969b0 2024-02-13T14:35:42.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:42.819+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fe2e0011830 con 0x7fe2ec1969b0 2024-02-13T14:35:43.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:37.738998+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:43.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:37.740340+0000 mon.a (mon.0) 166 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:37.740690+0000 mon.a (mon.0) 167 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:37.759423+0000 mon.a (mon.0) 168 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:37.759647+0000 mon.a (mon.0) 169 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:38.733671+0000 mon.a (mon.0) 170 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:39.027697+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:39.733862+0000 mon.a (mon.0) 171 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:40.734049+0000 mon.a (mon.0) 172 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:41.028104+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:43.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:41.734217+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:42.733542+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.759596+0000 mon.a (mon.0) 175 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.764989+0000 mon.a (mon.0) 176 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0,c=v1:172.21.15.62:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.783390+0000 mon.a (mon.0) 177 : cluster 0 fsmap 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.783447+0000 mon.a (mon.0) 178 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.783731+0000 mon.a (mon.0) 179 : cluster 0 mgrmap e13: y(active, since 79s) 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.784031+0000 mon.a (mon.0) 180 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.790895+0000 mon.a (mon.0) 181 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.790926+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-02-13T14:35:43.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: cluster 2024-02-13T14:35:42.790945+0000 mon.a (mon.0) 183 : cluster 3 mon.c (rank 2) addr v1:172.21.15.62:6790/0 is down (out of quorum) 2024-02-13T14:35:43.100 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:42.795166+0000 mon.a (mon.0) 184 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.100 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:42.800543+0000 mon.a (mon.0) 185 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.100 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:42.805955+0000 mon.a (mon.0) 186 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.100 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:42 smithi111 bash[23388]: audit 2024-02-13T14:35:42.830623+0000 mon.a (mon.0) 187 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:43.135+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe2ec197600 con 0x7fe2ec1969b0 2024-02-13T14:35:43.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:43.139+0000 7fe2db7fe700 1 -- 172.21.15.111:0/1088288460 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1125 (unknown 409899127 0 3262034215) 0x7fe2e0013930 con 0x7fe2ec1969b0 2024-02-13T14:35:43.144 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-02-13T14:35:43.144 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":3,"fsid":"9cdb3692-ca7c-11ee-95b9-87774f69a715","modified":"2024-02-13T14:35:37.734369Z","created":"2024-02-13T14:33:11.220516Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6789","nonce":0}]},"addr":"172.21.15.111:6789/0","public_addr":"172.21.15.111:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6790","nonce":0}]},"addr":"172.21.15.62:6790/0","public_addr":"172.21.15.62:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-13T14:35:43.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:43.139+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 >> v1:172.21.15.62:6800/1926838190 conn(0x7fe2d403a4e0 legacy=0x7fe2d403c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:43.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:43.139+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 >> v1:172.21.15.62:6789/0 conn(0x7fe2ec1969b0 legacy=0x7fe2ec1a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:43.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:43.139+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 shutdown_connections 2024-02-13T14:35:43.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:43.139+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 >> 172.21.15.111:0/1088288460 conn(0x7fe2ec0fd170 msgr2=0x7fe2ec1051b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:43.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:43.139+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 shutdown_connections 2024-02-13T14:35:43.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:43.139+0000 7fe2f0e72700 1 -- 172.21.15.111:0/1088288460 wait complete. 2024-02-13T14:35:43.147 INFO:teuthology.orchestra.run.smithi111.stderr:dumped monmap epoch 3 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:37.738998+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:37.740340+0000 mon.a (mon.0) 166 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:37.740690+0000 mon.a (mon.0) 167 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:37.759423+0000 mon.a (mon.0) 168 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:37.759647+0000 mon.a (mon.0) 169 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:38.733671+0000 mon.a (mon.0) 170 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:39.027697+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:39.733862+0000 mon.a (mon.0) 171 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:40.734049+0000 mon.a (mon.0) 172 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:41.028104+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:41.734217+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:42.733542+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.759596+0000 mon.a (mon.0) 175 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.764989+0000 mon.a (mon.0) 176 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0,c=v1:172.21.15.62:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.783390+0000 mon.a (mon.0) 177 : cluster 0 fsmap 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.783447+0000 mon.a (mon.0) 178 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.783731+0000 mon.a (mon.0) 179 : cluster 0 mgrmap e13: y(active, since 79s) 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.784031+0000 mon.a (mon.0) 180 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.790895+0000 mon.a (mon.0) 181 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.790926+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: cluster 2024-02-13T14:35:42.790945+0000 mon.a (mon.0) 183 : cluster 3 mon.c (rank 2) addr v1:172.21.15.62:6790/0 is down (out of quorum) 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:42.795166+0000 mon.a (mon.0) 184 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:42.800543+0000 mon.a (mon.0) 185 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:42.805955+0000 mon.a (mon.0) 186 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:42 smithi062 bash[21479]: audit 2024-02-13T14:35:42.830623+0000 mon.a (mon.0) 187 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.836 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-13T14:35:43.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph config generate-minimal-conf 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:42.836606+0000 mon.a (mon.0) 188 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: cluster 2024-02-13T14:35:43.028418+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.144210+0000 mon.a (mon.0) 189 : audit 0 from='client.? v1:172.21.15.111:0/1088288460' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.455178+0000 mon.a (mon.0) 190 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.456550+0000 mon.a (mon.0) 191 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: cephadm 2024-02-13T14:35:43.458707+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi062:/etc/ceph/ceph.conf 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: cephadm 2024-02-13T14:35:43.459068+0000 mgr.y (mgr.14152) 58 : cephadm 1 Updating smithi111:/etc/ceph/ceph.conf 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: cephadm 2024-02-13T14:35:43.623366+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: cephadm 2024-02-13T14:35:43.623711+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.733984+0000 mon.a (mon.0) 192 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:43.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.793578+0000 mon.a (mon.0) 193 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.797943+0000 mon.a (mon.0) 194 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.802505+0000 mon.a (mon.0) 195 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.807153+0000 mon.a (mon.0) 196 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:43.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:43 smithi111 bash[23388]: audit 2024-02-13T14:35:43.812106+0000 mon.a (mon.0) 197 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:44.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:42.836606+0000 mon.a (mon.0) 188 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:44.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: cluster 2024-02-13T14:35:43.028418+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.144210+0000 mon.a (mon.0) 189 : audit 0 from='client.? v1:172.21.15.111:0/1088288460' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.455178+0000 mon.a (mon.0) 190 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.456550+0000 mon.a (mon.0) 191 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: cephadm 2024-02-13T14:35:43.458707+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi062:/etc/ceph/ceph.conf 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: cephadm 2024-02-13T14:35:43.459068+0000 mgr.y (mgr.14152) 58 : cephadm 1 Updating smithi111:/etc/ceph/ceph.conf 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: cephadm 2024-02-13T14:35:43.623366+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: cephadm 2024-02-13T14:35:43.623711+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.733984+0000 mon.a (mon.0) 192 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.793578+0000 mon.a (mon.0) 193 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.797943+0000 mon.a (mon.0) 194 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.802505+0000 mon.a (mon.0) 195 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.807153+0000 mon.a (mon.0) 196 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:43 smithi062 bash[21479]: audit 2024-02-13T14:35:43.812106+0000 mon.a (mon.0) 197 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:32.236711+0000 mon.a (mon.0) 144 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:32.236971+0000 mon.a (mon.0) 145 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:32.237140+0000 mon.a (mon.0) 146 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:33.026533+0000 mgr.y (mgr.14152) 51 : cluster 0 pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:33.228874+0000 mon.a (mon.0) 147 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:34.229157+0000 mon.a (mon.0) 148 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:34.229613+0000 mon.b (mon.1) 1 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:35.026937+0000 mgr.y (mgr.14152) 52 : cluster 0 pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:35.229220+0000 mon.a (mon.0) 149 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:35.732910+0000 mon.a (mon.0) 150 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:36.229411+0000 mon.a (mon.0) 151 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:36.733336+0000 mon.a (mon.0) 152 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:37.229442+0000 mon.a (mon.0) 153 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:37.277935+0000 mon.a (mon.0) 154 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:37.288825+0000 mon.a (mon.0) 155 : cluster 0 monmap e2: 2 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:37.307342+0000 mon.a (mon.0) 156 : cluster 0 fsmap 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:37.307435+0000 mon.a (mon.0) 157 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:37.307784+0000 mon.a (mon.0) 158 : cluster 0 mgrmap e13: y(active, since 74s) 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:37.308122+0000 mon.a (mon.0) 159 : cluster 1 overall HEALTH_OK 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:37.316810+0000 mon.a (mon.0) 160 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:37.324783+0000 mon.a (mon.0) 161 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:37.351553+0000 mon.a (mon.0) 162 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:39.736228+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.771633+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.772444+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.773507+0000 mon.a (mon.0) 206 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.794758+0000 mon.a (mon.0) 207 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.802414+0000 mon.a (mon.0) 208 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0,c=v1:172.21.15.62:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.803453+0000 mon.a (mon.0) 209 : cluster 0 fsmap 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.803521+0000 mon.a (mon.0) 210 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.803823+0000 mon.a (mon.0) 211 : cluster 0 mgrmap e13: y(active, since 81s) 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.804135+0000 mon.a (mon.0) 212 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.804185+0000 mon.a (mon.0) 213 : cluster 1 Cluster is now healthy 2024-02-13T14:35:45.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[21479]: cluster 2024-02-13T14:35:44.828651+0000 mon.a (mon.0) 214 : cluster 1 overall HEALTH_OK 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:37.738998+0000 mon.b (mon.1) 2 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:37.740340+0000 mon.a (mon.0) 166 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:37.740690+0000 mon.a (mon.0) 167 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:37.759423+0000 mon.a (mon.0) 168 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:37.759647+0000 mon.a (mon.0) 169 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:38.733671+0000 mon.a (mon.0) 170 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:39.027697+0000 mgr.y (mgr.14152) 54 : cluster 0 pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:39.733862+0000 mon.a (mon.0) 171 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:40.734049+0000 mon.a (mon.0) 172 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:41.028104+0000 mgr.y (mgr.14152) 55 : cluster 0 pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:41.734217+0000 mon.a (mon.0) 173 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:42.733542+0000 mon.a (mon.0) 174 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.759596+0000 mon.a (mon.0) 175 : cluster 1 mon.a is new leader, mons a,b in quorum (ranks 0,1) 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.764989+0000 mon.a (mon.0) 176 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0,c=v1:172.21.15.62:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.783390+0000 mon.a (mon.0) 177 : cluster 0 fsmap 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.783447+0000 mon.a (mon.0) 178 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.783731+0000 mon.a (mon.0) 179 : cluster 0 mgrmap e13: y(active, since 79s) 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.784031+0000 mon.a (mon.0) 180 : cluster 3 Health check failed: 1/3 mons down, quorum a,b (MON_DOWN) 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.790895+0000 mon.a (mon.0) 181 : cluster 3 Health detail: HEALTH_WARN 1/3 mons down, quorum a,b 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.790926+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:42.790945+0000 mon.a (mon.0) 183 : cluster 3 mon.c (rank 2) addr v1:172.21.15.62:6790/0 is down (out of quorum) 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:42.795166+0000 mon.a (mon.0) 184 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:42.800543+0000 mon.a (mon.0) 185 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:42.805955+0000 mon.a (mon.0) 186 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:42.830623+0000 mon.a (mon.0) 187 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:42.836606+0000 mon.a (mon.0) 188 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:43.028418+0000 mgr.y (mgr.14152) 56 : cluster 0 pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.144210+0000 mon.a (mon.0) 189 : audit 0 from='client.? v1:172.21.15.111:0/1088288460' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.455178+0000 mon.a (mon.0) 190 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.456550+0000 mon.a (mon.0) 191 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cephadm 2024-02-13T14:35:43.458707+0000 mgr.y (mgr.14152) 57 : cephadm 1 Updating smithi062:/etc/ceph/ceph.conf 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cephadm 2024-02-13T14:35:43.459068+0000 mgr.y (mgr.14152) 58 : cephadm 1 Updating smithi111:/etc/ceph/ceph.conf 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cephadm 2024-02-13T14:35:43.623366+0000 mgr.y (mgr.14152) 59 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cephadm 2024-02-13T14:35:43.623711+0000 mgr.y (mgr.14152) 60 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.733984+0000 mon.a (mon.0) 192 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.793578+0000 mon.a (mon.0) 193 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.797943+0000 mon.a (mon.0) 194 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.802505+0000 mon.a (mon.0) 195 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.807153+0000 mon.a (mon.0) 196 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: audit 2024-02-13T14:35:43.812106+0000 mon.a (mon.0) 197 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:39.736228+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.771633+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.772444+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.773507+0000 mon.a (mon.0) 206 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.794758+0000 mon.a (mon.0) 207 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.802414+0000 mon.a (mon.0) 208 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0,c=v1:172.21.15.62:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.803453+0000 mon.a (mon.0) 209 : cluster 0 fsmap 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.803521+0000 mon.a (mon.0) 210 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.803823+0000 mon.a (mon.0) 211 : cluster 0 mgrmap e13: y(active, since 81s) 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.804135+0000 mon.a (mon.0) 212 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.804185+0000 mon.a (mon.0) 213 : cluster 1 Cluster is now healthy 2024-02-13T14:35:45.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:44 smithi062 bash[28859]: cluster 2024-02-13T14:35:44.828651+0000 mon.a (mon.0) 214 : cluster 1 overall HEALTH_OK 2024-02-13T14:35:45.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:39.736228+0000 mon.c (mon.2) 1 : cluster 1 mon.c calling monitor election 2024-02-13T14:35:45.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.771633+0000 mon.b (mon.1) 3 : cluster 1 mon.b calling monitor election 2024-02-13T14:35:45.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.772444+0000 mon.c (mon.2) 2 : cluster 1 mon.c calling monitor election 2024-02-13T14:35:45.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.773507+0000 mon.a (mon.0) 206 : cluster 1 mon.a calling monitor election 2024-02-13T14:35:45.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.794758+0000 mon.a (mon.0) 207 : cluster 1 mon.a is new leader, mons a,b,c in quorum (ranks 0,1,2) 2024-02-13T14:35:45.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.802414+0000 mon.a (mon.0) 208 : cluster 0 monmap e3: 3 mons at {a=v1:172.21.15.62:6789/0,b=v1:172.21.15.111:6789/0,c=v1:172.21.15.62:6790/0} removed_ranks: {} disallowed_leaders: {} 2024-02-13T14:35:45.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.803453+0000 mon.a (mon.0) 209 : cluster 0 fsmap 2024-02-13T14:35:45.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.803521+0000 mon.a (mon.0) 210 : cluster 0 osdmap e4: 0 total, 0 up, 0 in 2024-02-13T14:35:45.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.803823+0000 mon.a (mon.0) 211 : cluster 0 mgrmap e13: y(active, since 81s) 2024-02-13T14:35:45.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.804135+0000 mon.a (mon.0) 212 : cluster 1 Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,b) 2024-02-13T14:35:45.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.804185+0000 mon.a (mon.0) 213 : cluster 1 Cluster is now healthy 2024-02-13T14:35:45.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:44 smithi111 bash[23388]: cluster 2024-02-13T14:35:44.828651+0000 mon.a (mon.0) 214 : cluster 1 overall HEALTH_OK 2024-02-13T14:35:46.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:45 smithi062 bash[28859]: cluster 2024-02-13T14:35:45.028844+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:46.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:45 smithi062 bash[28859]: audit 2024-02-13T14:35:45.734705+0000 mon.a (mon.0) 215 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:46.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:45 smithi062 bash[21479]: cluster 2024-02-13T14:35:45.028844+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:45 smithi062 bash[21479]: audit 2024-02-13T14:35:45.734705+0000 mon.a (mon.0) 215 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:46.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:45 smithi111 bash[23388]: cluster 2024-02-13T14:35:45.028844+0000 mgr.y (mgr.14152) 63 : cluster 0 pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:46.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:45 smithi111 bash[23388]: audit 2024-02-13T14:35:45.734705+0000 mon.a (mon.0) 215 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:35:47.418 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[21479]: audit 2024-02-13T14:35:46.156371+0000 mon.a (mon.0) 216 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:47.418 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[21479]: audit 2024-02-13T14:35:46.162803+0000 mon.a (mon.0) 217 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:47.418 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[21479]: cephadm 2024-02-13T14:35:46.168788+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-02-13T14:35:47.418 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[21479]: audit 2024-02-13T14:35:46.169193+0000 mon.a (mon.0) 218 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:47.418 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[21479]: audit 2024-02-13T14:35:46.170395+0000 mon.a (mon.0) 219 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T14:35:47.418 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[21479]: audit 2024-02-13T14:35:46.171435+0000 mon.a (mon.0) 220 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:47.418 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[21479]: cephadm 2024-02-13T14:35:46.173123+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi062 2024-02-13T14:35:47.419 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[28859]: audit 2024-02-13T14:35:46.156371+0000 mon.a (mon.0) 216 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:47.419 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[28859]: audit 2024-02-13T14:35:46.162803+0000 mon.a (mon.0) 217 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:47.419 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[28859]: cephadm 2024-02-13T14:35:46.168788+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-02-13T14:35:47.419 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[28859]: audit 2024-02-13T14:35:46.169193+0000 mon.a (mon.0) 218 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:47.419 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[28859]: audit 2024-02-13T14:35:46.170395+0000 mon.a (mon.0) 219 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T14:35:47.419 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[28859]: audit 2024-02-13T14:35:46.171435+0000 mon.a (mon.0) 220 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:47.419 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:47 smithi062 bash[28859]: cephadm 2024-02-13T14:35:46.173123+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi062 2024-02-13T14:35:47.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:47 smithi111 bash[23388]: audit 2024-02-13T14:35:46.156371+0000 mon.a (mon.0) 216 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:47.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:47 smithi111 bash[23388]: audit 2024-02-13T14:35:46.162803+0000 mon.a (mon.0) 217 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:47.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:47 smithi111 bash[23388]: cephadm 2024-02-13T14:35:46.168788+0000 mgr.y (mgr.14152) 64 : cephadm 1 Reconfiguring mon.c (monmap changed)... 2024-02-13T14:35:47.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:47 smithi111 bash[23388]: audit 2024-02-13T14:35:46.169193+0000 mon.a (mon.0) 218 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:47.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:47 smithi111 bash[23388]: audit 2024-02-13T14:35:46.170395+0000 mon.a (mon.0) 219 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T14:35:47.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:47 smithi111 bash[23388]: audit 2024-02-13T14:35:46.171435+0000 mon.a (mon.0) 220 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:47.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:47 smithi111 bash[23388]: cephadm 2024-02-13T14:35:46.173123+0000 mgr.y (mgr.14152) 65 : cephadm 1 Reconfiguring daemon mon.c on smithi062 2024-02-13T14:35:48.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:48 smithi062 bash[28859]: cluster 2024-02-13T14:35:47.029245+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:48 smithi062 bash[21479]: cluster 2024-02-13T14:35:47.029245+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:48.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:48 smithi111 bash[23388]: cluster 2024-02-13T14:35:47.029245+0000 mgr.y (mgr.14152) 66 : cluster 0 pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:48.632 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:35:49.460 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:49 smithi111 bash[23388]: audit 2024-02-13T14:35:48.183840+0000 mon.a (mon.0) 221 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:49.460 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:49 smithi111 bash[23388]: audit 2024-02-13T14:35:48.191275+0000 mon.a (mon.0) 222 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:49.460 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:49 smithi111 bash[23388]: cephadm 2024-02-13T14:35:48.241722+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-02-13T14:35:49.460 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:49 smithi111 bash[23388]: audit 2024-02-13T14:35:48.242342+0000 mon.a (mon.0) 223 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:49.460 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:49 smithi111 bash[23388]: audit 2024-02-13T14:35:48.244119+0000 mon.a (mon.0) 224 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T14:35:49.460 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:49 smithi111 bash[23388]: audit 2024-02-13T14:35:48.245694+0000 mon.a (mon.0) 225 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:49.460 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:49 smithi111 bash[23388]: cephadm 2024-02-13T14:35:48.247694+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi111 2024-02-13T14:35:49.470 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[21479]: audit 2024-02-13T14:35:48.183840+0000 mon.a (mon.0) 221 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:49.470 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[21479]: audit 2024-02-13T14:35:48.191275+0000 mon.a (mon.0) 222 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:49.470 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[21479]: cephadm 2024-02-13T14:35:48.241722+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-02-13T14:35:49.470 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[21479]: audit 2024-02-13T14:35:48.242342+0000 mon.a (mon.0) 223 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:49.470 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[21479]: audit 2024-02-13T14:35:48.244119+0000 mon.a (mon.0) 224 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T14:35:49.470 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[21479]: audit 2024-02-13T14:35:48.245694+0000 mon.a (mon.0) 225 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:49.470 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[21479]: cephadm 2024-02-13T14:35:48.247694+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi111 2024-02-13T14:35:49.471 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[28859]: audit 2024-02-13T14:35:48.183840+0000 mon.a (mon.0) 221 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:49.471 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[28859]: audit 2024-02-13T14:35:48.191275+0000 mon.a (mon.0) 222 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:49.471 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[28859]: cephadm 2024-02-13T14:35:48.241722+0000 mgr.y (mgr.14152) 67 : cephadm 1 Reconfiguring mon.b (monmap changed)... 2024-02-13T14:35:49.471 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[28859]: audit 2024-02-13T14:35:48.242342+0000 mon.a (mon.0) 223 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-13T14:35:49.471 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[28859]: audit 2024-02-13T14:35:48.244119+0000 mon.a (mon.0) 224 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-13T14:35:49.471 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[28859]: audit 2024-02-13T14:35:48.245694+0000 mon.a (mon.0) 225 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:49.471 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:49 smithi062 bash[28859]: cephadm 2024-02-13T14:35:48.247694+0000 mgr.y (mgr.14152) 68 : cephadm 1 Reconfiguring daemon mon.b on smithi111 2024-02-13T14:35:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[21479]: cluster 2024-02-13T14:35:49.029617+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[21479]: audit 2024-02-13T14:35:50.136316+0000 mon.a (mon.0) 226 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[21479]: audit 2024-02-13T14:35:50.143734+0000 mon.a (mon.0) 227 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[21479]: audit 2024-02-13T14:35:50.168649+0000 mon.a (mon.0) 228 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[21479]: audit 2024-02-13T14:35:50.172541+0000 mon.a (mon.0) 229 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[21479]: audit 2024-02-13T14:35:50.174633+0000 mon.a (mon.0) 230 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[21479]: audit 2024-02-13T14:35:50.182689+0000 mon.a (mon.0) 231 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[28859]: cluster 2024-02-13T14:35:49.029617+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[28859]: audit 2024-02-13T14:35:50.136316+0000 mon.a (mon.0) 226 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[28859]: audit 2024-02-13T14:35:50.143734+0000 mon.a (mon.0) 227 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[28859]: audit 2024-02-13T14:35:50.168649+0000 mon.a (mon.0) 228 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[28859]: audit 2024-02-13T14:35:50.172541+0000 mon.a (mon.0) 229 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[28859]: audit 2024-02-13T14:35:50.174633+0000 mon.a (mon.0) 230 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:50 smithi062 bash[28859]: audit 2024-02-13T14:35:50.182689+0000 mon.a (mon.0) 231 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:50 smithi111 bash[23388]: cluster 2024-02-13T14:35:49.029617+0000 mgr.y (mgr.14152) 69 : cluster 0 pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:50 smithi111 bash[23388]: audit 2024-02-13T14:35:50.136316+0000 mon.a (mon.0) 226 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:50 smithi111 bash[23388]: audit 2024-02-13T14:35:50.143734+0000 mon.a (mon.0) 227 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:50 smithi111 bash[23388]: audit 2024-02-13T14:35:50.168649+0000 mon.a (mon.0) 228 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:50 smithi111 bash[23388]: audit 2024-02-13T14:35:50.172541+0000 mon.a (mon.0) 229 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:50 smithi111 bash[23388]: audit 2024-02-13T14:35:50.174633+0000 mon.a (mon.0) 230 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:50 smithi111 bash[23388]: audit 2024-02-13T14:35:50.182689+0000 mon.a (mon.0) 231 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- 172.21.15.62:0/1942717996 >> v1:172.21.15.62:6790/0 conn(0x7fb32410cb50 legacy=0x7fb32410ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- 172.21.15.62:0/1942717996 shutdown_connections 2024-02-13T14:35:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- 172.21.15.62:0/1942717996 >> 172.21.15.62:0/1942717996 conn(0x7fb3240ff7b0 msgr2=0x7fb324101bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- 172.21.15.62:0/1942717996 shutdown_connections 2024-02-13T14:35:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- 172.21.15.62:0/1942717996 wait complete. 2024-02-13T14:35:51.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 Processor -- start 2024-02-13T14:35:51.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- start start 2024-02-13T14:35:51.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb3241a8b50 con 0x7fb324103ec0 2024-02-13T14:35:51.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb3241a9d30 con 0x7fb3241106f0 2024-02-13T14:35:51.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb32a870700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb3241aaf30 con 0x7fb32410cb50 2024-02-13T14:35:51.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb323fff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb324103ec0 0x7fb3241090f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52494/0 (socket says 172.21.15.62:52494) 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3237fe700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fb32410cb50 0x7fb3241a3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:36044/0 (socket says 172.21.15.62:36044) 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb323fff700 1 -- 172.21.15.62:0/1697496979 learned_addr learned my addr 172.21.15.62:0/1697496979 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1961863126 0 0) 0x7fb3241a8b50 con 0x7fb324103ec0 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3040035b0 con 0x7fb324103ec0 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 746267630 0 0) 0x7fb3241aaf30 con 0x7fb32410cb50 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3241a8b50 con 0x7fb32410cb50 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 379199622 0 0) 0x7fb3241a8b50 con 0x7fb32410cb50 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb3241aaf30 con 0x7fb32410cb50 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb314004660 con 0x7fb32410cb50 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3886066597 0 0) 0x7fb3040035b0 con 0x7fb324103ec0 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb3241a8b50 con 0x7fb324103ec0 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb30c001920 con 0x7fb324103ec0 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.171+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144868209 0 0) 0x7fb3241a9d30 con 0x7fb3241106f0 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3040035b0 con 0x7fb3241106f0 2024-02-13T14:35:51.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3620384434 0 0) 0x7fb3241aaf30 con 0x7fb32410cb50 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 >> v1:172.21.15.111:6789/0 conn(0x7fb3241106f0 legacy=0x7fb3241a7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 >> v1:172.21.15.62:6789/0 conn(0x7fb324103ec0 legacy=0x7fb3241090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3241ac130 con 0x7fb32410cb50 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3241ab120 con 0x7fb32410cb50 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3241ab5a0 con 0x7fb32410cb50 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fb314003e90 con 0x7fb32410cb50 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb314004fa0 con 0x7fb32410cb50 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb308005120 con 0x7fb32410cb50 2024-02-13T14:35:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7fb314005120 con 0x7fb32410cb50 2024-02-13T14:35:51.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.175+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 3053702292 0 0) 0x7fb314047810 con 0x7fb32410cb50 2024-02-13T14:35:51.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.179+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fb314005560 con 0x7fb32410cb50 2024-02-13T14:35:51.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.395+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fb3080053d0 con 0x7fb32410cb50 2024-02-13T14:35:51.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.395+0000 7fb3217fa700 1 -- 172.21.15.62:0/1697496979 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+191 (unknown 2189217731 0 36534369) 0x7fb314015170 con 0x7fb32410cb50 2024-02-13T14:35:51.401 INFO:teuthology.orchestra.run.smithi062.stdout:# minimal ceph.conf for 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:35:51.401 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-02-13T14:35:51.401 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:35:51.401 INFO:teuthology.orchestra.run.smithi062.stdout: mon_host = 172.21.15.62:6789/0 172.21.15.111:6789/0 v1:172.21.15.62:6790/0 2024-02-13T14:35:51.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.399+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 >> v1:172.21.15.62:6800/1926838190 conn(0x7fb30403a730 legacy=0x7fb30403cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.399+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 >> v1:172.21.15.62:6790/0 conn(0x7fb32410cb50 legacy=0x7fb3241a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.399+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 shutdown_connections 2024-02-13T14:35:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.399+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 >> 172.21.15.62:0/1697496979 conn(0x7fb3240ff7b0 msgr2=0x7fb324113880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.399+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 shutdown_connections 2024-02-13T14:35:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:35:51.399+0000 7fb32a870700 1 -- 172.21.15.62:0/1697496979 wait complete. 2024-02-13T14:35:52.003 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-13T14:35:52.004 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:35:52.004 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.conf 2024-02-13T14:35:52.018 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:35:52.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:35:52.073 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:35:52.073 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.conf 2024-02-13T14:35:52.087 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:35:52.088 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:35:52.143 INFO:tasks.cephadm:Adding mgr.y on smithi062 2024-02-13T14:35:52.143 INFO:tasks.cephadm:Adding mgr.x on smithi111 2024-02-13T14:35:52.143 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch apply mgr '2;smithi062=y;smithi111=x' 2024-02-13T14:35:52.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:52 smithi062 bash[28859]: cluster 2024-02-13T14:35:51.029972+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:52.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:52 smithi062 bash[28859]: audit 2024-02-13T14:35:51.401661+0000 mon.c (mon.2) 3 : audit 0 from='client.? v1:172.21.15.62:0/1697496979' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:52 smithi062 bash[21479]: cluster 2024-02-13T14:35:51.029972+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:52 smithi062 bash[21479]: audit 2024-02-13T14:35:51.401661+0000 mon.c (mon.2) 3 : audit 0 from='client.? v1:172.21.15.62:0/1697496979' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:52.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:52 smithi111 bash[23388]: cluster 2024-02-13T14:35:51.029972+0000 mgr.y (mgr.14152) 70 : cluster 0 pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:52.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:52 smithi111 bash[23388]: audit 2024-02-13T14:35:51.401661+0000 mon.c (mon.2) 3 : audit 0 from='client.? v1:172.21.15.62:0/1697496979' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:54 smithi062 bash[28859]: cluster 2024-02-13T14:35:53.030407+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:54.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:54 smithi062 bash[21479]: cluster 2024-02-13T14:35:53.030407+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:54.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:54 smithi111 bash[23388]: cluster 2024-02-13T14:35:53.030407+0000 mgr.y (mgr.14152) 71 : cluster 0 pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:55.883 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:35:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:56 smithi062 bash[21479]: cluster 2024-02-13T14:35:55.030777+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:56.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:56 smithi062 bash[28859]: cluster 2024-02-13T14:35:55.030777+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:56.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:56 smithi111 bash[23388]: cluster 2024-02-13T14:35:55.030777+0000 mgr.y (mgr.14152) 72 : cluster 0 pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:58.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- 172.21.15.111:0/2246733181 >> v1:172.21.15.111:6789/0 conn(0x7f2e50105ee0 legacy=0x7f2e50108330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- 172.21.15.111:0/2246733181 shutdown_connections 2024-02-13T14:35:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- 172.21.15.111:0/2246733181 >> 172.21.15.111:0/2246733181 conn(0x7f2e500fd070 msgr2=0x7f2e500ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- 172.21.15.111:0/2246733181 shutdown_connections 2024-02-13T14:35:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- 172.21.15.111:0/2246733181 wait complete. 2024-02-13T14:35:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 Processor -- start 2024-02-13T14:35:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- start start 2024-02-13T14:35:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2e50197880 con 0x7f2e50105ee0 2024-02-13T14:35:58.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2e501a3070 con 0x7f2e50101ab0 2024-02-13T14:35:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f2e501a4210 con 0x7f2e50109c20 2024-02-13T14:35:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e5623d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f2e50101ab0 0x7f2e50196d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:54236/0 (socket says 172.21.15.111:54236) 2024-02-13T14:35:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e5623d700 1 -- 172.21.15.111:0/152330322 learned_addr learned my addr 172.21.15.111:0/152330322 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:35:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3135695296 0 0) 0x7f2e501a3070 con 0x7f2e50101ab0 2024-02-13T14:35:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0035b0 con 0x7f2e50101ab0 2024-02-13T14:35:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2870054420 0 0) 0x7f2e3c0035b0 con 0x7f2e50101ab0 2024-02-13T14:35:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f2e501a3070 con 0x7f2e50101ab0 2024-02-13T14:35:58.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f2e4c0018f0 con 0x7f2e50101ab0 2024-02-13T14:35:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521181695 0 0) 0x7f2e50197880 con 0x7f2e50105ee0 2024-02-13T14:35:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e3c0035b0 con 0x7f2e50105ee0 2024-02-13T14:35:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44241760 0 0) 0x7f2e501a4210 con 0x7f2e50109c20 2024-02-13T14:35:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e50197880 con 0x7f2e50109c20 2024-02-13T14:35:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1352441165 0 0) 0x7f2e501a3070 con 0x7f2e50101ab0 2024-02-13T14:35:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 >> v1:172.21.15.62:6790/0 conn(0x7f2e50109c20 legacy=0x7f2e501a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 >> v1:172.21.15.62:6789/0 conn(0x7f2e50105ee0 legacy=0x7f2e5019d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:58.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e501a53b0 con 0x7f2e50101ab0 2024-02-13T14:35:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e501a20c0 con 0x7f2e50101ab0 2024-02-13T14:35:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e501a25c0 con 0x7f2e50101ab0 2024-02-13T14:35:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f2e4c003b70 con 0x7f2e50101ab0 2024-02-13T14:35:58.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.307+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f2e4c005c20 con 0x7f2e50101ab0 2024-02-13T14:35:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.311+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 13) v1 ==== 46125+0+0 (unknown 145093108 0 0) 0x7f2e4c011280 con 0x7f2e50101ab0 2024-02-13T14:35:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.311+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e34005150 con 0x7f2e50101ab0 2024-02-13T14:35:58.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.311+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 3053702292 0 0) 0x7f2e4c047650 con 0x7f2e50101ab0 2024-02-13T14:35:58.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.315+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f2e4c012c00 con 0x7f2e50101ab0 2024-02-13T14:35:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.527+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi062=y;smithi111=x", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e34000bc0 con 0x7f2e3c03a4e0 2024-02-13T14:35:58.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.539+0000 7f2e477fe700 1 -- 172.21.15.111:0/152330322 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (unknown 0 0 325935098) 0x7f2e34000bc0 con 0x7f2e3c03a4e0 2024-02-13T14:35:58.546 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled mgr update... 2024-02-13T14:35:58.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.543+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 >> v1:172.21.15.62:6800/1926838190 conn(0x7f2e3c03a4e0 legacy=0x7f2e3c03c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:58.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.543+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 >> v1:172.21.15.111:6789/0 conn(0x7f2e50101ab0 legacy=0x7f2e50196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:35:58.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.543+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 shutdown_connections 2024-02-13T14:35:58.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.543+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 >> 172.21.15.111:0/152330322 conn(0x7f2e500fd070 msgr2=0x7f2e5010c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:35:58.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.543+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 shutdown_connections 2024-02-13T14:35:58.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:35:58.543+0000 7f2e584a1700 1 -- 172.21.15.111:0/152330322 wait complete. 2024-02-13T14:35:58.559 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:58 smithi111 bash[23388]: cluster 2024-02-13T14:35:57.031233+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:58.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:58 smithi062 bash[21479]: cluster 2024-02-13T14:35:57.031233+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:58.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:58 smithi062 bash[28859]: cluster 2024-02-13T14:35:57.031233+0000 mgr.y (mgr.14152) 73 : cluster 0 pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:35:59.415 DEBUG:teuthology.orchestra.run.smithi111:mgr.x> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.x.service 2024-02-13T14:35:59.417 INFO:tasks.cephadm:Deploying OSDs... 2024-02-13T14:35:59.418 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:35:59.418 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-02-13T14:35:59.424 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-13T14:35:59.424 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-02-13T14:35:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-13T14:35:59.470 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T14:35:59.470 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-02-13T14:35:59.471 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T14:35:59.471 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-13 14:26:06.822854980 +0000 2024-02-13T14:35:59.471 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-13 14:26:06.550823683 +0000 2024-02-13T14:35:59.471 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-13 14:26:06.550823683 +0000 2024-02-13T14:35:59.471 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-02-13T14:35:59.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-13T14:35:59.525 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-13T14:35:59.525 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-13T14:35:59.525 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000388392 s, 1.3 MB/s 2024-02-13T14:35:59.526 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-13T14:35:59.576 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-02-13T14:35:59.622 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-13T14:35:59.622 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T14:35:59.622 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-02-13T14:35:59.622 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T14:35:59.622 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-13 14:26:07.298908877 +0000 2024-02-13T14:35:59.622 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-13 14:26:07.050881084 +0000 2024-02-13T14:35:59.622 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-13 14:26:07.050881084 +0000 2024-02-13T14:35:59.622 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-02-13T14:35:59.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-13T14:35:59.676 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-13T14:35:59.676 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-13T14:35:59.676 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000356613 s, 1.4 MB/s 2024-02-13T14:35:59.677 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-13T14:35:59.731 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-02-13T14:35:59.777 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-13T14:35:59.778 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T14:35:59.778 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-02-13T14:35:59.778 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T14:35:59.778 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-13 14:26:07.786963566 +0000 2024-02-13T14:35:59.778 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-13 14:26:07.526934428 +0000 2024-02-13T14:35:59.778 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-13 14:26:07.526934428 +0000 2024-02-13T14:35:59.778 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-02-13T14:35:59.778 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-13T14:35:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.535483+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24112 v1:172.21.15.111:0/152330322' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi062=y;smithi111=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:35:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: cephadm 2024-02-13T14:35:58.539095+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi062=y;smithi111=x;count:2 2024-02-13T14:35:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.545909+0000 mon.a (mon.0) 232 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.585657+0000 mon.a (mon.0) 233 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.589517+0000 mon.a (mon.0) 234 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.591313+0000 mon.a (mon.0) 235 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.601122+0000 mon.a (mon.0) 236 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.604497+0000 mon.a (mon.0) 237 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.607076+0000 mon.a (mon.0) 238 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.611698+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: audit 2024-02-13T14:35:58.613443+0000 mon.a (mon.0) 240 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[28859]: cephadm 2024-02-13T14:35:58.615561+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi111 2024-02-13T14:35:59.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.535483+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24112 v1:172.21.15.111:0/152330322' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi062=y;smithi111=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: cephadm 2024-02-13T14:35:58.539095+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi062=y;smithi111=x;count:2 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.545909+0000 mon.a (mon.0) 232 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.585657+0000 mon.a (mon.0) 233 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.589517+0000 mon.a (mon.0) 234 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.591313+0000 mon.a (mon.0) 235 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.601122+0000 mon.a (mon.0) 236 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.604497+0000 mon.a (mon.0) 237 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.607076+0000 mon.a (mon.0) 238 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.611698+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: audit 2024-02-13T14:35:58.613443+0000 mon.a (mon.0) 240 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:35:59 smithi062 bash[21479]: cephadm 2024-02-13T14:35:58.615561+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi111 2024-02-13T14:35:59.825 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-13T14:35:59.825 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-13T14:35:59.825 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000344567 s, 1.5 MB/s 2024-02-13T14:35:59.826 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-13T14:35:59.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.535483+0000 mgr.y (mgr.14152) 74 : audit 0 from='client.24112 v1:172.21.15.111:0/152330322' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi062=y;smithi111=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:35:59.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: cephadm 2024-02-13T14:35:58.539095+0000 mgr.y (mgr.14152) 75 : cephadm 1 Saving service mgr spec with placement smithi062=y;smithi111=x;count:2 2024-02-13T14:35:59.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.545909+0000 mon.a (mon.0) 232 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:59.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.585657+0000 mon.a (mon.0) 233 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:35:59.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.589517+0000 mon.a (mon.0) 234 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:59.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.591313+0000 mon.a (mon.0) 235 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:35:59.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.601122+0000 mon.a (mon.0) 236 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:35:59.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.604497+0000 mon.a (mon.0) 237 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T14:35:59.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.607076+0000 mon.a (mon.0) 238 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-13T14:35:59.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.611698+0000 mon.a (mon.0) 239 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T14:35:59.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: audit 2024-02-13T14:35:58.613443+0000 mon.a (mon.0) 240 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:35:59.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:35:59 smithi111 bash[23388]: cephadm 2024-02-13T14:35:58.615561+0000 mgr.y (mgr.14152) 76 : cephadm 1 Deploying daemon mgr.x on smithi111 2024-02-13T14:35:59.878 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-02-13T14:35:59.925 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-13T14:35:59.926 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T14:35:59.926 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-02-13T14:35:59.926 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T14:35:59.926 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-02-13 14:26:08.279017613 +0000 2024-02-13T14:35:59.926 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-02-13 14:26:08.022989948 +0000 2024-02-13T14:35:59.926 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-02-13 14:26:08.022989948 +0000 2024-02-13T14:35:59.926 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2024-02-13T14:35:59.926 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-13T14:35:59.980 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-02-13T14:35:59.980 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-02-13T14:35:59.980 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000296561 s, 1.7 MB/s 2024-02-13T14:35:59.981 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-13T14:36:00.030 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:36:00.031 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-02-13T14:36:00.035 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-13T14:36:00.035 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-02-13T14:36:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-13T14:36:00.082 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T14:36:00.082 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-02-13T14:36:00.082 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T14:36:00.082 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-02-13 14:26:02.774151493 +0000 2024-02-13T14:36:00.083 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-02-13 14:26:02.494153990 +0000 2024-02-13T14:36:00.083 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-02-13 14:26:02.494153990 +0000 2024-02-13T14:36:00.083 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-02-13T14:36:00.083 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-13T14:36:00.139 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-02-13T14:36:00.139 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-02-13T14:36:00.139 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000276849 s, 1.8 MB/s 2024-02-13T14:36:00.140 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-13T14:36:00.187 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-02-13T14:36:00.239 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-13T14:36:00.239 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T14:36:00.239 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-02-13T14:36:00.239 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T14:36:00.239 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-02-13 14:26:03.034149173 +0000 2024-02-13T14:36:00.239 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-02-13 14:26:03.030149209 +0000 2024-02-13T14:36:00.239 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-02-13 14:26:03.030149209 +0000 2024-02-13T14:36:00.239 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-02-13T14:36:00.240 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-13T14:36:00.295 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-02-13T14:36:00.295 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-02-13T14:36:00.295 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000275975 s, 1.9 MB/s 2024-02-13T14:36:00.296 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-13T14:36:00.344 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-02-13T14:36:00.391 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-13T14:36:00.391 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T14:36:00.391 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-02-13T14:36:00.391 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T14:36:00.391 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-02-13 14:26:03.818142179 +0000 2024-02-13T14:36:00.391 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-02-13 14:26:03.558144498 +0000 2024-02-13T14:36:00.391 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-02-13 14:26:03.558144498 +0000 2024-02-13T14:36:00.391 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-02-13T14:36:00.392 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-13T14:36:00.446 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-02-13T14:36:00.446 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-02-13T14:36:00.446 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000351484 s, 1.5 MB/s 2024-02-13T14:36:00.447 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-13T14:36:00.496 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-02-13T14:36:00.542 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-13T14:36:00.543 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-13T14:36:00.543 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 5h/5d Inode: 943 Links: 1 2024-02-13T14:36:00.543 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-13T14:36:00.543 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-02-13 14:26:04.318137719 +0000 2024-02-13T14:36:00.543 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-02-13 14:26:04.058140038 +0000 2024-02-13T14:36:00.543 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-02-13 14:26:04.058140038 +0000 2024-02-13T14:36:00.543 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-02-13T14:36:00.543 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-13T14:36:00.597 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-02-13T14:36:00.597 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-02-13T14:36:00.598 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000399176 s, 1.3 MB/s 2024-02-13T14:36:00.599 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-13T14:36:00.649 INFO:tasks.cephadm:Deploying osd.0 on smithi062 with /dev/vg_nvme/lv_4... 2024-02-13T14:36:00.649 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-13T14:36:00.834 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:00 smithi111 bash[23388]: cluster 2024-02-13T14:35:59.031649+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:01.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:00 smithi062 bash[21479]: cluster 2024-02-13T14:35:59.031649+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:01.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:00 smithi062 bash[28859]: cluster 2024-02-13T14:35:59.031649+0000 mgr.y (mgr.14152) 77 : cluster 0 pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:01.318 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:00 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:01.318 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:01 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:01.318 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:01 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:01.318 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:01 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:01.318 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:01 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:01.318 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:01 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:01.318 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:01 smithi111 systemd[1]: Started Ceph mgr.x for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:36:02.459 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:02 smithi111 bash[23388]: cluster 2024-02-13T14:36:01.032160+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:02.459 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:02 smithi111 bash[23388]: audit 2024-02-13T14:36:01.366273+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.459 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:02 smithi111 bash[23388]: audit 2024-02-13T14:36:01.375465+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.459 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:02 smithi111 bash[23388]: audit 2024-02-13T14:36:01.394093+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.459 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:02 smithi111 bash[23388]: audit 2024-02-13T14:36:01.402576+0000 mon.a (mon.0) 244 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.459 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:02 smithi111 bash[23388]: audit 2024-02-13T14:36:01.472250+0000 mon.a (mon.0) 245 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[21479]: cluster 2024-02-13T14:36:01.032160+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[21479]: audit 2024-02-13T14:36:01.366273+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[21479]: audit 2024-02-13T14:36:01.375465+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[21479]: audit 2024-02-13T14:36:01.394093+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[21479]: audit 2024-02-13T14:36:01.402576+0000 mon.a (mon.0) 244 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[21479]: audit 2024-02-13T14:36:01.472250+0000 mon.a (mon.0) 245 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[28859]: cluster 2024-02-13T14:36:01.032160+0000 mgr.y (mgr.14152) 78 : cluster 0 pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[28859]: audit 2024-02-13T14:36:01.366273+0000 mon.a (mon.0) 241 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[28859]: audit 2024-02-13T14:36:01.375465+0000 mon.a (mon.0) 242 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[28859]: audit 2024-02-13T14:36:01.394093+0000 mon.a (mon.0) 243 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[28859]: audit 2024-02-13T14:36:01.402576+0000 mon.a (mon.0) 244 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:02 smithi062 bash[28859]: audit 2024-02-13T14:36:01.472250+0000 mon.a (mon.0) 245 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:02.845 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:02 smithi111 bash[24316]: debug 2024-02-13T14:36:02.455+0000 7f117717f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-13T14:36:04.096 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:04 smithi111 bash[24316]: debug 2024-02-13T14:36:04.011+0000 7f117717f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T14:36:04.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:03 smithi111 bash[23388]: audit 2024-02-13T14:36:02.803889+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:04.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:03 smithi111 bash[23388]: cluster 2024-02-13T14:36:03.032669+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:04.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:03 smithi062 bash[28859]: audit 2024-02-13T14:36:02.803889+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:04.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:03 smithi062 bash[28859]: cluster 2024-02-13T14:36:03.032669+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:04.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:03 smithi062 bash[21479]: audit 2024-02-13T14:36:02.803889+0000 mon.a (mon.0) 246 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:04.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:03 smithi062 bash[21479]: cluster 2024-02-13T14:36:03.032669+0000 mgr.y (mgr.14152) 79 : cluster 0 pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:04.596 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:04 smithi111 bash[24316]: debug 2024-02-13T14:36:04.107+0000 7f117717f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T14:36:04.596 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:04 smithi111 bash[24316]: debug 2024-02-13T14:36:04.351+0000 7f117717f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T14:36:05.378 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:36:05.596 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:05 smithi111 bash[24316]: debug 2024-02-13T14:36:05.139+0000 7f117717f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T14:36:05.596 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:05 smithi111 bash[24316]: debug 2024-02-13T14:36:05.247+0000 7f117717f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T14:36:05.596 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:05 smithi111 bash[24316]: debug 2024-02-13T14:36:05.347+0000 7f117717f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T14:36:06.087 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:05 smithi111 bash[24316]: debug 2024-02-13T14:36:05.695+0000 7f117717f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-13T14:36:06.087 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:05 smithi111 bash[24316]: debug 2024-02-13T14:36:05.807+0000 7f117717f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T14:36:06.087 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:05 smithi111 bash[24316]: debug 2024-02-13T14:36:05.911+0000 7f117717f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T14:36:06.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:06 smithi111 bash[23388]: cluster 2024-02-13T14:36:05.033084+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:06.346 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:06 smithi111 bash[24316]: debug 2024-02-13T14:36:06.259+0000 7f117717f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T14:36:06.400 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:06 smithi062 bash[21479]: cluster 2024-02-13T14:36:05.033084+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:06.400 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:06 smithi062 bash[28859]: cluster 2024-02-13T14:36:05.033084+0000 mgr.y (mgr.14152) 80 : cluster 0 pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:06.774 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:06 smithi111 bash[24316]: debug 2024-02-13T14:36:06.499+0000 7f117717f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T14:36:07.095 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:06 smithi111 bash[24316]: debug 2024-02-13T14:36:06.767+0000 7f117717f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T14:36:07.096 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:06 smithi111 bash[24316]: debug 2024-02-13T14:36:06.879+0000 7f117717f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T14:36:07.595 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[24316]: debug 2024-02-13T14:36:07.147+0000 7f117717f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T14:36:07.596 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[24316]: debug 2024-02-13T14:36:07.383+0000 7f117717f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:36:07.910 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[21479]: audit 2024-02-13T14:36:06.661187+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:07.910 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[21479]: audit 2024-02-13T14:36:06.669025+0000 mon.a (mon.0) 248 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[21479]: audit 2024-02-13T14:36:06.670664+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[21479]: audit 2024-02-13T14:36:06.672343+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[21479]: audit 2024-02-13T14:36:06.680342+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[21479]: audit 2024-02-13T14:36:06.748705+0000 mon.a (mon.0) 252 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[21479]: audit 2024-02-13T14:36:06.750425+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[21479]: audit 2024-02-13T14:36:06.751929+0000 mon.a (mon.0) 254 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[28859]: audit 2024-02-13T14:36:06.661187+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[28859]: audit 2024-02-13T14:36:06.669025+0000 mon.a (mon.0) 248 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[28859]: audit 2024-02-13T14:36:06.670664+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[28859]: audit 2024-02-13T14:36:06.672343+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[28859]: audit 2024-02-13T14:36:06.680342+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:07.911 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[28859]: audit 2024-02-13T14:36:06.748705+0000 mon.a (mon.0) 252 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T14:36:07.912 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[28859]: audit 2024-02-13T14:36:06.750425+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T14:36:07.912 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:07 smithi062 bash[28859]: audit 2024-02-13T14:36:06.751929+0000 mon.a (mon.0) 254 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[24316]: debug 2024-02-13T14:36:07.791+0000 7f117717f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[24316]: debug 2024-02-13T14:36:07.903+0000 7f117717f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[23388]: audit 2024-02-13T14:36:06.661187+0000 mon.a (mon.0) 247 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[23388]: audit 2024-02-13T14:36:06.669025+0000 mon.a (mon.0) 248 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[23388]: audit 2024-02-13T14:36:06.670664+0000 mon.a (mon.0) 249 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[23388]: audit 2024-02-13T14:36:06.672343+0000 mon.a (mon.0) 250 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[23388]: audit 2024-02-13T14:36:06.680342+0000 mon.a (mon.0) 251 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[23388]: audit 2024-02-13T14:36:06.748705+0000 mon.a (mon.0) 252 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-13T14:36:08.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[23388]: audit 2024-02-13T14:36:06.750425+0000 mon.a (mon.0) 253 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-13T14:36:08.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:07 smithi111 bash[23388]: audit 2024-02-13T14:36:06.751929+0000 mon.a (mon.0) 254 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:08.594 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-13T14:36:08.594 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-13T14:36:08.594 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-02-13T14:36:08.594 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-02-13T14:36:08.594 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0152711 s, 687 MB/s 2024-02-13T14:36:08.594 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-02-13T14:36:08.595 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:08 smithi111 bash[24316]: debug 2024-02-13T14:36:08.147+0000 7f117717f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:36:08.958 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:08 smithi062 bash[28859]: cephadm 2024-02-13T14:36:06.748003+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-02-13T14:36:08.958 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:08 smithi062 bash[28859]: cephadm 2024-02-13T14:36:06.753732+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi062 2024-02-13T14:36:08.958 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:08 smithi062 bash[28859]: cluster 2024-02-13T14:36:07.033552+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:08.958 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:08 smithi062 bash[21479]: cephadm 2024-02-13T14:36:06.748003+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-02-13T14:36:08.958 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:08 smithi062 bash[21479]: cephadm 2024-02-13T14:36:06.753732+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi062 2024-02-13T14:36:08.958 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:08 smithi062 bash[21479]: cluster 2024-02-13T14:36:07.033552+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:09.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:08 smithi111 bash[23388]: cephadm 2024-02-13T14:36:06.748003+0000 mgr.y (mgr.14152) 81 : cephadm 1 Reconfiguring mgr.y (unknown last config time)... 2024-02-13T14:36:09.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:08 smithi111 bash[23388]: cephadm 2024-02-13T14:36:06.753732+0000 mgr.y (mgr.14152) 82 : cephadm 1 Reconfiguring daemon mgr.y on smithi062 2024-02-13T14:36:09.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:08 smithi111 bash[23388]: cluster 2024-02-13T14:36:07.033552+0000 mgr.y (mgr.14152) 83 : cluster 0 pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:09.455 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi062:vg_nvme/lv_4 2024-02-13T14:36:09.558 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:09 smithi111 bash[24316]: debug 2024-02-13T14:36:09.135+0000 7f117717f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T14:36:09.558 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:09 smithi111 bash[24316]: debug 2024-02-13T14:36:09.251+0000 7f117717f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T14:36:09.845 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:09 smithi111 bash[24316]: debug 2024-02-13T14:36:09.551+0000 7f117717f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T14:36:09.846 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:09 smithi111 bash[24316]: debug 2024-02-13T14:36:09.667+0000 7f117717f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[24316]: debug 2024-02-13T14:36:10.111+0000 7f117717f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[24316]: debug 2024-02-13T14:36:10.227+0000 7f117717f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[23388]: cluster 2024-02-13T14:36:09.033975+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[23388]: audit 2024-02-13T14:36:09.095768+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[23388]: audit 2024-02-13T14:36:09.103148+0000 mon.a (mon.0) 256 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[23388]: audit 2024-02-13T14:36:09.123989+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[23388]: audit 2024-02-13T14:36:09.748814+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[23388]: audit 2024-02-13T14:36:09.750375+0000 mon.a (mon.0) 259 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:10.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:10 smithi111 bash[23388]: audit 2024-02-13T14:36:09.760620+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[21479]: cluster 2024-02-13T14:36:09.033975+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[21479]: audit 2024-02-13T14:36:09.095768+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[21479]: audit 2024-02-13T14:36:09.103148+0000 mon.a (mon.0) 256 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[21479]: audit 2024-02-13T14:36:09.123989+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[21479]: audit 2024-02-13T14:36:09.748814+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[21479]: audit 2024-02-13T14:36:09.750375+0000 mon.a (mon.0) 259 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[21479]: audit 2024-02-13T14:36:09.760620+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[28859]: cluster 2024-02-13T14:36:09.033975+0000 mgr.y (mgr.14152) 84 : cluster 0 pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[28859]: audit 2024-02-13T14:36:09.095768+0000 mon.a (mon.0) 255 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[28859]: audit 2024-02-13T14:36:09.103148+0000 mon.a (mon.0) 256 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[28859]: audit 2024-02-13T14:36:09.123989+0000 mon.a (mon.0) 257 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[28859]: audit 2024-02-13T14:36:09.748814+0000 mon.a (mon.0) 258 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[28859]: audit 2024-02-13T14:36:09.750375+0000 mon.a (mon.0) 259 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:10 smithi062 bash[28859]: audit 2024-02-13T14:36:09.760620+0000 mon.a (mon.0) 260 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:11.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[21479]: audit 2024-02-13T14:36:10.254527+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[21479]: cluster 2024-02-13T14:36:10.255300+0000 mon.a (mon.0) 261 : cluster 0 Standby manager daemon x started 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[21479]: audit 2024-02-13T14:36:10.255537+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[21479]: audit 2024-02-13T14:36:10.256735+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[21479]: audit 2024-02-13T14:36:10.257311+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[28859]: audit 2024-02-13T14:36:10.254527+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[28859]: cluster 2024-02-13T14:36:10.255300+0000 mon.a (mon.0) 261 : cluster 0 Standby manager daemon x started 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[28859]: audit 2024-02-13T14:36:10.255537+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[28859]: audit 2024-02-13T14:36:10.256735+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T14:36:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:11 smithi062 bash[28859]: audit 2024-02-13T14:36:10.257311+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T14:36:11.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:11 smithi111 bash[23388]: audit 2024-02-13T14:36:10.254527+0000 mon.b (mon.1) 4 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T14:36:11.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:11 smithi111 bash[23388]: cluster 2024-02-13T14:36:10.255300+0000 mon.a (mon.0) 261 : cluster 0 Standby manager daemon x started 2024-02-13T14:36:11.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:11 smithi111 bash[23388]: audit 2024-02-13T14:36:10.255537+0000 mon.b (mon.1) 5 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T14:36:11.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:11 smithi111 bash[23388]: audit 2024-02-13T14:36:10.256735+0000 mon.b (mon.1) 6 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T14:36:11.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:11 smithi111 bash[23388]: audit 2024-02-13T14:36:10.257311+0000 mon.b (mon.1) 7 : audit 0 from='mgr.? v1:172.21.15.111:0/3709111404' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T14:36:12.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:12 smithi062 bash[21479]: cluster 2024-02-13T14:36:11.034370+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:12.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:12 smithi062 bash[21479]: cluster 2024-02-13T14:36:11.114597+0000 mon.a (mon.0) 262 : cluster 0 mgrmap e14: y(active, since 108s), standbys: x 2024-02-13T14:36:12.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:12 smithi062 bash[21479]: audit 2024-02-13T14:36:11.114882+0000 mon.a (mon.0) 263 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T14:36:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:12 smithi062 bash[28859]: cluster 2024-02-13T14:36:11.034370+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:12 smithi062 bash[28859]: cluster 2024-02-13T14:36:11.114597+0000 mon.a (mon.0) 262 : cluster 0 mgrmap e14: y(active, since 108s), standbys: x 2024-02-13T14:36:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:12 smithi062 bash[28859]: audit 2024-02-13T14:36:11.114882+0000 mon.a (mon.0) 263 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T14:36:12.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:12 smithi111 bash[23388]: cluster 2024-02-13T14:36:11.034370+0000 mgr.y (mgr.14152) 85 : cluster 0 pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:12.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:12 smithi111 bash[23388]: cluster 2024-02-13T14:36:11.114597+0000 mon.a (mon.0) 262 : cluster 0 mgrmap e14: y(active, since 108s), standbys: x 2024-02-13T14:36:12.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:12 smithi111 bash[23388]: audit 2024-02-13T14:36:11.114882+0000 mon.a (mon.0) 263 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T14:36:14.181 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:36:14.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:14 smithi062 bash[21479]: cluster 2024-02-13T14:36:13.034793+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:14.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:14 smithi062 bash[28859]: cluster 2024-02-13T14:36:13.034793+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:14.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:14 smithi111 bash[23388]: cluster 2024-02-13T14:36:13.034793+0000 mgr.y (mgr.14152) 86 : cluster 0 pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:16.515 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:16 smithi062 bash[21479]: cluster 2024-02-13T14:36:15.035143+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:16.515 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:16 smithi062 bash[28859]: cluster 2024-02-13T14:36:15.035143+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:16.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:16 smithi111 bash[23388]: cluster 2024-02-13T14:36:15.035143+0000 mgr.y (mgr.14152) 87 : cluster 0 pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- 172.21.15.62:0/3340769928 >> v1:172.21.15.62:6789/0 conn(0x7fccc4110270 legacy=0x7fccc4112730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- 172.21.15.62:0/3340769928 shutdown_connections 2024-02-13T14:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- 172.21.15.62:0/3340769928 >> 172.21.15.62:0/3340769928 conn(0x7fccc40770f0 msgr2=0x7fccc4079530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- 172.21.15.62:0/3340769928 shutdown_connections 2024-02-13T14:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- 172.21.15.62:0/3340769928 wait complete. 2024-02-13T14:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 Processor -- start 2024-02-13T14:36:16.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- start start 2024-02-13T14:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fccc419dea0 con 0x7fccc4110270 2024-02-13T14:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fccc41a9690 con 0x7fccc410c530 2024-02-13T14:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccca6cf700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fccc41aa830 con 0x7fccc4108100 2024-02-13T14:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.671+0000 7fccc3fff700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fccc4108100 0x7fccc419d350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:55564/0 (socket says 172.21.15.62:55564) 2024-02-13T14:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc3fff700 1 -- 172.21.15.62:0/2678864410 learned_addr learned my addr 172.21.15.62:0/2678864410 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366534264 0 0) 0x7fccc41aa830 con 0x7fccc4108100 2024-02-13T14:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb0001a50 con 0x7fccc4108100 2024-02-13T14:36:16.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 327317831 0 0) 0x7fccc419dea0 con 0x7fccc4110270 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc41aa830 con 0x7fccc4110270 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 348128552 0 0) 0x7fccb0001a50 con 0x7fccc4108100 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fccc419dea0 con 0x7fccc4108100 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fccbc001c50 con 0x7fccc4108100 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3960694729 0 0) 0x7fccc41aa830 con 0x7fccc4110270 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fccb0001a50 con 0x7fccc4110270 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fccb4001430 con 0x7fccc4110270 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272667365 0 0) 0x7fccc41a9690 con 0x7fccc410c530 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccc41aa830 con 0x7fccc410c530 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3316484813 0 0) 0x7fccb0001a50 con 0x7fccc4110270 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 >> v1:172.21.15.62:6790/0 conn(0x7fccc4108100 legacy=0x7fccc419d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 >> v1:172.21.15.111:6789/0 conn(0x7fccc410c530 legacy=0x7fccc41a3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc41ab9d0 con 0x7fccc4110270 2024-02-13T14:36:16.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc41a86e0 con 0x7fccc4110270 2024-02-13T14:36:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc41a8be0 con 0x7fccc4110270 2024-02-13T14:36:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fccb4004590 con 0x7fccc4110270 2024-02-13T14:36:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fccb4004d50 con 0x7fccc4110270 2024-02-13T14:36:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca4005150 con 0x7fccc4110270 2024-02-13T14:36:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 14) v1 ==== 91659+0+0 (unknown 1448675161 0 0) 0x7fccb4003dd0 con 0x7fccc4110270 2024-02-13T14:36:16.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.675+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(4..4 src has 1..4) v4 ==== 1069+0+0 (unknown 3053702292 0 0) 0x7fccb4086910 con 0x7fccc4110270 2024-02-13T14:36:16.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.679+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fccb40512c0 con 0x7fccc4110270 2024-02-13T14:36:16.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:16.903+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcca4000bc0 con 0x7fccb006ee30 2024-02-13T14:36:17.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:17 smithi062 bash[21479]: audit 2024-02-13T14:36:16.918095+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:36:17.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:17 smithi062 bash[21479]: audit 2024-02-13T14:36:16.923956+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:36:17.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:17 smithi062 bash[21479]: audit 2024-02-13T14:36:16.925170+0000 mon.a (mon.0) 266 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:17 smithi062 bash[28859]: audit 2024-02-13T14:36:16.918095+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:36:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:17 smithi062 bash[28859]: audit 2024-02-13T14:36:16.923956+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:36:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:17 smithi062 bash[28859]: audit 2024-02-13T14:36:16.925170+0000 mon.a (mon.0) 266 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:17.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:17 smithi111 bash[23388]: audit 2024-02-13T14:36:16.918095+0000 mon.a (mon.0) 264 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:36:17.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:17 smithi111 bash[23388]: audit 2024-02-13T14:36:16.923956+0000 mon.a (mon.0) 265 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:36:17.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:17 smithi111 bash[23388]: audit 2024-02-13T14:36:16.925170+0000 mon.a (mon.0) 266 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:18.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:18 smithi062 bash[21479]: audit 2024-02-13T14:36:16.910766+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.14214 v1:172.21.15.62:0/2678864410' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:36:18.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:18 smithi062 bash[21479]: cluster 2024-02-13T14:36:17.035576+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:18.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:18 smithi062 bash[28859]: audit 2024-02-13T14:36:16.910766+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.14214 v1:172.21.15.62:0/2678864410' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:36:18.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:18 smithi062 bash[28859]: cluster 2024-02-13T14:36:17.035576+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:18.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:18 smithi111 bash[23388]: audit 2024-02-13T14:36:16.910766+0000 mgr.y (mgr.14152) 88 : audit 0 from='client.14214 v1:172.21.15.62:0/2678864410' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:36:18.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:18 smithi111 bash[23388]: cluster 2024-02-13T14:36:17.035576+0000 mgr.y (mgr.14152) 89 : cluster 0 pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:20.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:20 smithi062 bash[21479]: cluster 2024-02-13T14:36:19.036028+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:20.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:20 smithi062 bash[28859]: cluster 2024-02-13T14:36:19.036028+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:20.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:20 smithi111 bash[23388]: cluster 2024-02-13T14:36:19.036028+0000 mgr.y (mgr.14152) 90 : cluster 0 pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:22 smithi062 bash[21479]: cluster 2024-02-13T14:36:21.036485+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:22 smithi062 bash[28859]: cluster 2024-02-13T14:36:21.036485+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:22.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:22 smithi111 bash[23388]: cluster 2024-02-13T14:36:21.036485+0000 mgr.y (mgr.14152) 91 : cluster 0 pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:24.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:24 smithi062 bash[21479]: cluster 2024-02-13T14:36:23.036976+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:24.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:24 smithi062 bash[28859]: cluster 2024-02-13T14:36:23.036976+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:24.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:24 smithi111 bash[23388]: cluster 2024-02-13T14:36:23.036976+0000 mgr.y (mgr.14152) 92 : cluster 0 pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:25.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:25 smithi062 bash[21479]: audit 2024-02-13T14:36:25.080931+0000 mon.a (mon.0) 267 : audit 1 from='client.? v1:172.21.15.62:0/2530562106' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eacc17ac-916e-4f02-9a42-5de004ec7580"}]: dispatch 2024-02-13T14:36:25.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:25 smithi062 bash[21479]: audit 2024-02-13T14:36:25.083388+0000 mon.a (mon.0) 268 : audit 1 from='client.? v1:172.21.15.62:0/2530562106' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eacc17ac-916e-4f02-9a42-5de004ec7580"}]': finished 2024-02-13T14:36:25.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:25 smithi062 bash[21479]: cluster 2024-02-13T14:36:25.087759+0000 mon.a (mon.0) 269 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-02-13T14:36:25.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:25 smithi062 bash[21479]: audit 2024-02-13T14:36:25.088071+0000 mon.a (mon.0) 270 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:25 smithi062 bash[28859]: audit 2024-02-13T14:36:25.080931+0000 mon.a (mon.0) 267 : audit 1 from='client.? v1:172.21.15.62:0/2530562106' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eacc17ac-916e-4f02-9a42-5de004ec7580"}]: dispatch 2024-02-13T14:36:25.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:25 smithi062 bash[28859]: audit 2024-02-13T14:36:25.083388+0000 mon.a (mon.0) 268 : audit 1 from='client.? v1:172.21.15.62:0/2530562106' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eacc17ac-916e-4f02-9a42-5de004ec7580"}]': finished 2024-02-13T14:36:25.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:25 smithi062 bash[28859]: cluster 2024-02-13T14:36:25.087759+0000 mon.a (mon.0) 269 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-02-13T14:36:25.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:25 smithi062 bash[28859]: audit 2024-02-13T14:36:25.088071+0000 mon.a (mon.0) 270 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:25.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:25 smithi111 bash[23388]: audit 2024-02-13T14:36:25.080931+0000 mon.a (mon.0) 267 : audit 1 from='client.? v1:172.21.15.62:0/2530562106' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eacc17ac-916e-4f02-9a42-5de004ec7580"}]: dispatch 2024-02-13T14:36:25.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:25 smithi111 bash[23388]: audit 2024-02-13T14:36:25.083388+0000 mon.a (mon.0) 268 : audit 1 from='client.? v1:172.21.15.62:0/2530562106' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eacc17ac-916e-4f02-9a42-5de004ec7580"}]': finished 2024-02-13T14:36:25.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:25 smithi111 bash[23388]: cluster 2024-02-13T14:36:25.087759+0000 mon.a (mon.0) 269 : cluster 0 osdmap e5: 1 total, 0 up, 1 in 2024-02-13T14:36:25.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:25 smithi111 bash[23388]: audit 2024-02-13T14:36:25.088071+0000 mon.a (mon.0) 270 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:26 smithi062 bash[21479]: cluster 2024-02-13T14:36:25.037370+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:26 smithi062 bash[21479]: audit 2024-02-13T14:36:25.799173+0000 mon.a (mon.0) 271 : audit 0 from='client.? v1:172.21.15.62:0/2273547533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:36:26.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:26 smithi062 bash[28859]: cluster 2024-02-13T14:36:25.037370+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:26.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:26 smithi062 bash[28859]: audit 2024-02-13T14:36:25.799173+0000 mon.a (mon.0) 271 : audit 0 from='client.? v1:172.21.15.62:0/2273547533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:36:26.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:26 smithi111 bash[23388]: cluster 2024-02-13T14:36:25.037370+0000 mgr.y (mgr.14152) 93 : cluster 0 pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:26.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:26 smithi111 bash[23388]: audit 2024-02-13T14:36:25.799173+0000 mon.a (mon.0) 271 : audit 0 from='client.? v1:172.21.15.62:0/2273547533' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:36:28.471 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:28 smithi062 bash[28859]: cluster 2024-02-13T14:36:27.037767+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:28.472 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:28 smithi062 bash[21479]: cluster 2024-02-13T14:36:27.037767+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:28.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:28 smithi111 bash[23388]: cluster 2024-02-13T14:36:27.037767+0000 mgr.y (mgr.14152) 94 : cluster 0 pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:30 smithi062 bash[21479]: cluster 2024-02-13T14:36:29.038048+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:30 smithi062 bash[28859]: cluster 2024-02-13T14:36:29.038048+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:30.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:30 smithi111 bash[23388]: cluster 2024-02-13T14:36:29.038048+0000 mgr.y (mgr.14152) 95 : cluster 0 pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:32 smithi062 bash[21479]: cluster 2024-02-13T14:36:31.038475+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:32.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:32 smithi062 bash[28859]: cluster 2024-02-13T14:36:31.038475+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:32.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:32 smithi111 bash[23388]: cluster 2024-02-13T14:36:31.038475+0000 mgr.y (mgr.14152) 96 : cluster 0 pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:34.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:34 smithi062 bash[21479]: cluster 2024-02-13T14:36:33.038912+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:34 smithi062 bash[28859]: cluster 2024-02-13T14:36:33.038912+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:34.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:34 smithi111 bash[23388]: cluster 2024-02-13T14:36:33.038912+0000 mgr.y (mgr.14152) 97 : cluster 0 pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:36.454 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:36 smithi062 bash[28859]: cluster 2024-02-13T14:36:35.039290+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:36.454 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:36 smithi062 bash[21479]: cluster 2024-02-13T14:36:35.039290+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:36.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:36 smithi111 bash[23388]: cluster 2024-02-13T14:36:35.039290+0000 mgr.y (mgr.14152) 98 : cluster 0 pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:38 smithi062 bash[21479]: cluster 2024-02-13T14:36:37.039715+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:38 smithi062 bash[21479]: audit 2024-02-13T14:36:37.578064+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-13T14:36:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:38 smithi062 bash[21479]: audit 2024-02-13T14:36:37.579872+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:38 smithi062 bash[21479]: cephadm 2024-02-13T14:36:37.581601+0000 mgr.y (mgr.14152) 100 : cephadm 1 Deploying daemon osd.0 on smithi062 2024-02-13T14:36:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:38 smithi062 bash[28859]: cluster 2024-02-13T14:36:37.039715+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:38 smithi062 bash[28859]: audit 2024-02-13T14:36:37.578064+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-13T14:36:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:38 smithi062 bash[28859]: audit 2024-02-13T14:36:37.579872+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:38 smithi062 bash[28859]: cephadm 2024-02-13T14:36:37.581601+0000 mgr.y (mgr.14152) 100 : cephadm 1 Deploying daemon osd.0 on smithi062 2024-02-13T14:36:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:38 smithi111 bash[23388]: cluster 2024-02-13T14:36:37.039715+0000 mgr.y (mgr.14152) 99 : cluster 0 pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:38.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:38 smithi111 bash[23388]: audit 2024-02-13T14:36:37.578064+0000 mon.a (mon.0) 272 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-13T14:36:38.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:38 smithi111 bash[23388]: audit 2024-02-13T14:36:37.579872+0000 mon.a (mon.0) 273 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:38.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:38 smithi111 bash[23388]: cephadm 2024-02-13T14:36:37.581601+0000 mgr.y (mgr.14152) 100 : cephadm 1 Deploying daemon osd.0 on smithi062 2024-02-13T14:36:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:40 smithi062 bash[21479]: cluster 2024-02-13T14:36:39.040002+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:40.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:40 smithi062 bash[28859]: cluster 2024-02-13T14:36:39.040002+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:40.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:40 smithi111 bash[23388]: cluster 2024-02-13T14:36:39.040002+0000 mgr.y (mgr.14152) 101 : cluster 0 pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:41.747 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:41 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:41.748 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:36:41 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:41.748 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:41 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:42.017 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:36:41 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:42.018 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:41 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:42.018 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:41 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:36:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:42 smithi062 bash[21479]: cluster 2024-02-13T14:36:41.040370+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:42 smithi062 bash[21479]: audit 2024-02-13T14:36:42.017095+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:42 smithi062 bash[21479]: audit 2024-02-13T14:36:42.022328+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:42 smithi062 bash[21479]: audit 2024-02-13T14:36:42.030928+0000 mon.a (mon.0) 276 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:42 smithi062 bash[28859]: cluster 2024-02-13T14:36:41.040370+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:42 smithi062 bash[28859]: audit 2024-02-13T14:36:42.017095+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:42 smithi062 bash[28859]: audit 2024-02-13T14:36:42.022328+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:42 smithi062 bash[28859]: audit 2024-02-13T14:36:42.030928+0000 mon.a (mon.0) 276 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:42.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:42 smithi111 bash[23388]: cluster 2024-02-13T14:36:41.040370+0000 mgr.y (mgr.14152) 102 : cluster 0 pgmap v64: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:42.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:42 smithi111 bash[23388]: audit 2024-02-13T14:36:42.017095+0000 mon.a (mon.0) 274 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:42.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:42 smithi111 bash[23388]: audit 2024-02-13T14:36:42.022328+0000 mon.a (mon.0) 275 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:42.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:42 smithi111 bash[23388]: audit 2024-02-13T14:36:42.030928+0000 mon.a (mon.0) 276 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:44 smithi062 bash[21479]: cluster 2024-02-13T14:36:43.040706+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:44.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:44 smithi062 bash[28859]: cluster 2024-02-13T14:36:43.040706+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:44 smithi111 bash[23388]: cluster 2024-02-13T14:36:43.040706+0000 mgr.y (mgr.14152) 103 : cluster 0 pgmap v65: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:46.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:46 smithi062 bash[21479]: cluster 2024-02-13T14:36:45.041010+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:46 smithi062 bash[28859]: cluster 2024-02-13T14:36:45.041010+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:46.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:46 smithi111 bash[23388]: cluster 2024-02-13T14:36:45.041010+0000 mgr.y (mgr.14152) 104 : cluster 0 pgmap v66: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[21479]: cluster 2024-02-13T14:36:47.041310+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[21479]: audit 2024-02-13T14:36:47.313257+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[21479]: audit 2024-02-13T14:36:47.319428+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[21479]: audit 2024-02-13T14:36:47.888839+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[21479]: audit 2024-02-13T14:36:47.890571+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[21479]: audit 2024-02-13T14:36:47.903637+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[28859]: cluster 2024-02-13T14:36:47.041310+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[28859]: audit 2024-02-13T14:36:47.313257+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[28859]: audit 2024-02-13T14:36:47.319428+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[28859]: audit 2024-02-13T14:36:47.888839+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[28859]: audit 2024-02-13T14:36:47.890571+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:48 smithi062 bash[28859]: audit 2024-02-13T14:36:47.903637+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:48.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:48 smithi111 bash[23388]: cluster 2024-02-13T14:36:47.041310+0000 mgr.y (mgr.14152) 105 : cluster 0 pgmap v67: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:48.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:48 smithi111 bash[23388]: audit 2024-02-13T14:36:47.313257+0000 mon.a (mon.0) 277 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:48.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:48 smithi111 bash[23388]: audit 2024-02-13T14:36:47.319428+0000 mon.a (mon.0) 278 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:48.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:48 smithi111 bash[23388]: audit 2024-02-13T14:36:47.888839+0000 mon.a (mon.0) 279 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:36:48.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:48 smithi111 bash[23388]: audit 2024-02-13T14:36:47.890571+0000 mon.a (mon.0) 280 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:36:48.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:48 smithi111 bash[23388]: audit 2024-02-13T14:36:47.903637+0000 mon.a (mon.0) 281 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:49.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:49 smithi111 bash[23388]: audit 2024-02-13T14:36:48.345141+0000 mon.c (mon.2) 4 : audit 1 from='osd.0 v1:172.21.15.62:6801/143174597' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T14:36:49.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:49 smithi111 bash[23388]: audit 2024-02-13T14:36:48.345504+0000 mon.a (mon.0) 282 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T14:36:49.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:49 smithi062 bash[21479]: audit 2024-02-13T14:36:48.345141+0000 mon.c (mon.2) 4 : audit 1 from='osd.0 v1:172.21.15.62:6801/143174597' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T14:36:49.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:49 smithi062 bash[21479]: audit 2024-02-13T14:36:48.345504+0000 mon.a (mon.0) 282 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T14:36:49.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:49 smithi062 bash[28859]: audit 2024-02-13T14:36:48.345141+0000 mon.c (mon.2) 4 : audit 1 from='osd.0 v1:172.21.15.62:6801/143174597' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T14:36:49.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:49 smithi062 bash[28859]: audit 2024-02-13T14:36:48.345504+0000 mon.a (mon.0) 282 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-13T14:36:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:50 smithi111 bash[23388]: cluster 2024-02-13T14:36:49.041642+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:50 smithi111 bash[23388]: audit 2024-02-13T14:36:49.321469+0000 mon.a (mon.0) 283 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-13T14:36:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:50 smithi111 bash[23388]: cluster 2024-02-13T14:36:49.324376+0000 mon.a (mon.0) 284 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-02-13T14:36:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:50 smithi111 bash[23388]: audit 2024-02-13T14:36:49.324991+0000 mon.a (mon.0) 285 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:50 smithi111 bash[23388]: audit 2024-02-13T14:36:49.328010+0000 mon.c (mon.2) 5 : audit 1 from='osd.0 v1:172.21.15.62:6801/143174597' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:36:50.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:50 smithi111 bash[23388]: audit 2024-02-13T14:36:49.328788+0000 mon.a (mon.0) 286 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:36:50.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:50.711+0000 7fccc17fa700 1 -- 172.21.15.62:0/2678864410 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 2545657614) 0x7fcca4000bc0 con 0x7fccb006ee30 2024-02-13T14:36:50.715 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 0 on host 'smithi062' 2024-02-13T14:36:50.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:50.715+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 >> v1:172.21.15.62:6800/1926838190 conn(0x7fccb006ee30 legacy=0x7fccb00712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:36:50.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:50.715+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 >> v1:172.21.15.62:6789/0 conn(0x7fccc4110270 legacy=0x7fccc41a6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:36:50.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:50.715+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 shutdown_connections 2024-02-13T14:36:50.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:50.715+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 >> 172.21.15.62:0/2678864410 conn(0x7fccc40770f0 msgr2=0x7fccc410f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:36:50.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:50.715+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 shutdown_connections 2024-02-13T14:36:50.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:36:50.715+0000 7fccca6cf700 1 -- 172.21.15.62:0/2678864410 wait complete. 2024-02-13T14:36:50.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[28859]: cluster 2024-02-13T14:36:49.041642+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:50.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[28859]: audit 2024-02-13T14:36:49.321469+0000 mon.a (mon.0) 283 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-13T14:36:50.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[28859]: cluster 2024-02-13T14:36:49.324376+0000 mon.a (mon.0) 284 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-02-13T14:36:50.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[28859]: audit 2024-02-13T14:36:49.324991+0000 mon.a (mon.0) 285 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:50.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[28859]: audit 2024-02-13T14:36:49.328010+0000 mon.c (mon.2) 5 : audit 1 from='osd.0 v1:172.21.15.62:6801/143174597' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:36:50.736 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[28859]: audit 2024-02-13T14:36:49.328788+0000 mon.a (mon.0) 286 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:36:50.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[21479]: cluster 2024-02-13T14:36:49.041642+0000 mgr.y (mgr.14152) 106 : cluster 0 pgmap v68: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:50.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[21479]: audit 2024-02-13T14:36:49.321469+0000 mon.a (mon.0) 283 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-13T14:36:50.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[21479]: cluster 2024-02-13T14:36:49.324376+0000 mon.a (mon.0) 284 : cluster 0 osdmap e6: 1 total, 0 up, 1 in 2024-02-13T14:36:50.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[21479]: audit 2024-02-13T14:36:49.324991+0000 mon.a (mon.0) 285 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:50.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[21479]: audit 2024-02-13T14:36:49.328010+0000 mon.c (mon.2) 5 : audit 1 from='osd.0 v1:172.21.15.62:6801/143174597' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:36:50.737 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:50 smithi062 bash[21479]: audit 2024-02-13T14:36:49.328788+0000 mon.a (mon.0) 286 : audit 1 from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:36:51.419 DEBUG:teuthology.orchestra.run.smithi062:osd.0> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.0.service 2024-02-13T14:36:51.422 INFO:tasks.cephadm:Deploying osd.1 on smithi062 with /dev/vg_nvme/lv_3... 2024-02-13T14:36:51.422 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-13T14:36:51.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:51 smithi111 bash[23388]: audit 2024-02-13T14:36:50.323702+0000 mon.a (mon.0) 287 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:36:51.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:51 smithi111 bash[23388]: cluster 2024-02-13T14:36:50.328854+0000 mon.a (mon.0) 288 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-02-13T14:36:51.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:51 smithi111 bash[23388]: audit 2024-02-13T14:36:50.330067+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:51.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:51 smithi111 bash[23388]: audit 2024-02-13T14:36:50.337395+0000 mon.a (mon.0) 290 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:51.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:51 smithi111 bash[23388]: audit 2024-02-13T14:36:50.695567+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:51.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:51 smithi111 bash[23388]: audit 2024-02-13T14:36:50.706706+0000 mon.a (mon.0) 292 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:51.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:51 smithi111 bash[23388]: audit 2024-02-13T14:36:50.723912+0000 mon.a (mon.0) 293 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:51.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:51 smithi111 bash[23388]: audit 2024-02-13T14:36:50.819028+0000 mon.a (mon.0) 294 : audit 1 from='osd.0 ' entity='osd.0' 2024-02-13T14:36:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[21479]: audit 2024-02-13T14:36:50.323702+0000 mon.a (mon.0) 287 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:36:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[21479]: cluster 2024-02-13T14:36:50.328854+0000 mon.a (mon.0) 288 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-02-13T14:36:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[21479]: audit 2024-02-13T14:36:50.330067+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[21479]: audit 2024-02-13T14:36:50.337395+0000 mon.a (mon.0) 290 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[21479]: audit 2024-02-13T14:36:50.695567+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[21479]: audit 2024-02-13T14:36:50.706706+0000 mon.a (mon.0) 292 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[21479]: audit 2024-02-13T14:36:50.723912+0000 mon.a (mon.0) 293 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[21479]: audit 2024-02-13T14:36:50.819028+0000 mon.a (mon.0) 294 : audit 1 from='osd.0 ' entity='osd.0' 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[28859]: audit 2024-02-13T14:36:50.323702+0000 mon.a (mon.0) 287 : audit 1 from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[28859]: cluster 2024-02-13T14:36:50.328854+0000 mon.a (mon.0) 288 : cluster 0 osdmap e7: 1 total, 0 up, 1 in 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[28859]: audit 2024-02-13T14:36:50.330067+0000 mon.a (mon.0) 289 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[28859]: audit 2024-02-13T14:36:50.337395+0000 mon.a (mon.0) 290 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[28859]: audit 2024-02-13T14:36:50.695567+0000 mon.a (mon.0) 291 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[28859]: audit 2024-02-13T14:36:50.706706+0000 mon.a (mon.0) 292 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[28859]: audit 2024-02-13T14:36:50.723912+0000 mon.a (mon.0) 293 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:36:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:51 smithi062 bash[28859]: audit 2024-02-13T14:36:50.819028+0000 mon.a (mon.0) 294 : audit 1 from='osd.0 ' entity='osd.0' 2024-02-13T14:36:52.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:52 smithi111 bash[23388]: cluster 2024-02-13T14:36:49.319201+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:36:52.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:52 smithi111 bash[23388]: cluster 2024-02-13T14:36:49.319294+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:36:52.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:52 smithi111 bash[23388]: cluster 2024-02-13T14:36:51.041963+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:52.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:52 smithi111 bash[23388]: audit 2024-02-13T14:36:51.339936+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:52.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:52 smithi111 bash[23388]: cluster 2024-02-13T14:36:51.828032+0000 mon.a (mon.0) 296 : cluster 1 osd.0 v1:172.21.15.62:6801/143174597 boot 2024-02-13T14:36:52.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:52 smithi111 bash[23388]: cluster 2024-02-13T14:36:51.828138+0000 mon.a (mon.0) 297 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-02-13T14:36:52.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:52 smithi111 bash[23388]: audit 2024-02-13T14:36:51.828775+0000 mon.a (mon.0) 298 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[21479]: cluster 2024-02-13T14:36:49.319201+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:36:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[21479]: cluster 2024-02-13T14:36:49.319294+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:36:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[21479]: cluster 2024-02-13T14:36:51.041963+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[21479]: audit 2024-02-13T14:36:51.339936+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[21479]: cluster 2024-02-13T14:36:51.828032+0000 mon.a (mon.0) 296 : cluster 1 osd.0 v1:172.21.15.62:6801/143174597 boot 2024-02-13T14:36:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[21479]: cluster 2024-02-13T14:36:51.828138+0000 mon.a (mon.0) 297 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-02-13T14:36:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[21479]: audit 2024-02-13T14:36:51.828775+0000 mon.a (mon.0) 298 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[28859]: cluster 2024-02-13T14:36:49.319201+0000 osd.0 (osd.0) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:36:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[28859]: cluster 2024-02-13T14:36:49.319294+0000 osd.0 (osd.0) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:36:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[28859]: cluster 2024-02-13T14:36:51.041963+0000 mgr.y (mgr.14152) 107 : cluster 0 pgmap v71: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-13T14:36:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[28859]: audit 2024-02-13T14:36:51.339936+0000 mon.a (mon.0) 295 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[28859]: cluster 2024-02-13T14:36:51.828032+0000 mon.a (mon.0) 296 : cluster 1 osd.0 v1:172.21.15.62:6801/143174597 boot 2024-02-13T14:36:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[28859]: cluster 2024-02-13T14:36:51.828138+0000 mon.a (mon.0) 297 : cluster 0 osdmap e8: 1 total, 1 up, 1 in 2024-02-13T14:36:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:52 smithi062 bash[28859]: audit 2024-02-13T14:36:51.828775+0000 mon.a (mon.0) 298 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:36:54.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:53 smithi111 bash[23388]: cluster 2024-02-13T14:36:52.844363+0000 mon.a (mon.0) 299 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-02-13T14:36:54.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:53 smithi111 bash[23388]: cluster 2024-02-13T14:36:53.042351+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:54.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:53 smithi062 bash[28859]: cluster 2024-02-13T14:36:52.844363+0000 mon.a (mon.0) 299 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-02-13T14:36:54.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:53 smithi062 bash[28859]: cluster 2024-02-13T14:36:53.042351+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:54.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:53 smithi062 bash[21479]: cluster 2024-02-13T14:36:52.844363+0000 mon.a (mon.0) 299 : cluster 0 osdmap e9: 1 total, 1 up, 1 in 2024-02-13T14:36:54.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:53 smithi062 bash[21479]: cluster 2024-02-13T14:36:53.042351+0000 mgr.y (mgr.14152) 108 : cluster 0 pgmap v74: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:55.692 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:36:56.569 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:56 smithi062 bash[21479]: cluster 2024-02-13T14:36:55.042695+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:56.569 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:56 smithi062 bash[28859]: cluster 2024-02-13T14:36:55.042695+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:56.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:56 smithi111 bash[23388]: cluster 2024-02-13T14:36:55.042695+0000 mgr.y (mgr.14152) 109 : cluster 0 pgmap v75: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:36:58 smithi062 bash[21479]: cluster 2024-02-13T14:36:57.043123+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:58.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:36:58 smithi062 bash[28859]: cluster 2024-02-13T14:36:57.043123+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:58.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:36:58 smithi111 bash[23388]: cluster 2024-02-13T14:36:57.043123+0000 mgr.y (mgr.14152) 110 : cluster 0 pgmap v76: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:36:59.794 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-13T14:36:59.794 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-13T14:36:59.794 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-02-13T14:36:59.794 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-02-13T14:36:59.794 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0128728 s, 815 MB/s 2024-02-13T14:36:59.794 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-02-13T14:37:00.550 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:00 smithi062 bash[28859]: cluster 2024-02-13T14:36:59.043546+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:00.550 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:00 smithi062 bash[21479]: cluster 2024-02-13T14:36:59.043546+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:00.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:00 smithi111 bash[23388]: cluster 2024-02-13T14:36:59.043546+0000 mgr.y (mgr.14152) 111 : cluster 0 pgmap v77: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:00.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi062:vg_nvme/lv_3 2024-02-13T14:37:02.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: cluster 2024-02-13T14:37:01.044020+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: cephadm 2024-02-13T14:37:01.063756+0000 mgr.y (mgr.14152) 113 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: audit 2024-02-13T14:37:01.072227+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: audit 2024-02-13T14:37:01.081251+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: audit 2024-02-13T14:37:01.083416+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: cephadm 2024-02-13T14:37:01.084681+0000 mgr.y (mgr.14152) 114 : cephadm 1 Adjusting osd_memory_target on smithi062 to 16241M 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: audit 2024-02-13T14:37:01.090905+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: audit 2024-02-13T14:37:01.094954+0000 mon.a (mon.0) 304 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: audit 2024-02-13T14:37:01.096669+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:02.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:02 smithi111 bash[23388]: audit 2024-02-13T14:37:01.106054+0000 mon.a (mon.0) 306 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: cluster 2024-02-13T14:37:01.044020+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: cephadm 2024-02-13T14:37:01.063756+0000 mgr.y (mgr.14152) 113 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:37:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: audit 2024-02-13T14:37:01.072227+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: audit 2024-02-13T14:37:01.081251+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: audit 2024-02-13T14:37:01.083416+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: cephadm 2024-02-13T14:37:01.084681+0000 mgr.y (mgr.14152) 114 : cephadm 1 Adjusting osd_memory_target on smithi062 to 16241M 2024-02-13T14:37:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: audit 2024-02-13T14:37:01.090905+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: audit 2024-02-13T14:37:01.094954+0000 mon.a (mon.0) 304 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: audit 2024-02-13T14:37:01.096669+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[21479]: audit 2024-02-13T14:37:01.106054+0000 mon.a (mon.0) 306 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: cluster 2024-02-13T14:37:01.044020+0000 mgr.y (mgr.14152) 112 : cluster 0 pgmap v78: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: cephadm 2024-02-13T14:37:01.063756+0000 mgr.y (mgr.14152) 113 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: audit 2024-02-13T14:37:01.072227+0000 mon.a (mon.0) 300 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: audit 2024-02-13T14:37:01.081251+0000 mon.a (mon.0) 301 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: audit 2024-02-13T14:37:01.083416+0000 mon.a (mon.0) 302 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: cephadm 2024-02-13T14:37:01.084681+0000 mgr.y (mgr.14152) 114 : cephadm 1 Adjusting osd_memory_target on smithi062 to 16241M 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: audit 2024-02-13T14:37:01.090905+0000 mon.a (mon.0) 303 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: audit 2024-02-13T14:37:01.094954+0000 mon.a (mon.0) 304 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: audit 2024-02-13T14:37:01.096669+0000 mon.a (mon.0) 305 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:02 smithi062 bash[28859]: audit 2024-02-13T14:37:01.106054+0000 mon.a (mon.0) 306 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:04.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:04 smithi111 bash[23388]: cluster 2024-02-13T14:37:03.044504+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:04.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:04 smithi062 bash[21479]: cluster 2024-02-13T14:37:03.044504+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:04.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:04 smithi062 bash[28859]: cluster 2024-02-13T14:37:03.044504+0000 mgr.y (mgr.14152) 115 : cluster 0 pgmap v79: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:05.427 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:37:06.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:06 smithi111 bash[23388]: cluster 2024-02-13T14:37:05.045002+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:06.393 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:06 smithi062 bash[21479]: cluster 2024-02-13T14:37:05.045002+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:06.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:06 smithi062 bash[28859]: cluster 2024-02-13T14:37:05.045002+0000 mgr.y (mgr.14152) 116 : cluster 0 pgmap v80: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:07.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.830+0000 7fb27de18700 1 -- 172.21.15.62:0/1234322459 >> v1:172.21.15.62:6789/0 conn(0x7fb27810be40 legacy=0x7fb27810e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:37:07.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.830+0000 7fb27de18700 1 -- 172.21.15.62:0/1234322459 shutdown_connections 2024-02-13T14:37:07.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.830+0000 7fb27de18700 1 -- 172.21.15.62:0/1234322459 >> 172.21.15.62:0/1234322459 conn(0x7fb2780ff270 msgr2=0x7fb2781016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:37:07.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.830+0000 7fb27de18700 1 -- 172.21.15.62:0/1234322459 shutdown_connections 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.830+0000 7fb27de18700 1 -- 172.21.15.62:0/1234322459 wait complete. 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.830+0000 7fb27de18700 1 Processor -- start 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.830+0000 7fb27de18700 1 -- start start 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb27de18700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb278199ab0 con 0x7fb27810be40 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb27de18700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb2781a52a0 con 0x7fb278108100 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb27de18700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb2781a6440 con 0x7fb278103cd0 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb2777fe700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fb278103cd0 0x7fb278198f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:45290/0 (socket says 172.21.15.62:45290) 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb2777fe700 1 -- 172.21.15.62:0/3751194772 learned_addr learned my addr 172.21.15.62:0/3751194772 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:37:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb277fff700 1 --1- 172.21.15.62:0/3751194772 >> v1:172.21.15.62:6789/0 conn(0x7fb27810be40 0x7fb2781a2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53600/0 (socket says 172.21.15.62:53600) 2024-02-13T14:37:07.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601876240 0 0) 0x7fb2781a6440 con 0x7fb278103cd0 2024-02-13T14:37:07.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb260005070 con 0x7fb278103cd0 2024-02-13T14:37:07.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253362654 0 0) 0x7fb278199ab0 con 0x7fb27810be40 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2781a6440 con 0x7fb27810be40 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4203627424 0 0) 0x7fb2781a6440 con 0x7fb27810be40 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb278199ab0 con 0x7fb27810be40 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3547439428 0 0) 0x7fb260005070 con 0x7fb278103cd0 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb2781a6440 con 0x7fb278103cd0 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb2700046f0 con 0x7fb27810be40 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb268001920 con 0x7fb278103cd0 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872429795 0 0) 0x7fb2781a52a0 con 0x7fb278108100 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb260005070 con 0x7fb278108100 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2468145666 0 0) 0x7fb278199ab0 con 0x7fb27810be40 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 >> v1:172.21.15.62:6790/0 conn(0x7fb278103cd0 legacy=0x7fb278198f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 >> v1:172.21.15.111:6789/0 conn(0x7fb278108100 legacy=0x7fb27819f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2781a75e0 con 0x7fb27810be40 2024-02-13T14:37:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2781a42f0 con 0x7fb27810be40 2024-02-13T14:37:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2781a47f0 con 0x7fb27810be40 2024-02-13T14:37:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fb270001e70 con 0x7fb27810be40 2024-02-13T14:37:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb2700051c0 con 0x7fb27810be40 2024-02-13T14:37:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb264005150 con 0x7fb27810be40 2024-02-13T14:37:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 14) v1 ==== 91659+0+0 (unknown 1448675161 0 0) 0x7fb2700041e0 con 0x7fb27810be40 2024-02-13T14:37:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.834+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(9..9 src has 1..9) v4 ==== 1541+0+0 (unknown 1134889456 0 0) 0x7fb270087f00 con 0x7fb27810be40 2024-02-13T14:37:07.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:07.838+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fb270052730 con 0x7fb27810be40 2024-02-13T14:37:08.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:08.062+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fb264000bc0 con 0x7fb26006ee70 2024-02-13T14:37:08.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:08 smithi111 bash[23388]: cluster 2024-02-13T14:37:07.045511+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:08.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:08 smithi111 bash[23388]: audit 2024-02-13T14:37:08.070417+0000 mon.a (mon.0) 307 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:37:08.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:08 smithi111 bash[23388]: audit 2024-02-13T14:37:08.073879+0000 mon.a (mon.0) 308 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:37:08.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:08 smithi111 bash[23388]: audit 2024-02-13T14:37:08.074865+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:08 smithi062 bash[21479]: cluster 2024-02-13T14:37:07.045511+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:08 smithi062 bash[21479]: audit 2024-02-13T14:37:08.070417+0000 mon.a (mon.0) 307 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:37:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:08 smithi062 bash[21479]: audit 2024-02-13T14:37:08.073879+0000 mon.a (mon.0) 308 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:37:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:08 smithi062 bash[21479]: audit 2024-02-13T14:37:08.074865+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:08 smithi062 bash[28859]: cluster 2024-02-13T14:37:07.045511+0000 mgr.y (mgr.14152) 117 : cluster 0 pgmap v81: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:08 smithi062 bash[28859]: audit 2024-02-13T14:37:08.070417+0000 mon.a (mon.0) 307 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:37:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:08 smithi062 bash[28859]: audit 2024-02-13T14:37:08.073879+0000 mon.a (mon.0) 308 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:37:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:08 smithi062 bash[28859]: audit 2024-02-13T14:37:08.074865+0000 mon.a (mon.0) 309 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:09.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:09 smithi111 bash[23388]: audit 2024-02-13T14:37:08.067670+0000 mgr.y (mgr.14152) 118 : audit 0 from='client.14241 v1:172.21.15.62:0/3751194772' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:37:09.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:09 smithi062 bash[21479]: audit 2024-02-13T14:37:08.067670+0000 mgr.y (mgr.14152) 118 : audit 0 from='client.14241 v1:172.21.15.62:0/3751194772' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:37:09.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:09 smithi062 bash[28859]: audit 2024-02-13T14:37:08.067670+0000 mgr.y (mgr.14152) 118 : audit 0 from='client.14241 v1:172.21.15.62:0/3751194772' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:37:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:10 smithi062 bash[21479]: cluster 2024-02-13T14:37:09.045982+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:10.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:10 smithi062 bash[28859]: cluster 2024-02-13T14:37:09.045982+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:10.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:10 smithi111 bash[23388]: cluster 2024-02-13T14:37:09.045982+0000 mgr.y (mgr.14152) 119 : cluster 0 pgmap v82: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:12.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:12 smithi062 bash[21479]: cluster 2024-02-13T14:37:11.046386+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:12.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:12 smithi062 bash[28859]: cluster 2024-02-13T14:37:11.046386+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:12.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:12 smithi111 bash[23388]: cluster 2024-02-13T14:37:11.046386+0000 mgr.y (mgr.14152) 120 : cluster 0 pgmap v83: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:14.156 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:14 smithi062 bash[28859]: cluster 2024-02-13T14:37:13.046814+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:14.157 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:14 smithi062 bash[21479]: cluster 2024-02-13T14:37:13.046814+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:14.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:14 smithi111 bash[23388]: cluster 2024-02-13T14:37:13.046814+0000 mgr.y (mgr.14152) 121 : cluster 0 pgmap v84: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:16.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:16 smithi062 bash[21479]: cluster 2024-02-13T14:37:15.047193+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:16.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:16 smithi062 bash[28859]: cluster 2024-02-13T14:37:15.047193+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:16.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:16 smithi111 bash[23388]: cluster 2024-02-13T14:37:15.047193+0000 mgr.y (mgr.14152) 122 : cluster 0 pgmap v85: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[28859]: audit 2024-02-13T14:37:16.251885+0000 mon.c (mon.2) 6 : audit 1 from='client.? v1:172.21.15.62:0/2992777214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]: dispatch 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[28859]: audit 2024-02-13T14:37:16.252500+0000 mon.a (mon.0) 310 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]: dispatch 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[28859]: audit 2024-02-13T14:37:16.255392+0000 mon.a (mon.0) 311 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]': finished 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[28859]: cluster 2024-02-13T14:37:16.260558+0000 mon.a (mon.0) 312 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[28859]: audit 2024-02-13T14:37:16.261150+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[28859]: audit 2024-02-13T14:37:17.039965+0000 mon.c (mon.2) 7 : audit 0 from='client.? v1:172.21.15.62:0/3079935546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[21479]: audit 2024-02-13T14:37:16.251885+0000 mon.c (mon.2) 6 : audit 1 from='client.? v1:172.21.15.62:0/2992777214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]: dispatch 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[21479]: audit 2024-02-13T14:37:16.252500+0000 mon.a (mon.0) 310 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]: dispatch 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[21479]: audit 2024-02-13T14:37:16.255392+0000 mon.a (mon.0) 311 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]': finished 2024-02-13T14:37:17.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[21479]: cluster 2024-02-13T14:37:16.260558+0000 mon.a (mon.0) 312 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-02-13T14:37:17.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[21479]: audit 2024-02-13T14:37:16.261150+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:17.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:17 smithi062 bash[21479]: audit 2024-02-13T14:37:17.039965+0000 mon.c (mon.2) 7 : audit 0 from='client.? v1:172.21.15.62:0/3079935546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:37:17.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:17 smithi111 bash[23388]: audit 2024-02-13T14:37:16.251885+0000 mon.c (mon.2) 6 : audit 1 from='client.? v1:172.21.15.62:0/2992777214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]: dispatch 2024-02-13T14:37:17.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:17 smithi111 bash[23388]: audit 2024-02-13T14:37:16.252500+0000 mon.a (mon.0) 310 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]: dispatch 2024-02-13T14:37:17.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:17 smithi111 bash[23388]: audit 2024-02-13T14:37:16.255392+0000 mon.a (mon.0) 311 : audit 1 from='client.24152 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "21062ebc-0d8d-481b-95b0-1b10c843bcab"}]': finished 2024-02-13T14:37:17.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:17 smithi111 bash[23388]: cluster 2024-02-13T14:37:16.260558+0000 mon.a (mon.0) 312 : cluster 0 osdmap e10: 2 total, 1 up, 2 in 2024-02-13T14:37:17.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:17 smithi111 bash[23388]: audit 2024-02-13T14:37:16.261150+0000 mon.a (mon.0) 313 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:17.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:17 smithi111 bash[23388]: audit 2024-02-13T14:37:17.039965+0000 mon.c (mon.2) 7 : audit 0 from='client.? v1:172.21.15.62:0/3079935546' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:37:18.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:18 smithi062 bash[21479]: cluster 2024-02-13T14:37:17.047497+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:18.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:18 smithi062 bash[28859]: cluster 2024-02-13T14:37:17.047497+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:18.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:18 smithi111 bash[23388]: cluster 2024-02-13T14:37:17.047497+0000 mgr.y (mgr.14152) 123 : cluster 0 pgmap v87: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:20.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:20 smithi062 bash[21479]: cluster 2024-02-13T14:37:19.047986+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:20.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:20 smithi062 bash[28859]: cluster 2024-02-13T14:37:19.047986+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:20.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:20 smithi111 bash[23388]: cluster 2024-02-13T14:37:19.047986+0000 mgr.y (mgr.14152) 124 : cluster 0 pgmap v88: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:22.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:22 smithi062 bash[21479]: cluster 2024-02-13T14:37:21.048430+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:22 smithi062 bash[28859]: cluster 2024-02-13T14:37:21.048430+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:22.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:22 smithi111 bash[23388]: cluster 2024-02-13T14:37:21.048430+0000 mgr.y (mgr.14152) 125 : cluster 0 pgmap v89: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:24.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:24 smithi062 bash[21479]: cluster 2024-02-13T14:37:23.048854+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:24.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:24 smithi062 bash[28859]: cluster 2024-02-13T14:37:23.048854+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:24.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:24 smithi111 bash[23388]: cluster 2024-02-13T14:37:23.048854+0000 mgr.y (mgr.14152) 126 : cluster 0 pgmap v90: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:26.371 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:26 smithi062 bash[21479]: cluster 2024-02-13T14:37:25.049286+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:26.371 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:26 smithi062 bash[28859]: cluster 2024-02-13T14:37:25.049286+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:26.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:26 smithi111 bash[23388]: cluster 2024-02-13T14:37:25.049286+0000 mgr.y (mgr.14152) 127 : cluster 0 pgmap v91: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:28 smithi062 bash[21479]: cluster 2024-02-13T14:37:27.049704+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:28 smithi062 bash[28859]: cluster 2024-02-13T14:37:27.049704+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:28.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:28 smithi111 bash[23388]: cluster 2024-02-13T14:37:27.049704+0000 mgr.y (mgr.14152) 128 : cluster 0 pgmap v92: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:29.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:29 smithi062 bash[21479]: audit 2024-02-13T14:37:28.648854+0000 mon.a (mon.0) 314 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-13T14:37:29.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:29 smithi062 bash[21479]: audit 2024-02-13T14:37:28.650914+0000 mon.a (mon.0) 315 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:29.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:29 smithi062 bash[21479]: cephadm 2024-02-13T14:37:28.652810+0000 mgr.y (mgr.14152) 129 : cephadm 1 Deploying daemon osd.1 on smithi062 2024-02-13T14:37:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:29 smithi062 bash[28859]: audit 2024-02-13T14:37:28.648854+0000 mon.a (mon.0) 314 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-13T14:37:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:29 smithi062 bash[28859]: audit 2024-02-13T14:37:28.650914+0000 mon.a (mon.0) 315 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:29 smithi062 bash[28859]: cephadm 2024-02-13T14:37:28.652810+0000 mgr.y (mgr.14152) 129 : cephadm 1 Deploying daemon osd.1 on smithi062 2024-02-13T14:37:29.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:29 smithi111 bash[23388]: audit 2024-02-13T14:37:28.648854+0000 mon.a (mon.0) 314 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-13T14:37:29.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:29 smithi111 bash[23388]: audit 2024-02-13T14:37:28.650914+0000 mon.a (mon.0) 315 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:29.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:29 smithi111 bash[23388]: cephadm 2024-02-13T14:37:28.652810+0000 mgr.y (mgr.14152) 129 : cephadm 1 Deploying daemon osd.1 on smithi062 2024-02-13T14:37:30.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:30 smithi062 bash[21479]: cluster 2024-02-13T14:37:29.050131+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:30 smithi062 bash[28859]: cluster 2024-02-13T14:37:29.050131+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:30.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:30 smithi111 bash[23388]: cluster 2024-02-13T14:37:29.050131+0000 mgr.y (mgr.14152) 130 : cluster 0 pgmap v93: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:32.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:32 smithi062 bash[21479]: cluster 2024-02-13T14:37:31.050597+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:32.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:32 smithi062 bash[28859]: cluster 2024-02-13T14:37:31.050597+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:32.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:32 smithi111 bash[23388]: cluster 2024-02-13T14:37:31.050597+0000 mgr.y (mgr.14152) 131 : cluster 0 pgmap v94: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:33.027 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:37:32 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:37:33.028 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:32 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:37:33.028 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:32 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:37:33.028 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:37:32 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:37:33.295 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:33 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:37:33.295 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:37:33 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:37:33.295 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:33 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:37:33.295 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:37:33 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:37:34.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:34 smithi062 bash[28859]: cluster 2024-02-13T14:37:33.050899+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:34.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:34 smithi062 bash[28859]: audit 2024-02-13T14:37:33.287898+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:34 smithi062 bash[28859]: audit 2024-02-13T14:37:33.292900+0000 mon.a (mon.0) 317 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:34 smithi062 bash[28859]: audit 2024-02-13T14:37:33.322354+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:37:34.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:34 smithi062 bash[21479]: cluster 2024-02-13T14:37:33.050899+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:34.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:34 smithi062 bash[21479]: audit 2024-02-13T14:37:33.287898+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:34.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:34 smithi062 bash[21479]: audit 2024-02-13T14:37:33.292900+0000 mon.a (mon.0) 317 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:34.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:34 smithi062 bash[21479]: audit 2024-02-13T14:37:33.322354+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:37:34.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:34 smithi111 bash[23388]: cluster 2024-02-13T14:37:33.050899+0000 mgr.y (mgr.14152) 132 : cluster 0 pgmap v95: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:34.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:34 smithi111 bash[23388]: audit 2024-02-13T14:37:33.287898+0000 mon.a (mon.0) 316 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:34.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:34 smithi111 bash[23388]: audit 2024-02-13T14:37:33.292900+0000 mon.a (mon.0) 317 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:34.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:34 smithi111 bash[23388]: audit 2024-02-13T14:37:33.322354+0000 mon.a (mon.0) 318 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:37:36.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:36 smithi062 bash[21479]: cluster 2024-02-13T14:37:35.051285+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:36.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:36 smithi062 bash[28859]: cluster 2024-02-13T14:37:35.051285+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:36.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:36 smithi111 bash[23388]: cluster 2024-02-13T14:37:35.051285+0000 mgr.y (mgr.14152) 133 : cluster 0 pgmap v96: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:38.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:38 smithi062 bash[21479]: cluster 2024-02-13T14:37:37.051726+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:38.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:38 smithi062 bash[28859]: cluster 2024-02-13T14:37:37.051726+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:38 smithi111 bash[23388]: cluster 2024-02-13T14:37:37.051726+0000 mgr.y (mgr.14152) 134 : cluster 0 pgmap v97: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[21479]: audit 2024-02-13T14:37:38.610874+0000 mon.a (mon.0) 319 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[21479]: audit 2024-02-13T14:37:38.617340+0000 mon.a (mon.0) 320 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[21479]: audit 2024-02-13T14:37:38.618233+0000 mon.a (mon.0) 321 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[21479]: audit 2024-02-13T14:37:38.618996+0000 mon.a (mon.0) 322 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[21479]: audit 2024-02-13T14:37:38.623478+0000 mon.a (mon.0) 323 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[28859]: audit 2024-02-13T14:37:38.610874+0000 mon.a (mon.0) 319 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[28859]: audit 2024-02-13T14:37:38.617340+0000 mon.a (mon.0) 320 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[28859]: audit 2024-02-13T14:37:38.618233+0000 mon.a (mon.0) 321 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[28859]: audit 2024-02-13T14:37:38.618996+0000 mon.a (mon.0) 322 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:39.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:39 smithi062 bash[28859]: audit 2024-02-13T14:37:38.623478+0000 mon.a (mon.0) 323 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:40.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:39 smithi111 bash[23388]: audit 2024-02-13T14:37:38.610874+0000 mon.a (mon.0) 319 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:40.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:39 smithi111 bash[23388]: audit 2024-02-13T14:37:38.617340+0000 mon.a (mon.0) 320 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:40.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:39 smithi111 bash[23388]: audit 2024-02-13T14:37:38.618233+0000 mon.a (mon.0) 321 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:40.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:39 smithi111 bash[23388]: audit 2024-02-13T14:37:38.618996+0000 mon.a (mon.0) 322 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:40.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:39 smithi111 bash[23388]: audit 2024-02-13T14:37:38.623478+0000 mon.a (mon.0) 323 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:40 smithi062 bash[21479]: cluster 2024-02-13T14:37:39.052226+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:40 smithi062 bash[21479]: audit 2024-02-13T14:37:39.702858+0000 mon.a (mon.0) 324 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-13T14:37:41.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:40 smithi062 bash[28859]: cluster 2024-02-13T14:37:39.052226+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:41.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:40 smithi062 bash[28859]: audit 2024-02-13T14:37:39.702858+0000 mon.a (mon.0) 324 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-13T14:37:41.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:40 smithi111 bash[23388]: cluster 2024-02-13T14:37:39.052226+0000 mgr.y (mgr.14152) 135 : cluster 0 pgmap v98: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:41.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:40 smithi111 bash[23388]: audit 2024-02-13T14:37:39.702858+0000 mon.a (mon.0) 324 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-13T14:37:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[21479]: audit 2024-02-13T14:37:40.625990+0000 mon.a (mon.0) 325 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-13T14:37:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[21479]: cluster 2024-02-13T14:37:40.631939+0000 mon.a (mon.0) 326 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-02-13T14:37:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[21479]: audit 2024-02-13T14:37:40.632721+0000 mon.a (mon.0) 327 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:37:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[21479]: audit 2024-02-13T14:37:40.633081+0000 mon.a (mon.0) 328 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[21479]: audit 2024-02-13T14:37:41.628152+0000 mon.a (mon.0) 329 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:37:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[28859]: audit 2024-02-13T14:37:40.625990+0000 mon.a (mon.0) 325 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-13T14:37:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[28859]: cluster 2024-02-13T14:37:40.631939+0000 mon.a (mon.0) 326 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-02-13T14:37:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[28859]: audit 2024-02-13T14:37:40.632721+0000 mon.a (mon.0) 327 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:37:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[28859]: audit 2024-02-13T14:37:40.633081+0000 mon.a (mon.0) 328 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:41 smithi062 bash[28859]: audit 2024-02-13T14:37:41.628152+0000 mon.a (mon.0) 329 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:37:42.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:41 smithi111 bash[23388]: audit 2024-02-13T14:37:40.625990+0000 mon.a (mon.0) 325 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-13T14:37:42.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:41 smithi111 bash[23388]: cluster 2024-02-13T14:37:40.631939+0000 mon.a (mon.0) 326 : cluster 0 osdmap e11: 2 total, 1 up, 2 in 2024-02-13T14:37:42.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:41 smithi111 bash[23388]: audit 2024-02-13T14:37:40.632721+0000 mon.a (mon.0) 327 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:37:42.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:41 smithi111 bash[23388]: audit 2024-02-13T14:37:40.633081+0000 mon.a (mon.0) 328 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:42.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:41 smithi111 bash[23388]: audit 2024-02-13T14:37:41.628152+0000 mon.a (mon.0) 329 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:37:42.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:42.122+0000 7fb274ff9700 1 -- 172.21.15.62:0/3751194772 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 3417196986) 0x7fb264000bc0 con 0x7fb26006ee70 2024-02-13T14:37:42.126 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 1 on host 'smithi062' 2024-02-13T14:37:42.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:42.126+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 >> v1:172.21.15.62:6800/1926838190 conn(0x7fb26006ee70 legacy=0x7fb260071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:37:42.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:42.126+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 >> v1:172.21.15.62:6789/0 conn(0x7fb27810be40 legacy=0x7fb2781a2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:37:42.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:42.126+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 shutdown_connections 2024-02-13T14:37:42.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:42.126+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 >> 172.21.15.62:0/3751194772 conn(0x7fb2780ff270 msgr2=0x7fb27810ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:37:42.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:42.126+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 shutdown_connections 2024-02-13T14:37:42.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:42.126+0000 7fb27de18700 1 -- 172.21.15.62:0/3751194772 wait complete. 2024-02-13T14:37:42.796 DEBUG:teuthology.orchestra.run.smithi062:osd.1> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.1.service 2024-02-13T14:37:42.799 INFO:tasks.cephadm:Deploying osd.2 on smithi062 with /dev/vg_nvme/lv_2... 2024-02-13T14:37:42.799 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-13T14:37:43.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: cluster 2024-02-13T14:37:40.711935+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: cluster 2024-02-13T14:37:40.712044+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: cluster 2024-02-13T14:37:41.052587+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: cluster 2024-02-13T14:37:41.633709+0000 mon.a (mon.0) 330 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: audit 2024-02-13T14:37:41.638663+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: audit 2024-02-13T14:37:41.644360+0000 mon.a (mon.0) 332 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: audit 2024-02-13T14:37:42.114483+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: audit 2024-02-13T14:37:42.115159+0000 mon.a (mon.0) 334 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: audit 2024-02-13T14:37:42.123794+0000 mon.a (mon.0) 335 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: audit 2024-02-13T14:37:42.163952+0000 mon.a (mon.0) 336 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[21479]: audit 2024-02-13T14:37:42.643469+0000 mon.a (mon.0) 337 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: cluster 2024-02-13T14:37:40.711935+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: cluster 2024-02-13T14:37:40.712044+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: cluster 2024-02-13T14:37:41.052587+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: cluster 2024-02-13T14:37:41.633709+0000 mon.a (mon.0) 330 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: audit 2024-02-13T14:37:41.638663+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: audit 2024-02-13T14:37:41.644360+0000 mon.a (mon.0) 332 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: audit 2024-02-13T14:37:42.114483+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: audit 2024-02-13T14:37:42.115159+0000 mon.a (mon.0) 334 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: audit 2024-02-13T14:37:42.123794+0000 mon.a (mon.0) 335 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: audit 2024-02-13T14:37:42.163952+0000 mon.a (mon.0) 336 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' 2024-02-13T14:37:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:42 smithi062 bash[28859]: audit 2024-02-13T14:37:42.643469+0000 mon.a (mon.0) 337 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:43.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: cluster 2024-02-13T14:37:40.711935+0000 osd.1 (osd.1) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:37:43.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: cluster 2024-02-13T14:37:40.712044+0000 osd.1 (osd.1) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:37:43.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: cluster 2024-02-13T14:37:41.052587+0000 mgr.y (mgr.14152) 136 : cluster 0 pgmap v100: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:43.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: cluster 2024-02-13T14:37:41.633709+0000 mon.a (mon.0) 330 : cluster 0 osdmap e12: 2 total, 1 up, 2 in 2024-02-13T14:37:43.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: audit 2024-02-13T14:37:41.638663+0000 mon.a (mon.0) 331 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:43.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: audit 2024-02-13T14:37:41.644360+0000 mon.a (mon.0) 332 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:43.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: audit 2024-02-13T14:37:42.114483+0000 mon.a (mon.0) 333 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:43.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: audit 2024-02-13T14:37:42.115159+0000 mon.a (mon.0) 334 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:37:43.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: audit 2024-02-13T14:37:42.123794+0000 mon.a (mon.0) 335 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:43.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: audit 2024-02-13T14:37:42.163952+0000 mon.a (mon.0) 336 : audit 1 from='osd.1 v1:172.21.15.62:6805/3280693362' entity='osd.1' 2024-02-13T14:37:43.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:42 smithi111 bash[23388]: audit 2024-02-13T14:37:42.643469+0000 mon.a (mon.0) 337 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:44 smithi062 bash[28859]: cluster 2024-02-13T14:37:43.053018+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:44.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:44 smithi062 bash[28859]: cluster 2024-02-13T14:37:43.169794+0000 mon.a (mon.0) 338 : cluster 1 osd.1 v1:172.21.15.62:6805/3280693362 boot 2024-02-13T14:37:44.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:44 smithi062 bash[28859]: cluster 2024-02-13T14:37:43.169874+0000 mon.a (mon.0) 339 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-02-13T14:37:44.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:44 smithi062 bash[28859]: audit 2024-02-13T14:37:43.170566+0000 mon.a (mon.0) 340 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:44 smithi062 bash[21479]: cluster 2024-02-13T14:37:43.053018+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:44 smithi062 bash[21479]: cluster 2024-02-13T14:37:43.169794+0000 mon.a (mon.0) 338 : cluster 1 osd.1 v1:172.21.15.62:6805/3280693362 boot 2024-02-13T14:37:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:44 smithi062 bash[21479]: cluster 2024-02-13T14:37:43.169874+0000 mon.a (mon.0) 339 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-02-13T14:37:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:44 smithi062 bash[21479]: audit 2024-02-13T14:37:43.170566+0000 mon.a (mon.0) 340 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:44 smithi111 bash[23388]: cluster 2024-02-13T14:37:43.053018+0000 mgr.y (mgr.14152) 137 : cluster 0 pgmap v102: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-13T14:37:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:44 smithi111 bash[23388]: cluster 2024-02-13T14:37:43.169794+0000 mon.a (mon.0) 338 : cluster 1 osd.1 v1:172.21.15.62:6805/3280693362 boot 2024-02-13T14:37:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:44 smithi111 bash[23388]: cluster 2024-02-13T14:37:43.169874+0000 mon.a (mon.0) 339 : cluster 0 osdmap e13: 2 total, 2 up, 2 in 2024-02-13T14:37:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:44 smithi111 bash[23388]: audit 2024-02-13T14:37:43.170566+0000 mon.a (mon.0) 340 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:37:46.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:45 smithi062 bash[28859]: cluster 2024-02-13T14:37:44.760863+0000 mon.a (mon.0) 341 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-02-13T14:37:46.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:45 smithi062 bash[28859]: cluster 2024-02-13T14:37:45.053486+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:46.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:45 smithi062 bash[21479]: cluster 2024-02-13T14:37:44.760863+0000 mon.a (mon.0) 341 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-02-13T14:37:46.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:45 smithi062 bash[21479]: cluster 2024-02-13T14:37:45.053486+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:46.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:45 smithi111 bash[23388]: cluster 2024-02-13T14:37:44.760863+0000 mon.a (mon.0) 341 : cluster 0 osdmap e14: 2 total, 2 up, 2 in 2024-02-13T14:37:46.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:45 smithi111 bash[23388]: cluster 2024-02-13T14:37:45.053486+0000 mgr.y (mgr.14152) 138 : cluster 0 pgmap v105: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:47.093 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:37:48.446 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:48 smithi062 bash[28859]: cluster 2024-02-13T14:37:47.053942+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:48.446 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:48 smithi062 bash[21479]: cluster 2024-02-13T14:37:47.053942+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:48.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:48 smithi111 bash[23388]: cluster 2024-02-13T14:37:47.053942+0000 mgr.y (mgr.14152) 139 : cluster 0 pgmap v106: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:50.418 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:50 smithi062 bash[21479]: cluster 2024-02-13T14:37:49.054427+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:50.419 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:50 smithi062 bash[28859]: cluster 2024-02-13T14:37:49.054427+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:50.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:50 smithi111 bash[23388]: cluster 2024-02-13T14:37:49.054427+0000 mgr.y (mgr.14152) 140 : cluster 0 pgmap v107: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:51.125 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-13T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-13T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-02-13T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-02-13T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.014422 s, 727 MB/s 2024-02-13T14:37:51.126 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-02-13T14:37:52.013 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi062:vg_nvme/lv_2 2024-02-13T14:37:52.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:52 smithi062 bash[28859]: cluster 2024-02-13T14:37:51.054743+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:52.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:52 smithi062 bash[21479]: cluster 2024-02-13T14:37:51.054743+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:52.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:52 smithi111 bash[23388]: cluster 2024-02-13T14:37:51.054743+0000 mgr.y (mgr.14152) 141 : cluster 0 pgmap v108: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: cephadm 2024-02-13T14:37:52.406589+0000 mgr.y (mgr.14152) 142 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: audit 2024-02-13T14:37:52.413594+0000 mon.a (mon.0) 342 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: audit 2024-02-13T14:37:52.421019+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: audit 2024-02-13T14:37:52.422814+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: audit 2024-02-13T14:37:52.424197+0000 mon.a (mon.0) 345 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: cephadm 2024-02-13T14:37:52.425135+0000 mgr.y (mgr.14152) 143 : cephadm 1 Adjusting osd_memory_target on smithi062 to 8120M 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: audit 2024-02-13T14:37:52.430431+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: audit 2024-02-13T14:37:52.434194+0000 mon.a (mon.0) 347 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: audit 2024-02-13T14:37:52.435762+0000 mon.a (mon.0) 348 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[21479]: audit 2024-02-13T14:37:52.443829+0000 mon.a (mon.0) 349 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: cephadm 2024-02-13T14:37:52.406589+0000 mgr.y (mgr.14152) 142 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: audit 2024-02-13T14:37:52.413594+0000 mon.a (mon.0) 342 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: audit 2024-02-13T14:37:52.421019+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: audit 2024-02-13T14:37:52.422814+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: audit 2024-02-13T14:37:52.424197+0000 mon.a (mon.0) 345 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: cephadm 2024-02-13T14:37:52.425135+0000 mgr.y (mgr.14152) 143 : cephadm 1 Adjusting osd_memory_target on smithi062 to 8120M 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: audit 2024-02-13T14:37:52.430431+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: audit 2024-02-13T14:37:52.434194+0000 mon.a (mon.0) 347 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: audit 2024-02-13T14:37:52.435762+0000 mon.a (mon.0) 348 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:53 smithi062 bash[28859]: audit 2024-02-13T14:37:52.443829+0000 mon.a (mon.0) 349 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: cephadm 2024-02-13T14:37:52.406589+0000 mgr.y (mgr.14152) 142 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: audit 2024-02-13T14:37:52.413594+0000 mon.a (mon.0) 342 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: audit 2024-02-13T14:37:52.421019+0000 mon.a (mon.0) 343 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: audit 2024-02-13T14:37:52.422814+0000 mon.a (mon.0) 344 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: audit 2024-02-13T14:37:52.424197+0000 mon.a (mon.0) 345 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: cephadm 2024-02-13T14:37:52.425135+0000 mgr.y (mgr.14152) 143 : cephadm 1 Adjusting osd_memory_target on smithi062 to 8120M 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: audit 2024-02-13T14:37:52.430431+0000 mon.a (mon.0) 346 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: audit 2024-02-13T14:37:52.434194+0000 mon.a (mon.0) 347 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:37:53.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: audit 2024-02-13T14:37:52.435762+0000 mon.a (mon.0) 348 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:37:53.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:53 smithi111 bash[23388]: audit 2024-02-13T14:37:52.443829+0000 mon.a (mon.0) 349 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:37:54.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:54 smithi062 bash[21479]: cluster 2024-02-13T14:37:53.055129+0000 mgr.y (mgr.14152) 144 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:54.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:54 smithi062 bash[28859]: cluster 2024-02-13T14:37:53.055129+0000 mgr.y (mgr.14152) 144 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:54 smithi111 bash[23388]: cluster 2024-02-13T14:37:53.055129+0000 mgr.y (mgr.14152) 144 : cluster 0 pgmap v109: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:56.762 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:37:56.784 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:56 smithi062 bash[21479]: cluster 2024-02-13T14:37:55.055698+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:56.784 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:56 smithi062 bash[28859]: cluster 2024-02-13T14:37:55.055698+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:56.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:56 smithi111 bash[23388]: cluster 2024-02-13T14:37:55.055698+0000 mgr.y (mgr.14152) 145 : cluster 0 pgmap v110: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:37:58 smithi062 bash[21479]: cluster 2024-02-13T14:37:57.056266+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:37:58 smithi062 bash[28859]: cluster 2024-02-13T14:37:57.056266+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:58.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:37:58 smithi111 bash[23388]: cluster 2024-02-13T14:37:57.056266+0000 mgr.y (mgr.14152) 146 : cluster 0 pgmap v111: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:37:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.562+0000 7f38d2a0f700 1 -- 172.21.15.62:0/832488633 >> v1:172.21.15.62:6789/0 conn(0x7f38cc103ce0 legacy=0x7f38cc104100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:37:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- 172.21.15.62:0/832488633 shutdown_connections 2024-02-13T14:37:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- 172.21.15.62:0/832488633 >> 172.21.15.62:0/832488633 conn(0x7f38cc0ff280 msgr2=0x7f38cc1016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:37:59.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- 172.21.15.62:0/832488633 shutdown_connections 2024-02-13T14:37:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- 172.21.15.62:0/832488633 wait complete. 2024-02-13T14:37:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 Processor -- start 2024-02-13T14:37:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- start start 2024-02-13T14:37:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f38cc199c50 con 0x7f38cc108110 2024-02-13T14:37:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f38cc1a5440 con 0x7f38cc103ce0 2024-02-13T14:37:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f38cc1a65e0 con 0x7f38cc10be50 2024-02-13T14:37:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d0fac700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f38cc10be50 0x7f38cc1a2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:47516/0 (socket says 172.21.15.62:47516) 2024-02-13T14:37:59.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d0fac700 1 -- 172.21.15.62:0/1549843017 learned_addr learned my addr 172.21.15.62:0/1549843017 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226485803 0 0) 0x7f38cc199c50 con 0x7f38cc108110 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38b40035b0 con 0x7f38cc108110 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836469228 0 0) 0x7f38cc1a65e0 con 0x7f38cc10be50 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38cc199c50 con 0x7f38cc10be50 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3071085746 0 0) 0x7f38b40035b0 con 0x7f38cc108110 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f38cc1a65e0 con 0x7f38cc108110 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3580752488 0 0) 0x7f38cc199c50 con 0x7f38cc10be50 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f38b40035b0 con 0x7f38cc10be50 2024-02-13T14:37:59.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093048520 0 0) 0x7f38cc1a5440 con 0x7f38cc103ce0 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38cc199c50 con 0x7f38cc103ce0 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f38c00018d0 con 0x7f38cc108110 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f38c4001bb0 con 0x7f38cc10be50 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2809282713 0 0) 0x7f38b40035b0 con 0x7f38cc10be50 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 >> v1:172.21.15.111:6789/0 conn(0x7f38cc103ce0 legacy=0x7f38cc199100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 >> v1:172.21.15.62:6789/0 conn(0x7f38cc108110 legacy=0x7f38cc19f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc1a7780 con 0x7f38cc10be50 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38cc1a67d0 con 0x7f38cc10be50 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f38cc1a6cd0 con 0x7f38cc10be50 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f38c4001d50 con 0x7f38cc10be50 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f38c4005e50 con 0x7f38cc10be50 2024-02-13T14:37:59.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38b8005120 con 0x7f38cc10be50 2024-02-13T14:37:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.566+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 14) v1 ==== 91659+0+0 (unknown 1448675161 0 0) 0x7f38c4003a20 con 0x7f38cc10be50 2024-02-13T14:37:59.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.570+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(14..14 src has 1..14) v4 ==== 1833+0+0 (unknown 2231714705 0 0) 0x7f38c4087e50 con 0x7f38cc10be50 2024-02-13T14:37:59.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.574+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f38c4052560 con 0x7f38cc10be50 2024-02-13T14:37:59.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:37:59.798+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f38b8000b90 con 0x7f38b406edd0 2024-02-13T14:38:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:00 smithi062 bash[21479]: cluster 2024-02-13T14:37:59.056773+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:00 smithi062 bash[21479]: audit 2024-02-13T14:37:59.803913+0000 mon.a (mon.0) 350 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:38:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:00 smithi062 bash[21479]: audit 2024-02-13T14:37:59.809451+0000 mon.a (mon.0) 351 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:38:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:00 smithi062 bash[21479]: audit 2024-02-13T14:37:59.810589+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:00 smithi062 bash[28859]: cluster 2024-02-13T14:37:59.056773+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:00 smithi062 bash[28859]: audit 2024-02-13T14:37:59.803913+0000 mon.a (mon.0) 350 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:38:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:00 smithi062 bash[28859]: audit 2024-02-13T14:37:59.809451+0000 mon.a (mon.0) 351 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:38:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:00 smithi062 bash[28859]: audit 2024-02-13T14:37:59.810589+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:00 smithi111 bash[23388]: cluster 2024-02-13T14:37:59.056773+0000 mgr.y (mgr.14152) 147 : cluster 0 pgmap v112: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:00 smithi111 bash[23388]: audit 2024-02-13T14:37:59.803913+0000 mon.a (mon.0) 350 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:38:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:00 smithi111 bash[23388]: audit 2024-02-13T14:37:59.809451+0000 mon.a (mon.0) 351 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:38:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:00 smithi111 bash[23388]: audit 2024-02-13T14:37:59.810589+0000 mon.a (mon.0) 352 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:01.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:01 smithi062 bash[21479]: audit 2024-02-13T14:37:59.801050+0000 mgr.y (mgr.14152) 148 : audit 0 from='client.24173 v1:172.21.15.62:0/1549843017' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:38:01.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:01 smithi062 bash[28859]: audit 2024-02-13T14:37:59.801050+0000 mgr.y (mgr.14152) 148 : audit 0 from='client.24173 v1:172.21.15.62:0/1549843017' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:38:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:01 smithi111 bash[23388]: audit 2024-02-13T14:37:59.801050+0000 mgr.y (mgr.14152) 148 : audit 0 from='client.24173 v1:172.21.15.62:0/1549843017' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:38:02.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:02 smithi062 bash[21479]: cluster 2024-02-13T14:38:01.057164+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:02.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:02 smithi062 bash[28859]: cluster 2024-02-13T14:38:01.057164+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:02.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:02 smithi111 bash[23388]: cluster 2024-02-13T14:38:01.057164+0000 mgr.y (mgr.14152) 149 : cluster 0 pgmap v113: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:04.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:04 smithi062 bash[21479]: cluster 2024-02-13T14:38:03.057646+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:04.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:04 smithi062 bash[28859]: cluster 2024-02-13T14:38:03.057646+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:04.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:04 smithi111 bash[23388]: cluster 2024-02-13T14:38:03.057646+0000 mgr.y (mgr.14152) 150 : cluster 0 pgmap v114: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:06.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:06 smithi062 bash[21479]: cluster 2024-02-13T14:38:05.058122+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:06.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:06 smithi062 bash[28859]: cluster 2024-02-13T14:38:05.058122+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:06 smithi111 bash[23388]: cluster 2024-02-13T14:38:05.058122+0000 mgr.y (mgr.14152) 151 : cluster 0 pgmap v115: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[21479]: cluster 2024-02-13T14:38:07.058554+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[21479]: audit 2024-02-13T14:38:08.342320+0000 mon.c (mon.2) 8 : audit 1 from='client.? v1:172.21.15.62:0/520858328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]: dispatch 2024-02-13T14:38:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[21479]: audit 2024-02-13T14:38:08.342857+0000 mon.a (mon.0) 353 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]: dispatch 2024-02-13T14:38:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[21479]: audit 2024-02-13T14:38:08.345018+0000 mon.a (mon.0) 354 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]': finished 2024-02-13T14:38:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[21479]: cluster 2024-02-13T14:38:08.347469+0000 mon.a (mon.0) 355 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-02-13T14:38:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[21479]: audit 2024-02-13T14:38:08.347725+0000 mon.a (mon.0) 356 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[28859]: cluster 2024-02-13T14:38:07.058554+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[28859]: audit 2024-02-13T14:38:08.342320+0000 mon.c (mon.2) 8 : audit 1 from='client.? v1:172.21.15.62:0/520858328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]: dispatch 2024-02-13T14:38:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[28859]: audit 2024-02-13T14:38:08.342857+0000 mon.a (mon.0) 353 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]: dispatch 2024-02-13T14:38:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[28859]: audit 2024-02-13T14:38:08.345018+0000 mon.a (mon.0) 354 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]': finished 2024-02-13T14:38:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[28859]: cluster 2024-02-13T14:38:08.347469+0000 mon.a (mon.0) 355 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-02-13T14:38:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:08 smithi062 bash[28859]: audit 2024-02-13T14:38:08.347725+0000 mon.a (mon.0) 356 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:08.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:08 smithi111 bash[23388]: cluster 2024-02-13T14:38:07.058554+0000 mgr.y (mgr.14152) 152 : cluster 0 pgmap v116: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:08.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:08 smithi111 bash[23388]: audit 2024-02-13T14:38:08.342320+0000 mon.c (mon.2) 8 : audit 1 from='client.? v1:172.21.15.62:0/520858328' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]: dispatch 2024-02-13T14:38:08.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:08 smithi111 bash[23388]: audit 2024-02-13T14:38:08.342857+0000 mon.a (mon.0) 353 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]: dispatch 2024-02-13T14:38:08.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:08 smithi111 bash[23388]: audit 2024-02-13T14:38:08.345018+0000 mon.a (mon.0) 354 : audit 1 from='client.24179 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "932f8b3b-9b78-4433-9c7d-fe36ee894656"}]': finished 2024-02-13T14:38:08.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:08 smithi111 bash[23388]: cluster 2024-02-13T14:38:08.347469+0000 mon.a (mon.0) 355 : cluster 0 osdmap e15: 3 total, 2 up, 3 in 2024-02-13T14:38:08.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:08 smithi111 bash[23388]: audit 2024-02-13T14:38:08.347725+0000 mon.a (mon.0) 356 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:09.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:09 smithi062 bash[28859]: audit 2024-02-13T14:38:09.131744+0000 mon.c (mon.2) 9 : audit 0 from='client.? v1:172.21.15.62:0/2729526099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:38:09.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:09 smithi062 bash[21479]: audit 2024-02-13T14:38:09.131744+0000 mon.c (mon.2) 9 : audit 0 from='client.? v1:172.21.15.62:0/2729526099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:38:09.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:09 smithi111 bash[23388]: audit 2024-02-13T14:38:09.131744+0000 mon.c (mon.2) 9 : audit 0 from='client.? v1:172.21.15.62:0/2729526099' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:38:10.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:10 smithi062 bash[21479]: cluster 2024-02-13T14:38:09.058945+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:10.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:10 smithi062 bash[28859]: cluster 2024-02-13T14:38:09.058945+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:10.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:10 smithi111 bash[23388]: cluster 2024-02-13T14:38:09.058945+0000 mgr.y (mgr.14152) 153 : cluster 0 pgmap v118: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:12.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:12 smithi062 bash[28859]: cluster 2024-02-13T14:38:11.059433+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:12.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:12 smithi062 bash[21479]: cluster 2024-02-13T14:38:11.059433+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:12 smithi111 bash[23388]: cluster 2024-02-13T14:38:11.059433+0000 mgr.y (mgr.14152) 154 : cluster 0 pgmap v119: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:14.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:14 smithi062 bash[21479]: cluster 2024-02-13T14:38:13.060002+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:14.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:14 smithi062 bash[28859]: cluster 2024-02-13T14:38:13.060002+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:14 smithi111 bash[23388]: cluster 2024-02-13T14:38:13.060002+0000 mgr.y (mgr.14152) 155 : cluster 0 pgmap v120: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:16.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:16 smithi062 bash[21479]: cluster 2024-02-13T14:38:15.060511+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:16.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:16 smithi062 bash[28859]: cluster 2024-02-13T14:38:15.060511+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:16.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:16 smithi111 bash[23388]: cluster 2024-02-13T14:38:15.060511+0000 mgr.y (mgr.14152) 156 : cluster 0 pgmap v121: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:18 smithi062 bash[21479]: cluster 2024-02-13T14:38:17.061001+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:18.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:18 smithi062 bash[28859]: cluster 2024-02-13T14:38:17.061001+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:18 smithi111 bash[23388]: cluster 2024-02-13T14:38:17.061001+0000 mgr.y (mgr.14152) 157 : cluster 0 pgmap v122: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:20.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:20 smithi062 bash[21479]: cluster 2024-02-13T14:38:19.061356+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:20.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:20 smithi062 bash[28859]: cluster 2024-02-13T14:38:19.061356+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:20 smithi111 bash[23388]: cluster 2024-02-13T14:38:19.061356+0000 mgr.y (mgr.14152) 158 : cluster 0 pgmap v123: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:21.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:21 smithi062 bash[28859]: audit 2024-02-13T14:38:20.972001+0000 mon.a (mon.0) 357 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-13T14:38:21.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:21 smithi062 bash[28859]: audit 2024-02-13T14:38:20.973590+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:21.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:21 smithi062 bash[21479]: audit 2024-02-13T14:38:20.972001+0000 mon.a (mon.0) 357 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-13T14:38:21.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:21 smithi062 bash[21479]: audit 2024-02-13T14:38:20.973590+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:21.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:21 smithi111 bash[23388]: audit 2024-02-13T14:38:20.972001+0000 mon.a (mon.0) 357 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-13T14:38:21.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:21 smithi111 bash[23388]: audit 2024-02-13T14:38:20.973590+0000 mon.a (mon.0) 358 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:22.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:22 smithi062 bash[21479]: cephadm 2024-02-13T14:38:20.974914+0000 mgr.y (mgr.14152) 159 : cephadm 1 Deploying daemon osd.2 on smithi062 2024-02-13T14:38:22.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:22 smithi062 bash[21479]: cluster 2024-02-13T14:38:21.061782+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:22.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:22 smithi062 bash[28859]: cephadm 2024-02-13T14:38:20.974914+0000 mgr.y (mgr.14152) 159 : cephadm 1 Deploying daemon osd.2 on smithi062 2024-02-13T14:38:22.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:22 smithi062 bash[28859]: cluster 2024-02-13T14:38:21.061782+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:22 smithi111 bash[23388]: cephadm 2024-02-13T14:38:20.974914+0000 mgr.y (mgr.14152) 159 : cephadm 1 Deploying daemon osd.2 on smithi062 2024-02-13T14:38:22.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:22 smithi111 bash[23388]: cluster 2024-02-13T14:38:21.061782+0000 mgr.y (mgr.14152) 160 : cluster 0 pgmap v124: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:24.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:24 smithi062 bash[28859]: cluster 2024-02-13T14:38:23.062246+0000 mgr.y (mgr.14152) 161 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:24.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:24 smithi062 bash[21479]: cluster 2024-02-13T14:38:23.062246+0000 mgr.y (mgr.14152) 161 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:24 smithi111 bash[23388]: cluster 2024-02-13T14:38:23.062246+0000 mgr.y (mgr.14152) 161 : cluster 0 pgmap v125: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:25.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.310 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.311 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.311 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.560 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.561 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:25.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:38:26.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:26 smithi062 bash[28859]: cluster 2024-02-13T14:38:25.062784+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:26.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:26 smithi062 bash[28859]: audit 2024-02-13T14:38:25.581969+0000 mon.a (mon.0) 359 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:26.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:26 smithi062 bash[28859]: audit 2024-02-13T14:38:25.588448+0000 mon.a (mon.0) 360 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:26.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:26 smithi062 bash[28859]: audit 2024-02-13T14:38:25.613743+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:38:26.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:26 smithi062 bash[21479]: cluster 2024-02-13T14:38:25.062784+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:26.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:26 smithi062 bash[21479]: audit 2024-02-13T14:38:25.581969+0000 mon.a (mon.0) 359 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:26.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:26 smithi062 bash[21479]: audit 2024-02-13T14:38:25.588448+0000 mon.a (mon.0) 360 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:26.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:26 smithi062 bash[21479]: audit 2024-02-13T14:38:25.613743+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:38:26.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:26 smithi111 bash[23388]: cluster 2024-02-13T14:38:25.062784+0000 mgr.y (mgr.14152) 162 : cluster 0 pgmap v126: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:26.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:26 smithi111 bash[23388]: audit 2024-02-13T14:38:25.581969+0000 mon.a (mon.0) 359 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:26.848 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:26 smithi111 bash[23388]: audit 2024-02-13T14:38:25.588448+0000 mon.a (mon.0) 360 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:26.848 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:26 smithi111 bash[23388]: audit 2024-02-13T14:38:25.613743+0000 mon.a (mon.0) 361 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:38:28.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:28 smithi062 bash[21479]: cluster 2024-02-13T14:38:27.063111+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:28.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:28 smithi062 bash[28859]: cluster 2024-02-13T14:38:27.063111+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:28 smithi111 bash[23388]: cluster 2024-02-13T14:38:27.063111+0000 mgr.y (mgr.14152) 163 : cluster 0 pgmap v127: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:30.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:30 smithi111 bash[23388]: cluster 2024-02-13T14:38:29.063503+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:31.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:30 smithi062 bash[21479]: cluster 2024-02-13T14:38:29.063503+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:30 smithi062 bash[28859]: cluster 2024-02-13T14:38:29.063503+0000 mgr.y (mgr.14152) 164 : cluster 0 pgmap v128: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:32.104 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[28859]: audit 2024-02-13T14:38:30.950189+0000 mon.a (mon.0) 362 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[28859]: audit 2024-02-13T14:38:30.957358+0000 mon.a (mon.0) 363 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[28859]: cluster 2024-02-13T14:38:31.063923+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[28859]: audit 2024-02-13T14:38:31.524799+0000 mon.a (mon.0) 364 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[28859]: audit 2024-02-13T14:38:31.525825+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[28859]: audit 2024-02-13T14:38:31.531033+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[21479]: audit 2024-02-13T14:38:30.950189+0000 mon.a (mon.0) 362 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[21479]: audit 2024-02-13T14:38:30.957358+0000 mon.a (mon.0) 363 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[21479]: cluster 2024-02-13T14:38:31.063923+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[21479]: audit 2024-02-13T14:38:31.524799+0000 mon.a (mon.0) 364 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[21479]: audit 2024-02-13T14:38:31.525825+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:38:32.105 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:31 smithi062 bash[21479]: audit 2024-02-13T14:38:31.531033+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:32.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:31 smithi111 bash[23388]: audit 2024-02-13T14:38:30.950189+0000 mon.a (mon.0) 362 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:32.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:31 smithi111 bash[23388]: audit 2024-02-13T14:38:30.957358+0000 mon.a (mon.0) 363 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:32.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:31 smithi111 bash[23388]: cluster 2024-02-13T14:38:31.063923+0000 mgr.y (mgr.14152) 165 : cluster 0 pgmap v129: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:32.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:31 smithi111 bash[23388]: audit 2024-02-13T14:38:31.524799+0000 mon.a (mon.0) 364 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:32.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:31 smithi111 bash[23388]: audit 2024-02-13T14:38:31.525825+0000 mon.a (mon.0) 365 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:38:32.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:31 smithi111 bash[23388]: audit 2024-02-13T14:38:31.531033+0000 mon.a (mon.0) 366 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:33.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:32 smithi062 bash[21479]: audit 2024-02-13T14:38:32.110571+0000 mon.a (mon.0) 367 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-13T14:38:33.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:32 smithi062 bash[28859]: audit 2024-02-13T14:38:32.110571+0000 mon.a (mon.0) 367 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-13T14:38:33.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:32 smithi111 bash[23388]: audit 2024-02-13T14:38:32.110571+0000 mon.a (mon.0) 367 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-13T14:38:34.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[21479]: audit 2024-02-13T14:38:32.969741+0000 mon.a (mon.0) 368 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[21479]: cluster 2024-02-13T14:38:32.976340+0000 mon.a (mon.0) 369 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[21479]: audit 2024-02-13T14:38:32.976738+0000 mon.a (mon.0) 370 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[21479]: audit 2024-02-13T14:38:32.977118+0000 mon.a (mon.0) 371 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[21479]: cluster 2024-02-13T14:38:33.064371+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[28859]: audit 2024-02-13T14:38:32.969741+0000 mon.a (mon.0) 368 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[28859]: cluster 2024-02-13T14:38:32.976340+0000 mon.a (mon.0) 369 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[28859]: audit 2024-02-13T14:38:32.976738+0000 mon.a (mon.0) 370 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[28859]: audit 2024-02-13T14:38:32.977118+0000 mon.a (mon.0) 371 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:33 smithi062 bash[28859]: cluster 2024-02-13T14:38:33.064371+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:34.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:33 smithi111 bash[23388]: audit 2024-02-13T14:38:32.969741+0000 mon.a (mon.0) 368 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-13T14:38:34.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:33 smithi111 bash[23388]: cluster 2024-02-13T14:38:32.976340+0000 mon.a (mon.0) 369 : cluster 0 osdmap e16: 3 total, 2 up, 3 in 2024-02-13T14:38:34.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:33 smithi111 bash[23388]: audit 2024-02-13T14:38:32.976738+0000 mon.a (mon.0) 370 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:38:34.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:33 smithi111 bash[23388]: audit 2024-02-13T14:38:32.977118+0000 mon.a (mon.0) 371 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:34.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:33 smithi111 bash[23388]: cluster 2024-02-13T14:38:33.064371+0000 mgr.y (mgr.14152) 166 : cluster 0 pgmap v131: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:34.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:34.714+0000 7f38c97fa700 1 -- 172.21.15.62:0/1549843017 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 797997670) 0x7f38b8000b90 con 0x7f38b406edd0 2024-02-13T14:38:34.716 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 2 on host 'smithi062' 2024-02-13T14:38:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:34.722+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 >> v1:172.21.15.62:6800/1926838190 conn(0x7f38b406edd0 legacy=0x7f38b4071290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:38:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:34.722+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 >> v1:172.21.15.62:6790/0 conn(0x7f38cc10be50 legacy=0x7f38cc1a2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:38:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:34.722+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 shutdown_connections 2024-02-13T14:38:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:34.722+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 >> 172.21.15.62:0/1549843017 conn(0x7f38cc0ff280 msgr2=0x7f38cc101670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:38:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:34.722+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 shutdown_connections 2024-02-13T14:38:34.721 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:34.722+0000 7f38d2a0f700 1 -- 172.21.15.62:0/1549843017 wait complete. 2024-02-13T14:38:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[21479]: audit 2024-02-13T14:38:33.971251+0000 mon.a (mon.0) 372 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[21479]: cluster 2024-02-13T14:38:33.975492+0000 mon.a (mon.0) 373 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[21479]: audit 2024-02-13T14:38:33.976349+0000 mon.a (mon.0) 374 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[21479]: audit 2024-02-13T14:38:33.983232+0000 mon.a (mon.0) 375 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[21479]: audit 2024-02-13T14:38:34.652768+0000 mon.a (mon.0) 376 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[21479]: audit 2024-02-13T14:38:34.659237+0000 mon.a (mon.0) 377 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[21479]: audit 2024-02-13T14:38:34.669307+0000 mon.a (mon.0) 378 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[28859]: audit 2024-02-13T14:38:33.971251+0000 mon.a (mon.0) 372 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[28859]: cluster 2024-02-13T14:38:33.975492+0000 mon.a (mon.0) 373 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[28859]: audit 2024-02-13T14:38:33.976349+0000 mon.a (mon.0) 374 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[28859]: audit 2024-02-13T14:38:33.983232+0000 mon.a (mon.0) 375 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[28859]: audit 2024-02-13T14:38:34.652768+0000 mon.a (mon.0) 376 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:38:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[28859]: audit 2024-02-13T14:38:34.659237+0000 mon.a (mon.0) 377 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:34 smithi062 bash[28859]: audit 2024-02-13T14:38:34.669307+0000 mon.a (mon.0) 378 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:35.330 DEBUG:teuthology.orchestra.run.smithi062:osd.2> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.2.service 2024-02-13T14:38:35.333 INFO:tasks.cephadm:Deploying osd.3 on smithi062 with /dev/vg_nvme/lv_1... 2024-02-13T14:38:35.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-13T14:38:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:34 smithi111 bash[23388]: audit 2024-02-13T14:38:33.971251+0000 mon.a (mon.0) 372 : audit 1 from='osd.2 v1:172.21.15.62:6809/1346690857' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:38:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:34 smithi111 bash[23388]: cluster 2024-02-13T14:38:33.975492+0000 mon.a (mon.0) 373 : cluster 0 osdmap e17: 3 total, 2 up, 3 in 2024-02-13T14:38:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:34 smithi111 bash[23388]: audit 2024-02-13T14:38:33.976349+0000 mon.a (mon.0) 374 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:34 smithi111 bash[23388]: audit 2024-02-13T14:38:33.983232+0000 mon.a (mon.0) 375 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:34 smithi111 bash[23388]: audit 2024-02-13T14:38:34.652768+0000 mon.a (mon.0) 376 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:38:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:34 smithi111 bash[23388]: audit 2024-02-13T14:38:34.659237+0000 mon.a (mon.0) 377 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:34 smithi111 bash[23388]: audit 2024-02-13T14:38:34.669307+0000 mon.a (mon.0) 378 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:36.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[21479]: cluster 2024-02-13T14:38:33.150908+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[21479]: cluster 2024-02-13T14:38:33.151033+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[21479]: audit 2024-02-13T14:38:34.979938+0000 mon.a (mon.0) 379 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[21479]: cluster 2024-02-13T14:38:34.987253+0000 mon.a (mon.0) 380 : cluster 1 osd.2 v1:172.21.15.62:6809/1346690857 boot 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[21479]: cluster 2024-02-13T14:38:34.987336+0000 mon.a (mon.0) 381 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[21479]: audit 2024-02-13T14:38:34.988289+0000 mon.a (mon.0) 382 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[21479]: cluster 2024-02-13T14:38:35.064815+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[21479]: audit 2024-02-13T14:38:35.196546+0000 mon.a (mon.0) 383 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[28859]: cluster 2024-02-13T14:38:33.150908+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:38:36.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[28859]: cluster 2024-02-13T14:38:33.151033+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:38:36.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[28859]: audit 2024-02-13T14:38:34.979938+0000 mon.a (mon.0) 379 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:36.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[28859]: cluster 2024-02-13T14:38:34.987253+0000 mon.a (mon.0) 380 : cluster 1 osd.2 v1:172.21.15.62:6809/1346690857 boot 2024-02-13T14:38:36.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[28859]: cluster 2024-02-13T14:38:34.987336+0000 mon.a (mon.0) 381 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-02-13T14:38:36.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[28859]: audit 2024-02-13T14:38:34.988289+0000 mon.a (mon.0) 382 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:36.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[28859]: cluster 2024-02-13T14:38:35.064815+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:36.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:36 smithi062 bash[28859]: audit 2024-02-13T14:38:35.196546+0000 mon.a (mon.0) 383 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:38:36.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:36 smithi111 bash[23388]: cluster 2024-02-13T14:38:33.150908+0000 osd.2 (osd.2) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:38:36.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:36 smithi111 bash[23388]: cluster 2024-02-13T14:38:33.151033+0000 osd.2 (osd.2) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:38:36.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:36 smithi111 bash[23388]: audit 2024-02-13T14:38:34.979938+0000 mon.a (mon.0) 379 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:36.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:36 smithi111 bash[23388]: cluster 2024-02-13T14:38:34.987253+0000 mon.a (mon.0) 380 : cluster 1 osd.2 v1:172.21.15.62:6809/1346690857 boot 2024-02-13T14:38:36.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:36 smithi111 bash[23388]: cluster 2024-02-13T14:38:34.987336+0000 mon.a (mon.0) 381 : cluster 0 osdmap e18: 3 total, 3 up, 3 in 2024-02-13T14:38:36.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:36 smithi111 bash[23388]: audit 2024-02-13T14:38:34.988289+0000 mon.a (mon.0) 382 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:38:36.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:36 smithi111 bash[23388]: cluster 2024-02-13T14:38:35.064815+0000 mgr.y (mgr.14152) 167 : cluster 0 pgmap v134: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-02-13T14:38:36.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:36 smithi111 bash[23388]: audit 2024-02-13T14:38:35.196546+0000 mon.a (mon.0) 383 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:38:37.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:37 smithi062 bash[21479]: audit 2024-02-13T14:38:36.002017+0000 mon.a (mon.0) 384 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-13T14:38:37.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:37 smithi062 bash[21479]: cluster 2024-02-13T14:38:36.009890+0000 mon.a (mon.0) 385 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-02-13T14:38:37.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:37 smithi062 bash[21479]: audit 2024-02-13T14:38:36.012146+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:38:37.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:37 smithi062 bash[28859]: audit 2024-02-13T14:38:36.002017+0000 mon.a (mon.0) 384 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-13T14:38:37.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:37 smithi062 bash[28859]: cluster 2024-02-13T14:38:36.009890+0000 mon.a (mon.0) 385 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-02-13T14:38:37.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:37 smithi062 bash[28859]: audit 2024-02-13T14:38:36.012146+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:38:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:37 smithi111 bash[23388]: audit 2024-02-13T14:38:36.002017+0000 mon.a (mon.0) 384 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-13T14:38:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:37 smithi111 bash[23388]: cluster 2024-02-13T14:38:36.009890+0000 mon.a (mon.0) 385 : cluster 0 osdmap e19: 3 total, 3 up, 3 in 2024-02-13T14:38:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:37 smithi111 bash[23388]: audit 2024-02-13T14:38:36.012146+0000 mon.a (mon.0) 386 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:38:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:38 smithi062 bash[28859]: audit 2024-02-13T14:38:37.012185+0000 mon.a (mon.0) 387 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-13T14:38:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:38 smithi062 bash[28859]: cluster 2024-02-13T14:38:37.022218+0000 mon.a (mon.0) 388 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-02-13T14:38:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:38 smithi062 bash[28859]: cluster 2024-02-13T14:38:37.065247+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:38 smithi062 bash[21479]: audit 2024-02-13T14:38:37.012185+0000 mon.a (mon.0) 387 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-13T14:38:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:38 smithi062 bash[21479]: cluster 2024-02-13T14:38:37.022218+0000 mon.a (mon.0) 388 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-02-13T14:38:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:38 smithi062 bash[21479]: cluster 2024-02-13T14:38:37.065247+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:38 smithi111 bash[23388]: audit 2024-02-13T14:38:37.012185+0000 mon.a (mon.0) 387 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-13T14:38:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:38 smithi111 bash[23388]: cluster 2024-02-13T14:38:37.022218+0000 mon.a (mon.0) 388 : cluster 0 osdmap e20: 3 total, 3 up, 3 in 2024-02-13T14:38:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:38 smithi111 bash[23388]: cluster 2024-02-13T14:38:37.065247+0000 mgr.y (mgr.14152) 168 : cluster 0 pgmap v137: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:39.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:39 smithi062 bash[28859]: cluster 2024-02-13T14:38:38.028048+0000 mon.a (mon.0) 389 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-02-13T14:38:39.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:39 smithi062 bash[28859]: audit 2024-02-13T14:38:38.207527+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:39 smithi062 bash[21479]: cluster 2024-02-13T14:38:38.028048+0000 mon.a (mon.0) 389 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-02-13T14:38:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:39 smithi062 bash[21479]: audit 2024-02-13T14:38:38.207527+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:39 smithi111 bash[23388]: cluster 2024-02-13T14:38:38.028048+0000 mon.a (mon.0) 389 : cluster 0 osdmap e21: 3 total, 3 up, 3 in 2024-02-13T14:38:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:39 smithi111 bash[23388]: audit 2024-02-13T14:38:38.207527+0000 mon.a (mon.0) 390 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:39.695 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:38:40.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:40 smithi062 bash[21479]: cluster 2024-02-13T14:38:39.065723+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:40.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:40 smithi062 bash[28859]: cluster 2024-02-13T14:38:39.065723+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:40 smithi111 bash[23388]: cluster 2024-02-13T14:38:39.065723+0000 mgr.y (mgr.14152) 169 : cluster 0 pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: cluster 2024-02-13T14:38:40.038295+0000 mon.a (mon.0) 391 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-02-13T14:38:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: audit 2024-02-13T14:38:40.053445+0000 mon.a (mon.0) 392 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: audit 2024-02-13T14:38:40.053880+0000 mon.a (mon.0) 393 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: audit 2024-02-13T14:38:40.054361+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: audit 2024-02-13T14:38:40.054562+0000 mon.a (mon.0) 395 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: audit 2024-02-13T14:38:40.998377+0000 mon.a (mon.0) 396 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: audit 2024-02-13T14:38:41.001189+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: audit 2024-02-13T14:38:41.001429+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[21479]: audit 2024-02-13T14:38:41.001630+0000 mon.a (mon.0) 399 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: cluster 2024-02-13T14:38:40.038295+0000 mon.a (mon.0) 391 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: audit 2024-02-13T14:38:40.053445+0000 mon.a (mon.0) 392 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: audit 2024-02-13T14:38:40.053880+0000 mon.a (mon.0) 393 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: audit 2024-02-13T14:38:40.054361+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: audit 2024-02-13T14:38:40.054562+0000 mon.a (mon.0) 395 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: audit 2024-02-13T14:38:40.998377+0000 mon.a (mon.0) 396 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: audit 2024-02-13T14:38:41.001189+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: audit 2024-02-13T14:38:41.001429+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:41 smithi062 bash[28859]: audit 2024-02-13T14:38:41.001630+0000 mon.a (mon.0) 399 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: cluster 2024-02-13T14:38:40.038295+0000 mon.a (mon.0) 391 : cluster 0 mgrmap e15: y(active, since 4m), standbys: x 2024-02-13T14:38:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: audit 2024-02-13T14:38:40.053445+0000 mon.a (mon.0) 392 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: audit 2024-02-13T14:38:40.053880+0000 mon.a (mon.0) 393 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: audit 2024-02-13T14:38:40.054361+0000 mon.a (mon.0) 394 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: audit 2024-02-13T14:38:40.054562+0000 mon.a (mon.0) 395 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: audit 2024-02-13T14:38:40.998377+0000 mon.a (mon.0) 396 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: audit 2024-02-13T14:38:41.001189+0000 mon.a (mon.0) 397 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: audit 2024-02-13T14:38:41.001429+0000 mon.a (mon.0) 398 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:42.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:41 smithi111 bash[23388]: audit 2024-02-13T14:38:41.001630+0000 mon.a (mon.0) 399 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:43.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: audit 2024-02-13T14:38:41.000130+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:43.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: cluster 2024-02-13T14:38:41.066044+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:43.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: audit 2024-02-13T14:38:41.905510+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: audit 2024-02-13T14:38:41.963852+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: audit 2024-02-13T14:38:41.968574+0000 mon.a (mon.0) 401 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: audit 2024-02-13T14:38:41.969069+0000 mon.c (mon.2) 10 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: audit 2024-02-13T14:38:41.969175+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: audit 2024-02-13T14:38:41.969723+0000 mon.a (mon.0) 403 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[28859]: audit 2024-02-13T14:38:42.880778+0000 mon.c (mon.2) 11 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: audit 2024-02-13T14:38:41.000130+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: cluster 2024-02-13T14:38:41.066044+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: audit 2024-02-13T14:38:41.905510+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: audit 2024-02-13T14:38:41.963852+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: audit 2024-02-13T14:38:41.968574+0000 mon.a (mon.0) 401 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: audit 2024-02-13T14:38:41.969069+0000 mon.c (mon.2) 10 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: audit 2024-02-13T14:38:41.969175+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: audit 2024-02-13T14:38:41.969723+0000 mon.a (mon.0) 403 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:42 smithi062 bash[21479]: audit 2024-02-13T14:38:42.880778+0000 mon.c (mon.2) 11 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: audit 2024-02-13T14:38:41.000130+0000 mon.b (mon.1) 8 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: cluster 2024-02-13T14:38:41.066044+0000 mgr.y (mgr.14152) 170 : cluster 0 pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 85 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: audit 2024-02-13T14:38:41.905510+0000 mon.b (mon.1) 9 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: audit 2024-02-13T14:38:41.963852+0000 mon.a (mon.0) 400 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: audit 2024-02-13T14:38:41.968574+0000 mon.a (mon.0) 401 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: audit 2024-02-13T14:38:41.969069+0000 mon.c (mon.2) 10 : audit 1 from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: audit 2024-02-13T14:38:41.969175+0000 mon.a (mon.0) 402 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: audit 2024-02-13T14:38:41.969723+0000 mon.a (mon.0) 403 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:38:43.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:42 smithi111 bash[23388]: audit 2024-02-13T14:38:42.880778+0000 mon.c (mon.2) 11 : audit 1 from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-13T14:38:44.129 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-13T14:38:44.129 INFO:teuthology.orchestra.run.smithi062.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-13T14:38:44.129 INFO:teuthology.orchestra.run.smithi062.stderr: stderr: 10+0 records in 2024-02-13T14:38:44.129 INFO:teuthology.orchestra.run.smithi062.stderr:10+0 records out 2024-02-13T14:38:44.129 INFO:teuthology.orchestra.run.smithi062.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129919 s, 807 MB/s 2024-02-13T14:38:44.129 INFO:teuthology.orchestra.run.smithi062.stderr:--> Zapping successful for: 2024-02-13T14:38:44.168 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:43 smithi062 bash[21479]: cluster 2024-02-13T14:38:43.066512+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:44.168 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:43 smithi062 bash[28859]: cluster 2024-02-13T14:38:43.066512+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:44.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:43 smithi111 bash[23388]: cluster 2024-02-13T14:38:43.066512+0000 mgr.y (mgr.14152) 171 : cluster 0 pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:45.055 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi062:vg_nvme/lv_1 2024-02-13T14:38:46.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: cluster 2024-02-13T14:38:45.067127+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: cephadm 2024-02-13T14:38:45.457137+0000 mgr.y (mgr.14152) 173 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.466098+0000 mon.a (mon.0) 404 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.476487+0000 mon.a (mon.0) 405 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.479239+0000 mon.a (mon.0) 406 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.480987+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.482546+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: cephadm 2024-02-13T14:38:45.483689+0000 mgr.y (mgr.14152) 174 : cephadm 1 Adjusting osd_memory_target on smithi062 to 5413M 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.490163+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.495225+0000 mon.a (mon.0) 410 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.496813+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[21479]: audit 2024-02-13T14:38:45.506519+0000 mon.a (mon.0) 412 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: cluster 2024-02-13T14:38:45.067127+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: cephadm 2024-02-13T14:38:45.457137+0000 mgr.y (mgr.14152) 173 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.466098+0000 mon.a (mon.0) 404 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.476487+0000 mon.a (mon.0) 405 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.479239+0000 mon.a (mon.0) 406 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.480987+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.482546+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: cephadm 2024-02-13T14:38:45.483689+0000 mgr.y (mgr.14152) 174 : cephadm 1 Adjusting osd_memory_target on smithi062 to 5413M 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.490163+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.495225+0000 mon.a (mon.0) 410 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.496813+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:38:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:46 smithi062 bash[28859]: audit 2024-02-13T14:38:45.506519+0000 mon.a (mon.0) 412 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: cluster 2024-02-13T14:38:45.067127+0000 mgr.y (mgr.14152) 172 : cluster 0 pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: cephadm 2024-02-13T14:38:45.457137+0000 mgr.y (mgr.14152) 173 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.466098+0000 mon.a (mon.0) 404 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.476487+0000 mon.a (mon.0) 405 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.479239+0000 mon.a (mon.0) 406 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.480987+0000 mon.a (mon.0) 407 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.482546+0000 mon.a (mon.0) 408 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: cephadm 2024-02-13T14:38:45.483689+0000 mgr.y (mgr.14152) 174 : cephadm 1 Adjusting osd_memory_target on smithi062 to 5413M 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.490163+0000 mon.a (mon.0) 409 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.495225+0000 mon.a (mon.0) 410 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.496813+0000 mon.a (mon.0) 411 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:38:46.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:46 smithi111 bash[23388]: audit 2024-02-13T14:38:45.506519+0000 mon.a (mon.0) 412 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:38:48.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:48 smithi062 bash[28859]: cluster 2024-02-13T14:38:47.067732+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-13T14:38:48.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:48 smithi062 bash[21479]: cluster 2024-02-13T14:38:47.067732+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-13T14:38:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:48 smithi111 bash[23388]: cluster 2024-02-13T14:38:47.067732+0000 mgr.y (mgr.14152) 175 : cluster 0 pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-02-13T14:38:49.814 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:38:50.786 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:50 smithi062 bash[21479]: cluster 2024-02-13T14:38:49.068312+0000 mgr.y (mgr.14152) 176 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-13T14:38:50.786 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:50 smithi062 bash[28859]: cluster 2024-02-13T14:38:49.068312+0000 mgr.y (mgr.14152) 176 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-13T14:38:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:50 smithi111 bash[23388]: cluster 2024-02-13T14:38:49.068312+0000 mgr.y (mgr.14152) 176 : cluster 0 pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-13T14:38:52.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- 172.21.15.62:0/2893021611 >> v1:172.21.15.62:6790/0 conn(0x7fab4c102550 legacy=0x7fab4c104940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:38:52.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- 172.21.15.62:0/2893021611 shutdown_connections 2024-02-13T14:38:52.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- 172.21.15.62:0/2893021611 >> 172.21.15.62:0/2893021611 conn(0x7fab4c0fbf60 msgr2=0x7fab4c0fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:38:52.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- 172.21.15.62:0/2893021611 shutdown_connections 2024-02-13T14:38:52.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- 172.21.15.62:0/2893021611 wait complete. 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 Processor -- start 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- start start 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fab4c1a3ee0 con 0x7fab4c102550 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fab4c1a50e0 con 0x7fab4c106060 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab5450f700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fab4c1a62e0 con 0x7fab4c109c00 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab52aac700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fab4c109c00 0x7fab4c1a25a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:42100/0 (socket says 172.21.15.62:42100) 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab52aac700 1 -- 172.21.15.62:0/397693656 learned_addr learned my addr 172.21.15.62:0/397693656 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.565+0000 7fab522ab700 1 --1- 172.21.15.62:0/397693656 >> v1:172.21.15.62:6789/0 conn(0x7fab4c102550 0x7fab4c101d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44250/0 (socket says 172.21.15.62:44250) 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730390753 0 0) 0x7fab4c1a3ee0 con 0x7fab4c102550 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab38005070 con 0x7fab4c102550 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192432290 0 0) 0x7fab4c1a62e0 con 0x7fab4c109c00 2024-02-13T14:38:52.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4c1a3ee0 con 0x7fab4c109c00 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3508340124 0 0) 0x7fab38005070 con 0x7fab4c102550 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fab4c1a62e0 con 0x7fab4c102550 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fab48004500 con 0x7fab4c102550 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3556399279 0 0) 0x7fab4c1a3ee0 con 0x7fab4c109c00 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fab38005070 con 0x7fab4c109c00 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 823744086 0 0) 0x7fab4c1a50e0 con 0x7fab4c106060 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4c1a3ee0 con 0x7fab4c106060 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fab44001bf0 con 0x7fab4c109c00 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 684987309 0 0) 0x7fab4c1a62e0 con 0x7fab4c102550 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 >> v1:172.21.15.62:6790/0 conn(0x7fab4c109c00 legacy=0x7fab4c1a25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 >> v1:172.21.15.111:6789/0 conn(0x7fab4c106060 legacy=0x7fab4c19ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:38:52.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c1a74e0 con 0x7fab4c102550 2024-02-13T14:38:52.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c1a40d0 con 0x7fab4c102550 2024-02-13T14:38:52.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c1a45d0 con 0x7fab4c102550 2024-02-13T14:38:52.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fab480011c0 con 0x7fab4c102550 2024-02-13T14:38:52.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fab48004f50 con 0x7fab4c102550 2024-02-13T14:38:52.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab30005150 con 0x7fab4c102550 2024-02-13T14:38:52.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7fab480050d0 con 0x7fab4c102550 2024-02-13T14:38:52.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.569+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(21..21 src has 1..21) v4 ==== 2511+0+0 (unknown 1645807602 0 0) 0x7fab480882e0 con 0x7fab4c102550 2024-02-13T14:38:52.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.577+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fab480524a0 con 0x7fab4c102550 2024-02-13T14:38:52.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:38:52.793+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fab30000bc0 con 0x7fab3806edb0 2024-02-13T14:38:52.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:52 smithi062 bash[21479]: cluster 2024-02-13T14:38:51.068879+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:52 smithi062 bash[28859]: cluster 2024-02-13T14:38:51.068879+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:52 smithi111 bash[23388]: cluster 2024-02-13T14:38:51.068879+0000 mgr.y (mgr.14152) 177 : cluster 0 pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:53.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:53 smithi062 bash[28859]: audit 2024-02-13T14:38:52.802931+0000 mon.a (mon.0) 413 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:38:53.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:53 smithi062 bash[28859]: audit 2024-02-13T14:38:52.805828+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:38:53.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:53 smithi062 bash[28859]: audit 2024-02-13T14:38:52.806627+0000 mon.a (mon.0) 415 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:53 smithi062 bash[21479]: audit 2024-02-13T14:38:52.802931+0000 mon.a (mon.0) 413 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:38:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:53 smithi062 bash[21479]: audit 2024-02-13T14:38:52.805828+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:38:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:53 smithi062 bash[21479]: audit 2024-02-13T14:38:52.806627+0000 mon.a (mon.0) 415 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:53 smithi111 bash[23388]: audit 2024-02-13T14:38:52.802931+0000 mon.a (mon.0) 413 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:38:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:53 smithi111 bash[23388]: audit 2024-02-13T14:38:52.805828+0000 mon.a (mon.0) 414 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:38:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:53 smithi111 bash[23388]: audit 2024-02-13T14:38:52.806627+0000 mon.a (mon.0) 415 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:38:54.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:54 smithi062 bash[21479]: audit 2024-02-13T14:38:52.798995+0000 mgr.y (mgr.14152) 178 : audit 0 from='client.14304 v1:172.21.15.62:0/397693656' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:38:54.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:54 smithi062 bash[21479]: cluster 2024-02-13T14:38:53.069408+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:54.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:54 smithi062 bash[28859]: audit 2024-02-13T14:38:52.798995+0000 mgr.y (mgr.14152) 178 : audit 0 from='client.14304 v1:172.21.15.62:0/397693656' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:38:54.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:54 smithi062 bash[28859]: cluster 2024-02-13T14:38:53.069408+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:54 smithi111 bash[23388]: audit 2024-02-13T14:38:52.798995+0000 mgr.y (mgr.14152) 178 : audit 0 from='client.14304 v1:172.21.15.62:0/397693656' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi062:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:38:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:54 smithi111 bash[23388]: cluster 2024-02-13T14:38:53.069408+0000 mgr.y (mgr.14152) 179 : cluster 0 pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:56.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:56 smithi062 bash[21479]: cluster 2024-02-13T14:38:55.069934+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:56.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:56 smithi062 bash[28859]: cluster 2024-02-13T14:38:55.069934+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:56 smithi111 bash[23388]: cluster 2024-02-13T14:38:55.069934+0000 mgr.y (mgr.14152) 180 : cluster 0 pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-13T14:38:58.748 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:38:58 smithi062 bash[21479]: cluster 2024-02-13T14:38:57.070511+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:58.749 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:38:58 smithi062 bash[28859]: cluster 2024-02-13T14:38:57.070511+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:38:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:38:58 smithi111 bash[23388]: cluster 2024-02-13T14:38:57.070511+0000 mgr.y (mgr.14152) 181 : cluster 0 pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:00 smithi062 bash[21479]: cluster 2024-02-13T14:38:59.071021+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:00 smithi062 bash[28859]: cluster 2024-02-13T14:38:59.071021+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:00 smithi111 bash[23388]: cluster 2024-02-13T14:38:59.071021+0000 mgr.y (mgr.14152) 182 : cluster 0 pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:01.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:01 smithi062 bash[21479]: audit 2024-02-13T14:39:01.294827+0000 mon.a (mon.0) 416 : audit 1 from='client.? v1:172.21.15.62:0/200082305' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7eca01f3-8960-425b-887d-20f66959978e"}]: dispatch 2024-02-13T14:39:01.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:01 smithi062 bash[21479]: audit 2024-02-13T14:39:01.297408+0000 mon.a (mon.0) 417 : audit 1 from='client.? v1:172.21.15.62:0/200082305' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7eca01f3-8960-425b-887d-20f66959978e"}]': finished 2024-02-13T14:39:01.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:01 smithi062 bash[21479]: cluster 2024-02-13T14:39:01.303049+0000 mon.a (mon.0) 418 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-02-13T14:39:01.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:01 smithi062 bash[21479]: audit 2024-02-13T14:39:01.303690+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:01.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:01 smithi062 bash[28859]: audit 2024-02-13T14:39:01.294827+0000 mon.a (mon.0) 416 : audit 1 from='client.? v1:172.21.15.62:0/200082305' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7eca01f3-8960-425b-887d-20f66959978e"}]: dispatch 2024-02-13T14:39:01.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:01 smithi062 bash[28859]: audit 2024-02-13T14:39:01.297408+0000 mon.a (mon.0) 417 : audit 1 from='client.? v1:172.21.15.62:0/200082305' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7eca01f3-8960-425b-887d-20f66959978e"}]': finished 2024-02-13T14:39:01.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:01 smithi062 bash[28859]: cluster 2024-02-13T14:39:01.303049+0000 mon.a (mon.0) 418 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-02-13T14:39:01.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:01 smithi062 bash[28859]: audit 2024-02-13T14:39:01.303690+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:01 smithi111 bash[23388]: audit 2024-02-13T14:39:01.294827+0000 mon.a (mon.0) 416 : audit 1 from='client.? v1:172.21.15.62:0/200082305' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7eca01f3-8960-425b-887d-20f66959978e"}]: dispatch 2024-02-13T14:39:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:01 smithi111 bash[23388]: audit 2024-02-13T14:39:01.297408+0000 mon.a (mon.0) 417 : audit 1 from='client.? v1:172.21.15.62:0/200082305' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7eca01f3-8960-425b-887d-20f66959978e"}]': finished 2024-02-13T14:39:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:01 smithi111 bash[23388]: cluster 2024-02-13T14:39:01.303049+0000 mon.a (mon.0) 418 : cluster 0 osdmap e22: 4 total, 3 up, 4 in 2024-02-13T14:39:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:01 smithi111 bash[23388]: audit 2024-02-13T14:39:01.303690+0000 mon.a (mon.0) 419 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:02.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:02 smithi062 bash[21479]: cluster 2024-02-13T14:39:01.071310+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:02.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:02 smithi062 bash[21479]: audit 2024-02-13T14:39:02.054635+0000 mon.c (mon.2) 12 : audit 0 from='client.? v1:172.21.15.62:0/1519569522' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:39:02.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:02 smithi062 bash[28859]: cluster 2024-02-13T14:39:01.071310+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:02.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:02 smithi062 bash[28859]: audit 2024-02-13T14:39:02.054635+0000 mon.c (mon.2) 12 : audit 0 from='client.? v1:172.21.15.62:0/1519569522' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:39:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:02 smithi111 bash[23388]: cluster 2024-02-13T14:39:01.071310+0000 mgr.y (mgr.14152) 183 : cluster 0 pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:02 smithi111 bash[23388]: audit 2024-02-13T14:39:02.054635+0000 mon.c (mon.2) 12 : audit 0 from='client.? v1:172.21.15.62:0/1519569522' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:39:04.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:04 smithi062 bash[28859]: cluster 2024-02-13T14:39:03.071807+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:04.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:04 smithi062 bash[21479]: cluster 2024-02-13T14:39:03.071807+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:04 smithi111 bash[23388]: cluster 2024-02-13T14:39:03.071807+0000 mgr.y (mgr.14152) 184 : cluster 0 pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:06.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:06 smithi062 bash[28859]: cluster 2024-02-13T14:39:05.072370+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:06.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:06 smithi062 bash[21479]: cluster 2024-02-13T14:39:05.072370+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:06 smithi111 bash[23388]: cluster 2024-02-13T14:39:05.072370+0000 mgr.y (mgr.14152) 185 : cluster 0 pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:08 smithi062 bash[21479]: cluster 2024-02-13T14:39:07.072917+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:08.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:08 smithi062 bash[28859]: cluster 2024-02-13T14:39:07.072917+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:08 smithi111 bash[23388]: cluster 2024-02-13T14:39:07.072917+0000 mgr.y (mgr.14152) 186 : cluster 0 pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:10.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:10 smithi062 bash[21479]: cluster 2024-02-13T14:39:09.073471+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:10.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:10 smithi062 bash[28859]: cluster 2024-02-13T14:39:09.073471+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:10 smithi111 bash[23388]: cluster 2024-02-13T14:39:09.073471+0000 mgr.y (mgr.14152) 187 : cluster 0 pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:12.783 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:12 smithi062 bash[21479]: cluster 2024-02-13T14:39:11.074041+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:12.783 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:12 smithi062 bash[28859]: cluster 2024-02-13T14:39:11.074041+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:12 smithi111 bash[23388]: cluster 2024-02-13T14:39:11.074041+0000 mgr.y (mgr.14152) 188 : cluster 0 pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:14.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:14 smithi062 bash[21479]: cluster 2024-02-13T14:39:13.074683+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:14.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:14 smithi062 bash[21479]: audit 2024-02-13T14:39:13.964057+0000 mon.a (mon.0) 420 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-13T14:39:14.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:14 smithi062 bash[21479]: audit 2024-02-13T14:39:13.965727+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:14 smithi062 bash[28859]: cluster 2024-02-13T14:39:13.074683+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:14 smithi062 bash[28859]: audit 2024-02-13T14:39:13.964057+0000 mon.a (mon.0) 420 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-13T14:39:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:14 smithi062 bash[28859]: audit 2024-02-13T14:39:13.965727+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:14 smithi111 bash[23388]: cluster 2024-02-13T14:39:13.074683+0000 mgr.y (mgr.14152) 189 : cluster 0 pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:14 smithi111 bash[23388]: audit 2024-02-13T14:39:13.964057+0000 mon.a (mon.0) 420 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-13T14:39:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:14 smithi111 bash[23388]: audit 2024-02-13T14:39:13.965727+0000 mon.a (mon.0) 421 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:15.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:15 smithi062 bash[28859]: cephadm 2024-02-13T14:39:13.967174+0000 mgr.y (mgr.14152) 190 : cephadm 1 Deploying daemon osd.3 on smithi062 2024-02-13T14:39:15.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:15 smithi062 bash[21479]: cephadm 2024-02-13T14:39:13.967174+0000 mgr.y (mgr.14152) 190 : cephadm 1 Deploying daemon osd.3 on smithi062 2024-02-13T14:39:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:15 smithi111 bash[23388]: cephadm 2024-02-13T14:39:13.967174+0000 mgr.y (mgr.14152) 190 : cephadm 1 Deploying daemon osd.3 on smithi062 2024-02-13T14:39:16.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:16 smithi062 bash[28859]: cluster 2024-02-13T14:39:15.075236+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:16.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:16 smithi062 bash[21479]: cluster 2024-02-13T14:39:15.075236+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:16 smithi111 bash[23388]: cluster 2024-02-13T14:39:15.075236+0000 mgr.y (mgr.14152) 191 : cluster 0 pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:18.359 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.359 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.359 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.360 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.360 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.360 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.643 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.644 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:18 smithi062 bash[28859]: cluster 2024-02-13T14:39:17.075768+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:18.644 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.644 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.645 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.645 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.645 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:18 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:39:18.645 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:18 smithi062 bash[21479]: cluster 2024-02-13T14:39:17.075768+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:18 smithi111 bash[23388]: cluster 2024-02-13T14:39:17.075768+0000 mgr.y (mgr.14152) 192 : cluster 0 pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:20.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:19 smithi062 bash[21479]: audit 2024-02-13T14:39:18.650709+0000 mon.a (mon.0) 422 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:20.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:19 smithi062 bash[21479]: audit 2024-02-13T14:39:18.657407+0000 mon.a (mon.0) 423 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:20.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:19 smithi062 bash[21479]: audit 2024-02-13T14:39:18.676889+0000 mon.a (mon.0) 424 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:39:20.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:19 smithi062 bash[28859]: audit 2024-02-13T14:39:18.650709+0000 mon.a (mon.0) 422 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:20.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:19 smithi062 bash[28859]: audit 2024-02-13T14:39:18.657407+0000 mon.a (mon.0) 423 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:20.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:19 smithi062 bash[28859]: audit 2024-02-13T14:39:18.676889+0000 mon.a (mon.0) 424 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:39:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:19 smithi111 bash[23388]: audit 2024-02-13T14:39:18.650709+0000 mon.a (mon.0) 422 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:19 smithi111 bash[23388]: audit 2024-02-13T14:39:18.657407+0000 mon.a (mon.0) 423 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:19 smithi111 bash[23388]: audit 2024-02-13T14:39:18.676889+0000 mon.a (mon.0) 424 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:39:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:20 smithi062 bash[21479]: cluster 2024-02-13T14:39:19.076104+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:20.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:20 smithi062 bash[28859]: cluster 2024-02-13T14:39:19.076104+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:20 smithi111 bash[23388]: cluster 2024-02-13T14:39:19.076104+0000 mgr.y (mgr.14152) 193 : cluster 0 pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:23.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:22 smithi062 bash[28859]: cluster 2024-02-13T14:39:21.076605+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:22 smithi062 bash[21479]: cluster 2024-02-13T14:39:21.076605+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:22 smithi111 bash[23388]: cluster 2024-02-13T14:39:21.076605+0000 mgr.y (mgr.14152) 194 : cluster 0 pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:24.981 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[21479]: cluster 2024-02-13T14:39:23.076979+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:24.981 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[21479]: audit 2024-02-13T14:39:24.014542+0000 mon.a (mon.0) 425 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:24.981 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[21479]: audit 2024-02-13T14:39:24.022972+0000 mon.a (mon.0) 426 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:24.982 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[21479]: audit 2024-02-13T14:39:24.024601+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:24.982 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[21479]: audit 2024-02-13T14:39:24.025696+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:39:24.982 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[21479]: audit 2024-02-13T14:39:24.033818+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:24.982 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[28859]: cluster 2024-02-13T14:39:23.076979+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:24.982 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[28859]: audit 2024-02-13T14:39:24.014542+0000 mon.a (mon.0) 425 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:24.983 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[28859]: audit 2024-02-13T14:39:24.022972+0000 mon.a (mon.0) 426 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:24.983 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[28859]: audit 2024-02-13T14:39:24.024601+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:24.983 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[28859]: audit 2024-02-13T14:39:24.025696+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:39:24.983 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:24 smithi062 bash[28859]: audit 2024-02-13T14:39:24.033818+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:24 smithi111 bash[23388]: cluster 2024-02-13T14:39:23.076979+0000 mgr.y (mgr.14152) 195 : cluster 0 pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:24 smithi111 bash[23388]: audit 2024-02-13T14:39:24.014542+0000 mon.a (mon.0) 425 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:24 smithi111 bash[23388]: audit 2024-02-13T14:39:24.022972+0000 mon.a (mon.0) 426 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:24 smithi111 bash[23388]: audit 2024-02-13T14:39:24.024601+0000 mon.a (mon.0) 427 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:25.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:24 smithi111 bash[23388]: audit 2024-02-13T14:39:24.025696+0000 mon.a (mon.0) 428 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:39:25.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:24 smithi111 bash[23388]: audit 2024-02-13T14:39:24.033818+0000 mon.a (mon.0) 429 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:26.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:25 smithi062 bash[21479]: audit 2024-02-13T14:39:25.415693+0000 mon.c (mon.2) 13 : audit 1 from='osd.3 v1:172.21.15.62:6813/1701426775' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T14:39:26.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:25 smithi062 bash[21479]: audit 2024-02-13T14:39:25.416158+0000 mon.a (mon.0) 430 : audit 1 from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T14:39:26.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:25 smithi062 bash[28859]: audit 2024-02-13T14:39:25.415693+0000 mon.c (mon.2) 13 : audit 1 from='osd.3 v1:172.21.15.62:6813/1701426775' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T14:39:26.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:25 smithi062 bash[28859]: audit 2024-02-13T14:39:25.416158+0000 mon.a (mon.0) 430 : audit 1 from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T14:39:26.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:25 smithi111 bash[23388]: audit 2024-02-13T14:39:25.415693+0000 mon.c (mon.2) 13 : audit 1 from='osd.3 v1:172.21.15.62:6813/1701426775' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T14:39:26.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:25 smithi111 bash[23388]: audit 2024-02-13T14:39:25.416158+0000 mon.a (mon.0) 430 : audit 1 from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-13T14:39:27.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[21479]: cluster 2024-02-13T14:39:25.077482+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:27.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[21479]: audit 2024-02-13T14:39:25.678582+0000 mon.a (mon.0) 431 : audit 1 from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-13T14:39:27.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[21479]: audit 2024-02-13T14:39:25.687369+0000 mon.c (mon.2) 14 : audit 1 from='osd.3 v1:172.21.15.62:6813/1701426775' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:39:27.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[21479]: cluster 2024-02-13T14:39:25.689138+0000 mon.a (mon.0) 432 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-02-13T14:39:27.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[21479]: audit 2024-02-13T14:39:25.689733+0000 mon.a (mon.0) 433 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:27.040 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[21479]: audit 2024-02-13T14:39:25.690690+0000 mon.a (mon.0) 434 : audit 1 from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:39:27.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[28859]: cluster 2024-02-13T14:39:25.077482+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:27.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[28859]: audit 2024-02-13T14:39:25.678582+0000 mon.a (mon.0) 431 : audit 1 from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-13T14:39:27.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[28859]: audit 2024-02-13T14:39:25.687369+0000 mon.c (mon.2) 14 : audit 1 from='osd.3 v1:172.21.15.62:6813/1701426775' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:39:27.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[28859]: cluster 2024-02-13T14:39:25.689138+0000 mon.a (mon.0) 432 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-02-13T14:39:27.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[28859]: audit 2024-02-13T14:39:25.689733+0000 mon.a (mon.0) 433 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:27.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:26 smithi062 bash[28859]: audit 2024-02-13T14:39:25.690690+0000 mon.a (mon.0) 434 : audit 1 from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:39:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:26 smithi111 bash[23388]: cluster 2024-02-13T14:39:25.077482+0000 mgr.y (mgr.14152) 196 : cluster 0 pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:26 smithi111 bash[23388]: audit 2024-02-13T14:39:25.678582+0000 mon.a (mon.0) 431 : audit 1 from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-13T14:39:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:26 smithi111 bash[23388]: audit 2024-02-13T14:39:25.687369+0000 mon.c (mon.2) 14 : audit 1 from='osd.3 v1:172.21.15.62:6813/1701426775' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:39:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:26 smithi111 bash[23388]: cluster 2024-02-13T14:39:25.689138+0000 mon.a (mon.0) 432 : cluster 0 osdmap e23: 4 total, 3 up, 4 in 2024-02-13T14:39:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:26 smithi111 bash[23388]: audit 2024-02-13T14:39:25.689733+0000 mon.a (mon.0) 433 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:27.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:26 smithi111 bash[23388]: audit 2024-02-13T14:39:25.690690+0000 mon.a (mon.0) 434 : audit 1 from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]: dispatch 2024-02-13T14:39:27.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:39:27.649+0000 7fab437fe700 1 -- 172.21.15.62:0/397693656 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 1938134226) 0x7fab30000bc0 con 0x7fab3806edb0 2024-02-13T14:39:27.649 INFO:teuthology.orchestra.run.smithi062.stdout:Created osd(s) 3 on host 'smithi062' 2024-02-13T14:39:27.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:39:27.653+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 >> v1:172.21.15.62:6800/1926838190 conn(0x7fab3806edb0 legacy=0x7fab38071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:39:27.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:39:27.653+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 >> v1:172.21.15.62:6789/0 conn(0x7fab4c102550 legacy=0x7fab4c101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:39:27.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:39:27.653+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 shutdown_connections 2024-02-13T14:39:27.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:39:27.653+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 >> 172.21.15.62:0/397693656 conn(0x7fab4c0fbf60 msgr2=0x7fab4c104cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:39:27.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:39:27.653+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 shutdown_connections 2024-02-13T14:39:27.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:39:27.653+0000 7fab5450f700 1 -- 172.21.15.62:0/397693656 wait complete. 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[21479]: audit 2024-02-13T14:39:26.680373+0000 mon.a (mon.0) 435 : audit 1 from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[21479]: cluster 2024-02-13T14:39:26.683790+0000 mon.a (mon.0) 436 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[21479]: audit 2024-02-13T14:39:26.684377+0000 mon.a (mon.0) 437 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[21479]: audit 2024-02-13T14:39:26.691147+0000 mon.a (mon.0) 438 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[21479]: audit 2024-02-13T14:39:27.626191+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[21479]: audit 2024-02-13T14:39:27.633715+0000 mon.a (mon.0) 440 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[21479]: audit 2024-02-13T14:39:27.644181+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[28859]: audit 2024-02-13T14:39:26.680373+0000 mon.a (mon.0) 435 : audit 1 from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[28859]: cluster 2024-02-13T14:39:26.683790+0000 mon.a (mon.0) 436 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-02-13T14:39:28.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[28859]: audit 2024-02-13T14:39:26.684377+0000 mon.a (mon.0) 437 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:28.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[28859]: audit 2024-02-13T14:39:26.691147+0000 mon.a (mon.0) 438 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:28.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[28859]: audit 2024-02-13T14:39:27.626191+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:39:28.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[28859]: audit 2024-02-13T14:39:27.633715+0000 mon.a (mon.0) 440 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:28.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:27 smithi062 bash[28859]: audit 2024-02-13T14:39:27.644181+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:27 smithi111 bash[23388]: audit 2024-02-13T14:39:26.680373+0000 mon.a (mon.0) 435 : audit 1 from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi062", "root=default"]}]': finished 2024-02-13T14:39:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:27 smithi111 bash[23388]: cluster 2024-02-13T14:39:26.683790+0000 mon.a (mon.0) 436 : cluster 0 osdmap e24: 4 total, 3 up, 4 in 2024-02-13T14:39:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:27 smithi111 bash[23388]: audit 2024-02-13T14:39:26.684377+0000 mon.a (mon.0) 437 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:27 smithi111 bash[23388]: audit 2024-02-13T14:39:26.691147+0000 mon.a (mon.0) 438 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:28.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:27 smithi111 bash[23388]: audit 2024-02-13T14:39:27.626191+0000 mon.a (mon.0) 439 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:39:28.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:27 smithi111 bash[23388]: audit 2024-02-13T14:39:27.633715+0000 mon.a (mon.0) 440 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:28.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:27 smithi111 bash[23388]: audit 2024-02-13T14:39:27.644181+0000 mon.a (mon.0) 441 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:28.339 DEBUG:teuthology.orchestra.run.smithi062:osd.3> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.3.service 2024-02-13T14:39:28.342 INFO:tasks.cephadm:Deploying osd.4 on smithi111 with /dev/vg_nvme/lv_4... 2024-02-13T14:39:28.342 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-13T14:39:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[21479]: cluster 2024-02-13T14:39:26.430863+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:39:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[21479]: cluster 2024-02-13T14:39:26.430964+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:39:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[21479]: cluster 2024-02-13T14:39:27.077991+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[21479]: cluster 2024-02-13T14:39:27.692416+0000 mon.a (mon.0) 442 : cluster 1 osd.3 v1:172.21.15.62:6813/1701426775 boot 2024-02-13T14:39:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[21479]: cluster 2024-02-13T14:39:27.692478+0000 mon.a (mon.0) 443 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-02-13T14:39:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[21479]: audit 2024-02-13T14:39:27.693873+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[28859]: cluster 2024-02-13T14:39:26.430863+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:39:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[28859]: cluster 2024-02-13T14:39:26.430964+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:39:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[28859]: cluster 2024-02-13T14:39:27.077991+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[28859]: cluster 2024-02-13T14:39:27.692416+0000 mon.a (mon.0) 442 : cluster 1 osd.3 v1:172.21.15.62:6813/1701426775 boot 2024-02-13T14:39:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[28859]: cluster 2024-02-13T14:39:27.692478+0000 mon.a (mon.0) 443 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-02-13T14:39:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:28 smithi062 bash[28859]: audit 2024-02-13T14:39:27.693873+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:28 smithi111 bash[23388]: cluster 2024-02-13T14:39:26.430863+0000 osd.3 (osd.3) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:39:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:28 smithi111 bash[23388]: cluster 2024-02-13T14:39:26.430964+0000 osd.3 (osd.3) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:39:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:28 smithi111 bash[23388]: cluster 2024-02-13T14:39:27.077991+0000 mgr.y (mgr.14152) 197 : cluster 0 pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-02-13T14:39:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:28 smithi111 bash[23388]: cluster 2024-02-13T14:39:27.692416+0000 mon.a (mon.0) 442 : cluster 1 osd.3 v1:172.21.15.62:6813/1701426775 boot 2024-02-13T14:39:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:28 smithi111 bash[23388]: cluster 2024-02-13T14:39:27.692478+0000 mon.a (mon.0) 443 : cluster 0 osdmap e25: 4 total, 4 up, 4 in 2024-02-13T14:39:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:28 smithi111 bash[23388]: audit 2024-02-13T14:39:27.693873+0000 mon.a (mon.0) 444 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:39:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:29 smithi062 bash[21479]: cluster 2024-02-13T14:39:28.713505+0000 mon.a (mon.0) 445 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-02-13T14:39:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:29 smithi062 bash[21479]: cluster 2024-02-13T14:39:29.078636+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:30.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:29 smithi062 bash[28859]: cluster 2024-02-13T14:39:28.713505+0000 mon.a (mon.0) 445 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-02-13T14:39:30.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:29 smithi062 bash[28859]: cluster 2024-02-13T14:39:29.078636+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:29 smithi111 bash[23388]: cluster 2024-02-13T14:39:28.713505+0000 mon.a (mon.0) 445 : cluster 0 osdmap e26: 4 total, 4 up, 4 in 2024-02-13T14:39:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:29 smithi111 bash[23388]: cluster 2024-02-13T14:39:29.078636+0000 mgr.y (mgr.14152) 198 : cluster 0 pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:32.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:32 smithi062 bash[28859]: cluster 2024-02-13T14:39:31.079261+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:32.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:32 smithi062 bash[21479]: cluster 2024-02-13T14:39:31.079261+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:32 smithi111 bash[23388]: cluster 2024-02-13T14:39:31.079261+0000 mgr.y (mgr.14152) 199 : cluster 0 pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:33.058 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:39:34.305 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:34 smithi111 bash[23388]: cluster 2024-02-13T14:39:33.079841+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:34.412 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:34 smithi062 bash[28859]: cluster 2024-02-13T14:39:33.079841+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:34.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:34 smithi062 bash[21479]: cluster 2024-02-13T14:39:33.079841+0000 mgr.y (mgr.14152) 200 : cluster 0 pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:36.003 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-13T14:39:36.003 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-13T14:39:36.004 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-02-13T14:39:36.004 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-02-13T14:39:36.004 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0132166 s, 793 MB/s 2024-02-13T14:39:36.004 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-02-13T14:39:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:36 smithi111 bash[23388]: cluster 2024-02-13T14:39:35.080445+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:36.534 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:36 smithi062 bash[21479]: cluster 2024-02-13T14:39:35.080445+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:36.535 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:36 smithi062 bash[28859]: cluster 2024-02-13T14:39:35.080445+0000 mgr.y (mgr.14152) 201 : cluster 0 pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:36.655 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_4 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: cluster 2024-02-13T14:39:37.081115+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: cephadm 2024-02-13T14:39:37.316930+0000 mgr.y (mgr.14152) 203 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.325161+0000 mon.a (mon.0) 446 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.333607+0000 mon.a (mon.0) 447 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.335919+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.337305+0000 mon.a (mon.0) 449 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.338593+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.339850+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: cephadm 2024-02-13T14:39:37.340861+0000 mgr.y (mgr.14152) 204 : cephadm 1 Adjusting osd_memory_target on smithi062 to 4060M 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.347004+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.352034+0000 mon.a (mon.0) 453 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:38.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.353655+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:39:38.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:38 smithi111 bash[23388]: audit 2024-02-13T14:39:37.363639+0000 mon.a (mon.0) 455 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: cluster 2024-02-13T14:39:37.081115+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:38.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: cephadm 2024-02-13T14:39:37.316930+0000 mgr.y (mgr.14152) 203 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:39:38.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.325161+0000 mon.a (mon.0) 446 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.333607+0000 mon.a (mon.0) 447 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.335919+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.337305+0000 mon.a (mon.0) 449 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.338593+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.339850+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: cephadm 2024-02-13T14:39:37.340861+0000 mgr.y (mgr.14152) 204 : cephadm 1 Adjusting osd_memory_target on smithi062 to 4060M 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.347004+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.352034+0000 mon.a (mon.0) 453 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.353655+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[21479]: audit 2024-02-13T14:39:37.363639+0000 mon.a (mon.0) 455 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: cluster 2024-02-13T14:39:37.081115+0000 mgr.y (mgr.14152) 202 : cluster 0 pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: cephadm 2024-02-13T14:39:37.316930+0000 mgr.y (mgr.14152) 203 : cephadm 1 Detected new or changed devices on smithi062 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.325161+0000 mon.a (mon.0) 446 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.333607+0000 mon.a (mon.0) 447 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.335919+0000 mon.a (mon.0) 448 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.337305+0000 mon.a (mon.0) 449 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.338593+0000 mon.a (mon.0) 450 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.339850+0000 mon.a (mon.0) 451 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:39:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: cephadm 2024-02-13T14:39:37.340861+0000 mgr.y (mgr.14152) 204 : cephadm 1 Adjusting osd_memory_target on smithi062 to 4060M 2024-02-13T14:39:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.347004+0000 mon.a (mon.0) 452 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.352034+0000 mon.a (mon.0) 453 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.353655+0000 mon.a (mon.0) 454 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:39:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:38 smithi062 bash[28859]: audit 2024-02-13T14:39:37.363639+0000 mon.a (mon.0) 455 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:39:40.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:40 smithi111 bash[23388]: cluster 2024-02-13T14:39:39.081672+0000 mgr.y (mgr.14152) 205 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:40 smithi062 bash[21479]: cluster 2024-02-13T14:39:39.081672+0000 mgr.y (mgr.14152) 205 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:40.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:40 smithi062 bash[28859]: cluster 2024-02-13T14:39:39.081672+0000 mgr.y (mgr.14152) 205 : cluster 0 pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:41.372 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:39:42.419 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:42 smithi111 bash[23388]: cluster 2024-02-13T14:39:41.082219+0000 mgr.y (mgr.14152) 206 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:42.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:42 smithi062 bash[28859]: cluster 2024-02-13T14:39:41.082219+0000 mgr.y (mgr.14152) 206 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:42.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:42 smithi062 bash[21479]: cluster 2024-02-13T14:39:41.082219+0000 mgr.y (mgr.14152) 206 : cluster 0 pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:43.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- 172.21.15.111:0/3832633484 >> v1:172.21.15.111:6789/0 conn(0x7f3f5c108100 legacy=0x7f3f5c108520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:39:43.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- 172.21.15.111:0/3832633484 shutdown_connections 2024-02-13T14:39:43.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- 172.21.15.111:0/3832633484 >> 172.21.15.111:0/3832633484 conn(0x7f3f5c0770f0 msgr2=0x7f3f5c079530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:39:43.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- 172.21.15.111:0/3832633484 shutdown_connections 2024-02-13T14:39:43.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- 172.21.15.111:0/3832633484 wait complete. 2024-02-13T14:39:43.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 Processor -- start 2024-02-13T14:39:43.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- start start 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3f5c19e030 con 0x7f3f5c10c530 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3f5c1a9820 con 0x7f3f5c110270 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3f5c1aa9c0 con 0x7f3f5c108100 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f5b7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f3f5c110270 0x7f3f5c1a70f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:32792/0 (socket says 172.21.15.111:32792) 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f5b7fe700 1 -- 172.21.15.111:0/572254484 learned_addr learned my addr 172.21.15.111:0/572254484 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671199915 0 0) 0x7f3f5c1a9820 con 0x7f3f5c110270 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f480035b0 con 0x7f3f5c110270 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 402319005 0 0) 0x7f3f480035b0 con 0x7f3f5c110270 2024-02-13T14:39:43.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3f5c1a9820 con 0x7f3f5c110270 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3f54001c10 con 0x7f3f5c110270 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345084997 0 0) 0x7f3f5c1aa9c0 con 0x7f3f5c108100 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f480035b0 con 0x7f3f5c108100 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2229844500 0 0) 0x7f3f5c19e030 con 0x7f3f5c10c530 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f5c1aa9c0 con 0x7f3f5c10c530 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 696970103 0 0) 0x7f3f5c1a9820 con 0x7f3f5c110270 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 >> v1:172.21.15.62:6790/0 conn(0x7f3f5c108100 legacy=0x7f3f5c19d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 >> v1:172.21.15.62:6789/0 conn(0x7f3f5c10c530 legacy=0x7f3f5c1a39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c1abb60 con 0x7f3f5c110270 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c1a8870 con 0x7f3f5c110270 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.676+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c1a8d70 con 0x7f3f5c110270 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.680+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f3f54003e90 con 0x7f3f5c110270 2024-02-13T14:39:43.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.680+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3f54005fb0 con 0x7f3f5c110270 2024-02-13T14:39:43.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.680+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f3c005120 con 0x7f3f5c110270 2024-02-13T14:39:43.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.680+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7f3f54003a00 con 0x7f3f5c110270 2024-02-13T14:39:43.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.680+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(26..26 src has 1..26) v4 ==== 2803+0+0 (unknown 3023312685 0 0) 0x7f3f54088450 con 0x7f3f5c110270 2024-02-13T14:39:43.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.684+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f3f540526b0 con 0x7f3f5c110270 2024-02-13T14:39:43.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:39:43.904+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f3c000b90 con 0x7f3f4806ed00 2024-02-13T14:39:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:44 smithi111 bash[23388]: cluster 2024-02-13T14:39:43.082765+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:44 smithi111 bash[23388]: audit 2024-02-13T14:39:43.921193+0000 mon.a (mon.0) 456 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:39:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:44 smithi111 bash[23388]: audit 2024-02-13T14:39:43.927923+0000 mon.a (mon.0) 457 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:39:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:44 smithi111 bash[23388]: audit 2024-02-13T14:39:43.929674+0000 mon.a (mon.0) 458 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:44.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:44 smithi062 bash[21479]: cluster 2024-02-13T14:39:43.082765+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:44.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:44 smithi062 bash[21479]: audit 2024-02-13T14:39:43.921193+0000 mon.a (mon.0) 456 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:39:44.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:44 smithi062 bash[21479]: audit 2024-02-13T14:39:43.927923+0000 mon.a (mon.0) 457 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:39:44.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:44 smithi062 bash[21479]: audit 2024-02-13T14:39:43.929674+0000 mon.a (mon.0) 458 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:44.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:44 smithi062 bash[28859]: cluster 2024-02-13T14:39:43.082765+0000 mgr.y (mgr.14152) 207 : cluster 0 pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:44.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:44 smithi062 bash[28859]: audit 2024-02-13T14:39:43.921193+0000 mon.a (mon.0) 456 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:39:44.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:44 smithi062 bash[28859]: audit 2024-02-13T14:39:43.927923+0000 mon.a (mon.0) 457 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:39:44.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:44 smithi062 bash[28859]: audit 2024-02-13T14:39:43.929674+0000 mon.a (mon.0) 458 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:39:45.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:45 smithi062 bash[21479]: audit 2024-02-13T14:39:43.913390+0000 mgr.y (mgr.14152) 208 : audit 0 from='client.24235 v1:172.21.15.111:0/572254484' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:39:45.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:45 smithi062 bash[28859]: audit 2024-02-13T14:39:43.913390+0000 mgr.y (mgr.14152) 208 : audit 0 from='client.24235 v1:172.21.15.111:0/572254484' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:39:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:45 smithi111 bash[23388]: audit 2024-02-13T14:39:43.913390+0000 mgr.y (mgr.14152) 208 : audit 0 from='client.24235 v1:172.21.15.111:0/572254484' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:39:46.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:46 smithi062 bash[21479]: cluster 2024-02-13T14:39:45.083383+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:46.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:46 smithi062 bash[28859]: cluster 2024-02-13T14:39:45.083383+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:46 smithi111 bash[23388]: cluster 2024-02-13T14:39:45.083383+0000 mgr.y (mgr.14152) 209 : cluster 0 pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:48.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:48 smithi062 bash[28859]: cluster 2024-02-13T14:39:47.084029+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:48.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:48 smithi062 bash[21479]: cluster 2024-02-13T14:39:47.084029+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:48 smithi111 bash[23388]: cluster 2024-02-13T14:39:47.084029+0000 mgr.y (mgr.14152) 210 : cluster 0 pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:50.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:50 smithi062 bash[28859]: cluster 2024-02-13T14:39:49.084706+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:50.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:50 smithi062 bash[21479]: cluster 2024-02-13T14:39:49.084706+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:50 smithi111 bash[23388]: cluster 2024-02-13T14:39:49.084706+0000 mgr.y (mgr.14152) 211 : cluster 0 pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[21479]: cluster 2024-02-13T14:39:51.085320+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[21479]: audit 2024-02-13T14:39:52.084395+0000 mon.b (mon.1) 10 : audit 1 from='client.? v1:172.21.15.111:0/2524593316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]: dispatch 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[21479]: audit 2024-02-13T14:39:52.086662+0000 mon.a (mon.0) 459 : audit 1 from='client.24241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]: dispatch 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[21479]: audit 2024-02-13T14:39:52.089944+0000 mon.a (mon.0) 460 : audit 1 from='client.24241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]': finished 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[21479]: cluster 2024-02-13T14:39:52.095684+0000 mon.a (mon.0) 461 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[21479]: audit 2024-02-13T14:39:52.096363+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[28859]: cluster 2024-02-13T14:39:51.085320+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[28859]: audit 2024-02-13T14:39:52.084395+0000 mon.b (mon.1) 10 : audit 1 from='client.? v1:172.21.15.111:0/2524593316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]: dispatch 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[28859]: audit 2024-02-13T14:39:52.086662+0000 mon.a (mon.0) 459 : audit 1 from='client.24241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]: dispatch 2024-02-13T14:39:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[28859]: audit 2024-02-13T14:39:52.089944+0000 mon.a (mon.0) 460 : audit 1 from='client.24241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]': finished 2024-02-13T14:39:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[28859]: cluster 2024-02-13T14:39:52.095684+0000 mon.a (mon.0) 461 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-02-13T14:39:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:52 smithi062 bash[28859]: audit 2024-02-13T14:39:52.096363+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:39:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:52 smithi111 bash[23388]: cluster 2024-02-13T14:39:51.085320+0000 mgr.y (mgr.14152) 212 : cluster 0 pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:52 smithi111 bash[23388]: audit 2024-02-13T14:39:52.084395+0000 mon.b (mon.1) 10 : audit 1 from='client.? v1:172.21.15.111:0/2524593316' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]: dispatch 2024-02-13T14:39:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:52 smithi111 bash[23388]: audit 2024-02-13T14:39:52.086662+0000 mon.a (mon.0) 459 : audit 1 from='client.24241 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]: dispatch 2024-02-13T14:39:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:52 smithi111 bash[23388]: audit 2024-02-13T14:39:52.089944+0000 mon.a (mon.0) 460 : audit 1 from='client.24241 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e55ae8d9-af71-443f-b9e0-0a59ceb52b0d"}]': finished 2024-02-13T14:39:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:52 smithi111 bash[23388]: cluster 2024-02-13T14:39:52.095684+0000 mon.a (mon.0) 461 : cluster 0 osdmap e27: 5 total, 4 up, 5 in 2024-02-13T14:39:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:52 smithi111 bash[23388]: audit 2024-02-13T14:39:52.096363+0000 mon.a (mon.0) 462 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:39:53.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:53 smithi062 bash[21479]: audit 2024-02-13T14:39:52.810993+0000 mon.b (mon.1) 11 : audit 0 from='client.? v1:172.21.15.111:0/3259303060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:39:53.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:53 smithi062 bash[28859]: audit 2024-02-13T14:39:52.810993+0000 mon.b (mon.1) 11 : audit 0 from='client.? v1:172.21.15.111:0/3259303060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:39:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:53 smithi111 bash[23388]: audit 2024-02-13T14:39:52.810993+0000 mon.b (mon.1) 11 : audit 0 from='client.? v1:172.21.15.111:0/3259303060' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:39:54.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:54 smithi062 bash[21479]: cluster 2024-02-13T14:39:53.085832+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:54.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:54 smithi062 bash[28859]: cluster 2024-02-13T14:39:53.085832+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:54 smithi111 bash[23388]: cluster 2024-02-13T14:39:53.085832+0000 mgr.y (mgr.14152) 213 : cluster 0 pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:56.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:56 smithi062 bash[21479]: cluster 2024-02-13T14:39:55.086515+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:56.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:56 smithi062 bash[28859]: cluster 2024-02-13T14:39:55.086515+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:56 smithi111 bash[23388]: cluster 2024-02-13T14:39:55.086515+0000 mgr.y (mgr.14152) 214 : cluster 0 pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:58.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:39:58 smithi062 bash[28859]: cluster 2024-02-13T14:39:57.087081+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:39:58 smithi062 bash[21479]: cluster 2024-02-13T14:39:57.087081+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:39:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:39:58 smithi111 bash[23388]: cluster 2024-02-13T14:39:57.087081+0000 mgr.y (mgr.14152) 215 : cluster 0 pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:00 smithi062 bash[21479]: cluster 2024-02-13T14:39:59.087644+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:00 smithi062 bash[21479]: cluster 2024-02-13T14:40:00.000157+0000 mon.a (mon.0) 463 : cluster 1 overall HEALTH_OK 2024-02-13T14:40:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:00 smithi062 bash[28859]: cluster 2024-02-13T14:39:59.087644+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:00 smithi062 bash[28859]: cluster 2024-02-13T14:40:00.000157+0000 mon.a (mon.0) 463 : cluster 1 overall HEALTH_OK 2024-02-13T14:40:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:00 smithi111 bash[23388]: cluster 2024-02-13T14:39:59.087644+0000 mgr.y (mgr.14152) 216 : cluster 0 pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:00 smithi111 bash[23388]: cluster 2024-02-13T14:40:00.000157+0000 mon.a (mon.0) 463 : cluster 1 overall HEALTH_OK 2024-02-13T14:40:02.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:02 smithi062 bash[21479]: cluster 2024-02-13T14:40:01.088166+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:02.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:02 smithi062 bash[28859]: cluster 2024-02-13T14:40:01.088166+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:02 smithi111 bash[23388]: cluster 2024-02-13T14:40:01.088166+0000 mgr.y (mgr.14152) 217 : cluster 0 pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:04.721 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:04 smithi111 bash[23388]: cluster 2024-02-13T14:40:03.088695+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:04.721 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:04 smithi111 bash[23388]: audit 2024-02-13T14:40:04.283578+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-13T14:40:04.721 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:04 smithi111 bash[23388]: audit 2024-02-13T14:40:04.285297+0000 mon.a (mon.0) 465 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:04.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:04 smithi062 bash[21479]: cluster 2024-02-13T14:40:03.088695+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:04.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:04 smithi062 bash[21479]: audit 2024-02-13T14:40:04.283578+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-13T14:40:04.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:04 smithi062 bash[21479]: audit 2024-02-13T14:40:04.285297+0000 mon.a (mon.0) 465 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:04.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:04 smithi062 bash[28859]: cluster 2024-02-13T14:40:03.088695+0000 mgr.y (mgr.14152) 218 : cluster 0 pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:04.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:04 smithi062 bash[28859]: audit 2024-02-13T14:40:04.283578+0000 mon.a (mon.0) 464 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-13T14:40:04.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:04 smithi062 bash[28859]: audit 2024-02-13T14:40:04.285297+0000 mon.a (mon.0) 465 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:05.799 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:05 smithi111 bash[23388]: cephadm 2024-02-13T14:40:04.286988+0000 mgr.y (mgr.14152) 219 : cephadm 1 Deploying daemon osd.4 on smithi111 2024-02-13T14:40:05.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:05 smithi062 bash[21479]: cephadm 2024-02-13T14:40:04.286988+0000 mgr.y (mgr.14152) 219 : cephadm 1 Deploying daemon osd.4 on smithi111 2024-02-13T14:40:05.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:05 smithi062 bash[28859]: cephadm 2024-02-13T14:40:04.286988+0000 mgr.y (mgr.14152) 219 : cephadm 1 Deploying daemon osd.4 on smithi111 2024-02-13T14:40:06.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:06 smithi111 bash[23388]: cluster 2024-02-13T14:40:05.089258+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:06.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:06 smithi062 bash[21479]: cluster 2024-02-13T14:40:05.089258+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:06.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:06 smithi062 bash[28859]: cluster 2024-02-13T14:40:05.089258+0000 mgr.y (mgr.14152) 220 : cluster 0 pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:08.299 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:40:08 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:08.300 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:08 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:08.585 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:40:08 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:08.585 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:08 smithi111 bash[23388]: cluster 2024-02-13T14:40:07.089725+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:08.585 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:08 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:08.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:08 smithi062 bash[21479]: cluster 2024-02-13T14:40:07.089725+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:08.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:08 smithi062 bash[28859]: cluster 2024-02-13T14:40:07.089725+0000 mgr.y (mgr.14152) 221 : cluster 0 pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:09.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:09 smithi062 bash[21479]: audit 2024-02-13T14:40:08.588692+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:40:09.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:09 smithi062 bash[21479]: audit 2024-02-13T14:40:08.596522+0000 mon.a (mon.0) 467 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:09.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:09 smithi062 bash[21479]: audit 2024-02-13T14:40:08.607081+0000 mon.a (mon.0) 468 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:09.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:09 smithi062 bash[28859]: audit 2024-02-13T14:40:08.588692+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:40:09.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:09 smithi062 bash[28859]: audit 2024-02-13T14:40:08.596522+0000 mon.a (mon.0) 467 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:09.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:09 smithi062 bash[28859]: audit 2024-02-13T14:40:08.607081+0000 mon.a (mon.0) 468 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:09 smithi111 bash[23388]: audit 2024-02-13T14:40:08.588692+0000 mon.a (mon.0) 466 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:40:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:09 smithi111 bash[23388]: audit 2024-02-13T14:40:08.596522+0000 mon.a (mon.0) 467 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:09 smithi111 bash[23388]: audit 2024-02-13T14:40:08.607081+0000 mon.a (mon.0) 468 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:10 smithi062 bash[21479]: cluster 2024-02-13T14:40:09.090233+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:10 smithi062 bash[28859]: cluster 2024-02-13T14:40:09.090233+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:11.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:10 smithi111 bash[23388]: cluster 2024-02-13T14:40:09.090233+0000 mgr.y (mgr.14152) 222 : cluster 0 pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:13.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:12 smithi062 bash[21479]: cluster 2024-02-13T14:40:11.090799+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:12 smithi062 bash[28859]: cluster 2024-02-13T14:40:11.090799+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:13.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:12 smithi111 bash[23388]: cluster 2024-02-13T14:40:11.090799+0000 mgr.y (mgr.14152) 223 : cluster 0 pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:14.903 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:14 smithi111 bash[23388]: cluster 2024-02-13T14:40:13.091434+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:15.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:14 smithi062 bash[21479]: cluster 2024-02-13T14:40:13.091434+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:15.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:14 smithi062 bash[28859]: cluster 2024-02-13T14:40:13.091434+0000 mgr.y (mgr.14152) 224 : cluster 0 pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:15.905 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:15 smithi111 bash[23388]: audit 2024-02-13T14:40:14.909396+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.111:6800/1278246464' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T14:40:15.905 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:15 smithi111 bash[23388]: audit 2024-02-13T14:40:14.911569+0000 mon.a (mon.0) 469 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T14:40:15.906 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:15 smithi111 bash[23388]: audit 2024-02-13T14:40:15.388722+0000 mon.a (mon.0) 470 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:15.906 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:15 smithi111 bash[23388]: audit 2024-02-13T14:40:15.399681+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:16.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:15 smithi062 bash[21479]: audit 2024-02-13T14:40:14.909396+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.111:6800/1278246464' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T14:40:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:15 smithi062 bash[21479]: audit 2024-02-13T14:40:14.911569+0000 mon.a (mon.0) 469 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T14:40:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:15 smithi062 bash[21479]: audit 2024-02-13T14:40:15.388722+0000 mon.a (mon.0) 470 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:15 smithi062 bash[21479]: audit 2024-02-13T14:40:15.399681+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:15 smithi062 bash[28859]: audit 2024-02-13T14:40:14.909396+0000 mon.b (mon.1) 12 : audit 1 from='osd.4 v1:172.21.15.111:6800/1278246464' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T14:40:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:15 smithi062 bash[28859]: audit 2024-02-13T14:40:14.911569+0000 mon.a (mon.0) 469 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-13T14:40:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:15 smithi062 bash[28859]: audit 2024-02-13T14:40:15.388722+0000 mon.a (mon.0) 470 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:15 smithi062 bash[28859]: audit 2024-02-13T14:40:15.399681+0000 mon.a (mon.0) 471 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: cluster 2024-02-13T14:40:15.092015+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: audit 2024-02-13T14:40:15.625999+0000 mon.a (mon.0) 472 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-13T14:40:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: audit 2024-02-13T14:40:15.629620+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v1:172.21.15.111:6800/1278246464' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:40:16.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: cluster 2024-02-13T14:40:15.633506+0000 mon.a (mon.0) 473 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-02-13T14:40:16.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: audit 2024-02-13T14:40:15.634276+0000 mon.a (mon.0) 474 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:16.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: audit 2024-02-13T14:40:15.635070+0000 mon.a (mon.0) 475 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:40:16.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: audit 2024-02-13T14:40:16.126795+0000 mon.a (mon.0) 476 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:16.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: audit 2024-02-13T14:40:16.128706+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:40:16.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:16 smithi111 bash[23388]: audit 2024-02-13T14:40:16.138891+0000 mon.a (mon.0) 478 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:17.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: cluster 2024-02-13T14:40:15.092015+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:17.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: audit 2024-02-13T14:40:15.625999+0000 mon.a (mon.0) 472 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-13T14:40:17.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: audit 2024-02-13T14:40:15.629620+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v1:172.21.15.111:6800/1278246464' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:40:17.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: cluster 2024-02-13T14:40:15.633506+0000 mon.a (mon.0) 473 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-02-13T14:40:17.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: audit 2024-02-13T14:40:15.634276+0000 mon.a (mon.0) 474 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:17.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: audit 2024-02-13T14:40:15.635070+0000 mon.a (mon.0) 475 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:40:17.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: audit 2024-02-13T14:40:16.126795+0000 mon.a (mon.0) 476 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:17.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: audit 2024-02-13T14:40:16.128706+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:40:17.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[28859]: audit 2024-02-13T14:40:16.138891+0000 mon.a (mon.0) 478 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: cluster 2024-02-13T14:40:15.092015+0000 mgr.y (mgr.14152) 225 : cluster 0 pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: audit 2024-02-13T14:40:15.625999+0000 mon.a (mon.0) 472 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: audit 2024-02-13T14:40:15.629620+0000 mon.b (mon.1) 13 : audit 1 from='osd.4 v1:172.21.15.111:6800/1278246464' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: cluster 2024-02-13T14:40:15.633506+0000 mon.a (mon.0) 473 : cluster 0 osdmap e28: 5 total, 4 up, 5 in 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: audit 2024-02-13T14:40:15.634276+0000 mon.a (mon.0) 474 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: audit 2024-02-13T14:40:15.635070+0000 mon.a (mon.0) 475 : audit 1 from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: audit 2024-02-13T14:40:16.126795+0000 mon.a (mon.0) 476 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: audit 2024-02-13T14:40:16.128706+0000 mon.a (mon.0) 477 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:40:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:16 smithi062 bash[21479]: audit 2024-02-13T14:40:16.138891+0000 mon.a (mon.0) 478 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:18.040 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:17 smithi111 bash[23388]: audit 2024-02-13T14:40:16.628372+0000 mon.a (mon.0) 479 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:40:18.040 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:17 smithi111 bash[23388]: cluster 2024-02-13T14:40:16.635291+0000 mon.a (mon.0) 480 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-02-13T14:40:18.040 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:17 smithi111 bash[23388]: audit 2024-02-13T14:40:16.636397+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:18.040 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:17 smithi111 bash[23388]: audit 2024-02-13T14:40:16.649110+0000 mon.a (mon.0) 482 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:18.040 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:17 smithi111 bash[23388]: audit 2024-02-13T14:40:17.129372+0000 mon.a (mon.0) 483 : audit 1 from='osd.4 ' entity='osd.4' 2024-02-13T14:40:18.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[28859]: audit 2024-02-13T14:40:16.628372+0000 mon.a (mon.0) 479 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:40:18.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[28859]: cluster 2024-02-13T14:40:16.635291+0000 mon.a (mon.0) 480 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-02-13T14:40:18.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[28859]: audit 2024-02-13T14:40:16.636397+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:18.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[28859]: audit 2024-02-13T14:40:16.649110+0000 mon.a (mon.0) 482 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:18.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[28859]: audit 2024-02-13T14:40:17.129372+0000 mon.a (mon.0) 483 : audit 1 from='osd.4 ' entity='osd.4' 2024-02-13T14:40:18.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[21479]: audit 2024-02-13T14:40:16.628372+0000 mon.a (mon.0) 479 : audit 1 from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:40:18.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[21479]: cluster 2024-02-13T14:40:16.635291+0000 mon.a (mon.0) 480 : cluster 0 osdmap e29: 5 total, 4 up, 5 in 2024-02-13T14:40:18.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[21479]: audit 2024-02-13T14:40:16.636397+0000 mon.a (mon.0) 481 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:18.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[21479]: audit 2024-02-13T14:40:16.649110+0000 mon.a (mon.0) 482 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:18.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:17 smithi062 bash[21479]: audit 2024-02-13T14:40:17.129372+0000 mon.a (mon.0) 483 : audit 1 from='osd.4 ' entity='osd.4' 2024-02-13T14:40:18.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:18.492+0000 7f3f58ff9700 1 -- 172.21.15.111:0/572254484 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 692026426) 0x7f3f3c000b90 con 0x7f3f4806ed00 2024-02-13T14:40:18.496 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 4 on host 'smithi111' 2024-02-13T14:40:18.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:18.496+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 >> v1:172.21.15.62:6800/1926838190 conn(0x7f3f4806ed00 legacy=0x7f3f480711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:40:18.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:18.496+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 >> v1:172.21.15.111:6789/0 conn(0x7f3f5c110270 legacy=0x7f3f5c1a70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:40:18.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:18.496+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 shutdown_connections 2024-02-13T14:40:18.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:18.496+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 >> 172.21.15.111:0/572254484 conn(0x7f3f5c0770f0 msgr2=0x7f3f5c10e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:40:18.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:18.496+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 shutdown_connections 2024-02-13T14:40:18.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:18.496+0000 7f3f613ff700 1 -- 172.21.15.111:0/572254484 wait complete. 2024-02-13T14:40:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: cluster 2024-02-13T14:40:15.952831+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:40:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: cluster 2024-02-13T14:40:15.952954+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:40:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: cluster 2024-02-13T14:40:17.092563+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: cluster 2024-02-13T14:40:17.639813+0000 mon.a (mon.0) 484 : cluster 1 osd.4 v1:172.21.15.111:6800/1278246464 boot 2024-02-13T14:40:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: cluster 2024-02-13T14:40:17.639920+0000 mon.a (mon.0) 485 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-02-13T14:40:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: audit 2024-02-13T14:40:17.640272+0000 mon.a (mon.0) 486 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: audit 2024-02-13T14:40:18.455701+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:18.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: audit 2024-02-13T14:40:18.466269+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:18.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: audit 2024-02-13T14:40:18.481337+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:40:18.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:18 smithi111 bash[23388]: cluster 2024-02-13T14:40:18.646113+0000 mon.a (mon.0) 490 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: cluster 2024-02-13T14:40:15.952831+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: cluster 2024-02-13T14:40:15.952954+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: cluster 2024-02-13T14:40:17.092563+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: cluster 2024-02-13T14:40:17.639813+0000 mon.a (mon.0) 484 : cluster 1 osd.4 v1:172.21.15.111:6800/1278246464 boot 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: cluster 2024-02-13T14:40:17.639920+0000 mon.a (mon.0) 485 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: audit 2024-02-13T14:40:17.640272+0000 mon.a (mon.0) 486 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: audit 2024-02-13T14:40:18.455701+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: audit 2024-02-13T14:40:18.466269+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: audit 2024-02-13T14:40:18.481337+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[21479]: cluster 2024-02-13T14:40:18.646113+0000 mon.a (mon.0) 490 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: cluster 2024-02-13T14:40:15.952831+0000 osd.4 (osd.4) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: cluster 2024-02-13T14:40:15.952954+0000 osd.4 (osd.4) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: cluster 2024-02-13T14:40:17.092563+0000 mgr.y (mgr.14152) 226 : cluster 0 pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 116 MiB used, 357 GiB / 358 GiB avail 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: cluster 2024-02-13T14:40:17.639813+0000 mon.a (mon.0) 484 : cluster 1 osd.4 v1:172.21.15.111:6800/1278246464 boot 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: cluster 2024-02-13T14:40:17.639920+0000 mon.a (mon.0) 485 : cluster 0 osdmap e30: 5 total, 5 up, 5 in 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: audit 2024-02-13T14:40:17.640272+0000 mon.a (mon.0) 486 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: audit 2024-02-13T14:40:18.455701+0000 mon.a (mon.0) 487 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: audit 2024-02-13T14:40:18.466269+0000 mon.a (mon.0) 488 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: audit 2024-02-13T14:40:18.481337+0000 mon.a (mon.0) 489 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:40:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:18 smithi062 bash[28859]: cluster 2024-02-13T14:40:18.646113+0000 mon.a (mon.0) 490 : cluster 0 osdmap e31: 5 total, 5 up, 5 in 2024-02-13T14:40:19.129 DEBUG:teuthology.orchestra.run.smithi111:osd.4> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.4.service 2024-02-13T14:40:19.132 INFO:tasks.cephadm:Deploying osd.5 on smithi111 with /dev/vg_nvme/lv_3... 2024-02-13T14:40:19.132 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-13T14:40:21.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:20 smithi062 bash[28859]: cluster 2024-02-13T14:40:19.093118+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 499 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:20 smithi062 bash[28859]: cluster 2024-02-13T14:40:19.644954+0000 mon.a (mon.0) 491 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-02-13T14:40:21.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:20 smithi062 bash[21479]: cluster 2024-02-13T14:40:19.093118+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 499 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:21.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:20 smithi062 bash[21479]: cluster 2024-02-13T14:40:19.644954+0000 mon.a (mon.0) 491 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-02-13T14:40:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:20 smithi111 bash[23388]: cluster 2024-02-13T14:40:19.093118+0000 mgr.y (mgr.14152) 227 : cluster 0 pgmap v199: 1 pgs: 1 remapped+peering; 577 KiB data, 499 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:20 smithi111 bash[23388]: cluster 2024-02-13T14:40:19.644954+0000 mon.a (mon.0) 491 : cluster 0 osdmap e32: 5 total, 5 up, 5 in 2024-02-13T14:40:22.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:21 smithi062 bash[28859]: cluster 2024-02-13T14:40:20.664482+0000 mon.a (mon.0) 492 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-02-13T14:40:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:21 smithi062 bash[21479]: cluster 2024-02-13T14:40:20.664482+0000 mon.a (mon.0) 492 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-02-13T14:40:22.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:21 smithi111 bash[23388]: cluster 2024-02-13T14:40:20.664482+0000 mon.a (mon.0) 492 : cluster 0 osdmap e33: 5 total, 5 up, 5 in 2024-02-13T14:40:23.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:22 smithi062 bash[21479]: cluster 2024-02-13T14:40:21.093645+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 499 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:22 smithi062 bash[21479]: cluster 2024-02-13T14:40:21.666248+0000 mon.a (mon.0) 493 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-02-13T14:40:23.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:22 smithi062 bash[28859]: cluster 2024-02-13T14:40:21.093645+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 499 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:23.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:22 smithi062 bash[28859]: cluster 2024-02-13T14:40:21.666248+0000 mon.a (mon.0) 493 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-02-13T14:40:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:22 smithi111 bash[23388]: cluster 2024-02-13T14:40:21.093645+0000 mgr.y (mgr.14152) 228 : cluster 0 pgmap v202: 1 pgs: 1 remapped+peering; 577 KiB data, 499 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:22 smithi111 bash[23388]: cluster 2024-02-13T14:40:21.666248+0000 mon.a (mon.0) 493 : cluster 0 osdmap e34: 5 total, 5 up, 5 in 2024-02-13T14:40:23.453 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:40:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:24 smithi111 bash[23388]: cluster 2024-02-13T14:40:23.094205+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 148 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:25.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:24 smithi062 bash[21479]: cluster 2024-02-13T14:40:23.094205+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 148 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:25.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:24 smithi062 bash[28859]: cluster 2024-02-13T14:40:23.094205+0000 mgr.y (mgr.14152) 229 : cluster 0 pgmap v204: 1 pgs: 1 remapped+peering; 577 KiB data, 148 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:26 smithi111 bash[23388]: cluster 2024-02-13T14:40:25.094808+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 148 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:40:27.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:26 smithi062 bash[21479]: cluster 2024-02-13T14:40:25.094808+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 148 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:40:27.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:26 smithi062 bash[28859]: cluster 2024-02-13T14:40:25.094808+0000 mgr.y (mgr.14152) 230 : cluster 0 pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 148 MiB used, 447 GiB / 447 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:40:27.294 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-13T14:40:27.294 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-13T14:40:27.294 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-02-13T14:40:27.294 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-02-13T14:40:27.294 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0136814 s, 766 MB/s 2024-02-13T14:40:27.295 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-02-13T14:40:27.952 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_3 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[21479]: cluster 2024-02-13T14:40:27.095344+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[21479]: audit 2024-02-13T14:40:28.335893+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[21479]: audit 2024-02-13T14:40:28.345211+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[21479]: audit 2024-02-13T14:40:28.347567+0000 mon.a (mon.0) 496 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[21479]: audit 2024-02-13T14:40:28.355025+0000 mon.a (mon.0) 497 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[21479]: audit 2024-02-13T14:40:28.359297+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[21479]: audit 2024-02-13T14:40:28.360933+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[21479]: audit 2024-02-13T14:40:28.372067+0000 mon.a (mon.0) 500 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[28859]: cluster 2024-02-13T14:40:27.095344+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-02-13T14:40:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[28859]: audit 2024-02-13T14:40:28.335893+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[28859]: audit 2024-02-13T14:40:28.345211+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[28859]: audit 2024-02-13T14:40:28.347567+0000 mon.a (mon.0) 496 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:40:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[28859]: audit 2024-02-13T14:40:28.355025+0000 mon.a (mon.0) 497 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[28859]: audit 2024-02-13T14:40:28.359297+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[28859]: audit 2024-02-13T14:40:28.360933+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:40:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:28 smithi062 bash[28859]: audit 2024-02-13T14:40:28.372067+0000 mon.a (mon.0) 500 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:28 smithi111 bash[23388]: cluster 2024-02-13T14:40:27.095344+0000 mgr.y (mgr.14152) 231 : cluster 0 pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-02-13T14:40:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:28 smithi111 bash[23388]: audit 2024-02-13T14:40:28.335893+0000 mon.a (mon.0) 494 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:28 smithi111 bash[23388]: audit 2024-02-13T14:40:28.345211+0000 mon.a (mon.0) 495 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:28 smithi111 bash[23388]: audit 2024-02-13T14:40:28.347567+0000 mon.a (mon.0) 496 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:40:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:28 smithi111 bash[23388]: audit 2024-02-13T14:40:28.355025+0000 mon.a (mon.0) 497 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:28 smithi111 bash[23388]: audit 2024-02-13T14:40:28.359297+0000 mon.a (mon.0) 498 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:28 smithi111 bash[23388]: audit 2024-02-13T14:40:28.360933+0000 mon.a (mon.0) 499 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:40:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:28 smithi111 bash[23388]: audit 2024-02-13T14:40:28.372067+0000 mon.a (mon.0) 500 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:40:30.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:29 smithi062 bash[28859]: cephadm 2024-02-13T14:40:28.327194+0000 mgr.y (mgr.14152) 232 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:40:30.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:29 smithi062 bash[28859]: cephadm 2024-02-13T14:40:28.348946+0000 mgr.y (mgr.14152) 233 : cephadm 1 Adjusting osd_memory_target on smithi111 to 17265M 2024-02-13T14:40:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:29 smithi062 bash[21479]: cephadm 2024-02-13T14:40:28.327194+0000 mgr.y (mgr.14152) 232 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:40:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:29 smithi062 bash[21479]: cephadm 2024-02-13T14:40:28.348946+0000 mgr.y (mgr.14152) 233 : cephadm 1 Adjusting osd_memory_target on smithi111 to 17265M 2024-02-13T14:40:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:29 smithi111 bash[23388]: cephadm 2024-02-13T14:40:28.327194+0000 mgr.y (mgr.14152) 232 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:40:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:29 smithi111 bash[23388]: cephadm 2024-02-13T14:40:28.348946+0000 mgr.y (mgr.14152) 233 : cephadm 1 Adjusting osd_memory_target on smithi111 to 17265M 2024-02-13T14:40:31.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:30 smithi062 bash[21479]: cluster 2024-02-13T14:40:29.095955+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-02-13T14:40:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:30 smithi062 bash[28859]: cluster 2024-02-13T14:40:29.095955+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-02-13T14:40:31.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:30 smithi111 bash[23388]: cluster 2024-02-13T14:40:29.095955+0000 mgr.y (mgr.14152) 234 : cluster 0 pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-02-13T14:40:32.672 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:40:33.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:32 smithi062 bash[21479]: cluster 2024-02-13T14:40:31.096615+0000 mgr.y (mgr.14152) 235 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:40:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:32 smithi062 bash[28859]: cluster 2024-02-13T14:40:31.096615+0000 mgr.y (mgr.14152) 235 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:40:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:32 smithi111 bash[23388]: cluster 2024-02-13T14:40:31.096615+0000 mgr.y (mgr.14152) 235 : cluster 0 pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:40:34.958 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:34 smithi111 bash[23388]: cluster 2024-02-13T14:40:33.097217+0000 mgr.y (mgr.14152) 236 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-02-13T14:40:35.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:34 smithi062 bash[28859]: cluster 2024-02-13T14:40:33.097217+0000 mgr.y (mgr.14152) 236 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-02-13T14:40:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:34 smithi062 bash[21479]: cluster 2024-02-13T14:40:33.097217+0000 mgr.y (mgr.14152) 236 : cluster 0 pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-02-13T14:40:35.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- 172.21.15.111:0/3884492591 >> v1:172.21.15.111:6789/0 conn(0x7fc1bc109c20 legacy=0x7fc1bc10c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:40:35.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- 172.21.15.111:0/3884492591 shutdown_connections 2024-02-13T14:40:35.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- 172.21.15.111:0/3884492591 >> 172.21.15.111:0/3884492591 conn(0x7fc1bc0fd070 msgr2=0x7fc1bc0ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:40:35.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- 172.21.15.111:0/3884492591 shutdown_connections 2024-02-13T14:40:35.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- 172.21.15.111:0/3884492591 wait complete. 2024-02-13T14:40:35.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 Processor -- start 2024-02-13T14:40:35.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- start start 2024-02-13T14:40:35.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc1bc1a4140 con 0x7fc1bc101ab0 2024-02-13T14:40:35.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc1bc1a5340 con 0x7fc1bc105ee0 2024-02-13T14:40:35.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc1bc1a6540 con 0x7fc1bc109c20 2024-02-13T14:40:35.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c0d83700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fc1bc105ee0 0x7fc1bc19ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:47944/0 (socket says 172.21.15.111:47944) 2024-02-13T14:40:35.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c0d83700 1 -- 172.21.15.111:0/695871469 learned_addr learned my addr 172.21.15.111:0/695871469 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:40:35.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304342310 0 0) 0x7fc1bc1a5340 con 0x7fc1bc105ee0 2024-02-13T14:40:35.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a80035b0 con 0x7fc1bc105ee0 2024-02-13T14:40:35.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3903717389 0 0) 0x7fc1a80035b0 con 0x7fc1bc105ee0 2024-02-13T14:40:35.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc1bc1a5340 con 0x7fc1bc105ee0 2024-02-13T14:40:35.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fc1ac001970 con 0x7fc1bc105ee0 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1986506464 0 0) 0x7fc1bc1a4140 con 0x7fc1bc101ab0 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1a80035b0 con 0x7fc1bc101ab0 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160656285 0 0) 0x7fc1bc1a6540 con 0x7fc1bc109c20 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1bc1a4140 con 0x7fc1bc109c20 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1441849103 0 0) 0x7fc1bc1a5340 con 0x7fc1bc105ee0 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 >> v1:172.21.15.62:6790/0 conn(0x7fc1bc109c20 legacy=0x7fc1bc1a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 >> v1:172.21.15.62:6789/0 conn(0x7fc1bc101ab0 legacy=0x7fc1bc075930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1bc1a7740 con 0x7fc1bc105ee0 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1bc1a4330 con 0x7fc1bc105ee0 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1bc1a4830 con 0x7fc1bc105ee0 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fc1ac001c70 con 0x7fc1bc105ee0 2024-02-13T14:40:35.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.120+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fc1ac005d10 con 0x7fc1bc105ee0 2024-02-13T14:40:35.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.124+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a0005150 con 0x7fc1bc105ee0 2024-02-13T14:40:35.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.124+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7fc1ac004050 con 0x7fc1bc105ee0 2024-02-13T14:40:35.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.124+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(34..34 src has 1..34) v4 ==== 3205+0+0 (unknown 4260720205 0 0) 0x7fc1ac0882b0 con 0x7fc1bc105ee0 2024-02-13T14:40:35.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.128+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fc1ac052460 con 0x7fc1bc105ee0 2024-02-13T14:40:35.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:40:35.348+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc1a0000bc0 con 0x7fc1a806ecb0 2024-02-13T14:40:36.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:35 smithi062 bash[28859]: audit 2024-02-13T14:40:35.360740+0000 mon.a (mon.0) 501 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:40:36.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:35 smithi062 bash[28859]: audit 2024-02-13T14:40:35.367019+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:40:36.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:35 smithi062 bash[28859]: audit 2024-02-13T14:40:35.368574+0000 mon.a (mon.0) 503 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:36.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:35 smithi062 bash[21479]: audit 2024-02-13T14:40:35.360740+0000 mon.a (mon.0) 501 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:40:36.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:35 smithi062 bash[21479]: audit 2024-02-13T14:40:35.367019+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:40:36.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:35 smithi062 bash[21479]: audit 2024-02-13T14:40:35.368574+0000 mon.a (mon.0) 503 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:36.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:35 smithi111 bash[23388]: audit 2024-02-13T14:40:35.360740+0000 mon.a (mon.0) 501 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:40:36.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:35 smithi111 bash[23388]: audit 2024-02-13T14:40:35.367019+0000 mon.a (mon.0) 502 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:40:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:35 smithi111 bash[23388]: audit 2024-02-13T14:40:35.368574+0000 mon.a (mon.0) 503 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:37.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:36 smithi062 bash[21479]: cluster 2024-02-13T14:40:35.097846+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:40:37.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:36 smithi062 bash[21479]: audit 2024-02-13T14:40:35.353757+0000 mgr.y (mgr.14152) 238 : audit 0 from='client.24262 v1:172.21.15.111:0/695871469' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:40:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:36 smithi062 bash[28859]: cluster 2024-02-13T14:40:35.097846+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:40:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:36 smithi062 bash[28859]: audit 2024-02-13T14:40:35.353757+0000 mgr.y (mgr.14152) 238 : audit 0 from='client.24262 v1:172.21.15.111:0/695871469' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:40:37.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:36 smithi111 bash[23388]: cluster 2024-02-13T14:40:35.097846+0000 mgr.y (mgr.14152) 237 : cluster 0 pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:40:37.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:36 smithi111 bash[23388]: audit 2024-02-13T14:40:35.353757+0000 mgr.y (mgr.14152) 238 : audit 0 from='client.24262 v1:172.21.15.111:0/695871469' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:40:38.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:37 smithi062 bash[21479]: cluster 2024-02-13T14:40:37.098394+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:38.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:37 smithi062 bash[28859]: cluster 2024-02-13T14:40:37.098394+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:38.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:37 smithi111 bash[23388]: cluster 2024-02-13T14:40:37.098394+0000 mgr.y (mgr.14152) 239 : cluster 0 pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:40.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:40 smithi062 bash[21479]: cluster 2024-02-13T14:40:39.098922+0000 mgr.y (mgr.14152) 240 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:40.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:40 smithi062 bash[28859]: cluster 2024-02-13T14:40:39.098922+0000 mgr.y (mgr.14152) 240 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:40.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:40 smithi111 bash[23388]: cluster 2024-02-13T14:40:39.098922+0000 mgr.y (mgr.14152) 240 : cluster 0 pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:42.531 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:42 smithi111 bash[23388]: cluster 2024-02-13T14:40:41.099458+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:42.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:42 smithi062 bash[21479]: cluster 2024-02-13T14:40:41.099458+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:42 smithi062 bash[28859]: cluster 2024-02-13T14:40:41.099458+0000 mgr.y (mgr.14152) 241 : cluster 0 pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:44.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[28859]: cluster 2024-02-13T14:40:43.099955+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[28859]: audit 2024-02-13T14:40:43.438699+0000 mon.b (mon.1) 14 : audit 1 from='client.? v1:172.21.15.111:0/1408119119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]: dispatch 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[28859]: audit 2024-02-13T14:40:43.440873+0000 mon.a (mon.0) 504 : audit 1 from='client.24268 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]: dispatch 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[28859]: audit 2024-02-13T14:40:43.444330+0000 mon.a (mon.0) 505 : audit 1 from='client.24268 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]': finished 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[28859]: cluster 2024-02-13T14:40:43.452229+0000 mon.a (mon.0) 506 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[28859]: audit 2024-02-13T14:40:43.452924+0000 mon.a (mon.0) 507 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[21479]: cluster 2024-02-13T14:40:43.099955+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[21479]: audit 2024-02-13T14:40:43.438699+0000 mon.b (mon.1) 14 : audit 1 from='client.? v1:172.21.15.111:0/1408119119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]: dispatch 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[21479]: audit 2024-02-13T14:40:43.440873+0000 mon.a (mon.0) 504 : audit 1 from='client.24268 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]: dispatch 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[21479]: audit 2024-02-13T14:40:43.444330+0000 mon.a (mon.0) 505 : audit 1 from='client.24268 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]': finished 2024-02-13T14:40:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[21479]: cluster 2024-02-13T14:40:43.452229+0000 mon.a (mon.0) 506 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-02-13T14:40:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:44 smithi062 bash[21479]: audit 2024-02-13T14:40:43.452924+0000 mon.a (mon.0) 507 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:40:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:44 smithi111 bash[23388]: cluster 2024-02-13T14:40:43.099955+0000 mgr.y (mgr.14152) 242 : cluster 0 pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:44 smithi111 bash[23388]: audit 2024-02-13T14:40:43.438699+0000 mon.b (mon.1) 14 : audit 1 from='client.? v1:172.21.15.111:0/1408119119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]: dispatch 2024-02-13T14:40:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:44 smithi111 bash[23388]: audit 2024-02-13T14:40:43.440873+0000 mon.a (mon.0) 504 : audit 1 from='client.24268 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]: dispatch 2024-02-13T14:40:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:44 smithi111 bash[23388]: audit 2024-02-13T14:40:43.444330+0000 mon.a (mon.0) 505 : audit 1 from='client.24268 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5b44f2d-fb54-4f64-b523-7ff9f373ec4d"}]': finished 2024-02-13T14:40:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:44 smithi111 bash[23388]: cluster 2024-02-13T14:40:43.452229+0000 mon.a (mon.0) 506 : cluster 0 osdmap e35: 6 total, 5 up, 6 in 2024-02-13T14:40:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:44 smithi111 bash[23388]: audit 2024-02-13T14:40:43.452924+0000 mon.a (mon.0) 507 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:40:45.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:45 smithi062 bash[28859]: audit 2024-02-13T14:40:44.199240+0000 mon.b (mon.1) 15 : audit 0 from='client.? v1:172.21.15.111:0/2638101844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:40:45.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:45 smithi062 bash[21479]: audit 2024-02-13T14:40:44.199240+0000 mon.b (mon.1) 15 : audit 0 from='client.? v1:172.21.15.111:0/2638101844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:40:45.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:45 smithi111 bash[23388]: audit 2024-02-13T14:40:44.199240+0000 mon.b (mon.1) 15 : audit 0 from='client.? v1:172.21.15.111:0/2638101844' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:40:46.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:46 smithi062 bash[28859]: cluster 2024-02-13T14:40:45.100567+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:46.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:46 smithi062 bash[21479]: cluster 2024-02-13T14:40:45.100567+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:46.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:46 smithi111 bash[23388]: cluster 2024-02-13T14:40:45.100567+0000 mgr.y (mgr.14152) 243 : cluster 0 pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:48.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:48 smithi062 bash[21479]: cluster 2024-02-13T14:40:47.101108+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:48.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:48 smithi062 bash[28859]: cluster 2024-02-13T14:40:47.101108+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:48.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:48 smithi111 bash[23388]: cluster 2024-02-13T14:40:47.101108+0000 mgr.y (mgr.14152) 244 : cluster 0 pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:50.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:50 smithi062 bash[28859]: cluster 2024-02-13T14:40:49.101619+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:50.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:50 smithi062 bash[21479]: cluster 2024-02-13T14:40:49.101619+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:50.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:50 smithi111 bash[23388]: cluster 2024-02-13T14:40:49.101619+0000 mgr.y (mgr.14152) 245 : cluster 0 pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:52.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:52 smithi062 bash[21479]: cluster 2024-02-13T14:40:51.102157+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:52 smithi062 bash[28859]: cluster 2024-02-13T14:40:51.102157+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:52 smithi111 bash[23388]: cluster 2024-02-13T14:40:51.102157+0000 mgr.y (mgr.14152) 246 : cluster 0 pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:54.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:54 smithi111 bash[23388]: cluster 2024-02-13T14:40:53.102731+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:54.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:54 smithi062 bash[21479]: cluster 2024-02-13T14:40:53.102731+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:54.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:54 smithi062 bash[28859]: cluster 2024-02-13T14:40:53.102731+0000 mgr.y (mgr.14152) 247 : cluster 0 pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:56 smithi111 bash[23388]: cluster 2024-02-13T14:40:55.103293+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:56 smithi111 bash[23388]: audit 2024-02-13T14:40:55.536103+0000 mon.a (mon.0) 508 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-13T14:40:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:56 smithi111 bash[23388]: audit 2024-02-13T14:40:55.538044+0000 mon.a (mon.0) 509 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:56 smithi111 bash[23388]: cephadm 2024-02-13T14:40:55.539753+0000 mgr.y (mgr.14152) 249 : cephadm 1 Deploying daemon osd.5 on smithi111 2024-02-13T14:40:56.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:56 smithi062 bash[21479]: cluster 2024-02-13T14:40:55.103293+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:56.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:56 smithi062 bash[21479]: audit 2024-02-13T14:40:55.536103+0000 mon.a (mon.0) 508 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-13T14:40:56.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:56 smithi062 bash[21479]: audit 2024-02-13T14:40:55.538044+0000 mon.a (mon.0) 509 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:56.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:56 smithi062 bash[21479]: cephadm 2024-02-13T14:40:55.539753+0000 mgr.y (mgr.14152) 249 : cephadm 1 Deploying daemon osd.5 on smithi111 2024-02-13T14:40:56.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:56 smithi062 bash[28859]: cluster 2024-02-13T14:40:55.103293+0000 mgr.y (mgr.14152) 248 : cluster 0 pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:56.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:56 smithi062 bash[28859]: audit 2024-02-13T14:40:55.536103+0000 mon.a (mon.0) 508 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-13T14:40:56.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:56 smithi062 bash[28859]: audit 2024-02-13T14:40:55.538044+0000 mon.a (mon.0) 509 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:40:56.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:56 smithi062 bash[28859]: cephadm 2024-02-13T14:40:55.539753+0000 mgr.y (mgr.14152) 249 : cephadm 1 Deploying daemon osd.5 on smithi111 2024-02-13T14:40:58.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:40:58 smithi062 bash[21479]: cluster 2024-02-13T14:40:57.103813+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:40:58 smithi062 bash[28859]: cluster 2024-02-13T14:40:57.103813+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:58.578 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:58 smithi111 bash[23388]: cluster 2024-02-13T14:40:57.103813+0000 mgr.y (mgr.14152) 250 : cluster 0 pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:40:59.589 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:59 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:59.589 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:40:59 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:59.590 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:40:59 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:40:59 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:59.844 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:40:59 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:40:59.844 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:40:59 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:00.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:00 smithi062 bash[21479]: cluster 2024-02-13T14:40:59.104315+0000 mgr.y (mgr.14152) 251 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:00 smithi062 bash[21479]: audit 2024-02-13T14:40:59.881699+0000 mon.a (mon.0) 510 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:00 smithi062 bash[21479]: audit 2024-02-13T14:40:59.892271+0000 mon.a (mon.0) 511 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:00 smithi062 bash[21479]: audit 2024-02-13T14:40:59.893505+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:00 smithi062 bash[28859]: cluster 2024-02-13T14:40:59.104315+0000 mgr.y (mgr.14152) 251 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:00 smithi062 bash[28859]: audit 2024-02-13T14:40:59.881699+0000 mon.a (mon.0) 510 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:00 smithi062 bash[28859]: audit 2024-02-13T14:40:59.892271+0000 mon.a (mon.0) 511 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:00 smithi062 bash[28859]: audit 2024-02-13T14:40:59.893505+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:00.579 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:00 smithi111 bash[23388]: cluster 2024-02-13T14:40:59.104315+0000 mgr.y (mgr.14152) 251 : cluster 0 pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:00.579 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:00 smithi111 bash[23388]: audit 2024-02-13T14:40:59.881699+0000 mon.a (mon.0) 510 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:00.579 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:00 smithi111 bash[23388]: audit 2024-02-13T14:40:59.892271+0000 mon.a (mon.0) 511 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:00.579 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:00 smithi111 bash[23388]: audit 2024-02-13T14:40:59.893505+0000 mon.a (mon.0) 512 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:02.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:02 smithi062 bash[21479]: cluster 2024-02-13T14:41:01.104846+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:02 smithi062 bash[28859]: cluster 2024-02-13T14:41:01.104846+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:02.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:02 smithi111 bash[23388]: cluster 2024-02-13T14:41:01.104846+0000 mgr.y (mgr.14152) 252 : cluster 0 pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:04.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:04 smithi062 bash[21479]: cluster 2024-02-13T14:41:03.105390+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:04.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:04 smithi062 bash[28859]: cluster 2024-02-13T14:41:03.105390+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:04.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:04 smithi111 bash[23388]: cluster 2024-02-13T14:41:03.105390+0000 mgr.y (mgr.14152) 253 : cluster 0 pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:06 smithi062 bash[21479]: cluster 2024-02-13T14:41:05.105918+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:06 smithi062 bash[21479]: audit 2024-02-13T14:41:05.919776+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.111:6804/575601374' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T14:41:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:06 smithi062 bash[21479]: audit 2024-02-13T14:41:05.921493+0000 mon.a (mon.0) 513 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T14:41:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:06 smithi062 bash[28859]: cluster 2024-02-13T14:41:05.105918+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:06 smithi062 bash[28859]: audit 2024-02-13T14:41:05.919776+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.111:6804/575601374' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T14:41:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:06 smithi062 bash[28859]: audit 2024-02-13T14:41:05.921493+0000 mon.a (mon.0) 513 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T14:41:06.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:06 smithi111 bash[23388]: cluster 2024-02-13T14:41:05.105918+0000 mgr.y (mgr.14152) 254 : cluster 0 pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:06.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:06 smithi111 bash[23388]: audit 2024-02-13T14:41:05.919776+0000 mon.b (mon.1) 16 : audit 1 from='osd.5 v1:172.21.15.111:6804/575601374' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T14:41:06.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:06 smithi111 bash[23388]: audit 2024-02-13T14:41:05.921493+0000 mon.a (mon.0) 513 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-13T14:41:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.212997+0000 mon.a (mon.0) 514 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-13T14:41:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: cluster 2024-02-13T14:41:06.218358+0000 mon.a (mon.0) 515 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-02-13T14:41:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.219225+0000 mon.a (mon.0) 516 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.220211+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v1:172.21.15.111:6804/575601374' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.230633+0000 mon.a (mon.0) 517 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.592847+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.602255+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:07.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.604173+0000 mon.a (mon.0) 520 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:07.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.605873+0000 mon.a (mon.0) 521 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:07.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:07 smithi111 bash[23388]: audit 2024-02-13T14:41:06.615371+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.212997+0000 mon.a (mon.0) 514 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: cluster 2024-02-13T14:41:06.218358+0000 mon.a (mon.0) 515 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.219225+0000 mon.a (mon.0) 516 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.220211+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v1:172.21.15.111:6804/575601374' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.230633+0000 mon.a (mon.0) 517 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.592847+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.602255+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.604173+0000 mon.a (mon.0) 520 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.605873+0000 mon.a (mon.0) 521 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:07.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[21479]: audit 2024-02-13T14:41:06.615371+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.212997+0000 mon.a (mon.0) 514 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: cluster 2024-02-13T14:41:06.218358+0000 mon.a (mon.0) 515 : cluster 0 osdmap e36: 6 total, 5 up, 6 in 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.219225+0000 mon.a (mon.0) 516 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.220211+0000 mon.b (mon.1) 17 : audit 1 from='osd.5 v1:172.21.15.111:6804/575601374' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.230633+0000 mon.a (mon.0) 517 : audit 1 from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.592847+0000 mon.a (mon.0) 518 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.602255+0000 mon.a (mon.0) 519 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.604173+0000 mon.a (mon.0) 520 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.605873+0000 mon.a (mon.0) 521 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:07.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:07 smithi062 bash[28859]: audit 2024-02-13T14:41:06.615371+0000 mon.a (mon.0) 522 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[21479]: cluster 2024-02-13T14:41:07.106509+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[21479]: audit 2024-02-13T14:41:07.224077+0000 mon.a (mon.0) 523 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:41:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[21479]: cluster 2024-02-13T14:41:07.231354+0000 mon.a (mon.0) 524 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-02-13T14:41:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[21479]: audit 2024-02-13T14:41:07.232764+0000 mon.a (mon.0) 525 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[21479]: audit 2024-02-13T14:41:07.241941+0000 mon.a (mon.0) 526 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[21479]: audit 2024-02-13T14:41:07.759068+0000 mon.a (mon.0) 527 : audit 1 from='osd.5 ' entity='osd.5' 2024-02-13T14:41:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[28859]: cluster 2024-02-13T14:41:07.106509+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[28859]: audit 2024-02-13T14:41:07.224077+0000 mon.a (mon.0) 523 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:41:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[28859]: cluster 2024-02-13T14:41:07.231354+0000 mon.a (mon.0) 524 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-02-13T14:41:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[28859]: audit 2024-02-13T14:41:07.232764+0000 mon.a (mon.0) 525 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[28859]: audit 2024-02-13T14:41:07.241941+0000 mon.a (mon.0) 526 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:08.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:08 smithi062 bash[28859]: audit 2024-02-13T14:41:07.759068+0000 mon.a (mon.0) 527 : audit 1 from='osd.5 ' entity='osd.5' 2024-02-13T14:41:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:08 smithi111 bash[23388]: cluster 2024-02-13T14:41:07.106509+0000 mgr.y (mgr.14152) 255 : cluster 0 pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 147 MiB used, 447 GiB / 447 GiB avail 2024-02-13T14:41:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:08 smithi111 bash[23388]: audit 2024-02-13T14:41:07.224077+0000 mon.a (mon.0) 523 : audit 1 from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:41:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:08 smithi111 bash[23388]: cluster 2024-02-13T14:41:07.231354+0000 mon.a (mon.0) 524 : cluster 0 osdmap e37: 6 total, 5 up, 6 in 2024-02-13T14:41:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:08 smithi111 bash[23388]: audit 2024-02-13T14:41:07.232764+0000 mon.a (mon.0) 525 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:08 smithi111 bash[23388]: audit 2024-02-13T14:41:07.241941+0000 mon.a (mon.0) 526 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:08 smithi111 bash[23388]: audit 2024-02-13T14:41:07.759068+0000 mon.a (mon.0) 527 : audit 1 from='osd.5 ' entity='osd.5' 2024-02-13T14:41:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[21479]: cluster 2024-02-13T14:41:06.923757+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:41:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[21479]: cluster 2024-02-13T14:41:06.923863+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:41:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[21479]: cluster 2024-02-13T14:41:08.232789+0000 mon.a (mon.0) 528 : cluster 1 osd.5 v1:172.21.15.111:6804/575601374 boot 2024-02-13T14:41:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[21479]: cluster 2024-02-13T14:41:08.232908+0000 mon.a (mon.0) 529 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-02-13T14:41:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[21479]: audit 2024-02-13T14:41:08.233246+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[21479]: cluster 2024-02-13T14:41:09.235019+0000 mon.a (mon.0) 531 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-02-13T14:41:09.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[28859]: cluster 2024-02-13T14:41:06.923757+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:41:09.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[28859]: cluster 2024-02-13T14:41:06.923863+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:41:09.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[28859]: cluster 2024-02-13T14:41:08.232789+0000 mon.a (mon.0) 528 : cluster 1 osd.5 v1:172.21.15.111:6804/575601374 boot 2024-02-13T14:41:09.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[28859]: cluster 2024-02-13T14:41:08.232908+0000 mon.a (mon.0) 529 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-02-13T14:41:09.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[28859]: audit 2024-02-13T14:41:08.233246+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:09.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:09 smithi062 bash[28859]: cluster 2024-02-13T14:41:09.235019+0000 mon.a (mon.0) 531 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-02-13T14:41:09.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:09 smithi111 bash[23388]: cluster 2024-02-13T14:41:06.923757+0000 osd.5 (osd.5) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:41:09.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:09 smithi111 bash[23388]: cluster 2024-02-13T14:41:06.923863+0000 osd.5 (osd.5) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:41:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:09 smithi111 bash[23388]: cluster 2024-02-13T14:41:08.232789+0000 mon.a (mon.0) 528 : cluster 1 osd.5 v1:172.21.15.111:6804/575601374 boot 2024-02-13T14:41:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:09 smithi111 bash[23388]: cluster 2024-02-13T14:41:08.232908+0000 mon.a (mon.0) 529 : cluster 0 osdmap e38: 6 total, 6 up, 6 in 2024-02-13T14:41:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:09 smithi111 bash[23388]: audit 2024-02-13T14:41:08.233246+0000 mon.a (mon.0) 530 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:41:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:09 smithi111 bash[23388]: cluster 2024-02-13T14:41:09.235019+0000 mon.a (mon.0) 531 : cluster 0 osdmap e39: 6 total, 6 up, 6 in 2024-02-13T14:41:09.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:09.620+0000 7fc1b27fc700 1 -- 172.21.15.111:0/695871469 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 1965724302) 0x7fc1a0000bc0 con 0x7fc1a806ecb0 2024-02-13T14:41:09.622 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 5 on host 'smithi111' 2024-02-13T14:41:09.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:09.624+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 >> v1:172.21.15.62:6800/1926838190 conn(0x7fc1a806ecb0 legacy=0x7fc1a8071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:41:09.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:09.624+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 >> v1:172.21.15.111:6789/0 conn(0x7fc1bc105ee0 legacy=0x7fc1bc19ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:41:09.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:09.624+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 shutdown_connections 2024-02-13T14:41:09.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:09.624+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 >> 172.21.15.111:0/695871469 conn(0x7fc1bc0fd070 msgr2=0x7fc1bc10c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:41:09.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:09.624+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 shutdown_connections 2024-02-13T14:41:09.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:09.624+0000 7fc1c37e8700 1 -- 172.21.15.111:0/695871469 wait complete. 2024-02-13T14:41:10.285 DEBUG:teuthology.orchestra.run.smithi111:osd.5> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.5.service 2024-02-13T14:41:10.288 INFO:tasks.cephadm:Deploying osd.6 on smithi111 with /dev/vg_nvme/lv_2... 2024-02-13T14:41:10.288 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-13T14:41:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:10 smithi111 bash[23388]: cluster 2024-02-13T14:41:09.107034+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v231: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:10 smithi111 bash[23388]: audit 2024-02-13T14:41:09.578102+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:10 smithi111 bash[23388]: audit 2024-02-13T14:41:09.587699+0000 mon.a (mon.0) 533 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:10 smithi111 bash[23388]: audit 2024-02-13T14:41:09.610740+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:10 smithi111 bash[23388]: cluster 2024-02-13T14:41:10.251909+0000 mon.a (mon.0) 535 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[21479]: cluster 2024-02-13T14:41:09.107034+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v231: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[21479]: audit 2024-02-13T14:41:09.578102+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[21479]: audit 2024-02-13T14:41:09.587699+0000 mon.a (mon.0) 533 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[21479]: audit 2024-02-13T14:41:09.610740+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[21479]: cluster 2024-02-13T14:41:10.251909+0000 mon.a (mon.0) 535 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[28859]: cluster 2024-02-13T14:41:09.107034+0000 mgr.y (mgr.14152) 256 : cluster 0 pgmap v231: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[28859]: audit 2024-02-13T14:41:09.578102+0000 mon.a (mon.0) 532 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[28859]: audit 2024-02-13T14:41:09.587699+0000 mon.a (mon.0) 533 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[28859]: audit 2024-02-13T14:41:09.610740+0000 mon.a (mon.0) 534 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:11.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:10 smithi062 bash[28859]: cluster 2024-02-13T14:41:10.251909+0000 mon.a (mon.0) 535 : cluster 0 osdmap e40: 6 total, 6 up, 6 in 2024-02-13T14:41:12.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:12 smithi062 bash[21479]: cluster 2024-02-13T14:41:11.107537+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v234: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:12.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:12 smithi062 bash[21479]: cluster 2024-02-13T14:41:11.131523+0000 mon.a (mon.0) 536 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-02-13T14:41:12.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:12 smithi062 bash[28859]: cluster 2024-02-13T14:41:11.107537+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v234: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:12.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:12 smithi062 bash[28859]: cluster 2024-02-13T14:41:11.131523+0000 mon.a (mon.0) 536 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-02-13T14:41:12.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:12 smithi111 bash[23388]: cluster 2024-02-13T14:41:11.107537+0000 mgr.y (mgr.14152) 257 : cluster 0 pgmap v234: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:12.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:12 smithi111 bash[23388]: cluster 2024-02-13T14:41:11.131523+0000 mon.a (mon.0) 536 : cluster 0 osdmap e41: 6 total, 6 up, 6 in 2024-02-13T14:41:13.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:13 smithi062 bash[21479]: cluster 2024-02-13T14:41:12.134182+0000 mon.a (mon.0) 537 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-02-13T14:41:13.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:13 smithi062 bash[28859]: cluster 2024-02-13T14:41:12.134182+0000 mon.a (mon.0) 537 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-02-13T14:41:13.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:13 smithi111 bash[23388]: cluster 2024-02-13T14:41:12.134182+0000 mon.a (mon.0) 537 : cluster 0 osdmap e42: 6 total, 6 up, 6 in 2024-02-13T14:41:14.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:14 smithi062 bash[21479]: cluster 2024-02-13T14:41:13.108066+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v237: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:14.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:14 smithi062 bash[28859]: cluster 2024-02-13T14:41:13.108066+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v237: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:14.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:14 smithi111 bash[23388]: cluster 2024-02-13T14:41:13.108066+0000 mgr.y (mgr.14152) 258 : cluster 0 pgmap v237: 1 pgs: 1 unknown; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:41:16.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:16 smithi111 bash[23388]: cluster 2024-02-13T14:41:15.108590+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-02-13T14:41:16.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:16 smithi062 bash[21479]: cluster 2024-02-13T14:41:15.108590+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-02-13T14:41:16.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:16 smithi062 bash[28859]: cluster 2024-02-13T14:41:15.108590+0000 mgr.y (mgr.14152) 259 : cluster 0 pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-02-13T14:41:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-13T14:41:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-13T14:41:18.452 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-02-13T14:41:18.452 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-02-13T14:41:18.453 INFO:teuthology.orchestra.run.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0135426 s, 774 MB/s 2024-02-13T14:41:18.453 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 2024-02-13T14:41:18.453 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-02-13T14:41:18.482 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:18 smithi111 bash[23388]: cluster 2024-02-13T14:41:17.109076+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-02-13T14:41:18.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:18 smithi062 bash[21479]: cluster 2024-02-13T14:41:17.109076+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-02-13T14:41:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:18 smithi062 bash[28859]: cluster 2024-02-13T14:41:17.109076+0000 mgr.y (mgr.14152) 260 : cluster 0 pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-02-13T14:41:19.279 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_2 2024-02-13T14:41:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: cluster 2024-02-13T14:41:19.109664+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-13T14:41:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: cephadm 2024-02-13T14:41:19.467400+0000 mgr.y (mgr.14152) 262 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:41:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: audit 2024-02-13T14:41:19.477264+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: audit 2024-02-13T14:41:19.486510+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: audit 2024-02-13T14:41:19.488950+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:41:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: audit 2024-02-13T14:41:19.490723+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:41:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: cephadm 2024-02-13T14:41:19.492116+0000 mgr.y (mgr.14152) 263 : cephadm 1 Adjusting osd_memory_target on smithi111 to 8632M 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: audit 2024-02-13T14:41:19.498537+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: audit 2024-02-13T14:41:19.502893+0000 mon.a (mon.0) 543 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: audit 2024-02-13T14:41:19.504819+0000 mon.a (mon.0) 544 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[21479]: audit 2024-02-13T14:41:19.514835+0000 mon.a (mon.0) 545 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: cluster 2024-02-13T14:41:19.109664+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: cephadm 2024-02-13T14:41:19.467400+0000 mgr.y (mgr.14152) 262 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: audit 2024-02-13T14:41:19.477264+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: audit 2024-02-13T14:41:19.486510+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: audit 2024-02-13T14:41:19.488950+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: audit 2024-02-13T14:41:19.490723+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:41:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: cephadm 2024-02-13T14:41:19.492116+0000 mgr.y (mgr.14152) 263 : cephadm 1 Adjusting osd_memory_target on smithi111 to 8632M 2024-02-13T14:41:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: audit 2024-02-13T14:41:19.498537+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: audit 2024-02-13T14:41:19.502893+0000 mon.a (mon.0) 543 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: audit 2024-02-13T14:41:19.504819+0000 mon.a (mon.0) 544 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:20 smithi062 bash[28859]: audit 2024-02-13T14:41:19.514835+0000 mon.a (mon.0) 545 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: cluster 2024-02-13T14:41:19.109664+0000 mgr.y (mgr.14152) 261 : cluster 0 pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: cephadm 2024-02-13T14:41:19.467400+0000 mgr.y (mgr.14152) 262 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: audit 2024-02-13T14:41:19.477264+0000 mon.a (mon.0) 538 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: audit 2024-02-13T14:41:19.486510+0000 mon.a (mon.0) 539 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: audit 2024-02-13T14:41:19.488950+0000 mon.a (mon.0) 540 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: audit 2024-02-13T14:41:19.490723+0000 mon.a (mon.0) 541 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: cephadm 2024-02-13T14:41:19.492116+0000 mgr.y (mgr.14152) 263 : cephadm 1 Adjusting osd_memory_target on smithi111 to 8632M 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: audit 2024-02-13T14:41:19.498537+0000 mon.a (mon.0) 542 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: audit 2024-02-13T14:41:19.502893+0000 mon.a (mon.0) 543 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: audit 2024-02-13T14:41:19.504819+0000 mon.a (mon.0) 544 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:20 smithi111 bash[23388]: audit 2024-02-13T14:41:19.514835+0000 mon.a (mon.0) 545 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:22.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:22 smithi062 bash[21479]: cluster 2024-02-13T14:41:21.110323+0000 mgr.y (mgr.14152) 264 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:41:22.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:22 smithi062 bash[28859]: cluster 2024-02-13T14:41:21.110323+0000 mgr.y (mgr.14152) 264 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:41:22.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:22 smithi111 bash[23388]: cluster 2024-02-13T14:41:21.110323+0000 mgr.y (mgr.14152) 264 : cluster 0 pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:41:24.006 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:41:24.776 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:24 smithi111 bash[23388]: cluster 2024-02-13T14:41:23.111028+0000 mgr.y (mgr.14152) 265 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-02-13T14:41:24.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:24 smithi062 bash[21479]: cluster 2024-02-13T14:41:23.111028+0000 mgr.y (mgr.14152) 265 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-02-13T14:41:24.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:24 smithi062 bash[28859]: cluster 2024-02-13T14:41:23.111028+0000 mgr.y (mgr.14152) 265 : cluster 0 pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- 172.21.15.111:0/1398556374 >> v1:172.21.15.111:6789/0 conn(0x7f02b4108b10 legacy=0x7f02b410afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- 172.21.15.111:0/1398556374 shutdown_connections 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- 172.21.15.111:0/1398556374 >> 172.21.15.111:0/1398556374 conn(0x7f02b40fbf80 msgr2=0x7f02b40fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- 172.21.15.111:0/1398556374 shutdown_connections 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- 172.21.15.111:0/1398556374 wait complete. 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 Processor -- start 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- start start 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f02b41a4180 con 0x7f02b4104dd0 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f02b41a5380 con 0x7f02b41009a0 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f02b41a6580 con 0x7f02b4108b10 2024-02-13T14:41:26.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02b92ba700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f02b41009a0 0x7f02b4106ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:51712/0 (socket says 172.21.15.111:51712) 2024-02-13T14:41:26.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02b92ba700 1 -- 172.21.15.111:0/585251255 learned_addr learned my addr 172.21.15.111:0/585251255 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218857554 0 0) 0x7f02b41a5380 con 0x7f02b41009a0 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a00035b0 con 0x7f02b41009a0 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2108589586 0 0) 0x7f02a00035b0 con 0x7f02b41009a0 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f02b41a5380 con 0x7f02b41009a0 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f02b00018f0 con 0x7f02b41009a0 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545189384 0 0) 0x7f02b41a6580 con 0x7f02b4108b10 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02a00035b0 con 0x7f02b4108b10 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3298575540 0 0) 0x7f02b41a4180 con 0x7f02b4104dd0 2024-02-13T14:41:26.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b41a6580 con 0x7f02b4104dd0 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1712559439 0 0) 0x7f02b41a5380 con 0x7f02b41009a0 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 >> v1:172.21.15.62:6790/0 conn(0x7f02b4108b10 legacy=0x7f02b41a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 >> v1:172.21.15.62:6789/0 conn(0x7f02b4104dd0 legacy=0x7f02b419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b41a7780 con 0x7f02b41009a0 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02b41a6770 con 0x7f02b41009a0 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f02b41a6c70 con 0x7f02b41009a0 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f02b0003b70 con 0x7f02b41009a0 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f02b0005ca0 con 0x7f02b41009a0 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.340+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0298005150 con 0x7f02b41009a0 2024-02-13T14:41:26.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.344+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7f02b00036e0 con 0x7f02b41009a0 2024-02-13T14:41:26.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.344+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(42..42 src has 1..42) v4 ==== 3497+0+0 (unknown 131960598 0 0) 0x7f02b0088180 con 0x7f02b41009a0 2024-02-13T14:41:26.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.348+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f02b0052210 con 0x7f02b41009a0 2024-02-13T14:41:26.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:41:26.564+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f0298000bc0 con 0x7f02a006ef40 2024-02-13T14:41:26.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:26 smithi062 bash[21479]: cluster 2024-02-13T14:41:25.111746+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:41:26.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:26 smithi062 bash[28859]: cluster 2024-02-13T14:41:25.111746+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:41:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:26 smithi111 bash[23388]: cluster 2024-02-13T14:41:25.111746+0000 mgr.y (mgr.14152) 266 : cluster 0 pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:41:27.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:27 smithi062 bash[21479]: audit 2024-02-13T14:41:26.570607+0000 mgr.y (mgr.14152) 267 : audit 0 from='client.24289 v1:172.21.15.111:0/585251255' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:41:27.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:27 smithi062 bash[21479]: audit 2024-02-13T14:41:26.577943+0000 mon.a (mon.0) 546 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:41:27.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:27 smithi062 bash[21479]: audit 2024-02-13T14:41:26.587500+0000 mon.a (mon.0) 547 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:41:27.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:27 smithi062 bash[21479]: audit 2024-02-13T14:41:26.588993+0000 mon.a (mon.0) 548 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:27.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:27 smithi062 bash[28859]: audit 2024-02-13T14:41:26.570607+0000 mgr.y (mgr.14152) 267 : audit 0 from='client.24289 v1:172.21.15.111:0/585251255' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:41:27.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:27 smithi062 bash[28859]: audit 2024-02-13T14:41:26.577943+0000 mon.a (mon.0) 546 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:41:27.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:27 smithi062 bash[28859]: audit 2024-02-13T14:41:26.587500+0000 mon.a (mon.0) 547 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:41:27.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:27 smithi062 bash[28859]: audit 2024-02-13T14:41:26.588993+0000 mon.a (mon.0) 548 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:27.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:27 smithi111 bash[23388]: audit 2024-02-13T14:41:26.570607+0000 mgr.y (mgr.14152) 267 : audit 0 from='client.24289 v1:172.21.15.111:0/585251255' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:41:27.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:27 smithi111 bash[23388]: audit 2024-02-13T14:41:26.577943+0000 mon.a (mon.0) 546 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:41:27.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:27 smithi111 bash[23388]: audit 2024-02-13T14:41:26.587500+0000 mon.a (mon.0) 547 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:41:27.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:27 smithi111 bash[23388]: audit 2024-02-13T14:41:26.588993+0000 mon.a (mon.0) 548 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:28.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:28 smithi062 bash[28859]: cluster 2024-02-13T14:41:27.112315+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:28.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:28 smithi062 bash[21479]: cluster 2024-02-13T14:41:27.112315+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:28 smithi111 bash[23388]: cluster 2024-02-13T14:41:27.112315+0000 mgr.y (mgr.14152) 268 : cluster 0 pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:30.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:30 smithi062 bash[21479]: cluster 2024-02-13T14:41:29.112848+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:30 smithi062 bash[28859]: cluster 2024-02-13T14:41:29.112848+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:30 smithi111 bash[23388]: cluster 2024-02-13T14:41:29.112848+0000 mgr.y (mgr.14152) 269 : cluster 0 pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:32.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:32 smithi111 bash[23388]: cluster 2024-02-13T14:41:31.113409+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:32.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:32 smithi062 bash[28859]: cluster 2024-02-13T14:41:31.113409+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:32 smithi062 bash[21479]: cluster 2024-02-13T14:41:31.113409+0000 mgr.y (mgr.14152) 270 : cluster 0 pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:34.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:34 smithi062 bash[21479]: cluster 2024-02-13T14:41:33.113959+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:34.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:34 smithi062 bash[28859]: cluster 2024-02-13T14:41:33.113959+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:34.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:34 smithi111 bash[23388]: cluster 2024-02-13T14:41:33.113959+0000 mgr.y (mgr.14152) 271 : cluster 0 pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:35.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[21479]: audit 2024-02-13T14:41:34.679685+0000 mon.b (mon.1) 18 : audit 1 from='client.? v1:172.21.15.111:0/531884547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]: dispatch 2024-02-13T14:41:35.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[21479]: audit 2024-02-13T14:41:34.681357+0000 mon.a (mon.0) 549 : audit 1 from='client.24295 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]: dispatch 2024-02-13T14:41:35.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[21479]: audit 2024-02-13T14:41:34.685074+0000 mon.a (mon.0) 550 : audit 1 from='client.24295 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]': finished 2024-02-13T14:41:35.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[21479]: cluster 2024-02-13T14:41:34.691131+0000 mon.a (mon.0) 551 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-02-13T14:41:35.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[21479]: audit 2024-02-13T14:41:34.691846+0000 mon.a (mon.0) 552 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:41:35.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[21479]: audit 2024-02-13T14:41:35.417032+0000 mon.b (mon.1) 19 : audit 0 from='client.? v1:172.21.15.111:0/1941776456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:41:35.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[28859]: audit 2024-02-13T14:41:34.679685+0000 mon.b (mon.1) 18 : audit 1 from='client.? v1:172.21.15.111:0/531884547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]: dispatch 2024-02-13T14:41:35.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[28859]: audit 2024-02-13T14:41:34.681357+0000 mon.a (mon.0) 549 : audit 1 from='client.24295 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]: dispatch 2024-02-13T14:41:35.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[28859]: audit 2024-02-13T14:41:34.685074+0000 mon.a (mon.0) 550 : audit 1 from='client.24295 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]': finished 2024-02-13T14:41:35.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[28859]: cluster 2024-02-13T14:41:34.691131+0000 mon.a (mon.0) 551 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-02-13T14:41:35.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[28859]: audit 2024-02-13T14:41:34.691846+0000 mon.a (mon.0) 552 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:41:35.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:35 smithi062 bash[28859]: audit 2024-02-13T14:41:35.417032+0000 mon.b (mon.1) 19 : audit 0 from='client.? v1:172.21.15.111:0/1941776456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:41:35.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:35 smithi111 bash[23388]: audit 2024-02-13T14:41:34.679685+0000 mon.b (mon.1) 18 : audit 1 from='client.? v1:172.21.15.111:0/531884547' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]: dispatch 2024-02-13T14:41:35.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:35 smithi111 bash[23388]: audit 2024-02-13T14:41:34.681357+0000 mon.a (mon.0) 549 : audit 1 from='client.24295 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]: dispatch 2024-02-13T14:41:35.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:35 smithi111 bash[23388]: audit 2024-02-13T14:41:34.685074+0000 mon.a (mon.0) 550 : audit 1 from='client.24295 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e4d903d9-30df-41ef-b09e-651111416a2c"}]': finished 2024-02-13T14:41:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:35 smithi111 bash[23388]: cluster 2024-02-13T14:41:34.691131+0000 mon.a (mon.0) 551 : cluster 0 osdmap e43: 7 total, 6 up, 7 in 2024-02-13T14:41:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:35 smithi111 bash[23388]: audit 2024-02-13T14:41:34.691846+0000 mon.a (mon.0) 552 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:41:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:35 smithi111 bash[23388]: audit 2024-02-13T14:41:35.417032+0000 mon.b (mon.1) 19 : audit 0 from='client.? v1:172.21.15.111:0/1941776456' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:41:37.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:36 smithi062 bash[21479]: cluster 2024-02-13T14:41:35.114598+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:36 smithi062 bash[28859]: cluster 2024-02-13T14:41:35.114598+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:37.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:36 smithi111 bash[23388]: cluster 2024-02-13T14:41:35.114598+0000 mgr.y (mgr.14152) 272 : cluster 0 pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:39.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:38 smithi062 bash[21479]: cluster 2024-02-13T14:41:37.115166+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:39.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:38 smithi062 bash[28859]: cluster 2024-02-13T14:41:37.115166+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:39.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:38 smithi111 bash[23388]: cluster 2024-02-13T14:41:37.115166+0000 mgr.y (mgr.14152) 273 : cluster 0 pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:40 smithi062 bash[21479]: cluster 2024-02-13T14:41:39.115719+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:41.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:40 smithi062 bash[28859]: cluster 2024-02-13T14:41:39.115719+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:40 smithi111 bash[23388]: cluster 2024-02-13T14:41:39.115719+0000 mgr.y (mgr.14152) 274 : cluster 0 pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:43.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:42 smithi062 bash[21479]: cluster 2024-02-13T14:41:41.116225+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:43.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:42 smithi062 bash[28859]: cluster 2024-02-13T14:41:41.116225+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:43.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:42 smithi111 bash[23388]: cluster 2024-02-13T14:41:41.116225+0000 mgr.y (mgr.14152) 275 : cluster 0 pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:45.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:44 smithi062 bash[21479]: cluster 2024-02-13T14:41:43.116768+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:45.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:44 smithi062 bash[28859]: cluster 2024-02-13T14:41:43.116768+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:45.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:44 smithi111 bash[23388]: cluster 2024-02-13T14:41:43.116768+0000 mgr.y (mgr.14152) 276 : cluster 0 pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:47.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:46 smithi062 bash[21479]: cluster 2024-02-13T14:41:45.117316+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:47.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:46 smithi062 bash[28859]: cluster 2024-02-13T14:41:45.117316+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:47.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:46 smithi111 bash[23388]: cluster 2024-02-13T14:41:45.117316+0000 mgr.y (mgr.14152) 277 : cluster 0 pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:47.973 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:47 smithi111 bash[23388]: audit 2024-02-13T14:41:46.811163+0000 mon.a (mon.0) 553 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-13T14:41:47.973 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:47 smithi111 bash[23388]: audit 2024-02-13T14:41:46.812889+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:48.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:47 smithi062 bash[21479]: audit 2024-02-13T14:41:46.811163+0000 mon.a (mon.0) 553 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-13T14:41:48.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:47 smithi062 bash[21479]: audit 2024-02-13T14:41:46.812889+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:48.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:47 smithi062 bash[28859]: audit 2024-02-13T14:41:46.811163+0000 mon.a (mon.0) 553 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-13T14:41:48.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:47 smithi062 bash[28859]: audit 2024-02-13T14:41:46.812889+0000 mon.a (mon.0) 554 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:48 smithi062 bash[21479]: cephadm 2024-02-13T14:41:46.814674+0000 mgr.y (mgr.14152) 278 : cephadm 1 Deploying daemon osd.6 on smithi111 2024-02-13T14:41:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:48 smithi062 bash[21479]: cluster 2024-02-13T14:41:47.117848+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:49.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:48 smithi062 bash[28859]: cephadm 2024-02-13T14:41:46.814674+0000 mgr.y (mgr.14152) 278 : cephadm 1 Deploying daemon osd.6 on smithi111 2024-02-13T14:41:49.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:48 smithi062 bash[28859]: cluster 2024-02-13T14:41:47.117848+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:48 smithi111 bash[23388]: cephadm 2024-02-13T14:41:46.814674+0000 mgr.y (mgr.14152) 278 : cephadm 1 Deploying daemon osd.6 on smithi111 2024-02-13T14:41:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:48 smithi111 bash[23388]: cluster 2024-02-13T14:41:47.117848+0000 mgr.y (mgr.14152) 279 : cluster 0 pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:50.790 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:41:50 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:50.790 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:50 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:50.790 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:50 smithi111 bash[23388]: cluster 2024-02-13T14:41:49.118475+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:50.790 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:41:50 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:50.791 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:41:50 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:51.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:50 smithi062 bash[28859]: cluster 2024-02-13T14:41:49.118475+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:50 smithi062 bash[21479]: cluster 2024-02-13T14:41:49.118475+0000 mgr.y (mgr.14152) 280 : cluster 0 pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:51.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:50 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:51.069 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:41:50 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:51.069 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:41:50 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:51.070 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:41:50 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:41:52.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:52 smithi111 bash[23388]: audit 2024-02-13T14:41:51.078700+0000 mon.a (mon.0) 555 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:52.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:52 smithi111 bash[23388]: audit 2024-02-13T14:41:51.090210+0000 mon.a (mon.0) 556 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:52.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:52 smithi111 bash[23388]: audit 2024-02-13T14:41:51.094960+0000 mon.a (mon.0) 557 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:52.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:52 smithi111 bash[23388]: cluster 2024-02-13T14:41:51.118996+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:52 smithi062 bash[21479]: audit 2024-02-13T14:41:51.078700+0000 mon.a (mon.0) 555 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:52 smithi062 bash[21479]: audit 2024-02-13T14:41:51.090210+0000 mon.a (mon.0) 556 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:52 smithi062 bash[21479]: audit 2024-02-13T14:41:51.094960+0000 mon.a (mon.0) 557 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:52 smithi062 bash[21479]: cluster 2024-02-13T14:41:51.118996+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:52 smithi062 bash[28859]: audit 2024-02-13T14:41:51.078700+0000 mon.a (mon.0) 555 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:52 smithi062 bash[28859]: audit 2024-02-13T14:41:51.090210+0000 mon.a (mon.0) 556 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:52 smithi062 bash[28859]: audit 2024-02-13T14:41:51.094960+0000 mon.a (mon.0) 557 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:41:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:52 smithi062 bash[28859]: cluster 2024-02-13T14:41:51.118996+0000 mgr.y (mgr.14152) 281 : cluster 0 pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:54.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:54 smithi062 bash[21479]: cluster 2024-02-13T14:41:53.119662+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:54.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:54 smithi062 bash[28859]: cluster 2024-02-13T14:41:53.119662+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:54 smithi111 bash[23388]: cluster 2024-02-13T14:41:53.119662+0000 mgr.y (mgr.14152) 282 : cluster 0 pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:56.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:56 smithi062 bash[28859]: cluster 2024-02-13T14:41:55.120357+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:56.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:56 smithi062 bash[21479]: cluster 2024-02-13T14:41:55.120357+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:56.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:56 smithi111 bash[23388]: cluster 2024-02-13T14:41:55.120357+0000 mgr.y (mgr.14152) 283 : cluster 0 pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:58.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:58 smithi111 bash[23388]: cluster 2024-02-13T14:41:57.120938+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:58.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:58 smithi111 bash[23388]: audit 2024-02-13T14:41:57.195193+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.111:6808/2146440304' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T14:41:58.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:58 smithi111 bash[23388]: audit 2024-02-13T14:41:57.196453+0000 mon.a (mon.0) 558 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T14:41:58.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:58 smithi111 bash[23388]: audit 2024-02-13T14:41:57.946360+0000 mon.a (mon.0) 559 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:58.449 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:58 smithi111 bash[23388]: audit 2024-02-13T14:41:57.956109+0000 mon.a (mon.0) 560 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[21479]: cluster 2024-02-13T14:41:57.120938+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[21479]: audit 2024-02-13T14:41:57.195193+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.111:6808/2146440304' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T14:41:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[21479]: audit 2024-02-13T14:41:57.196453+0000 mon.a (mon.0) 558 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T14:41:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[21479]: audit 2024-02-13T14:41:57.946360+0000 mon.a (mon.0) 559 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[21479]: audit 2024-02-13T14:41:57.956109+0000 mon.a (mon.0) 560 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[28859]: cluster 2024-02-13T14:41:57.120938+0000 mgr.y (mgr.14152) 284 : cluster 0 pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:41:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[28859]: audit 2024-02-13T14:41:57.195193+0000 mon.b (mon.1) 20 : audit 1 from='osd.6 v1:172.21.15.111:6808/2146440304' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T14:41:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[28859]: audit 2024-02-13T14:41:57.196453+0000 mon.a (mon.0) 558 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-13T14:41:58.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[28859]: audit 2024-02-13T14:41:57.946360+0000 mon.a (mon.0) 559 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:58.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:58 smithi062 bash[28859]: audit 2024-02-13T14:41:57.956109+0000 mon.a (mon.0) 560 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[21479]: audit 2024-02-13T14:41:58.193504+0000 mon.a (mon.0) 561 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-13T14:41:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[21479]: cluster 2024-02-13T14:41:58.198500+0000 mon.a (mon.0) 562 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-02-13T14:41:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[21479]: audit 2024-02-13T14:41:58.198983+0000 mon.a (mon.0) 563 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:41:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[21479]: audit 2024-02-13T14:41:58.201528+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v1:172.21.15.111:6808/2146440304' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[21479]: audit 2024-02-13T14:41:58.202882+0000 mon.a (mon.0) 564 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[21479]: audit 2024-02-13T14:41:58.690478+0000 mon.a (mon.0) 565 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[21479]: audit 2024-02-13T14:41:58.692428+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[21479]: audit 2024-02-13T14:41:58.703003+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[28859]: audit 2024-02-13T14:41:58.193504+0000 mon.a (mon.0) 561 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-13T14:41:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[28859]: cluster 2024-02-13T14:41:58.198500+0000 mon.a (mon.0) 562 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-02-13T14:41:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[28859]: audit 2024-02-13T14:41:58.198983+0000 mon.a (mon.0) 563 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:41:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[28859]: audit 2024-02-13T14:41:58.201528+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v1:172.21.15.111:6808/2146440304' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[28859]: audit 2024-02-13T14:41:58.202882+0000 mon.a (mon.0) 564 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[28859]: audit 2024-02-13T14:41:58.690478+0000 mon.a (mon.0) 565 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[28859]: audit 2024-02-13T14:41:58.692428+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:41:59 smithi062 bash[28859]: audit 2024-02-13T14:41:58.703003+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:41:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:59 smithi111 bash[23388]: audit 2024-02-13T14:41:58.193504+0000 mon.a (mon.0) 561 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-13T14:41:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:59 smithi111 bash[23388]: cluster 2024-02-13T14:41:58.198500+0000 mon.a (mon.0) 562 : cluster 0 osdmap e44: 7 total, 6 up, 7 in 2024-02-13T14:41:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:59 smithi111 bash[23388]: audit 2024-02-13T14:41:58.198983+0000 mon.a (mon.0) 563 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:41:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:59 smithi111 bash[23388]: audit 2024-02-13T14:41:58.201528+0000 mon.b (mon.1) 21 : audit 1 from='osd.6 v1:172.21.15.111:6808/2146440304' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:59.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:59 smithi111 bash[23388]: audit 2024-02-13T14:41:58.202882+0000 mon.a (mon.0) 564 : audit 1 from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:41:59.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:59 smithi111 bash[23388]: audit 2024-02-13T14:41:58.690478+0000 mon.a (mon.0) 565 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:41:59.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:59 smithi111 bash[23388]: audit 2024-02-13T14:41:58.692428+0000 mon.a (mon.0) 566 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:41:59.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:41:59 smithi111 bash[23388]: audit 2024-02-13T14:41:58.703003+0000 mon.a (mon.0) 567 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:00.526 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:00 smithi111 bash[23388]: cluster 2024-02-13T14:41:58.150403+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:42:00.526 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:00 smithi111 bash[23388]: cluster 2024-02-13T14:41:58.150563+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:42:00.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:00 smithi111 bash[23388]: cluster 2024-02-13T14:41:59.121507+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:42:00.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:00 smithi111 bash[23388]: audit 2024-02-13T14:41:59.195995+0000 mon.a (mon.0) 568 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:42:00.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:00 smithi111 bash[23388]: cluster 2024-02-13T14:41:59.202279+0000 mon.a (mon.0) 569 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-02-13T14:42:00.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:00 smithi111 bash[23388]: audit 2024-02-13T14:41:59.203265+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:00.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:00 smithi111 bash[23388]: audit 2024-02-13T14:41:59.213122+0000 mon.a (mon.0) 571 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:00.527 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:00 smithi111 bash[23388]: audit 2024-02-13T14:41:59.707227+0000 mon.a (mon.0) 572 : audit 1 from='osd.6 ' entity='osd.6' 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[28859]: cluster 2024-02-13T14:41:58.150403+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[28859]: cluster 2024-02-13T14:41:58.150563+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[28859]: cluster 2024-02-13T14:41:59.121507+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[28859]: audit 2024-02-13T14:41:59.195995+0000 mon.a (mon.0) 568 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[28859]: cluster 2024-02-13T14:41:59.202279+0000 mon.a (mon.0) 569 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[28859]: audit 2024-02-13T14:41:59.203265+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[28859]: audit 2024-02-13T14:41:59.213122+0000 mon.a (mon.0) 571 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[28859]: audit 2024-02-13T14:41:59.707227+0000 mon.a (mon.0) 572 : audit 1 from='osd.6 ' entity='osd.6' 2024-02-13T14:42:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[21479]: cluster 2024-02-13T14:41:58.150403+0000 osd.6 (osd.6) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:42:00.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[21479]: cluster 2024-02-13T14:41:58.150563+0000 osd.6 (osd.6) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:42:00.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[21479]: cluster 2024-02-13T14:41:59.121507+0000 mgr.y (mgr.14152) 285 : cluster 0 pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:42:00.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[21479]: audit 2024-02-13T14:41:59.195995+0000 mon.a (mon.0) 568 : audit 1 from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:42:00.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[21479]: cluster 2024-02-13T14:41:59.202279+0000 mon.a (mon.0) 569 : cluster 0 osdmap e45: 7 total, 6 up, 7 in 2024-02-13T14:42:00.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[21479]: audit 2024-02-13T14:41:59.203265+0000 mon.a (mon.0) 570 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:00.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[21479]: audit 2024-02-13T14:41:59.213122+0000 mon.a (mon.0) 571 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:00.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:00 smithi062 bash[21479]: audit 2024-02-13T14:41:59.707227+0000 mon.a (mon.0) 572 : audit 1 from='osd.6 ' entity='osd.6' 2024-02-13T14:42:01.265 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:01.263+0000 7f02aa7fc700 1 -- 172.21.15.111:0/585251255 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 2434048338) 0x7f0298000bc0 con 0x7f02a006ef40 2024-02-13T14:42:01.266 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 6 on host 'smithi111' 2024-02-13T14:42:01.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:01.267+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 >> v1:172.21.15.62:6800/1926838190 conn(0x7f02a006ef40 legacy=0x7f02a0071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:42:01.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:01.267+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 >> v1:172.21.15.111:6789/0 conn(0x7f02b41009a0 legacy=0x7f02b4106ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:42:01.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:01.267+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 shutdown_connections 2024-02-13T14:42:01.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:01.267+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 >> 172.21.15.111:0/585251255 conn(0x7f02b40fbf80 msgr2=0x7f02b4069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:42:01.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:01.267+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 shutdown_connections 2024-02-13T14:42:01.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:01.267+0000 7f02bb51e700 1 -- 172.21.15.111:0/585251255 wait complete. 2024-02-13T14:42:01.481 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:01 smithi111 bash[23388]: audit 2024-02-13T14:42:00.205846+0000 mon.a (mon.0) 573 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:01.482 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:01 smithi111 bash[23388]: cluster 2024-02-13T14:42:00.220806+0000 mon.a (mon.0) 574 : cluster 1 osd.6 v1:172.21.15.111:6808/2146440304 boot 2024-02-13T14:42:01.482 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:01 smithi111 bash[23388]: cluster 2024-02-13T14:42:00.220912+0000 mon.a (mon.0) 575 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-02-13T14:42:01.482 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:01 smithi111 bash[23388]: audit 2024-02-13T14:42:00.221325+0000 mon.a (mon.0) 576 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:01.482 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:01 smithi111 bash[23388]: cluster 2024-02-13T14:42:01.144715+0000 mon.a (mon.0) 577 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-02-13T14:42:01.482 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:01 smithi111 bash[23388]: audit 2024-02-13T14:42:01.197408+0000 mon.a (mon.0) 578 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:01.482 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:01 smithi111 bash[23388]: audit 2024-02-13T14:42:01.205691+0000 mon.a (mon.0) 579 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:01.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[21479]: audit 2024-02-13T14:42:00.205846+0000 mon.a (mon.0) 573 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:01.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[21479]: cluster 2024-02-13T14:42:00.220806+0000 mon.a (mon.0) 574 : cluster 1 osd.6 v1:172.21.15.111:6808/2146440304 boot 2024-02-13T14:42:01.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[21479]: cluster 2024-02-13T14:42:00.220912+0000 mon.a (mon.0) 575 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-02-13T14:42:01.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[21479]: audit 2024-02-13T14:42:00.221325+0000 mon.a (mon.0) 576 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:01.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[21479]: cluster 2024-02-13T14:42:01.144715+0000 mon.a (mon.0) 577 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-02-13T14:42:01.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[21479]: audit 2024-02-13T14:42:01.197408+0000 mon.a (mon.0) 578 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:01.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[21479]: audit 2024-02-13T14:42:01.205691+0000 mon.a (mon.0) 579 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[28859]: audit 2024-02-13T14:42:00.205846+0000 mon.a (mon.0) 573 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[28859]: cluster 2024-02-13T14:42:00.220806+0000 mon.a (mon.0) 574 : cluster 1 osd.6 v1:172.21.15.111:6808/2146440304 boot 2024-02-13T14:42:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[28859]: cluster 2024-02-13T14:42:00.220912+0000 mon.a (mon.0) 575 : cluster 0 osdmap e46: 7 total, 7 up, 7 in 2024-02-13T14:42:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[28859]: audit 2024-02-13T14:42:00.221325+0000 mon.a (mon.0) 576 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:42:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[28859]: cluster 2024-02-13T14:42:01.144715+0000 mon.a (mon.0) 577 : cluster 0 osdmap e47: 7 total, 7 up, 7 in 2024-02-13T14:42:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[28859]: audit 2024-02-13T14:42:01.197408+0000 mon.a (mon.0) 578 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:01 smithi062 bash[28859]: audit 2024-02-13T14:42:01.205691+0000 mon.a (mon.0) 579 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:01.851 DEBUG:teuthology.orchestra.run.smithi111:osd.6> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.6.service 2024-02-13T14:42:01.853 INFO:tasks.cephadm:Deploying osd.7 on smithi111 with /dev/vg_nvme/lv_1... 2024-02-13T14:42:01.854 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-13T14:42:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:02 smithi062 bash[21479]: cluster 2024-02-13T14:42:01.122039+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:42:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:02 smithi062 bash[21479]: audit 2024-02-13T14:42:01.222674+0000 mon.a (mon.0) 580 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:02 smithi062 bash[21479]: cluster 2024-02-13T14:42:02.146629+0000 mon.a (mon.0) 581 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-02-13T14:42:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:02 smithi062 bash[28859]: cluster 2024-02-13T14:42:01.122039+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:42:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:02 smithi062 bash[28859]: audit 2024-02-13T14:42:01.222674+0000 mon.a (mon.0) 580 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:02 smithi062 bash[28859]: cluster 2024-02-13T14:42:02.146629+0000 mon.a (mon.0) 581 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-02-13T14:42:02.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:02 smithi111 bash[23388]: cluster 2024-02-13T14:42:01.122039+0000 mgr.y (mgr.14152) 286 : cluster 0 pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-02-13T14:42:02.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:02 smithi111 bash[23388]: audit 2024-02-13T14:42:01.222674+0000 mon.a (mon.0) 580 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:02.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:02 smithi111 bash[23388]: cluster 2024-02-13T14:42:02.146629+0000 mon.a (mon.0) 581 : cluster 0 osdmap e48: 7 total, 7 up, 7 in 2024-02-13T14:42:04.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:04 smithi062 bash[21479]: cluster 2024-02-13T14:42:03.122645+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-13T14:42:04.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:04 smithi062 bash[21479]: cluster 2024-02-13T14:42:03.236982+0000 mon.a (mon.0) 582 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-02-13T14:42:04.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:04 smithi062 bash[28859]: cluster 2024-02-13T14:42:03.122645+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-13T14:42:04.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:04 smithi062 bash[28859]: cluster 2024-02-13T14:42:03.236982+0000 mon.a (mon.0) 582 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-02-13T14:42:04.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:04 smithi111 bash[23388]: cluster 2024-02-13T14:42:03.122645+0000 mgr.y (mgr.14152) 287 : cluster 0 pgmap v268: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-13T14:42:04.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:04 smithi111 bash[23388]: cluster 2024-02-13T14:42:03.236982+0000 mon.a (mon.0) 582 : cluster 0 osdmap e49: 7 total, 7 up, 7 in 2024-02-13T14:42:05.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:05 smithi062 bash[21479]: cluster 2024-02-13T14:42:04.239787+0000 mon.a (mon.0) 583 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-02-13T14:42:05.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:05 smithi062 bash[28859]: cluster 2024-02-13T14:42:04.239787+0000 mon.a (mon.0) 583 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-02-13T14:42:05.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:05 smithi111 bash[23388]: cluster 2024-02-13T14:42:04.239787+0000 mon.a (mon.0) 583 : cluster 0 osdmap e50: 7 total, 7 up, 7 in 2024-02-13T14:42:06.211 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:42:06.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:06 smithi062 bash[28859]: cluster 2024-02-13T14:42:05.123166+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v271: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-13T14:42:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:06 smithi062 bash[21479]: cluster 2024-02-13T14:42:05.123166+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v271: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-13T14:42:06.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:06 smithi111 bash[23388]: cluster 2024-02-13T14:42:05.123166+0000 mgr.y (mgr.14152) 288 : cluster 0 pgmap v271: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-02-13T14:42:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:08 smithi062 bash[28859]: cluster 2024-02-13T14:42:07.123845+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:42:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:08 smithi062 bash[21479]: cluster 2024-02-13T14:42:07.123845+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:42:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:08 smithi111 bash[23388]: cluster 2024-02-13T14:42:07.123845+0000 mgr.y (mgr.14152) 289 : cluster 0 pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:42:09.911 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-13T14:42:09.911 INFO:teuthology.orchestra.run.smithi111.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-13T14:42:09.911 INFO:teuthology.orchestra.run.smithi111.stderr: stderr: 10+0 records in 2024-02-13T14:42:09.912 INFO:teuthology.orchestra.run.smithi111.stderr:10+0 records out 2024-02-13T14:42:09.912 INFO:teuthology.orchestra.run.smithi111.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0154411 s, 679 MB/s 2024-02-13T14:42:09.912 INFO:teuthology.orchestra.run.smithi111.stderr:--> Zapping successful for: 2024-02-13T14:42:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:10 smithi062 bash[21479]: cluster 2024-02-13T14:42:09.124561+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-02-13T14:42:10.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:10 smithi062 bash[28859]: cluster 2024-02-13T14:42:09.124561+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-02-13T14:42:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:10 smithi111 bash[23388]: cluster 2024-02-13T14:42:09.124561+0000 mgr.y (mgr.14152) 290 : cluster 0 pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-02-13T14:42:10.677 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch daemon add osd smithi111:vg_nvme/lv_1 2024-02-13T14:42:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: cephadm 2024-02-13T14:42:11.041944+0000 mgr.y (mgr.14152) 291 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:42:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.050897+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.060693+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.063135+0000 mon.a (mon.0) 586 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.064689+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.066075+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: cephadm 2024-02-13T14:42:11.067314+0000 mgr.y (mgr.14152) 292 : cephadm 1 Adjusting osd_memory_target on smithi111 to 5755M 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.074900+0000 mon.a (mon.0) 589 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.080524+0000 mon.a (mon.0) 590 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.082366+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: audit 2024-02-13T14:42:11.093400+0000 mon.a (mon.0) 592 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[21479]: cluster 2024-02-13T14:42:11.125254+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: cephadm 2024-02-13T14:42:11.041944+0000 mgr.y (mgr.14152) 291 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.050897+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.060693+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.063135+0000 mon.a (mon.0) 586 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.064689+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.066075+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: cephadm 2024-02-13T14:42:11.067314+0000 mgr.y (mgr.14152) 292 : cephadm 1 Adjusting osd_memory_target on smithi111 to 5755M 2024-02-13T14:42:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.074900+0000 mon.a (mon.0) 589 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.080524+0000 mon.a (mon.0) 590 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.082366+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:42:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: audit 2024-02-13T14:42:11.093400+0000 mon.a (mon.0) 592 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:12 smithi062 bash[28859]: cluster 2024-02-13T14:42:11.125254+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:12.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: cephadm 2024-02-13T14:42:11.041944+0000 mgr.y (mgr.14152) 291 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.050897+0000 mon.a (mon.0) 584 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.060693+0000 mon.a (mon.0) 585 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.063135+0000 mon.a (mon.0) 586 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.064689+0000 mon.a (mon.0) 587 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.066075+0000 mon.a (mon.0) 588 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: cephadm 2024-02-13T14:42:11.067314+0000 mgr.y (mgr.14152) 292 : cephadm 1 Adjusting osd_memory_target on smithi111 to 5755M 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.074900+0000 mon.a (mon.0) 589 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.080524+0000 mon.a (mon.0) 590 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.082366+0000 mon.a (mon.0) 591 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: audit 2024-02-13T14:42:11.093400+0000 mon.a (mon.0) 592 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:12 smithi111 bash[23388]: cluster 2024-02-13T14:42:11.125254+0000 mgr.y (mgr.14152) 293 : cluster 0 pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:14.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:14 smithi062 bash[28859]: cluster 2024-02-13T14:42:13.125833+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:14.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:14 smithi062 bash[21479]: cluster 2024-02-13T14:42:13.125833+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:14.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:14 smithi111 bash[23388]: cluster 2024-02-13T14:42:13.125833+0000 mgr.y (mgr.14152) 294 : cluster 0 pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:15.415 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:42:16.529 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:16 smithi111 bash[23388]: cluster 2024-02-13T14:42:15.126394+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:16.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:16 smithi062 bash[21479]: cluster 2024-02-13T14:42:15.126394+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:16.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:16 smithi062 bash[28859]: cluster 2024-02-13T14:42:15.126394+0000 mgr.y (mgr.14152) 295 : cluster 0 pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:17.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- 172.21.15.111:0/1731140743 >> v1:172.21.15.111:6789/0 conn(0x7fb9381060f0 legacy=0x7fb9381084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:42:17.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- 172.21.15.111:0/1731140743 shutdown_connections 2024-02-13T14:42:17.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- 172.21.15.111:0/1731140743 >> 172.21.15.111:0/1731140743 conn(0x7fb9380fbf90 msgr2=0x7fb9380fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:42:17.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- 172.21.15.111:0/1731140743 shutdown_connections 2024-02-13T14:42:17.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- 172.21.15.111:0/1731140743 wait complete. 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 Processor -- start 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- start start 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb93810e970 con 0x7fb9381060f0 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb938197c00 con 0x7fb9381025e0 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93cf26700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb9381a43a0 con 0x7fb938109c00 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93659c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fb9381025e0 0x7fb938197050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:46580/0 (socket says 172.21.15.111:46580) 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb93659c700 1 -- 172.21.15.111:0/790818525 learned_addr learned my addr 172.21.15.111:0/790818525 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186681665 0 0) 0x7fb938197c00 con 0x7fb9381025e0 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9240035b0 con 0x7fb9381025e0 2024-02-13T14:42:17.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2834899353 0 0) 0x7fb9240035b0 con 0x7fb9381025e0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb938197c00 con 0x7fb9381025e0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb930001cb0 con 0x7fb9381025e0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583855268 0 0) 0x7fb93810e970 con 0x7fb9381060f0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9240035b0 con 0x7fb9381060f0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248189214 0 0) 0x7fb9381a43a0 con 0x7fb938109c00 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.991+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb93810e970 con 0x7fb938109c00 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 288156210 0 0) 0x7fb938197c00 con 0x7fb9381025e0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 >> v1:172.21.15.62:6790/0 conn(0x7fb938109c00 legacy=0x7fb9381a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 >> v1:172.21.15.62:6789/0 conn(0x7fb9381060f0 legacy=0x7fb93819d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9381a5540 con 0x7fb9381025e0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9381a4590 con 0x7fb9381025e0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9381a4a90 con 0x7fb9381025e0 2024-02-13T14:42:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fb930003f30 con 0x7fb9381025e0 2024-02-13T14:42:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb930006090 con 0x7fb9381025e0 2024-02-13T14:42:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb918005150 con 0x7fb9381025e0 2024-02-13T14:42:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7fb930003aa0 con 0x7fb9381025e0 2024-02-13T14:42:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.995+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(50..50 src has 1..50) v4 ==== 3789+0+0 (unknown 2183783581 0 0) 0x7fb9300888c0 con 0x7fb9381025e0 2024-02-13T14:42:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:17.999+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fb930052750 con 0x7fb9381025e0 2024-02-13T14:42:18.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:18.207+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fb918000bc0 con 0x7fb92406ed50 2024-02-13T14:42:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:18 smithi062 bash[28859]: cluster 2024-02-13T14:42:17.127008+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:18.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:18 smithi062 bash[21479]: cluster 2024-02-13T14:42:17.127008+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:18.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:18 smithi111 bash[23388]: cluster 2024-02-13T14:42:17.127008+0000 mgr.y (mgr.14152) 296 : cluster 0 pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:19 smithi062 bash[21479]: audit 2024-02-13T14:42:18.214517+0000 mgr.y (mgr.14152) 297 : audit 0 from='client.24316 v1:172.21.15.111:0/790818525' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:42:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:19 smithi062 bash[21479]: audit 2024-02-13T14:42:18.221457+0000 mon.a (mon.0) 593 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:42:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:19 smithi062 bash[21479]: audit 2024-02-13T14:42:18.228607+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:42:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:19 smithi062 bash[21479]: audit 2024-02-13T14:42:18.230142+0000 mon.a (mon.0) 595 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:19.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:19 smithi062 bash[28859]: audit 2024-02-13T14:42:18.214517+0000 mgr.y (mgr.14152) 297 : audit 0 from='client.24316 v1:172.21.15.111:0/790818525' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:42:19.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:19 smithi062 bash[28859]: audit 2024-02-13T14:42:18.221457+0000 mon.a (mon.0) 593 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:42:19.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:19 smithi062 bash[28859]: audit 2024-02-13T14:42:18.228607+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:42:19.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:19 smithi062 bash[28859]: audit 2024-02-13T14:42:18.230142+0000 mon.a (mon.0) 595 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:19 smithi111 bash[23388]: audit 2024-02-13T14:42:18.214517+0000 mgr.y (mgr.14152) 297 : audit 0 from='client.24316 v1:172.21.15.111:0/790818525' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi111:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:42:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:19 smithi111 bash[23388]: audit 2024-02-13T14:42:18.221457+0000 mon.a (mon.0) 593 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-13T14:42:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:19 smithi111 bash[23388]: audit 2024-02-13T14:42:18.228607+0000 mon.a (mon.0) 594 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-13T14:42:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:19 smithi111 bash[23388]: audit 2024-02-13T14:42:18.230142+0000 mon.a (mon.0) 595 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:20.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:20 smithi062 bash[21479]: cluster 2024-02-13T14:42:19.127566+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:20 smithi062 bash[28859]: cluster 2024-02-13T14:42:19.127566+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:20 smithi111 bash[23388]: cluster 2024-02-13T14:42:19.127566+0000 mgr.y (mgr.14152) 298 : cluster 0 pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:22.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:22 smithi062 bash[28859]: cluster 2024-02-13T14:42:21.128076+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:22 smithi062 bash[21479]: cluster 2024-02-13T14:42:21.128076+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:22.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:22 smithi111 bash[23388]: cluster 2024-02-13T14:42:21.128076+0000 mgr.y (mgr.14152) 299 : cluster 0 pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:24.262 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:24 smithi111 bash[23388]: cluster 2024-02-13T14:42:23.128632+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:24.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:24 smithi062 bash[21479]: cluster 2024-02-13T14:42:23.128632+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:24.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:24 smithi062 bash[28859]: cluster 2024-02-13T14:42:23.128632+0000 mgr.y (mgr.14152) 300 : cluster 0 pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:26.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:26 smithi062 bash[21479]: cluster 2024-02-13T14:42:25.129144+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:26.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:26 smithi062 bash[28859]: cluster 2024-02-13T14:42:25.129144+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:26.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:26 smithi111 bash[23388]: cluster 2024-02-13T14:42:25.129144+0000 mgr.y (mgr.14152) 301 : cluster 0 pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:27.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[21479]: audit 2024-02-13T14:42:26.260594+0000 mon.b (mon.1) 22 : audit 1 from='client.? v1:172.21.15.111:0/1004964705' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]: dispatch 2024-02-13T14:42:27.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[21479]: audit 2024-02-13T14:42:26.262079+0000 mon.a (mon.0) 596 : audit 1 from='client.24322 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]: dispatch 2024-02-13T14:42:27.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[21479]: audit 2024-02-13T14:42:26.265640+0000 mon.a (mon.0) 597 : audit 1 from='client.24322 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]': finished 2024-02-13T14:42:27.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[21479]: cluster 2024-02-13T14:42:26.271225+0000 mon.a (mon.0) 598 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-02-13T14:42:27.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[21479]: audit 2024-02-13T14:42:26.272029+0000 mon.a (mon.0) 599 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:27.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[21479]: audit 2024-02-13T14:42:26.970821+0000 mon.b (mon.1) 23 : audit 0 from='client.? v1:172.21.15.111:0/160968137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:42:27.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[28859]: audit 2024-02-13T14:42:26.260594+0000 mon.b (mon.1) 22 : audit 1 from='client.? v1:172.21.15.111:0/1004964705' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]: dispatch 2024-02-13T14:42:27.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[28859]: audit 2024-02-13T14:42:26.262079+0000 mon.a (mon.0) 596 : audit 1 from='client.24322 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]: dispatch 2024-02-13T14:42:27.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[28859]: audit 2024-02-13T14:42:26.265640+0000 mon.a (mon.0) 597 : audit 1 from='client.24322 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]': finished 2024-02-13T14:42:27.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[28859]: cluster 2024-02-13T14:42:26.271225+0000 mon.a (mon.0) 598 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-02-13T14:42:27.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[28859]: audit 2024-02-13T14:42:26.272029+0000 mon.a (mon.0) 599 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:27.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:27 smithi062 bash[28859]: audit 2024-02-13T14:42:26.970821+0000 mon.b (mon.1) 23 : audit 0 from='client.? v1:172.21.15.111:0/160968137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:42:27.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:27 smithi111 bash[23388]: audit 2024-02-13T14:42:26.260594+0000 mon.b (mon.1) 22 : audit 1 from='client.? v1:172.21.15.111:0/1004964705' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]: dispatch 2024-02-13T14:42:27.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:27 smithi111 bash[23388]: audit 2024-02-13T14:42:26.262079+0000 mon.a (mon.0) 596 : audit 1 from='client.24322 ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]: dispatch 2024-02-13T14:42:27.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:27 smithi111 bash[23388]: audit 2024-02-13T14:42:26.265640+0000 mon.a (mon.0) 597 : audit 1 from='client.24322 ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2b696400-d368-44a0-b57a-71c31e8292f0"}]': finished 2024-02-13T14:42:27.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:27 smithi111 bash[23388]: cluster 2024-02-13T14:42:26.271225+0000 mon.a (mon.0) 598 : cluster 0 osdmap e51: 8 total, 7 up, 8 in 2024-02-13T14:42:27.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:27 smithi111 bash[23388]: audit 2024-02-13T14:42:26.272029+0000 mon.a (mon.0) 599 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:27.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:27 smithi111 bash[23388]: audit 2024-02-13T14:42:26.970821+0000 mon.b (mon.1) 23 : audit 0 from='client.? v1:172.21.15.111:0/160968137' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-13T14:42:28.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:28 smithi062 bash[21479]: cluster 2024-02-13T14:42:27.129699+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:28.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:28 smithi062 bash[28859]: cluster 2024-02-13T14:42:27.129699+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:28 smithi111 bash[23388]: cluster 2024-02-13T14:42:27.129699+0000 mgr.y (mgr.14152) 302 : cluster 0 pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:30.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:30 smithi062 bash[21479]: cluster 2024-02-13T14:42:29.130301+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:30.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:30 smithi062 bash[28859]: cluster 2024-02-13T14:42:29.130301+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:30.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:30 smithi111 bash[23388]: cluster 2024-02-13T14:42:29.130301+0000 mgr.y (mgr.14152) 303 : cluster 0 pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:32.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:32 smithi062 bash[21479]: cluster 2024-02-13T14:42:31.130847+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:32.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:32 smithi062 bash[28859]: cluster 2024-02-13T14:42:31.130847+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:32 smithi111 bash[23388]: cluster 2024-02-13T14:42:31.130847+0000 mgr.y (mgr.14152) 304 : cluster 0 pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:34.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:34 smithi062 bash[21479]: cluster 2024-02-13T14:42:33.131366+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:34.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:34 smithi062 bash[28859]: cluster 2024-02-13T14:42:33.131366+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:34.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:34 smithi111 bash[23388]: cluster 2024-02-13T14:42:33.131366+0000 mgr.y (mgr.14152) 305 : cluster 0 pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:36.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:36 smithi062 bash[21479]: cluster 2024-02-13T14:42:35.131884+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:36.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:36 smithi062 bash[28859]: cluster 2024-02-13T14:42:35.131884+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:36.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:36 smithi111 bash[23388]: cluster 2024-02-13T14:42:35.131884+0000 mgr.y (mgr.14152) 306 : cluster 0 pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:38.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:38 smithi062 bash[21479]: cluster 2024-02-13T14:42:37.132457+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:38.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:38 smithi062 bash[28859]: cluster 2024-02-13T14:42:37.132457+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:38.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:38 smithi111 bash[23388]: cluster 2024-02-13T14:42:37.132457+0000 mgr.y (mgr.14152) 307 : cluster 0 pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:39.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:39 smithi062 bash[21479]: audit 2024-02-13T14:42:38.523611+0000 mon.a (mon.0) 600 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-13T14:42:39.632 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:39 smithi062 bash[21479]: audit 2024-02-13T14:42:38.525374+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:39.632 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:39 smithi062 bash[21479]: cephadm 2024-02-13T14:42:38.526948+0000 mgr.y (mgr.14152) 308 : cephadm 1 Deploying daemon osd.7 on smithi111 2024-02-13T14:42:39.633 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:39 smithi062 bash[28859]: audit 2024-02-13T14:42:38.523611+0000 mon.a (mon.0) 600 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-13T14:42:39.633 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:39 smithi062 bash[28859]: audit 2024-02-13T14:42:38.525374+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:39.633 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:39 smithi062 bash[28859]: cephadm 2024-02-13T14:42:38.526948+0000 mgr.y (mgr.14152) 308 : cephadm 1 Deploying daemon osd.7 on smithi111 2024-02-13T14:42:39.636 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:39 smithi111 bash[23388]: audit 2024-02-13T14:42:38.523611+0000 mon.a (mon.0) 600 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-13T14:42:39.636 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:39 smithi111 bash[23388]: audit 2024-02-13T14:42:38.525374+0000 mon.a (mon.0) 601 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:39.636 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:39 smithi111 bash[23388]: cephadm 2024-02-13T14:42:38.526948+0000 mgr.y (mgr.14152) 308 : cephadm 1 Deploying daemon osd.7 on smithi111 2024-02-13T14:42:40.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:40 smithi062 bash[21479]: cluster 2024-02-13T14:42:39.133028+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:40.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:40 smithi062 bash[28859]: cluster 2024-02-13T14:42:39.133028+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:40.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:40 smithi111 bash[23388]: cluster 2024-02-13T14:42:39.133028+0000 mgr.y (mgr.14152) 309 : cluster 0 pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:42.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:42 smithi062 bash[21479]: cluster 2024-02-13T14:42:41.133597+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:42 smithi062 bash[28859]: cluster 2024-02-13T14:42:41.133597+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:42 smithi111 bash[23388]: cluster 2024-02-13T14:42:41.133597+0000 mgr.y (mgr.14152) 310 : cluster 0 pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.594 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.594 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.594 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.852 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.853 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.853 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.853 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:42.854 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:42:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:42:44.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:43 smithi111 bash[23388]: audit 2024-02-13T14:42:42.910625+0000 mon.a (mon.0) 602 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:44.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:43 smithi111 bash[23388]: audit 2024-02-13T14:42:42.915800+0000 mon.a (mon.0) 603 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:44.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:43 smithi111 bash[23388]: audit 2024-02-13T14:42:42.920887+0000 mon.a (mon.0) 604 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:44.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:43 smithi111 bash[23388]: cluster 2024-02-13T14:42:43.134159+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:44.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:43 smithi062 bash[21479]: audit 2024-02-13T14:42:42.910625+0000 mon.a (mon.0) 602 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:44.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:43 smithi062 bash[21479]: audit 2024-02-13T14:42:42.915800+0000 mon.a (mon.0) 603 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:44.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:43 smithi062 bash[21479]: audit 2024-02-13T14:42:42.920887+0000 mon.a (mon.0) 604 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:44.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:43 smithi062 bash[21479]: cluster 2024-02-13T14:42:43.134159+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:44.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:43 smithi062 bash[28859]: audit 2024-02-13T14:42:42.910625+0000 mon.a (mon.0) 602 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:44.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:43 smithi062 bash[28859]: audit 2024-02-13T14:42:42.915800+0000 mon.a (mon.0) 603 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:44.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:43 smithi062 bash[28859]: audit 2024-02-13T14:42:42.920887+0000 mon.a (mon.0) 604 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:44.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:43 smithi062 bash[28859]: cluster 2024-02-13T14:42:43.134159+0000 mgr.y (mgr.14152) 311 : cluster 0 pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:46.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:46 smithi062 bash[28859]: cluster 2024-02-13T14:42:45.134752+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:46 smithi062 bash[21479]: cluster 2024-02-13T14:42:45.134752+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:46.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:46 smithi111 bash[23388]: cluster 2024-02-13T14:42:45.134752+0000 mgr.y (mgr.14152) 312 : cluster 0 pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:48.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:48 smithi062 bash[21479]: cluster 2024-02-13T14:42:47.135268+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:48.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:48 smithi062 bash[28859]: cluster 2024-02-13T14:42:47.135268+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:48.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:48 smithi111 bash[23388]: cluster 2024-02-13T14:42:47.135268+0000 mgr.y (mgr.14152) 313 : cluster 0 pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:49.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:49 smithi111 bash[23388]: audit 2024-02-13T14:42:49.034283+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.111:6812/1629494259' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T14:42:49.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:49 smithi111 bash[23388]: audit 2024-02-13T14:42:49.035432+0000 mon.a (mon.0) 605 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T14:42:49.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:49 smithi062 bash[21479]: audit 2024-02-13T14:42:49.034283+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.111:6812/1629494259' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T14:42:49.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:49 smithi062 bash[21479]: audit 2024-02-13T14:42:49.035432+0000 mon.a (mon.0) 605 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T14:42:49.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:49 smithi062 bash[28859]: audit 2024-02-13T14:42:49.034283+0000 mon.b (mon.1) 24 : audit 1 from='osd.7 v1:172.21.15.111:6812/1629494259' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T14:42:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:49 smithi062 bash[28859]: audit 2024-02-13T14:42:49.035432+0000 mon.a (mon.0) 605 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-13T14:42:50.441 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: cluster 2024-02-13T14:42:49.135835+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:50.441 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.203291+0000 mon.a (mon.0) 606 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-13T14:42:50.441 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.208622+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v1:172.21.15.111:6812/1629494259' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:42:50.441 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: cluster 2024-02-13T14:42:49.209207+0000 mon.a (mon.0) 607 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-02-13T14:42:50.441 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.209863+0000 mon.a (mon.0) 608 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:50.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.210737+0000 mon.a (mon.0) 609 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:42:50.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.783491+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:50.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.793893+0000 mon.a (mon.0) 611 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:50.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.796216+0000 mon.a (mon.0) 612 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:50.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.798135+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:42:50.442 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:50 smithi111 bash[23388]: audit 2024-02-13T14:42:49.808653+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:50.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: cluster 2024-02-13T14:42:49.135835+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:50.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.203291+0000 mon.a (mon.0) 606 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-13T14:42:50.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.208622+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v1:172.21.15.111:6812/1629494259' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:42:50.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: cluster 2024-02-13T14:42:49.209207+0000 mon.a (mon.0) 607 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-02-13T14:42:50.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.209863+0000 mon.a (mon.0) 608 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.210737+0000 mon.a (mon.0) 609 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.783491+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.793893+0000 mon.a (mon.0) 611 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.796216+0000 mon.a (mon.0) 612 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.798135+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[21479]: audit 2024-02-13T14:42:49.808653+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: cluster 2024-02-13T14:42:49.135835+0000 mgr.y (mgr.14152) 314 : cluster 0 pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.203291+0000 mon.a (mon.0) 606 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.208622+0000 mon.b (mon.1) 25 : audit 1 from='osd.7 v1:172.21.15.111:6812/1629494259' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: cluster 2024-02-13T14:42:49.209207+0000 mon.a (mon.0) 607 : cluster 0 osdmap e52: 8 total, 7 up, 8 in 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.209863+0000 mon.a (mon.0) 608 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.210737+0000 mon.a (mon.0) 609 : audit 1 from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]: dispatch 2024-02-13T14:42:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.783491+0000 mon.a (mon.0) 610 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.793893+0000 mon.a (mon.0) 611 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.796216+0000 mon.a (mon.0) 612 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:42:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.798135+0000 mon.a (mon.0) 613 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:42:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:50 smithi062 bash[28859]: audit 2024-02-13T14:42:49.808653+0000 mon.a (mon.0) 614 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[21479]: audit 2024-02-13T14:42:50.207700+0000 mon.a (mon.0) 615 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:42:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[21479]: cluster 2024-02-13T14:42:50.214920+0000 mon.a (mon.0) 616 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-02-13T14:42:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[21479]: audit 2024-02-13T14:42:50.215839+0000 mon.a (mon.0) 617 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[21479]: cluster 2024-02-13T14:42:51.155692+0000 mon.a (mon.0) 618 : cluster 1 osd.7 v1:172.21.15.111:6812/1629494259 boot 2024-02-13T14:42:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[21479]: cluster 2024-02-13T14:42:51.155792+0000 mon.a (mon.0) 619 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-02-13T14:42:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[21479]: audit 2024-02-13T14:42:51.156133+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:51.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[28859]: audit 2024-02-13T14:42:50.207700+0000 mon.a (mon.0) 615 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:42:51.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[28859]: cluster 2024-02-13T14:42:50.214920+0000 mon.a (mon.0) 616 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-02-13T14:42:51.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[28859]: audit 2024-02-13T14:42:50.215839+0000 mon.a (mon.0) 617 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:51.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[28859]: cluster 2024-02-13T14:42:51.155692+0000 mon.a (mon.0) 618 : cluster 1 osd.7 v1:172.21.15.111:6812/1629494259 boot 2024-02-13T14:42:51.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[28859]: cluster 2024-02-13T14:42:51.155792+0000 mon.a (mon.0) 619 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-02-13T14:42:51.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:51 smithi062 bash[28859]: audit 2024-02-13T14:42:51.156133+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:51 smithi111 bash[23388]: audit 2024-02-13T14:42:50.207700+0000 mon.a (mon.0) 615 : audit 1 from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi111", "root=default"]}]': finished 2024-02-13T14:42:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:51 smithi111 bash[23388]: cluster 2024-02-13T14:42:50.214920+0000 mon.a (mon.0) 616 : cluster 0 osdmap e53: 8 total, 7 up, 8 in 2024-02-13T14:42:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:51 smithi111 bash[23388]: audit 2024-02-13T14:42:50.215839+0000 mon.a (mon.0) 617 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:51 smithi111 bash[23388]: cluster 2024-02-13T14:42:51.155692+0000 mon.a (mon.0) 618 : cluster 1 osd.7 v1:172.21.15.111:6812/1629494259 boot 2024-02-13T14:42:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:51 smithi111 bash[23388]: cluster 2024-02-13T14:42:51.155792+0000 mon.a (mon.0) 619 : cluster 0 osdmap e54: 8 total, 8 up, 8 in 2024-02-13T14:42:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:51 smithi111 bash[23388]: audit 2024-02-13T14:42:51.156133+0000 mon.a (mon.0) 620 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:42:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:52 smithi062 bash[28859]: cluster 2024-02-13T14:42:50.081563+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:42:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:52 smithi062 bash[28859]: cluster 2024-02-13T14:42:50.081678+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:42:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:52 smithi062 bash[28859]: cluster 2024-02-13T14:42:51.136393+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:52 smithi062 bash[28859]: cluster 2024-02-13T14:42:52.157613+0000 mon.a (mon.0) 621 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-02-13T14:42:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:52 smithi062 bash[21479]: cluster 2024-02-13T14:42:50.081563+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:42:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:52 smithi062 bash[21479]: cluster 2024-02-13T14:42:50.081678+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:42:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:52 smithi062 bash[21479]: cluster 2024-02-13T14:42:51.136393+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:52.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:52 smithi062 bash[21479]: cluster 2024-02-13T14:42:52.157613+0000 mon.a (mon.0) 621 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-02-13T14:42:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:52 smithi111 bash[23388]: cluster 2024-02-13T14:42:50.081563+0000 osd.7 (osd.7) 1 : cluster 0 purged_snaps scrub starts 2024-02-13T14:42:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:52 smithi111 bash[23388]: cluster 2024-02-13T14:42:50.081678+0000 osd.7 (osd.7) 2 : cluster 0 purged_snaps scrub ok 2024-02-13T14:42:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:52 smithi111 bash[23388]: cluster 2024-02-13T14:42:51.136393+0000 mgr.y (mgr.14152) 315 : cluster 0 pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-02-13T14:42:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:52 smithi111 bash[23388]: cluster 2024-02-13T14:42:52.157613+0000 mon.a (mon.0) 621 : cluster 0 osdmap e55: 8 total, 8 up, 8 in 2024-02-13T14:42:52.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:52.930+0000 7fb92f7fe700 1 -- 172.21.15.111:0/790818525 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (unknown 0 0 3439415270) 0x7fb918000bc0 con 0x7fb92406ed50 2024-02-13T14:42:52.933 INFO:teuthology.orchestra.run.smithi111.stdout:Created osd(s) 7 on host 'smithi111' 2024-02-13T14:42:52.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:52.930+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 >> v1:172.21.15.62:6800/1926838190 conn(0x7fb92406ed50 legacy=0x7fb924071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:42:52.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:52.930+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 >> v1:172.21.15.111:6789/0 conn(0x7fb9381025e0 legacy=0x7fb938197050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:42:52.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:52.930+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 shutdown_connections 2024-02-13T14:42:52.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:52.930+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 >> 172.21.15.111:0/790818525 conn(0x7fb9380fbf90 msgr2=0x7fb93810c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:42:52.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:52.934+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 shutdown_connections 2024-02-13T14:42:52.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:42:52.934+0000 7fb93cf26700 1 -- 172.21.15.111:0/790818525 wait complete. 2024-02-13T14:42:53.563 DEBUG:teuthology.orchestra.run.smithi111:osd.7> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.7.service 2024-02-13T14:42:53.574 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-13T14:42:53.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd stat -f json 2024-02-13T14:42:54.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[21479]: audit 2024-02-13T14:42:52.881295+0000 mon.a (mon.0) 622 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:54.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[21479]: audit 2024-02-13T14:42:52.891522+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:54.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[21479]: audit 2024-02-13T14:42:52.904472+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:54.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[21479]: cluster 2024-02-13T14:42:53.136956+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v300: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:42:54.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[21479]: cluster 2024-02-13T14:42:53.161740+0000 mon.a (mon.0) 625 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-02-13T14:42:54.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[28859]: audit 2024-02-13T14:42:52.881295+0000 mon.a (mon.0) 622 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:54.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[28859]: audit 2024-02-13T14:42:52.891522+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:54.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[28859]: audit 2024-02-13T14:42:52.904472+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:54.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[28859]: cluster 2024-02-13T14:42:53.136956+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v300: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:42:54.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:53 smithi062 bash[28859]: cluster 2024-02-13T14:42:53.161740+0000 mon.a (mon.0) 625 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-02-13T14:42:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:53 smithi111 bash[23388]: audit 2024-02-13T14:42:52.881295+0000 mon.a (mon.0) 622 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:53 smithi111 bash[23388]: audit 2024-02-13T14:42:52.891522+0000 mon.a (mon.0) 623 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:42:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:53 smithi111 bash[23388]: audit 2024-02-13T14:42:52.904472+0000 mon.a (mon.0) 624 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:42:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:53 smithi111 bash[23388]: cluster 2024-02-13T14:42:53.136956+0000 mgr.y (mgr.14152) 316 : cluster 0 pgmap v300: 1 pgs: 1 remapped+peering; 577 KiB data, 236 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:42:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:53 smithi111 bash[23388]: cluster 2024-02-13T14:42:53.161740+0000 mon.a (mon.0) 625 : cluster 0 osdmap e56: 8 total, 8 up, 8 in 2024-02-13T14:42:55.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:55 smithi062 bash[21479]: cluster 2024-02-13T14:42:54.163291+0000 mon.a (mon.0) 626 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-02-13T14:42:55.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:55 smithi062 bash[28859]: cluster 2024-02-13T14:42:54.163291+0000 mon.a (mon.0) 626 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-02-13T14:42:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:55 smithi111 bash[23388]: cluster 2024-02-13T14:42:54.163291+0000 mon.a (mon.0) 626 : cluster 0 osdmap e57: 8 total, 8 up, 8 in 2024-02-13T14:42:56.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:56 smithi062 bash[21479]: cluster 2024-02-13T14:42:55.137508+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v303: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:42:56.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:56 smithi062 bash[21479]: cluster 2024-02-13T14:42:55.173619+0000 mon.a (mon.0) 627 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-02-13T14:42:56.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:56 smithi062 bash[28859]: cluster 2024-02-13T14:42:55.137508+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v303: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:42:56.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:56 smithi062 bash[28859]: cluster 2024-02-13T14:42:55.173619+0000 mon.a (mon.0) 627 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-02-13T14:42:56.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:56 smithi111 bash[23388]: cluster 2024-02-13T14:42:55.137508+0000 mgr.y (mgr.14152) 317 : cluster 0 pgmap v303: 1 pgs: 1 remapped+peering; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:42:56.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:56 smithi111 bash[23388]: cluster 2024-02-13T14:42:55.173619+0000 mon.a (mon.0) 627 : cluster 0 osdmap e58: 8 total, 8 up, 8 in 2024-02-13T14:42:58.343 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:42:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:42:58 smithi062 bash[21479]: cluster 2024-02-13T14:42:57.138125+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-02-13T14:42:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:42:58 smithi062 bash[28859]: cluster 2024-02-13T14:42:57.138125+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-02-13T14:42:58.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:42:58 smithi111 bash[23388]: cluster 2024-02-13T14:42:57.138125+0000 mgr.y (mgr.14152) 318 : cluster 0 pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 116 KiB/s, 0 objects/s recovering 2024-02-13T14:43:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:00 smithi062 bash[21479]: cluster 2024-02-13T14:42:59.138741+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:43:00.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:00 smithi062 bash[28859]: cluster 2024-02-13T14:42:59.138741+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:43:00.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:00 smithi111 bash[23388]: cluster 2024-02-13T14:42:59.138741+0000 mgr.y (mgr.14152) 319 : cluster 0 pgmap v306: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-13T14:43:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- 172.21.15.62:0/945186217 >> v1:172.21.15.62:6789/0 conn(0x7f0ba8108110 legacy=0x7f0ba810a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- 172.21.15.62:0/945186217 shutdown_connections 2024-02-13T14:43:01.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- 172.21.15.62:0/945186217 >> 172.21.15.62:0/945186217 conn(0x7f0ba80ff280 msgr2=0x7f0ba81016c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- 172.21.15.62:0/945186217 shutdown_connections 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- 172.21.15.62:0/945186217 wait complete. 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 Processor -- start 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- start start 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0ba8199a60 con 0x7f0ba810be50 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0ba81a5250 con 0x7f0ba8103ce0 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0ba81a63f0 con 0x7f0ba8108110 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0bac8d5700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f0ba8108110 0x7f0ba819f3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:36672/0 (socket says 172.21.15.62:36672) 2024-02-13T14:43:01.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0bac8d5700 1 -- 172.21.15.62:0/3214692104 learned_addr learned my addr 172.21.15.62:0/3214692104 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:43:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364827343 0 0) 0x7f0ba81a63f0 con 0x7f0ba8108110 2024-02-13T14:43:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b940035b0 con 0x7f0ba8108110 2024-02-13T14:43:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002746294 0 0) 0x7f0ba8199a60 con 0x7f0ba810be50 2024-02-13T14:43:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba81a63f0 con 0x7f0ba810be50 2024-02-13T14:43:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1468968108 0 0) 0x7f0b940035b0 con 0x7f0ba8108110 2024-02-13T14:43:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0ba8199a60 con 0x7f0ba8108110 2024-02-13T14:43:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f0b98004540 con 0x7f0ba8108110 2024-02-13T14:43:01.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 674753159 0 0) 0x7f0ba81a63f0 con 0x7f0ba810be50 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b940035b0 con 0x7f0ba810be50 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2895470095 0 0) 0x7f0ba81a5250 con 0x7f0ba8103ce0 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba81a63f0 con 0x7f0ba8103ce0 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f0b90001770 con 0x7f0ba810be50 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1573194836 0 0) 0x7f0ba8199a60 con 0x7f0ba8108110 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 >> v1:172.21.15.111:6789/0 conn(0x7f0ba8103ce0 legacy=0x7f0ba8198f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 >> v1:172.21.15.62:6789/0 conn(0x7f0ba810be50 legacy=0x7f0ba81a2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba81a7590 con 0x7f0ba8108110 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba81a42a0 con 0x7f0ba8108110 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba81a47a0 con 0x7f0ba8108110 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f0b98001a70 con 0x7f0ba8108110 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f0b98004e40 con 0x7f0ba8108110 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.642+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b88005150 con 0x7f0ba8108110 2024-02-13T14:43:01.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.646+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7f0b980050d0 con 0x7f0ba8108110 2024-02-13T14:43:01.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.646+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(58..58 src has 1..58) v4 ==== 4081+0+0 (unknown 792489679 0 0) 0x7f0b98088af0 con 0x7f0ba8108110 2024-02-13T14:43:01.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.650+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f0b98052850 con 0x7f0ba8108110 2024-02-13T14:43:01.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.862+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f0b88005400 con 0x7f0ba8108110 2024-02-13T14:43:01.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.862+0000 7f0ba67fc700 1 -- 172.21.15.62:0/3214692104 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v58) v1 ==== 74+0+130 (unknown 4023224526 0 3936337569) 0x7f0b98054780 con 0x7f0ba8108110 2024-02-13T14:43:01.863 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:43:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.866+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 >> v1:172.21.15.62:6800/1926838190 conn(0x7f0b9406edc0 legacy=0x7f0b94071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.866+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 >> v1:172.21.15.62:6790/0 conn(0x7f0ba8108110 legacy=0x7f0ba819f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.866+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 shutdown_connections 2024-02-13T14:43:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.866+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 >> 172.21.15.62:0/3214692104 conn(0x7f0ba80ff280 msgr2=0x7f0ba810a560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.866+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 shutdown_connections 2024-02-13T14:43:01.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:01.866+0000 7f0baf33a700 1 -- 172.21.15.62:0/3214692104 wait complete. 2024-02-13T14:43:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: cluster 2024-02-13T14:43:01.139322+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-13T14:43:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.865305+0000 mon.c (mon.2) 15 : audit 0 from='client.? v1:172.21.15.62:0/3214692104' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-13T14:43:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.899734+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.906070+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.907408+0000 mon.a (mon.0) 630 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.908179+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.908891+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.909745+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.916223+0000 mon.a (mon.0) 634 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.917977+0000 mon.a (mon.0) 635 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.918631+0000 mon.a (mon.0) 636 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[21479]: audit 2024-02-13T14:43:01.924936+0000 mon.a (mon.0) 637 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: cluster 2024-02-13T14:43:01.139322+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.865305+0000 mon.c (mon.2) 15 : audit 0 from='client.? v1:172.21.15.62:0/3214692104' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.899734+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.906070+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.907408+0000 mon.a (mon.0) 630 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.908179+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.908891+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.909745+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.916223+0000 mon.a (mon.0) 634 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.917977+0000 mon.a (mon.0) 635 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.918631+0000 mon.a (mon.0) 636 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:02 smithi062 bash[28859]: audit 2024-02-13T14:43:01.924936+0000 mon.a (mon.0) 637 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: cluster 2024-02-13T14:43:01.139322+0000 mgr.y (mgr.14152) 320 : cluster 0 pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.865305+0000 mon.c (mon.2) 15 : audit 0 from='client.? v1:172.21.15.62:0/3214692104' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.899734+0000 mon.a (mon.0) 628 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.906070+0000 mon.a (mon.0) 629 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.907408+0000 mon.a (mon.0) 630 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.908179+0000 mon.a (mon.0) 631 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.908891+0000 mon.a (mon.0) 632 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.909745+0000 mon.a (mon.0) 633 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.916223+0000 mon.a (mon.0) 634 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.917977+0000 mon.a (mon.0) 635 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.918631+0000 mon.a (mon.0) 636 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:02 smithi111 bash[23388]: audit 2024-02-13T14:43:01.924936+0000 mon.a (mon.0) 637 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:02.829 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1707835371,"num_in_osds":8,"osd_in_since":1707835346,"num_remapped_pgs":0} 2024-02-13T14:43:02.830 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-13T14:43:03.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:03 smithi062 bash[21479]: cephadm 2024-02-13T14:43:01.894962+0000 mgr.y (mgr.14152) 321 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:43:03.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:03 smithi062 bash[21479]: cephadm 2024-02-13T14:43:01.910716+0000 mgr.y (mgr.14152) 322 : cephadm 1 Adjusting osd_memory_target on smithi111 to 4316M 2024-02-13T14:43:03.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:03 smithi062 bash[28859]: cephadm 2024-02-13T14:43:01.894962+0000 mgr.y (mgr.14152) 321 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:43:03.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:03 smithi062 bash[28859]: cephadm 2024-02-13T14:43:01.910716+0000 mgr.y (mgr.14152) 322 : cephadm 1 Adjusting osd_memory_target on smithi111 to 4316M 2024-02-13T14:43:03.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:03 smithi111 bash[23388]: cephadm 2024-02-13T14:43:01.894962+0000 mgr.y (mgr.14152) 321 : cephadm 1 Detected new or changed devices on smithi111 2024-02-13T14:43:03.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:03 smithi111 bash[23388]: cephadm 2024-02-13T14:43:01.910716+0000 mgr.y (mgr.14152) 322 : cephadm 1 Adjusting osd_memory_target on smithi111 to 4316M 2024-02-13T14:43:04.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:04 smithi062 bash[21479]: cluster 2024-02-13T14:43:03.139901+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-13T14:43:04.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:04 smithi062 bash[28859]: cluster 2024-02-13T14:43:03.139901+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-13T14:43:04.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:04 smithi111 bash[23388]: cluster 2024-02-13T14:43:03.139901+0000 mgr.y (mgr.14152) 323 : cluster 0 pgmap v308: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-02-13T14:43:06.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:06 smithi062 bash[28859]: cluster 2024-02-13T14:43:05.140543+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:43:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:06 smithi062 bash[21479]: cluster 2024-02-13T14:43:05.140543+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:43:06.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:06 smithi111 bash[23388]: cluster 2024-02-13T14:43:05.140543+0000 mgr.y (mgr.14152) 324 : cluster 0 pgmap v309: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-02-13T14:43:07.596 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:43:08.517 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:08 smithi062 bash[21479]: cluster 2024-02-13T14:43:07.141166+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:43:08.517 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:08 smithi062 bash[28859]: cluster 2024-02-13T14:43:07.141166+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:43:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:08 smithi111 bash[23388]: cluster 2024-02-13T14:43:07.141166+0000 mgr.y (mgr.14152) 325 : cluster 0 pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-02-13T14:43:10.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- 172.21.15.62:0/2123804119 >> v1:172.21.15.62:6789/0 conn(0x7fc950110710 legacy=0x7fc950112bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:10.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- 172.21.15.62:0/2123804119 shutdown_connections 2024-02-13T14:43:10.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- 172.21.15.62:0/2123804119 >> 172.21.15.62:0/2123804119 conn(0x7fc9500fd560 msgr2=0x7fc9500ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:10.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- 172.21.15.62:0/2123804119 shutdown_connections 2024-02-13T14:43:10.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- 172.21.15.62:0/2123804119 wait complete. 2024-02-13T14:43:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 Processor -- start 2024-02-13T14:43:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- start start 2024-02-13T14:43:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc9501a8980 con 0x7fc950110710 2024-02-13T14:43:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc9501a9b60 con 0x7fc9500740a0 2024-02-13T14:43:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc955975700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc9501aad40 con 0x7fc950074b90 2024-02-13T14:43:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc94f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc950110710 0x7fc9501a7190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33008/0 (socket says 172.21.15.62:33008) 2024-02-13T14:43:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc94f7fe700 1 -- 172.21.15.62:0/750154100 learned_addr learned my addr 172.21.15.62:0/750154100 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:43:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc94e7fc700 1 --1- 172.21.15.62:0/750154100 >> v1:172.21.15.62:6790/0 conn(0x7fc950074b90 0x7fc9501a3a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:36684/0 (socket says 172.21.15.62:36684) 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682142667 0 0) 0x7fc9501a8980 con 0x7fc950110710 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc93c0035b0 con 0x7fc950110710 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1426407798 0 0) 0x7fc9501aad40 con 0x7fc950074b90 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9501a8980 con 0x7fc950074b90 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423435647 0 0) 0x7fc9501a9b60 con 0x7fc9500740a0 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9501aad40 con 0x7fc9500740a0 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2636318345 0 0) 0x7fc93c0035b0 con 0x7fc950110710 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc9501a9b60 con 0x7fc950110710 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fc9480047e0 con 0x7fc950110710 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3630671265 0 0) 0x7fc9501a8980 con 0x7fc950074b90 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc93c0035b0 con 0x7fc950074b90 2024-02-13T14:43:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.422+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fc940001830 con 0x7fc950074b90 2024-02-13T14:43:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 936732682 0 0) 0x7fc9501a9b60 con 0x7fc950110710 2024-02-13T14:43:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 >> v1:172.21.15.62:6790/0 conn(0x7fc950074b90 legacy=0x7fc9501a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 >> v1:172.21.15.111:6789/0 conn(0x7fc9500740a0 legacy=0x7fc95010c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9501abf40 con 0x7fc950110710 2024-02-13T14:43:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9501a8b70 con 0x7fc950110710 2024-02-13T14:43:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9501a8ff0 con 0x7fc950110710 2024-02-13T14:43:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fc948001eb0 con 0x7fc950110710 2024-02-13T14:43:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fc948005170 con 0x7fc950110710 2024-02-13T14:43:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc930005120 con 0x7fc950110710 2024-02-13T14:43:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7fc9480052f0 con 0x7fc950110710 2024-02-13T14:43:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.426+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(58..58 src has 1..58) v4 ==== 4081+0+0 (unknown 792489679 0 0) 0x7fc948088990 con 0x7fc950110710 2024-02-13T14:43:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.430+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fc948052690 con 0x7fc950110710 2024-02-13T14:43:10.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:10 smithi062 bash[21479]: cluster 2024-02-13T14:43:09.141674+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:10.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:10 smithi062 bash[28859]: cluster 2024-02-13T14:43:09.141674+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:10 smithi111 bash[23388]: cluster 2024-02-13T14:43:09.141674+0000 mgr.y (mgr.14152) 326 : cluster 0 pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:10.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.642+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9300053d0 con 0x7fc950110710 2024-02-13T14:43:10.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.646+0000 7fc954973700 1 -- 172.21.15.62:0/750154100 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+11493 (unknown 2626357731 0 2872868309) 0x7fc9480545c0 con 0x7fc950110710 2024-02-13T14:43:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:43:10.645 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":58,"fsid":"9cdb3692-ca7c-11ee-95b9-87774f69a715","created":"2024-02-13T14:33:15.381692+0000","modified":"2024-02-13T14:42:55.158393+0000","last_up_change":"2024-02-13T14:42:51.147139+0000","last_in_change":"2024-02-13T14:42:26.263327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-13T14:38:35.651796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eacc17ac-916e-4f02-9a42-5de004ec7580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":143174597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":143174597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":143174597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":143174597}]},"public_addr":"172.21.15.62:6801/143174597","cluster_addr":"172.21.15.62:6802/143174597","heartbeat_back_addr":"172.21.15.62:6804/143174597","heartbeat_front_addr":"172.21.15.62:6803/143174597","state":["exists","up"]},{"osd":1,"uuid":"21062ebc-0d8d-481b-95b0-1b10c843bcab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":3280693362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":3280693362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":3280693362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":3280693362}]},"public_addr":"172.21.15.62:6805/3280693362","cluster_addr":"172.21.15.62:6806/3280693362","heartbeat_back_addr":"172.21.15.62:6808/3280693362","heartbeat_front_addr":"172.21.15.62:6807/3280693362","state":["exists","up"]},{"osd":2,"uuid":"932f8b3b-9b78-4433-9c7d-fe36ee894656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":1346690857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":1346690857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":1346690857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":1346690857}]},"public_addr":"172.21.15.62:6809/1346690857","cluster_addr":"172.21.15.62:6810/1346690857","heartbeat_back_addr":"172.21.15.62:6812/1346690857","heartbeat_front_addr":"172.21.15.62:6811/1346690857","state":["exists","up"]},{"osd":3,"uuid":"7eca01f3-8960-425b-887d-20f66959978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":1701426775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":1701426775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6816","nonce":1701426775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":1701426775}]},"public_addr":"172.21.15.62:6813/1701426775","cluster_addr":"172.21.15.62:6814/1701426775","heartbeat_back_addr":"172.21.15.62:6816/1701426775","heartbeat_front_addr":"172.21.15.62:6815/1701426775","state":["exists","up"]},{"osd":4,"uuid":"e55ae8d9-af71-443f-b9e0-0a59ceb52b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":1278246464}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":1278246464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":1278246464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":1278246464}]},"public_addr":"172.21.15.111:6800/1278246464","cluster_addr":"172.21.15.111:6801/1278246464","heartbeat_back_addr":"172.21.15.111:6803/1278246464","heartbeat_front_addr":"172.21.15.111:6802/1278246464","state":["exists","up"]},{"osd":5,"uuid":"b5b44f2d-fb54-4f64-b523-7ff9f373ec4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":575601374}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":575601374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":575601374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":575601374}]},"public_addr":"172.21.15.111:6804/575601374","cluster_addr":"172.21.15.111:6805/575601374","heartbeat_back_addr":"172.21.15.111:6807/575601374","heartbeat_front_addr":"172.21.15.111:6806/575601374","state":["exists","up"]},{"osd":6,"uuid":"e4d903d9-30df-41ef-b09e-651111416a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":2146440304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":2146440304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":2146440304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":2146440304}]},"public_addr":"172.21.15.111:6808/2146440304","cluster_addr":"172.21.15.111:6809/2146440304","heartbeat_back_addr":"172.21.15.111:6811/2146440304","heartbeat_front_addr":"172.21.15.111:6810/2146440304","state":["exists","up"]},{"osd":7,"uuid":"2b696400-d368-44a0-b57a-71c31e8292f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":1629494259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":1629494259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":1629494259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":1629494259}]},"public_addr":"172.21.15.111:6812/1629494259","cluster_addr":"172.21.15.111:6813/1629494259","heartbeat_back_addr":"172.21.15.111:6815/1629494259","heartbeat_front_addr":"172.21.15.111:6814/1629494259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:36:49.319298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:37:40.712051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:38:33.151039+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:39:26.430970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:40:15.952959+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:41:06.923868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:41:58.150572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:42:50.081684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:6800/70089425":"2024-02-14T14:34:23.004283+0000","172.21.15.62:0/384574915":"2024-02-14T14:34:23.004283+0000","172.21.15.62:6800/3755300204":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/1390781974":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/501986268":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/2037740662":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/807021312":"2024-02-14T14:34:23.004283+0000","172.21.15.62:0/1160844063":"2024-02-14T14:34:23.004283+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-13T14:43:10.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.646+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 >> v1:172.21.15.62:6800/1926838190 conn(0x7fc93c06ef50 legacy=0x7fc93c071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:10.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.646+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 >> v1:172.21.15.62:6789/0 conn(0x7fc950110710 legacy=0x7fc9501a7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:10.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.646+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 shutdown_connections 2024-02-13T14:43:10.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.646+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 >> 172.21.15.62:0/750154100 conn(0x7fc9500fd560 msgr2=0x7fc95010ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:10.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.646+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 shutdown_connections 2024-02-13T14:43:10.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:10.646+0000 7fc955975700 1 -- 172.21.15.62:0/750154100 wait complete. 2024-02-13T14:43:11.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:11 smithi062 bash[28859]: audit 2024-02-13T14:43:10.645540+0000 mon.a (mon.0) 638 : audit 0 from='client.? v1:172.21.15.62:0/750154100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:43:11.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:11 smithi062 bash[21479]: audit 2024-02-13T14:43:10.645540+0000 mon.a (mon.0) 638 : audit 0 from='client.? v1:172.21.15.62:0/750154100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:43:11.553 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-13T14:38:35.651796+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-13T14:43:11.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-13T14:43:11.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:11 smithi111 bash[23388]: audit 2024-02-13T14:43:10.645540+0000 mon.a (mon.0) 638 : audit 0 from='client.? v1:172.21.15.62:0/750154100' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:43:12.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:12 smithi062 bash[21479]: cluster 2024-02-13T14:43:11.142223+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:12.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:12 smithi062 bash[28859]: cluster 2024-02-13T14:43:11.142223+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:12.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:12 smithi111 bash[23388]: cluster 2024-02-13T14:43:11.142223+0000 mgr.y (mgr.14152) 327 : cluster 0 pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:14.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:14 smithi062 bash[21479]: cluster 2024-02-13T14:43:13.142851+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:14.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:14 smithi062 bash[28859]: cluster 2024-02-13T14:43:13.142851+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:14.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:14 smithi111 bash[23388]: cluster 2024-02-13T14:43:13.142851+0000 mgr.y (mgr.14152) 328 : cluster 0 pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:43:16.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:16 smithi062 bash[21479]: cluster 2024-02-13T14:43:15.143436+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:16.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:16 smithi062 bash[28859]: cluster 2024-02-13T14:43:15.143436+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:16.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:16 smithi111 bash[23388]: cluster 2024-02-13T14:43:15.143436+0000 mgr.y (mgr.14152) 329 : cluster 0 pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:18 smithi062 bash[28859]: cluster 2024-02-13T14:43:17.144049+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:18.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:18 smithi062 bash[21479]: cluster 2024-02-13T14:43:17.144049+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:18.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:18 smithi111 bash[23388]: cluster 2024-02-13T14:43:17.144049+0000 mgr.y (mgr.14152) 330 : cluster 0 pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- 172.21.15.62:0/1520321592 >> v1:172.21.15.62:6789/0 conn(0x7fe164103ea0 legacy=0x7fe164104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- 172.21.15.62:0/1520321592 shutdown_connections 2024-02-13T14:43:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- 172.21.15.62:0/1520321592 >> 172.21.15.62:0/1520321592 conn(0x7fe1640ff710 msgr2=0x7fe164101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- 172.21.15.62:0/1520321592 shutdown_connections 2024-02-13T14:43:19.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- 172.21.15.62:0/1520321592 wait complete. 2024-02-13T14:43:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 Processor -- start 2024-02-13T14:43:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- start start 2024-02-13T14:43:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe1641a8cc0 con 0x7fe16410cb30 2024-02-13T14:43:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe1641a9ea0 con 0x7fe164103ea0 2024-02-13T14:43:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe16c3e8700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe1641ab0a0 con 0x7fe1641106d0 2024-02-13T14:43:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe169983700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe16410cb30 0x7fe1641a3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:42924/0 (socket says 172.21.15.62:42924) 2024-02-13T14:43:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.273+0000 7fe169983700 1 -- 172.21.15.62:0/3977172379 learned_addr learned my addr 172.21.15.62:0/3977172379 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:43:19.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242292136 0 0) 0x7fe1641a8cc0 con 0x7fe16410cb30 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14c0037f0 con 0x7fe16410cb30 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2994992943 0 0) 0x7fe1641ab0a0 con 0x7fe1641106d0 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1641a8cc0 con 0x7fe1641106d0 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 501009654 0 0) 0x7fe14c0037f0 con 0x7fe16410cb30 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1641ab0a0 con 0x7fe16410cb30 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe158001870 con 0x7fe16410cb30 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386145750 0 0) 0x7fe1641a9ea0 con 0x7fe164103ea0 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe14c0037f0 con 0x7fe164103ea0 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1510819954 0 0) 0x7fe1641a8cc0 con 0x7fe1641106d0 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe1641a9ea0 con 0x7fe1641106d0 2024-02-13T14:43:19.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe15c0018d0 con 0x7fe1641106d0 2024-02-13T14:43:19.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3083790392 0 0) 0x7fe1641ab0a0 con 0x7fe16410cb30 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 >> v1:172.21.15.62:6790/0 conn(0x7fe1641106d0 legacy=0x7fe1641a7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 >> v1:172.21.15.111:6789/0 conn(0x7fe164103ea0 legacy=0x7fe164109250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1641ac2a0 con 0x7fe16410cb30 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1641a8eb0 con 0x7fe16410cb30 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1641a9330 con 0x7fe16410cb30 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fe158003b30 con 0x7fe16410cb30 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe158005b90 con 0x7fe16410cb30 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe150005120 con 0x7fe16410cb30 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7fe15801c420 con 0x7fe16410cb30 2024-02-13T14:43:19.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.277+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(58..58 src has 1..58) v4 ==== 4081+0+0 (unknown 792489679 0 0) 0x7fe158088620 con 0x7fe16410cb30 2024-02-13T14:43:19.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.285+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fe158052150 con 0x7fe16410cb30 2024-02-13T14:43:19.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.493+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe150005950 con 0x7fe16410cb30 2024-02-13T14:43:19.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.493+0000 7fe1637fe700 1 -- 172.21.15.62:0/3977172379 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v58) v1 ==== 93+0+10 (unknown 3844627101 0 2170607528) 0x7fe158054250 con 0x7fe16410cb30 2024-02-13T14:43:19.494 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2024-02-13T14:43:19.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.497+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 >> v1:172.21.15.62:6800/1926838190 conn(0x7fe14c06eff0 legacy=0x7fe14c0714b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.497+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 >> v1:172.21.15.62:6789/0 conn(0x7fe16410cb30 legacy=0x7fe1641a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.497+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 shutdown_connections 2024-02-13T14:43:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.497+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 >> 172.21.15.62:0/3977172379 conn(0x7fe1640ff710 msgr2=0x7fe164113bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.497+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 shutdown_connections 2024-02-13T14:43:19.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:43:19.497+0000 7fe16c3e8700 1 -- 172.21.15.62:0/3977172379 wait complete. 2024-02-13T14:43:20.299 INFO:tasks.cephadm:Adding ceph.rgw.foo.a on smithi062 2024-02-13T14:43:20.300 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch apply rgw foo.a --placement '1;smithi062=foo.a' 2024-02-13T14:43:20.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:20 smithi062 bash[21479]: cluster 2024-02-13T14:43:19.144628+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:20.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:20 smithi062 bash[21479]: audit 2024-02-13T14:43:19.496829+0000 mon.a (mon.0) 639 : audit 0 from='client.? v1:172.21.15.62:0/3977172379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-13T14:43:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:20 smithi062 bash[28859]: cluster 2024-02-13T14:43:19.144628+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:20 smithi062 bash[28859]: audit 2024-02-13T14:43:19.496829+0000 mon.a (mon.0) 639 : audit 0 from='client.? v1:172.21.15.62:0/3977172379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-13T14:43:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:20 smithi111 bash[23388]: cluster 2024-02-13T14:43:19.144628+0000 mgr.y (mgr.14152) 331 : cluster 0 pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:20 smithi111 bash[23388]: audit 2024-02-13T14:43:19.496829+0000 mon.a (mon.0) 639 : audit 0 from='client.? v1:172.21.15.62:0/3977172379' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-13T14:43:22.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:22 smithi062 bash[21479]: cluster 2024-02-13T14:43:21.145201+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:22.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:22 smithi062 bash[28859]: cluster 2024-02-13T14:43:21.145201+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:22.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:22 smithi111 bash[23388]: cluster 2024-02-13T14:43:21.145201+0000 mgr.y (mgr.14152) 332 : cluster 0 pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:24.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:24 smithi062 bash[21479]: cluster 2024-02-13T14:43:23.145800+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:24.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:24 smithi062 bash[28859]: cluster 2024-02-13T14:43:23.145800+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:24.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:24 smithi111 bash[23388]: cluster 2024-02-13T14:43:23.145800+0000 mgr.y (mgr.14152) 333 : cluster 0 pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:25.052 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:43:26.557 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:26 smithi111 bash[23388]: cluster 2024-02-13T14:43:25.146369+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:26.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:26 smithi062 bash[21479]: cluster 2024-02-13T14:43:25.146369+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:26.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:26 smithi062 bash[28859]: cluster 2024-02-13T14:43:25.146369+0000 mgr.y (mgr.14152) 334 : cluster 0 pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:27.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.494+0000 7f52ac980700 1 -- 172.21.15.111:0/607249066 >> v1:172.21.15.111:6789/0 conn(0x7f52a8110270 legacy=0x7f52a8112730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:27.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.494+0000 7f52ac980700 1 -- 172.21.15.111:0/607249066 shutdown_connections 2024-02-13T14:43:27.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.494+0000 7f52ac980700 1 -- 172.21.15.111:0/607249066 >> 172.21.15.111:0/607249066 conn(0x7f52a80770f0 msgr2=0x7f52a8079530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:27.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.494+0000 7f52ac980700 1 -- 172.21.15.111:0/607249066 shutdown_connections 2024-02-13T14:43:27.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.494+0000 7f52ac980700 1 -- 172.21.15.111:0/607249066 wait complete. 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.494+0000 7f52ac980700 1 Processor -- start 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.494+0000 7f52ac980700 1 -- start start 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52ac980700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f52a819dfc0 con 0x7f52a810c530 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52ac980700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f52a81a97b0 con 0x7f52a8110270 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52ac980700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f52a81aa950 con 0x7f52a8108100 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52a6d9d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f52a8110270 0x7f52a81a7080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:51854/0 (socket says 172.21.15.111:51854) 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52a6d9d700 1 -- 172.21.15.111:0/2839899927 learned_addr learned my addr 172.21.15.111:0/2839899927 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3268867606 0 0) 0x7f52a81a97b0 con 0x7f52a8110270 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52900035b0 con 0x7f52a8110270 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2804817664 0 0) 0x7f52900035b0 con 0x7f52a8110270 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f52a81a97b0 con 0x7f52a8110270 2024-02-13T14:43:27.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064038534 0 0) 0x7f52a81aa950 con 0x7f52a8108100 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52900035b0 con 0x7f52a8108100 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f52a00017b0 con 0x7f52a8110270 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488419887 0 0) 0x7f52a819dfc0 con 0x7f52a810c530 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52a81aa950 con 0x7f52a810c530 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4145297260 0 0) 0x7f52a81a97b0 con 0x7f52a8110270 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 >> v1:172.21.15.62:6790/0 conn(0x7f52a8108100 legacy=0x7f52a819d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 >> v1:172.21.15.62:6789/0 conn(0x7f52a810c530 legacy=0x7f52a81a3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a81abaf0 con 0x7f52a8110270 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a81aab40 con 0x7f52a8110270 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a81ab040 con 0x7f52a8110270 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f52a0001ef0 con 0x7f52a8110270 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f52a0005430 con 0x7f52a8110270 2024-02-13T14:43:27.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5288005150 con 0x7f52a8110270 2024-02-13T14:43:27.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7f52a0005630 con 0x7f52a8110270 2024-02-13T14:43:27.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.498+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(58..58 src has 1..58) v4 ==== 4081+0+0 (unknown 792489679 0 0) 0x7f52a0088d60 con 0x7f52a8110270 2024-02-13T14:43:27.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.502+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f52a0052a60 con 0x7f52a8110270 2024-02-13T14:43:27.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.722+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi062=foo.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f5288000bc0 con 0x7f529006ec40 2024-02-13T14:43:27.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.738+0000 7f52977fe700 1 -- 172.21.15.111:0/2839899927 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+30 (unknown 0 0 1123153589) 0x7f5288000bc0 con 0x7f529006ec40 2024-02-13T14:43:27.740 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled rgw.foo.a update... 2024-02-13T14:43:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.742+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 >> v1:172.21.15.62:6800/1926838190 conn(0x7f529006ec40 legacy=0x7f5290071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.742+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 >> v1:172.21.15.111:6789/0 conn(0x7f52a8110270 legacy=0x7f52a81a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.742+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 shutdown_connections 2024-02-13T14:43:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.742+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 >> 172.21.15.111:0/2839899927 conn(0x7f52a80770f0 msgr2=0x7f52a8106a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.742+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 shutdown_connections 2024-02-13T14:43:27.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:27.742+0000 7f52ac980700 1 -- 172.21.15.111:0/2839899927 wait complete. 2024-02-13T14:43:28.403 DEBUG:teuthology.orchestra.run.smithi062:rgw.foo.a> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@rgw.foo.a.service 2024-02-13T14:43:28.406 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi111 2024-02-13T14:43:28.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd pool create datapool 3 3 replicated 2024-02-13T14:43:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: cluster 2024-02-13T14:43:27.146944+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:27.728144+0000 mgr.y (mgr.14152) 336 : audit 0 from='client.24361 v1:172.21.15.111:0/2839899927' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi062=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:43:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: cephadm 2024-02-13T14:43:27.732190+0000 mgr.y (mgr.14152) 337 : cephadm 1 Saving service rgw.foo.a spec with placement smithi062=foo.a;count:1 2024-02-13T14:43:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:27.741068+0000 mon.a (mon.0) 640 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:27.753970+0000 mon.a (mon.0) 641 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:29.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:28.438531+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:28.440088+0000 mon.a (mon.0) 643 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:28.447623+0000 mon.a (mon.0) 644 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:28.451949+0000 mon.a (mon.0) 645 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:28.455910+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:28.465984+0000 mon.a (mon.0) 647 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[21479]: audit 2024-02-13T14:43:28.468474+0000 mon.a (mon.0) 648 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: cluster 2024-02-13T14:43:27.146944+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:27.728144+0000 mgr.y (mgr.14152) 336 : audit 0 from='client.24361 v1:172.21.15.111:0/2839899927' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi062=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: cephadm 2024-02-13T14:43:27.732190+0000 mgr.y (mgr.14152) 337 : cephadm 1 Saving service rgw.foo.a spec with placement smithi062=foo.a;count:1 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:27.741068+0000 mon.a (mon.0) 640 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:27.753970+0000 mon.a (mon.0) 641 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:29.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:28.438531+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:28.440088+0000 mon.a (mon.0) 643 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:28.447623+0000 mon.a (mon.0) 644 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:28.451949+0000 mon.a (mon.0) 645 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-13T14:43:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:28.455910+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-13T14:43:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:28.465984+0000 mon.a (mon.0) 647 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:28 smithi062 bash[28859]: audit 2024-02-13T14:43:28.468474+0000 mon.a (mon.0) 648 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:29.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: cluster 2024-02-13T14:43:27.146944+0000 mgr.y (mgr.14152) 335 : cluster 0 pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:27.728144+0000 mgr.y (mgr.14152) 336 : audit 0 from='client.24361 v1:172.21.15.111:0/2839899927' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo.a", "placement": "1;smithi062=foo.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: cephadm 2024-02-13T14:43:27.732190+0000 mgr.y (mgr.14152) 337 : cephadm 1 Saving service rgw.foo.a spec with placement smithi062=foo.a;count:1 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:27.741068+0000 mon.a (mon.0) 640 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:27.753970+0000 mon.a (mon.0) 641 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:28.438531+0000 mon.a (mon.0) 642 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:28.440088+0000 mon.a (mon.0) 643 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:28.447623+0000 mon.a (mon.0) 644 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:28.451949+0000 mon.a (mon.0) 645 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:28.455910+0000 mon.a (mon.0) 646 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:28.465984+0000 mon.a (mon.0) 647 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:28 smithi111 bash[23388]: audit 2024-02-13T14:43:28.468474+0000 mon.a (mon.0) 648 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:30.041 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:29 smithi062 bash[21479]: cephadm 2024-02-13T14:43:28.470070+0000 mgr.y (mgr.14152) 338 : cephadm 1 Deploying daemon rgw.foo.a on smithi062 2024-02-13T14:43:30.041 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:29 smithi062 bash[28859]: cephadm 2024-02-13T14:43:28.470070+0000 mgr.y (mgr.14152) 338 : cephadm 1 Deploying daemon rgw.foo.a on smithi062 2024-02-13T14:43:30.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:29 smithi111 bash[23388]: cephadm 2024-02-13T14:43:28.470070+0000 mgr.y (mgr.14152) 338 : cephadm 1 Deploying daemon rgw.foo.a on smithi062 2024-02-13T14:43:31.060 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:43:30 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:30 smithi062 bash[21479]: cluster 2024-02-13T14:43:29.147481+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:31.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:30 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.061 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:43:30 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:30 smithi062 bash[28859]: cluster 2024-02-13T14:43:29.147481+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:30 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.062 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:43:30 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.062 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 14:43:30 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.063 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:43:30 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:30 smithi111 bash[23388]: cluster 2024-02-13T14:43:29.147481+0000 mgr.y (mgr.14152) 339 : cluster 0 pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:31.315 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:31 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.316 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:31 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.316 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:43:31 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.316 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 14:43:31 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.316 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:43:31 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.317 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:43:31 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:31.317 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:43:31 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[21479]: cluster 2024-02-13T14:43:31.147844+0000 mgr.y (mgr.14152) 340 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[21479]: audit 2024-02-13T14:43:31.365613+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[21479]: audit 2024-02-13T14:43:31.371913+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[21479]: audit 2024-02-13T14:43:31.395346+0000 mon.a (mon.0) 651 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[21479]: cephadm 2024-02-13T14:43:31.396211+0000 mgr.y (mgr.14152) 341 : cephadm 1 Saving service rgw.foo.a spec with placement smithi062=foo.a;count:1 2024-02-13T14:43:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[21479]: audit 2024-02-13T14:43:31.400858+0000 mon.a (mon.0) 652 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[21479]: audit 2024-02-13T14:43:31.404618+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[21479]: audit 2024-02-13T14:43:31.452856+0000 mon.a (mon.0) 654 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[28859]: cluster 2024-02-13T14:43:31.147844+0000 mgr.y (mgr.14152) 340 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[28859]: audit 2024-02-13T14:43:31.365613+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[28859]: audit 2024-02-13T14:43:31.371913+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[28859]: audit 2024-02-13T14:43:31.395346+0000 mon.a (mon.0) 651 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[28859]: cephadm 2024-02-13T14:43:31.396211+0000 mgr.y (mgr.14152) 341 : cephadm 1 Saving service rgw.foo.a spec with placement smithi062=foo.a;count:1 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[28859]: audit 2024-02-13T14:43:31.400858+0000 mon.a (mon.0) 652 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[28859]: audit 2024-02-13T14:43:31.404618+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:32 smithi062 bash[28859]: audit 2024-02-13T14:43:31.452856+0000 mon.a (mon.0) 654 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:32 smithi111 bash[23388]: cluster 2024-02-13T14:43:31.147844+0000 mgr.y (mgr.14152) 340 : cluster 0 pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:32 smithi111 bash[23388]: audit 2024-02-13T14:43:31.365613+0000 mon.a (mon.0) 649 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:32 smithi111 bash[23388]: audit 2024-02-13T14:43:31.371913+0000 mon.a (mon.0) 650 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:32 smithi111 bash[23388]: audit 2024-02-13T14:43:31.395346+0000 mon.a (mon.0) 651 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:32 smithi111 bash[23388]: cephadm 2024-02-13T14:43:31.396211+0000 mgr.y (mgr.14152) 341 : cephadm 1 Saving service rgw.foo.a spec with placement smithi062=foo.a;count:1 2024-02-13T14:43:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:32 smithi111 bash[23388]: audit 2024-02-13T14:43:31.400858+0000 mon.a (mon.0) 652 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:32 smithi111 bash[23388]: audit 2024-02-13T14:43:31.404618+0000 mon.a (mon.0) 653 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:32 smithi111 bash[23388]: audit 2024-02-13T14:43:31.452856+0000 mon.a (mon.0) 654 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:33.147 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:43:34.268 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:34 smithi111 bash[23388]: audit 2024-02-13T14:43:33.039713+0000 mon.a (mon.0) 655 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:34.268 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:34 smithi111 bash[23388]: cluster 2024-02-13T14:43:33.148334+0000 mgr.y (mgr.14152) 342 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:34.268 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:34 smithi111 bash[23388]: cluster 2024-02-13T14:43:33.378077+0000 mon.a (mon.0) 656 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-02-13T14:43:34.268 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:34 smithi111 bash[23388]: audit 2024-02-13T14:43:33.385315+0000 mon.c (mon.2) 16 : audit 1 from='client.? v1:172.21.15.62:0/2976514745' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T14:43:34.269 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:34 smithi111 bash[23388]: audit 2024-02-13T14:43:33.386184+0000 mon.a (mon.0) 657 : audit 1 from='client.24356 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T14:43:34.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[21479]: audit 2024-02-13T14:43:33.039713+0000 mon.a (mon.0) 655 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:34.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[21479]: cluster 2024-02-13T14:43:33.148334+0000 mgr.y (mgr.14152) 342 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:34.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[21479]: cluster 2024-02-13T14:43:33.378077+0000 mon.a (mon.0) 656 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-02-13T14:43:34.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[21479]: audit 2024-02-13T14:43:33.385315+0000 mon.c (mon.2) 16 : audit 1 from='client.? v1:172.21.15.62:0/2976514745' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T14:43:34.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[21479]: audit 2024-02-13T14:43:33.386184+0000 mon.a (mon.0) 657 : audit 1 from='client.24356 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T14:43:34.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[28859]: audit 2024-02-13T14:43:33.039713+0000 mon.a (mon.0) 655 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[28859]: cluster 2024-02-13T14:43:33.148334+0000 mgr.y (mgr.14152) 342 : cluster 0 pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[28859]: cluster 2024-02-13T14:43:33.378077+0000 mon.a (mon.0) 656 : cluster 0 osdmap e59: 8 total, 8 up, 8 in 2024-02-13T14:43:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[28859]: audit 2024-02-13T14:43:33.385315+0000 mon.c (mon.2) 16 : audit 1 from='client.? v1:172.21.15.62:0/2976514745' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T14:43:34.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:34 smithi062 bash[28859]: audit 2024-02-13T14:43:33.386184+0000 mon.a (mon.0) 657 : audit 1 from='client.24356 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-13T14:43:35.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.618+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2954965839 >> v1:172.21.15.111:6789/0 conn(0x7fcfbc10be40 legacy=0x7fcfbc10e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:35.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.618+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2954965839 shutdown_connections 2024-02-13T14:43:35.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.618+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2954965839 >> 172.21.15.111:0/2954965839 conn(0x7fcfbc0ff270 msgr2=0x7fcfbc1016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:35.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.618+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2954965839 shutdown_connections 2024-02-13T14:43:35.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.618+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2954965839 wait complete. 2024-02-13T14:43:35.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc3f50700 1 Processor -- start 2024-02-13T14:43:35.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc3f50700 1 -- start start 2024-02-13T14:43:35.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc3f50700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcfbc199ac0 con 0x7fcfbc108100 2024-02-13T14:43:35.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc3f50700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcfbc1a52b0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc3f50700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcfbc1a6450 con 0x7fcfbc10be40 2024-02-13T14:43:35.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc1cec700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fcfbc103cd0 0x7fcfbc198f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:51882/0 (socket says 172.21.15.111:51882) 2024-02-13T14:43:35.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc1cec700 1 -- 172.21.15.111:0/2833131697 learned_addr learned my addr 172.21.15.111:0/2833131697 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:43:35.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3105367174 0 0) 0x7fcfbc1a52b0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa80035b0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2453942001 0 0) 0x7fcfa80035b0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcfbc1a52b0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fcfb00018f0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3112334796 0 0) 0x7fcfbc1a52b0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 >> v1:172.21.15.62:6790/0 conn(0x7fcfbc10be40 legacy=0x7fcfbc1a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:35.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 >> v1:172.21.15.62:6789/0 conn(0x7fcfbc108100 legacy=0x7fcfbc19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:35.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc1a75f0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc1a4300 con 0x7fcfbc103cd0 2024-02-13T14:43:35.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc1a4800 con 0x7fcfbc103cd0 2024-02-13T14:43:35.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fcfb0003b30 con 0x7fcfbc103cd0 2024-02-13T14:43:35.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fcfb0005ca0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa0005150 con 0x7fcfbc103cd0 2024-02-13T14:43:35.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7fcfb0003680 con 0x7fcfbc103cd0 2024-02-13T14:43:35.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.622+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(61..61 src has 1..61) v4 ==== 4794+0+0 (unknown 1592354664 0 0) 0x7fcfb0088930 con 0x7fcfbc103cd0 2024-02-13T14:43:35.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.630+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fcfb00523d0 con 0x7fcfbc103cd0 2024-02-13T14:43:35.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:35 smithi062 bash[21479]: audit 2024-02-13T14:43:34.371116+0000 mon.a (mon.0) 658 : audit 1 from='client.24356 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-13T14:43:35.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:35 smithi062 bash[21479]: cluster 2024-02-13T14:43:34.379347+0000 mon.a (mon.0) 659 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-02-13T14:43:35.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:35 smithi062 bash[28859]: audit 2024-02-13T14:43:34.371116+0000 mon.a (mon.0) 658 : audit 1 from='client.24356 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-13T14:43:35.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:35 smithi062 bash[28859]: cluster 2024-02-13T14:43:34.379347+0000 mon.a (mon.0) 659 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-02-13T14:43:35.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:35.838+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"} v 0) v1 -- 0x7fcfa0005980 con 0x7fcfbc103cd0 2024-02-13T14:43:35.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:35 smithi111 bash[23388]: audit 2024-02-13T14:43:34.371116+0000 mon.a (mon.0) 658 : audit 1 from='client.24356 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-13T14:43:35.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:35 smithi111 bash[23388]: cluster 2024-02-13T14:43:34.379347+0000 mon.a (mon.0) 659 : cluster 0 osdmap e60: 8 total, 8 up, 8 in 2024-02-13T14:43:36.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:36.390+0000 7fcfaeffd700 1 -- 172.21.15.111:0/2833131697 <== mon.1 v1:172.21.15.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]=0 pool 'datapool' created v62) v1 ==== 160+0+0 (unknown 531222546 0 0) 0x7fcfb0054300 con 0x7fcfbc103cd0 2024-02-13T14:43:36.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:36.394+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 >> v1:172.21.15.62:6800/1926838190 conn(0x7fcfa806ead0 legacy=0x7fcfa8070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:36.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:36.394+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 >> v1:172.21.15.111:6789/0 conn(0x7fcfbc103cd0 legacy=0x7fcfbc198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:36.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:36.398+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 shutdown_connections 2024-02-13T14:43:36.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:36.398+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 >> 172.21.15.111:0/2833131697 conn(0x7fcfbc0ff270 msgr2=0x7fcfbc10ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:36.402+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 shutdown_connections 2024-02-13T14:43:36.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:36.402+0000 7fcfc3f50700 1 -- 172.21.15.111:0/2833131697 wait complete. 2024-02-13T14:43:36.410 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'datapool' created 2024-02-13T14:43:36.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[21479]: cluster 2024-02-13T14:43:35.148888+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v326: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[21479]: cluster 2024-02-13T14:43:35.391252+0000 mon.a (mon.0) 660 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[21479]: audit 2024-02-13T14:43:35.400924+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[21479]: audit 2024-02-13T14:43:35.402391+0000 mon.a (mon.0) 661 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[21479]: audit 2024-02-13T14:43:35.839842+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.111:0/2833131697' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[21479]: audit 2024-02-13T14:43:35.841086+0000 mon.a (mon.0) 662 : audit 1 from='client.24385 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[28859]: cluster 2024-02-13T14:43:35.148888+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v326: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[28859]: cluster 2024-02-13T14:43:35.391252+0000 mon.a (mon.0) 660 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[28859]: audit 2024-02-13T14:43:35.400924+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T14:43:36.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[28859]: audit 2024-02-13T14:43:35.402391+0000 mon.a (mon.0) 661 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T14:43:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[28859]: audit 2024-02-13T14:43:35.839842+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.111:0/2833131697' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T14:43:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:36 smithi062 bash[28859]: audit 2024-02-13T14:43:35.841086+0000 mon.a (mon.0) 662 : audit 1 from='client.24385 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T14:43:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:36 smithi111 bash[23388]: cluster 2024-02-13T14:43:35.148888+0000 mgr.y (mgr.14152) 343 : cluster 0 pgmap v326: 33 pgs: 9 creating+peering, 1 active+clean, 23 unknown; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:43:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:36 smithi111 bash[23388]: cluster 2024-02-13T14:43:35.391252+0000 mon.a (mon.0) 660 : cluster 0 osdmap e61: 8 total, 8 up, 8 in 2024-02-13T14:43:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:36 smithi111 bash[23388]: audit 2024-02-13T14:43:35.400924+0000 mon.c (mon.2) 17 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T14:43:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:36 smithi111 bash[23388]: audit 2024-02-13T14:43:35.402391+0000 mon.a (mon.0) 661 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]: dispatch 2024-02-13T14:43:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:36 smithi111 bash[23388]: audit 2024-02-13T14:43:35.839842+0000 mon.b (mon.1) 26 : audit 1 from='client.? v1:172.21.15.111:0/2833131697' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T14:43:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:36 smithi111 bash[23388]: audit 2024-02-13T14:43:35.841086+0000 mon.a (mon.0) 662 : audit 1 from='client.24385 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2024-02-13T14:43:37.119 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- rbd pool init datapool 2024-02-13T14:43:37.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:37 smithi111 bash[23388]: audit 2024-02-13T14:43:36.384432+0000 mon.a (mon.0) 663 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-13T14:43:37.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:37 smithi111 bash[23388]: audit 2024-02-13T14:43:36.384619+0000 mon.a (mon.0) 664 : audit 1 from='client.24385 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-13T14:43:37.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:37 smithi111 bash[23388]: cluster 2024-02-13T14:43:36.394269+0000 mon.a (mon.0) 665 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-02-13T14:43:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:37 smithi111 bash[23388]: audit 2024-02-13T14:43:36.892925+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:37 smithi111 bash[23388]: audit 2024-02-13T14:43:36.900936+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:37 smithi111 bash[23388]: audit 2024-02-13T14:43:36.902670+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:37 smithi111 bash[23388]: audit 2024-02-13T14:43:36.903508+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[21479]: audit 2024-02-13T14:43:36.384432+0000 mon.a (mon.0) 663 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-13T14:43:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[21479]: audit 2024-02-13T14:43:36.384619+0000 mon.a (mon.0) 664 : audit 1 from='client.24385 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-13T14:43:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[21479]: cluster 2024-02-13T14:43:36.394269+0000 mon.a (mon.0) 665 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-02-13T14:43:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[21479]: audit 2024-02-13T14:43:36.892925+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[21479]: audit 2024-02-13T14:43:36.900936+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[21479]: audit 2024-02-13T14:43:36.902670+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[21479]: audit 2024-02-13T14:43:36.903508+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[28859]: audit 2024-02-13T14:43:36.384432+0000 mon.a (mon.0) 663 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.log","app": "rgw"}]': finished 2024-02-13T14:43:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[28859]: audit 2024-02-13T14:43:36.384619+0000 mon.a (mon.0) 664 : audit 1 from='client.24385 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "datapool", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2024-02-13T14:43:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[28859]: cluster 2024-02-13T14:43:36.394269+0000 mon.a (mon.0) 665 : cluster 0 osdmap e62: 8 total, 8 up, 8 in 2024-02-13T14:43:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[28859]: audit 2024-02-13T14:43:36.892925+0000 mon.a (mon.0) 666 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[28859]: audit 2024-02-13T14:43:36.900936+0000 mon.a (mon.0) 667 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[28859]: audit 2024-02-13T14:43:36.902670+0000 mon.a (mon.0) 668 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:37 smithi062 bash[28859]: audit 2024-02-13T14:43:36.903508+0000 mon.a (mon.0) 669 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: cephadm 2024-02-13T14:43:36.908210+0000 mgr.y (mgr.14152) 344 : cephadm 1 Checking dashboard <-> RGW credentials 2024-02-13T14:43:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: cluster 2024-02-13T14:43:37.149398+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v329: 68 pgs: 16 active+clean, 17 creating+peering, 35 unknown; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2024-02-13T14:43:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: cluster 2024-02-13T14:43:37.562994+0000 mon.a (mon.0) 670 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-02-13T14:43:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: audit 2024-02-13T14:43:37.565897+0000 mon.c (mon.2) 18 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: audit 2024-02-13T14:43:37.568607+0000 mon.a (mon.0) 671 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: audit 2024-02-13T14:43:37.568923+0000 mon.c (mon.2) 19 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: audit 2024-02-13T14:43:37.578537+0000 mon.a (mon.0) 672 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: cluster 2024-02-13T14:43:37.896947+0000 mon.a (mon.0) 673 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:43:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: audit 2024-02-13T14:43:38.560772+0000 mon.a (mon.0) 674 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T14:43:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: audit 2024-02-13T14:43:38.560995+0000 mon.a (mon.0) 675 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T14:43:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:38 smithi111 bash[23388]: cluster 2024-02-13T14:43:38.570350+0000 mon.a (mon.0) 676 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-02-13T14:43:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: cephadm 2024-02-13T14:43:36.908210+0000 mgr.y (mgr.14152) 344 : cephadm 1 Checking dashboard <-> RGW credentials 2024-02-13T14:43:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: cluster 2024-02-13T14:43:37.149398+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v329: 68 pgs: 16 active+clean, 17 creating+peering, 35 unknown; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2024-02-13T14:43:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: cluster 2024-02-13T14:43:37.562994+0000 mon.a (mon.0) 670 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-02-13T14:43:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: audit 2024-02-13T14:43:37.565897+0000 mon.c (mon.2) 18 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: audit 2024-02-13T14:43:37.568607+0000 mon.a (mon.0) 671 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: audit 2024-02-13T14:43:37.568923+0000 mon.c (mon.2) 19 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: audit 2024-02-13T14:43:37.578537+0000 mon.a (mon.0) 672 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: cluster 2024-02-13T14:43:37.896947+0000 mon.a (mon.0) 673 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: audit 2024-02-13T14:43:38.560772+0000 mon.a (mon.0) 674 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: audit 2024-02-13T14:43:38.560995+0000 mon.a (mon.0) 675 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[21479]: cluster 2024-02-13T14:43:38.570350+0000 mon.a (mon.0) 676 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: cephadm 2024-02-13T14:43:36.908210+0000 mgr.y (mgr.14152) 344 : cephadm 1 Checking dashboard <-> RGW credentials 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: cluster 2024-02-13T14:43:37.149398+0000 mgr.y (mgr.14152) 345 : cluster 0 pgmap v329: 68 pgs: 16 active+clean, 17 creating+peering, 35 unknown; 577 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 255 B/s wr, 0 op/s 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: cluster 2024-02-13T14:43:37.562994+0000 mon.a (mon.0) 670 : cluster 0 osdmap e63: 8 total, 8 up, 8 in 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: audit 2024-02-13T14:43:37.565897+0000 mon.c (mon.2) 18 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: audit 2024-02-13T14:43:37.568607+0000 mon.a (mon.0) 671 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:39.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: audit 2024-02-13T14:43:37.568923+0000 mon.c (mon.2) 19 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: audit 2024-02-13T14:43:37.578537+0000 mon.a (mon.0) 672 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]: dispatch 2024-02-13T14:43:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: cluster 2024-02-13T14:43:37.896947+0000 mon.a (mon.0) 673 : cluster 3 Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:43:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: audit 2024-02-13T14:43:38.560772+0000 mon.a (mon.0) 674 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T14:43:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: audit 2024-02-13T14:43:38.560995+0000 mon.a (mon.0) 675 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.control","app": "rgw"}]': finished 2024-02-13T14:43:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:38 smithi062 bash[28859]: cluster 2024-02-13T14:43:38.570350+0000 mon.a (mon.0) 676 : cluster 0 osdmap e64: 8 total, 8 up, 8 in 2024-02-13T14:43:41.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[28859]: cluster 2024-02-13T14:43:39.150242+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v332: 100 pgs: 68 active+clean, 17 creating+peering, 15 unknown; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-02-13T14:43:41.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[28859]: cluster 2024-02-13T14:43:39.603655+0000 mon.a (mon.0) 677 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-02-13T14:43:41.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[28859]: audit 2024-02-13T14:43:39.609819+0000 mon.c (mon.2) 20 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[28859]: audit 2024-02-13T14:43:39.612595+0000 mon.c (mon.2) 21 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[28859]: audit 2024-02-13T14:43:39.612644+0000 mon.a (mon.0) 678 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[28859]: audit 2024-02-13T14:43:39.613708+0000 mon.a (mon.0) 679 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[21479]: cluster 2024-02-13T14:43:39.150242+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v332: 100 pgs: 68 active+clean, 17 creating+peering, 15 unknown; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-02-13T14:43:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[21479]: cluster 2024-02-13T14:43:39.603655+0000 mon.a (mon.0) 677 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-02-13T14:43:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[21479]: audit 2024-02-13T14:43:39.609819+0000 mon.c (mon.2) 20 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[21479]: audit 2024-02-13T14:43:39.612595+0000 mon.c (mon.2) 21 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[21479]: audit 2024-02-13T14:43:39.612644+0000 mon.a (mon.0) 678 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:40 smithi062 bash[21479]: audit 2024-02-13T14:43:39.613708+0000 mon.a (mon.0) 679 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:40 smithi111 bash[23388]: cluster 2024-02-13T14:43:39.150242+0000 mgr.y (mgr.14152) 346 : cluster 0 pgmap v332: 100 pgs: 68 active+clean, 17 creating+peering, 15 unknown; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 5 op/s 2024-02-13T14:43:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:40 smithi111 bash[23388]: cluster 2024-02-13T14:43:39.603655+0000 mon.a (mon.0) 677 : cluster 0 osdmap e65: 8 total, 8 up, 8 in 2024-02-13T14:43:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:40 smithi111 bash[23388]: audit 2024-02-13T14:43:39.609819+0000 mon.c (mon.2) 20 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:40 smithi111 bash[23388]: audit 2024-02-13T14:43:39.612595+0000 mon.c (mon.2) 21 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:40 smithi111 bash[23388]: audit 2024-02-13T14:43:39.612644+0000 mon.a (mon.0) 678 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:40 smithi111 bash[23388]: audit 2024-02-13T14:43:39.613708+0000 mon.a (mon.0) 679 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]: dispatch 2024-02-13T14:43:41.867 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:43:41.886 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:41 smithi111 bash[23388]: audit 2024-02-13T14:43:40.611893+0000 mon.a (mon.0) 680 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T14:43:41.887 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:41 smithi111 bash[23388]: audit 2024-02-13T14:43:40.612091+0000 mon.a (mon.0) 681 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T14:43:41.887 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:41 smithi111 bash[23388]: cluster 2024-02-13T14:43:40.619910+0000 mon.a (mon.0) 682 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-02-13T14:43:41.887 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:41 smithi111 bash[23388]: audit 2024-02-13T14:43:40.625791+0000 mon.c (mon.2) 22 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:41.887 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:41 smithi111 bash[23388]: audit 2024-02-13T14:43:40.627622+0000 mon.a (mon.0) 683 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:41.887 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:41 smithi111 bash[23388]: audit 2024-02-13T14:43:40.629298+0000 mon.c (mon.2) 23 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:41.887 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:41 smithi111 bash[23388]: audit 2024-02-13T14:43:40.630940+0000 mon.a (mon.0) 684 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[21479]: audit 2024-02-13T14:43:40.611893+0000 mon.a (mon.0) 680 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[21479]: audit 2024-02-13T14:43:40.612091+0000 mon.a (mon.0) 681 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[21479]: cluster 2024-02-13T14:43:40.619910+0000 mon.a (mon.0) 682 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[21479]: audit 2024-02-13T14:43:40.625791+0000 mon.c (mon.2) 22 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[21479]: audit 2024-02-13T14:43:40.627622+0000 mon.a (mon.0) 683 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[21479]: audit 2024-02-13T14:43:40.629298+0000 mon.c (mon.2) 23 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[21479]: audit 2024-02-13T14:43:40.630940+0000 mon.a (mon.0) 684 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[28859]: audit 2024-02-13T14:43:40.611893+0000 mon.a (mon.0) 680 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[28859]: audit 2024-02-13T14:43:40.612091+0000 mon.a (mon.0) 681 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable","pool": "default.rgw.meta","app": "rgw"}]': finished 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[28859]: cluster 2024-02-13T14:43:40.619910+0000 mon.a (mon.0) 682 : cluster 0 osdmap e66: 8 total, 8 up, 8 in 2024-02-13T14:43:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[28859]: audit 2024-02-13T14:43:40.625791+0000 mon.c (mon.2) 22 : audit 1 from='client.? v1:172.21.15.62:0/2110384863' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[28859]: audit 2024-02-13T14:43:40.627622+0000 mon.a (mon.0) 683 : audit 1 from='client.24398 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[28859]: audit 2024-02-13T14:43:40.629298+0000 mon.c (mon.2) 23 : audit 1 from='client.? v1:172.21.15.62:0/3017678699' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:41 smithi062 bash[28859]: audit 2024-02-13T14:43:40.630940+0000 mon.a (mon.0) 684 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd=[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-13T14:43:42.939 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: cluster 2024-02-13T14:43:41.151111+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v335: 132 pgs: 75 active+clean, 17 creating+peering, 40 unknown; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-13T14:43:42.939 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:41.622612+0000 mon.a (mon.0) 685 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T14:43:42.939 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:41.622795+0000 mon.a (mon.0) 686 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T14:43:42.939 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: cluster 2024-02-13T14:43:41.631172+0000 mon.a (mon.0) 687 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-02-13T14:43:42.940 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:41.908048+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:42.940 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:41.914101+0000 mon.a (mon.0) 689 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:42.940 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:41.922223+0000 mon.a (mon.0) 690 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:42.940 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:41.989654+0000 mon.a (mon.0) 691 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:42.940 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:41.991702+0000 mon.a (mon.0) 692 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:42.940 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:41.992497+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:42.940 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:42 smithi111 bash[23388]: audit 2024-02-13T14:43:42.256870+0000 mon.a (mon.0) 694 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:43.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: cluster 2024-02-13T14:43:41.151111+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v335: 132 pgs: 75 active+clean, 17 creating+peering, 40 unknown; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-13T14:43:43.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:41.622612+0000 mon.a (mon.0) 685 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T14:43:43.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:41.622795+0000 mon.a (mon.0) 686 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T14:43:43.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: cluster 2024-02-13T14:43:41.631172+0000 mon.a (mon.0) 687 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-02-13T14:43:43.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:41.908048+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:43.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:41.914101+0000 mon.a (mon.0) 689 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:41.922223+0000 mon.a (mon.0) 690 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:41.989654+0000 mon.a (mon.0) 691 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:41.991702+0000 mon.a (mon.0) 692 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:41.992497+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[21479]: audit 2024-02-13T14:43:42.256870+0000 mon.a (mon.0) 694 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: cluster 2024-02-13T14:43:41.151111+0000 mgr.y (mgr.14152) 347 : cluster 0 pgmap v335: 132 pgs: 75 active+clean, 17 creating+peering, 40 unknown; 578 KiB data, 237 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:41.622612+0000 mon.a (mon.0) 685 : audit 1 from='client.24398 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:41.622795+0000 mon.a (mon.0) 686 : audit 1 from='client.24365 ' entity='client.rgw.foo.a' cmd='[{"prefix": "osd pool set", "pool": "default.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: cluster 2024-02-13T14:43:41.631172+0000 mon.a (mon.0) 687 : cluster 0 osdmap e67: 8 total, 8 up, 8 in 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:41.908048+0000 mon.a (mon.0) 688 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:41.914101+0000 mon.a (mon.0) 689 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:43.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:41.922223+0000 mon.a (mon.0) 690 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:41.989654+0000 mon.a (mon.0) 691 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:41.991702+0000 mon.a (mon.0) 692 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:41.992497+0000 mon.a (mon.0) 693 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:42 smithi062 bash[28859]: audit 2024-02-13T14:43:42.256870+0000 mon.a (mon.0) 694 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:44.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:43 smithi062 bash[28859]: cephadm 2024-02-13T14:43:41.997691+0000 mgr.y (mgr.14152) 348 : cephadm 1 Checking dashboard <-> RGW credentials 2024-02-13T14:43:44.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:43 smithi062 bash[21479]: cephadm 2024-02-13T14:43:41.997691+0000 mgr.y (mgr.14152) 348 : cephadm 1 Checking dashboard <-> RGW credentials 2024-02-13T14:43:44.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:43 smithi111 bash[23388]: cephadm 2024-02-13T14:43:41.997691+0000 mgr.y (mgr.14152) 348 : cephadm 1 Checking dashboard <-> RGW credentials 2024-02-13T14:43:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:44 smithi111 bash[23388]: cluster 2024-02-13T14:43:43.152368+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v337: 132 pgs: 113 active+clean, 5 creating+peering, 14 unknown; 579 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 2.4 KiB/s wr, 69 op/s 2024-02-13T14:43:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:44 smithi111 bash[23388]: audit 2024-02-13T14:43:44.588433+0000 mon.b (mon.1) 27 : audit 1 from='client.? v1:172.21.15.111:0/3761731423' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-13T14:43:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:44 smithi111 bash[23388]: audit 2024-02-13T14:43:44.589509+0000 mon.a (mon.0) 695 : audit 1 from='client.24466 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-13T14:43:45.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:44 smithi062 bash[21479]: cluster 2024-02-13T14:43:43.152368+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v337: 132 pgs: 113 active+clean, 5 creating+peering, 14 unknown; 579 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 2.4 KiB/s wr, 69 op/s 2024-02-13T14:43:45.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:44 smithi062 bash[21479]: audit 2024-02-13T14:43:44.588433+0000 mon.b (mon.1) 27 : audit 1 from='client.? v1:172.21.15.111:0/3761731423' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-13T14:43:45.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:44 smithi062 bash[21479]: audit 2024-02-13T14:43:44.589509+0000 mon.a (mon.0) 695 : audit 1 from='client.24466 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-13T14:43:45.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:44 smithi062 bash[28859]: cluster 2024-02-13T14:43:43.152368+0000 mgr.y (mgr.14152) 349 : cluster 0 pgmap v337: 132 pgs: 113 active+clean, 5 creating+peering, 14 unknown; 579 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 2.4 KiB/s wr, 69 op/s 2024-02-13T14:43:45.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:44 smithi062 bash[28859]: audit 2024-02-13T14:43:44.588433+0000 mon.b (mon.1) 27 : audit 1 from='client.? v1:172.21.15.111:0/3761731423' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-13T14:43:45.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:44 smithi062 bash[28859]: audit 2024-02-13T14:43:44.589509+0000 mon.a (mon.0) 695 : audit 1 from='client.24466 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]: dispatch 2024-02-13T14:43:46.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:45 smithi062 bash[21479]: audit 2024-02-13T14:43:44.635798+0000 mon.a (mon.0) 696 : audit 1 from='client.24466 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-02-13T14:43:46.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:45 smithi062 bash[21479]: cluster 2024-02-13T14:43:44.644184+0000 mon.a (mon.0) 697 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-02-13T14:43:46.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:45 smithi062 bash[28859]: audit 2024-02-13T14:43:44.635798+0000 mon.a (mon.0) 696 : audit 1 from='client.24466 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-02-13T14:43:46.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:45 smithi062 bash[28859]: cluster 2024-02-13T14:43:44.644184+0000 mon.a (mon.0) 697 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-02-13T14:43:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:45 smithi111 bash[23388]: audit 2024-02-13T14:43:44.635798+0000 mon.a (mon.0) 696 : audit 1 from='client.24466 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "datapool","app": "rbd"}]': finished 2024-02-13T14:43:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:45 smithi111 bash[23388]: cluster 2024-02-13T14:43:44.644184+0000 mon.a (mon.0) 697 : cluster 0 osdmap e68: 8 total, 8 up, 8 in 2024-02-13T14:43:47.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:46 smithi062 bash[21479]: cluster 2024-02-13T14:43:45.153115+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v339: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 5.0 KiB/s wr, 155 op/s 2024-02-13T14:43:47.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:46 smithi062 bash[21479]: cluster 2024-02-13T14:43:45.646718+0000 mon.a (mon.0) 698 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-13T14:43:47.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:46 smithi062 bash[21479]: cluster 2024-02-13T14:43:45.646769+0000 mon.a (mon.0) 699 : cluster 1 Cluster is now healthy 2024-02-13T14:43:47.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:46 smithi062 bash[21479]: cluster 2024-02-13T14:43:45.662953+0000 mon.a (mon.0) 700 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-02-13T14:43:47.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:46 smithi062 bash[28859]: cluster 2024-02-13T14:43:45.153115+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v339: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 5.0 KiB/s wr, 155 op/s 2024-02-13T14:43:47.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:46 smithi062 bash[28859]: cluster 2024-02-13T14:43:45.646718+0000 mon.a (mon.0) 698 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-13T14:43:47.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:46 smithi062 bash[28859]: cluster 2024-02-13T14:43:45.646769+0000 mon.a (mon.0) 699 : cluster 1 Cluster is now healthy 2024-02-13T14:43:47.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:46 smithi062 bash[28859]: cluster 2024-02-13T14:43:45.662953+0000 mon.a (mon.0) 700 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-02-13T14:43:47.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:46 smithi111 bash[23388]: cluster 2024-02-13T14:43:45.153115+0000 mgr.y (mgr.14152) 350 : cluster 0 pgmap v339: 132 pgs: 132 active+clean; 581 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 66 KiB/s rd, 5.0 KiB/s wr, 155 op/s 2024-02-13T14:43:47.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:46 smithi111 bash[23388]: cluster 2024-02-13T14:43:45.646718+0000 mon.a (mon.0) 698 : cluster 1 Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-02-13T14:43:47.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:46 smithi111 bash[23388]: cluster 2024-02-13T14:43:45.646769+0000 mon.a (mon.0) 699 : cluster 1 Cluster is now healthy 2024-02-13T14:43:47.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:46 smithi111 bash[23388]: cluster 2024-02-13T14:43:45.662953+0000 mon.a (mon.0) 700 : cluster 0 osdmap e69: 8 total, 8 up, 8 in 2024-02-13T14:43:47.353 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch apply iscsi datapool admin admin --trusted_ip_list 172.21.15.111 --placement '1;smithi111=iscsi.a' 2024-02-13T14:43:48.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:47 smithi062 bash[21479]: cluster 2024-02-13T14:43:46.665444+0000 mon.a (mon.0) 701 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-02-13T14:43:48.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:47 smithi062 bash[28859]: cluster 2024-02-13T14:43:46.665444+0000 mon.a (mon.0) 701 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-02-13T14:43:48.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:47 smithi111 bash[23388]: cluster 2024-02-13T14:43:46.665444+0000 mon.a (mon.0) 701 : cluster 0 osdmap e70: 8 total, 8 up, 8 in 2024-02-13T14:43:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:48 smithi062 bash[21479]: cluster 2024-02-13T14:43:47.153898+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 6.5 KiB/s wr, 206 op/s 2024-02-13T14:43:49.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:48 smithi062 bash[28859]: cluster 2024-02-13T14:43:47.153898+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 6.5 KiB/s wr, 206 op/s 2024-02-13T14:43:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:48 smithi111 bash[23388]: cluster 2024-02-13T14:43:47.153898+0000 mgr.y (mgr.14152) 351 : cluster 0 pgmap v342: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 87 KiB/s rd, 6.5 KiB/s wr, 206 op/s 2024-02-13T14:43:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:50 smithi062 bash[21479]: cluster 2024-02-13T14:43:49.155199+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.8 KiB/s wr, 138 op/s 2024-02-13T14:43:51.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:50 smithi062 bash[28859]: cluster 2024-02-13T14:43:49.155199+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.8 KiB/s wr, 138 op/s 2024-02-13T14:43:51.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:50 smithi111 bash[23388]: cluster 2024-02-13T14:43:49.155199+0000 mgr.y (mgr.14152) 352 : cluster 0 pgmap v343: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s rd, 4.8 KiB/s wr, 138 op/s 2024-02-13T14:43:52.105 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:43:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:52 smithi062 bash[21479]: cluster 2024-02-13T14:43:51.155996+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.5 KiB/s wr, 44 op/s 2024-02-13T14:43:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:52 smithi062 bash[21479]: cluster 2024-02-13T14:43:51.298011+0000 mon.a (mon.0) 702 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-02-13T14:43:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:52 smithi062 bash[28859]: cluster 2024-02-13T14:43:51.155996+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.5 KiB/s wr, 44 op/s 2024-02-13T14:43:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:52 smithi062 bash[28859]: cluster 2024-02-13T14:43:51.298011+0000 mon.a (mon.0) 702 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-02-13T14:43:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:52 smithi111 bash[23388]: cluster 2024-02-13T14:43:51.155996+0000 mgr.y (mgr.14152) 353 : cluster 0 pgmap v344: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 1.5 KiB/s wr, 44 op/s 2024-02-13T14:43:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:52 smithi111 bash[23388]: cluster 2024-02-13T14:43:51.298011+0000 mon.a (mon.0) 702 : cluster 0 osdmap e71: 8 total, 8 up, 8 in 2024-02-13T14:43:54.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:54 smithi062 bash[28859]: cluster 2024-02-13T14:43:53.156979+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 38 op/s 2024-02-13T14:43:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:54 smithi062 bash[21479]: cluster 2024-02-13T14:43:53.156979+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 38 op/s 2024-02-13T14:43:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:54 smithi111 bash[23388]: cluster 2024-02-13T14:43:53.156979+0000 mgr.y (mgr.14152) 354 : cluster 0 pgmap v346: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 16 KiB/s rd, 1.3 KiB/s wr, 38 op/s 2024-02-13T14:43:54.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.669+0000 7f787deb4700 1 -- 172.21.15.111:0/1167633534 >> v1:172.21.15.111:6789/0 conn(0x7f7878074880 legacy=0x7f787810a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:54.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.669+0000 7f787deb4700 1 -- 172.21.15.111:0/1167633534 shutdown_connections 2024-02-13T14:43:54.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.669+0000 7f787deb4700 1 -- 172.21.15.111:0/1167633534 >> 172.21.15.111:0/1167633534 conn(0x7f78780fd070 msgr2=0x7f78780ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:54.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.669+0000 7f787deb4700 1 -- 172.21.15.111:0/1167633534 shutdown_connections 2024-02-13T14:43:54.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.669+0000 7f787deb4700 1 -- 172.21.15.111:0/1167633534 wait complete. 2024-02-13T14:43:54.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.669+0000 7f787deb4700 1 Processor -- start 2024-02-13T14:43:54.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f787deb4700 1 -- start start 2024-02-13T14:43:54.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f787deb4700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f7878199ac0 con 0x7f7878074880 2024-02-13T14:43:54.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f787deb4700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f78781a52b0 con 0x7f7878075c20 2024-02-13T14:43:54.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f787deb4700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f78781a6450 con 0x7f787810c050 2024-02-13T14:43:54.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f786effd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f7878075c20 0x7f787819f450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:49982/0 (socket says 172.21.15.111:49982) 2024-02-13T14:43:54.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f786effd700 1 -- 172.21.15.111:0/708058547 learned_addr learned my addr 172.21.15.111:0/708058547 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855600911 0 0) 0x7f78781a52b0 con 0x7f7878075c20 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78640035b0 con 0x7f7878075c20 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1589647432 0 0) 0x7f78640035b0 con 0x7f7878075c20 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78781a52b0 con 0x7f7878075c20 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f7860001430 con 0x7f7878075c20 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067933904 0 0) 0x7f7878199ac0 con 0x7f7878074880 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78640035b0 con 0x7f7878074880 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022596691 0 0) 0x7f78781a6450 con 0x7f787810c050 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7878199ac0 con 0x7f787810c050 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1032616740 0 0) 0x7f78781a52b0 con 0x7f7878075c20 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 >> v1:172.21.15.62:6790/0 conn(0x7f787810c050 legacy=0x7f78781a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 >> v1:172.21.15.62:6789/0 conn(0x7f7878074880 legacy=0x7f7878198f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78781a75f0 con 0x7f7878075c20 2024-02-13T14:43:54.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78781a4300 con 0x7f7878075c20 2024-02-13T14:43:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f78781a4800 con 0x7f7878075c20 2024-02-13T14:43:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f78600016f0 con 0x7f7878075c20 2024-02-13T14:43:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f7860005080 con 0x7f7878075c20 2024-02-13T14:43:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7858005150 con 0x7f7878075c20 2024-02-13T14:43:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 15) v1 ==== 91715+0+0 (unknown 2304362302 0 0) 0x7f7860005200 con 0x7f7878075c20 2024-02-13T14:43:54.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.673+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 5942+0+0 (unknown 235741708 0 0) 0x7f7860089250 con 0x7f7878075c20 2024-02-13T14:43:54.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.681+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f7860052810 con 0x7f7878075c20 2024-02-13T14:43:54.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.889+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.111", "placement": "1;smithi111=iscsi.a", "target": ["mon-mgr", ""]}) v1 -- 0x7f7858000c90 con 0x7f786406ed00 2024-02-13T14:43:54.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.905+0000 7f78757fa700 1 -- 172.21.15.111:0/708058547 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+35 (unknown 0 0 803663096) 0x7f7858000c90 con 0x7f786406ed00 2024-02-13T14:43:54.908 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled iscsi.datapool update... 2024-02-13T14:43:54.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.909+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 >> v1:172.21.15.62:6800/1926838190 conn(0x7f786406ed00 legacy=0x7f78640711c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:54.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.909+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 >> v1:172.21.15.111:6789/0 conn(0x7f7878075c20 legacy=0x7f787819f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:43:54.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.909+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 shutdown_connections 2024-02-13T14:43:54.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.909+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 >> 172.21.15.111:0/708058547 conn(0x7f78780fd070 msgr2=0x7f78780fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:43:54.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.909+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 shutdown_connections 2024-02-13T14:43:54.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:43:54.909+0000 7f787deb4700 1 -- 172.21.15.111:0/708058547 wait complete. 2024-02-13T14:43:55.551 INFO:tasks.cephadm:Distributing iscsi-gateway.cfg... 2024-02-13T14:43:55.552 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:43:55.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-02-13T14:43:55.565 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:43:55.565 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/iscsi-gateway.cfg 2024-02-13T14:43:55.579 DEBUG:teuthology.orchestra.run.smithi111:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@iscsi.iscsi.a.service 2024-02-13T14:43:55.631 INFO:tasks.cephadm:Adding prometheus.a on smithi111 2024-02-13T14:43:55.632 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch apply prometheus '1;smithi111=a' 2024-02-13T14:43:56.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:54.895043+0000 mgr.y (mgr.14152) 355 : audit 0 from='client.24472 v1:172.21.15.111:0/708058547' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.111", "placement": "1;smithi111=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:43:56.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: cephadm 2024-02-13T14:43:54.901320+0000 mgr.y (mgr.14152) 356 : cephadm 1 Saving service iscsi.datapool spec with placement smithi111=iscsi.a;count:1 2024-02-13T14:43:56.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:54.908858+0000 mon.a (mon.0) 703 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:54.939641+0000 mon.a (mon.0) 704 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: cluster 2024-02-13T14:43:55.158046+0000 mgr.y (mgr.14152) 357 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 241 B/s wr, 0 op/s 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:55.617171+0000 mon.a (mon.0) 705 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:55.618641+0000 mon.a (mon.0) 706 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:55.626152+0000 mon.a (mon.0) 707 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:55.633408+0000 mon.a (mon.0) 708 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:55.636536+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: audit 2024-02-13T14:43:55.665175+0000 mon.a (mon.0) 710 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[21479]: cephadm 2024-02-13T14:43:55.667228+0000 mgr.y (mgr.14152) 358 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi111 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:54.895043+0000 mgr.y (mgr.14152) 355 : audit 0 from='client.24472 v1:172.21.15.111:0/708058547' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.111", "placement": "1;smithi111=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:43:56.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: cephadm 2024-02-13T14:43:54.901320+0000 mgr.y (mgr.14152) 356 : cephadm 1 Saving service iscsi.datapool spec with placement smithi111=iscsi.a;count:1 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:54.908858+0000 mon.a (mon.0) 703 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:54.939641+0000 mon.a (mon.0) 704 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: cluster 2024-02-13T14:43:55.158046+0000 mgr.y (mgr.14152) 357 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 241 B/s wr, 0 op/s 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:55.617171+0000 mon.a (mon.0) 705 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:55.618641+0000 mon.a (mon.0) 706 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:55.626152+0000 mon.a (mon.0) 707 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:55.633408+0000 mon.a (mon.0) 708 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:55.636536+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: audit 2024-02-13T14:43:55.665175+0000 mon.a (mon.0) 710 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:56.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:55 smithi062 bash[28859]: cephadm 2024-02-13T14:43:55.667228+0000 mgr.y (mgr.14152) 358 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi111 2024-02-13T14:43:56.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:54.895043+0000 mgr.y (mgr.14152) 355 : audit 0 from='client.24472 v1:172.21.15.111:0/708058547' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "datapool", "api_user": "admin", "api_password": "admin", "trusted_ip_list": "172.21.15.111", "placement": "1;smithi111=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:43:56.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: cephadm 2024-02-13T14:43:54.901320+0000 mgr.y (mgr.14152) 356 : cephadm 1 Saving service iscsi.datapool spec with placement smithi111=iscsi.a;count:1 2024-02-13T14:43:56.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:54.908858+0000 mon.a (mon.0) 703 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:54.939641+0000 mon.a (mon.0) 704 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: cluster 2024-02-13T14:43:55.158046+0000 mgr.y (mgr.14152) 357 : cluster 0 pgmap v347: 132 pgs: 132 active+clean; 582 KiB data, 238 MiB used, 715 GiB / 715 GiB avail; 241 B/s wr, 0 op/s 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:55.617171+0000 mon.a (mon.0) 705 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:55.618641+0000 mon.a (mon.0) 706 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:55.626152+0000 mon.a (mon.0) 707 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:55.633408+0000 mon.a (mon.0) 708 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:55.636536+0000 mon.a (mon.0) 709 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: audit 2024-02-13T14:43:55.665175+0000 mon.a (mon.0) 710 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:43:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:55 smithi111 bash[23388]: cephadm 2024-02-13T14:43:55.667228+0000 mgr.y (mgr.14152) 358 : cephadm 1 Deploying daemon iscsi.iscsi.a on smithi111 2024-02-13T14:43:58.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.096 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.096 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.096 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.097 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.097 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.388 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.388 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.389 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.389 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.389 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:58 smithi111 bash[23388]: cluster 2024-02-13T14:43:57.159122+0000 mgr.y (mgr.14152) 359 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-02-13T14:43:58.389 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:58 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:43:58.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:58 smithi062 bash[21479]: cluster 2024-02-13T14:43:57.159122+0000 mgr.y (mgr.14152) 359 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-02-13T14:43:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:58 smithi062 bash[28859]: cluster 2024-02-13T14:43:57.159122+0000 mgr.y (mgr.14152) 359 : cluster 0 pgmap v348: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 204 B/s wr, 0 op/s 2024-02-13T14:43:59.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[21479]: audit 2024-02-13T14:43:58.454913+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[21479]: audit 2024-02-13T14:43:58.468414+0000 mon.a (mon.0) 712 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[21479]: audit 2024-02-13T14:43:58.497480+0000 mon.a (mon.0) 713 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[21479]: cephadm 2024-02-13T14:43:58.499212+0000 mgr.y (mgr.14152) 360 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-02-13T14:43:59.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[21479]: audit 2024-02-13T14:43:58.515485+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[21479]: audit 2024-02-13T14:43:58.580376+0000 mon.a (mon.0) 715 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:59.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[28859]: audit 2024-02-13T14:43:58.454913+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[28859]: audit 2024-02-13T14:43:58.468414+0000 mon.a (mon.0) 712 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[28859]: audit 2024-02-13T14:43:58.497480+0000 mon.a (mon.0) 713 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[28859]: cephadm 2024-02-13T14:43:58.499212+0000 mgr.y (mgr.14152) 360 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-02-13T14:43:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[28859]: audit 2024-02-13T14:43:58.515485+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:43:59 smithi062 bash[28859]: audit 2024-02-13T14:43:58.580376+0000 mon.a (mon.0) 715 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:43:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:59 smithi111 bash[23388]: audit 2024-02-13T14:43:58.454913+0000 mon.a (mon.0) 711 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:59 smithi111 bash[23388]: audit 2024-02-13T14:43:58.468414+0000 mon.a (mon.0) 712 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:59 smithi111 bash[23388]: audit 2024-02-13T14:43:58.497480+0000 mon.a (mon.0) 713 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:59 smithi111 bash[23388]: cephadm 2024-02-13T14:43:58.499212+0000 mgr.y (mgr.14152) 360 : cephadm 1 Checking pool "datapool" exists for service iscsi.datapool 2024-02-13T14:43:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:59 smithi111 bash[23388]: audit 2024-02-13T14:43:58.515485+0000 mon.a (mon.0) 714 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:43:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:43:59 smithi111 bash[23388]: audit 2024-02-13T14:43:58.580376+0000 mon.a (mon.0) 715 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:00.184 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:43:59 smithi111 bash[47639]: debug Processing osd blocklist entries for this node 2024-02-13T14:44:00.185 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:00 smithi111 bash[47639]: debug Reading the configuration object to update local LIO configuration 2024-02-13T14:44:00.185 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:00 smithi111 bash[47639]: debug Configuration does not have an entry for this host(smithi111.front.sepia.ceph.com) - nothing to define to LIO 2024-02-13T14:44:00.515 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:00 smithi111 bash[47639]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2024-02-13T14:44:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:00 smithi062 bash[21479]: cluster 2024-02-13T14:43:59.160298+0000 mgr.y (mgr.14152) 361 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:00 smithi062 bash[21479]: audit 2024-02-13T14:44:00.171526+0000 mon.b (mon.1) 28 : audit 0 from='client.? v1:172.21.15.111:0/2966383121' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-13T14:44:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:00 smithi062 bash[28859]: cluster 2024-02-13T14:43:59.160298+0000 mgr.y (mgr.14152) 361 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:00 smithi062 bash[28859]: audit 2024-02-13T14:44:00.171526+0000 mon.b (mon.1) 28 : audit 0 from='client.? v1:172.21.15.111:0/2966383121' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-13T14:44:00.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:00 smithi111 bash[23388]: cluster 2024-02-13T14:43:59.160298+0000 mgr.y (mgr.14152) 361 : cluster 0 pgmap v349: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:00.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:00 smithi111 bash[23388]: audit 2024-02-13T14:44:00.171526+0000 mon.b (mon.1) 28 : audit 0 from='client.? v1:172.21.15.111:0/2966383121' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-13T14:44:01.432 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:44:01.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:01 smithi062 bash[21479]: cluster 2024-02-13T14:44:00.543046+0000 mon.a (mon.0) 716 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-02-13T14:44:01.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:01 smithi062 bash[28859]: cluster 2024-02-13T14:44:00.543046+0000 mon.a (mon.0) 716 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-02-13T14:44:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:01 smithi111 bash[23388]: cluster 2024-02-13T14:44:00.543046+0000 mon.a (mon.0) 716 : cluster 0 mgrmap e16: y(active, since 9m), standbys: x 2024-02-13T14:44:02.721 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:02 smithi111 bash[23388]: cluster 2024-02-13T14:44:01.161076+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:02.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:02 smithi062 bash[21479]: cluster 2024-02-13T14:44:01.161076+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:02.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:02 smithi062 bash[28859]: cluster 2024-02-13T14:44:01.161076+0000 mgr.y (mgr.14152) 362 : cluster 0 pgmap v350: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:04.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.017+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3305533854 >> v1:172.21.15.111:6789/0 conn(0x7fad08109c20 legacy=0x7fad0810c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:04.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.017+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3305533854 shutdown_connections 2024-02-13T14:44:04.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.017+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3305533854 >> 172.21.15.111:0/3305533854 conn(0x7fad080fd070 msgr2=0x7fad080ff490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:04.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.017+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3305533854 shutdown_connections 2024-02-13T14:44:04.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.017+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3305533854 wait complete. 2024-02-13T14:44:04.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad0ebbd700 1 Processor -- start 2024-02-13T14:44:04.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad0ebbd700 1 -- start start 2024-02-13T14:44:04.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad0ebbd700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fad081a41c0 con 0x7fad08109c20 2024-02-13T14:44:04.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad0ebbd700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fad081a53c0 con 0x7fad08105ee0 2024-02-13T14:44:04.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad0ebbd700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fad081a65c0 con 0x7fad08101ab0 2024-02-13T14:44:04.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad07fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fad08105ee0 0x7fad0819efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:46888/0 (socket says 172.21.15.111:46888) 2024-02-13T14:44:04.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad07fff700 1 -- 172.21.15.111:0/3245801191 learned_addr learned my addr 172.21.15.111:0/3245801191 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:44:04.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376248573 0 0) 0x7fad081a53c0 con 0x7fad08105ee0 2024-02-13T14:44:04.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf40035b0 con 0x7fad08105ee0 2024-02-13T14:44:04.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 638581833 0 0) 0x7facf40035b0 con 0x7fad08105ee0 2024-02-13T14:44:04.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fad081a53c0 con 0x7fad08105ee0 2024-02-13T14:44:04.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7facf0001930 con 0x7fad08105ee0 2024-02-13T14:44:04.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1676418277 0 0) 0x7fad081a65c0 con 0x7fad08101ab0 2024-02-13T14:44:04.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf40035b0 con 0x7fad08101ab0 2024-02-13T14:44:04.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089328855 0 0) 0x7fad081a41c0 con 0x7fad08109c20 2024-02-13T14:44:04.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad081a65c0 con 0x7fad08109c20 2024-02-13T14:44:04.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1446897054 0 0) 0x7fad081a53c0 con 0x7fad08105ee0 2024-02-13T14:44:04.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 >> v1:172.21.15.62:6790/0 conn(0x7fad08101ab0 legacy=0x7fad08075930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:04.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 >> v1:172.21.15.62:6789/0 conn(0x7fad08109c20 legacy=0x7fad081a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:04.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad081a77c0 con 0x7fad08105ee0 2024-02-13T14:44:04.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad081a67b0 con 0x7fad08105ee0 2024-02-13T14:44:04.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fad081a6cb0 con 0x7fad08105ee0 2024-02-13T14:44:04.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7facf0001d00 con 0x7fad08105ee0 2024-02-13T14:44:04.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7facf0005d60 con 0x7fad08105ee0 2024-02-13T14:44:04.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face8005120 con 0x7fad08105ee0 2024-02-13T14:44:04.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.021+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 16) v1 ==== 91766+0+0 (unknown 34175280 0 0) 0x7facf00040f0 con 0x7fad08105ee0 2024-02-13T14:44:04.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.025+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 5942+0+0 (unknown 235741708 0 0) 0x7facf0088f10 con 0x7fad08105ee0 2024-02-13T14:44:04.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.029+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7facf0052370 con 0x7fad08105ee0 2024-02-13T14:44:04.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.253+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}) v1 -- 0x7face8000b90 con 0x7facf406ed70 2024-02-13T14:44:04.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.269+0000 7fad05ffb700 1 -- 172.21.15.111:0/3245801191 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (unknown 0 0 1342662408) 0x7face8000b90 con 0x7facf406ed70 2024-02-13T14:44:04.271 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled prometheus update... 2024-02-13T14:44:04.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.273+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 >> v1:172.21.15.62:6800/1926838190 conn(0x7facf406ed70 legacy=0x7facf4071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:04.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.273+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 >> v1:172.21.15.111:6789/0 conn(0x7fad08105ee0 legacy=0x7fad0819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:04.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.273+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 shutdown_connections 2024-02-13T14:44:04.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.273+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 >> 172.21.15.111:0/3245801191 conn(0x7fad080fd070 msgr2=0x7fad0810c840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:04.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.273+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 shutdown_connections 2024-02-13T14:44:04.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:04.273+0000 7fad0ebbd700 1 -- 172.21.15.111:0/3245801191 wait complete. 2024-02-13T14:44:04.284 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:04 smithi111 bash[23388]: audit 2024-02-13T14:44:03.050510+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:04.284 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:04 smithi111 bash[23388]: cluster 2024-02-13T14:44:03.162213+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:04.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:04 smithi062 bash[28859]: audit 2024-02-13T14:44:03.050510+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:04.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:04 smithi062 bash[28859]: cluster 2024-02-13T14:44:03.162213+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:04.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:04 smithi062 bash[21479]: audit 2024-02-13T14:44:03.050510+0000 mon.a (mon.0) 717 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:04.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:04 smithi062 bash[21479]: cluster 2024-02-13T14:44:03.162213+0000 mgr.y (mgr.14152) 363 : cluster 0 pgmap v351: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:04.915 DEBUG:teuthology.orchestra.run.smithi111:prometheus.a> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@prometheus.a.service 2024-02-13T14:44:04.917 INFO:tasks.cephadm:Adding node-exporter.a on smithi062 2024-02-13T14:44:04.917 INFO:tasks.cephadm:Adding node-exporter.b on smithi111 2024-02-13T14:44:04.918 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch apply node-exporter '2;smithi062=a;smithi111=b' 2024-02-13T14:44:05.170 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:05 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.173795+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.184466+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.186843+0000 mon.a (mon.0) 720 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.188670+0000 mon.a (mon.0) 721 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.198883+0000 mon.a (mon.0) 722 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.258907+0000 mgr.y (mgr.14152) 364 : audit 0 from='client.24508 v1:172.21.15.111:0/3245801191' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: cephadm 2024-02-13T14:44:04.263301+0000 mgr.y (mgr.14152) 365 : cephadm 1 Saving service prometheus spec with placement smithi111=a;count:1 2024-02-13T14:44:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.272720+0000 mon.a (mon.0) 723 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.282076+0000 mon.a (mon.0) 724 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.282973+0000 mgr.y (mgr.14152) 366 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: cephadm 2024-02-13T14:44:04.285007+0000 mgr.y (mgr.14152) 367 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.285617+0000 mon.a (mon.0) 725 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.286191+0000 mgr.y (mgr.14152) 368 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.292843+0000 mon.a (mon.0) 726 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.305048+0000 mon.a (mon.0) 727 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.305938+0000 mgr.y (mgr.14152) 369 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.320940+0000 mon.a (mon.0) 728 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.326033+0000 mon.a (mon.0) 729 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.328820+0000 mon.a (mon.0) 730 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.330005+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: audit 2024-02-13T14:44:04.339507+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:05 smithi111 bash[23388]: cephadm 2024-02-13T14:44:04.653427+0000 mgr.y (mgr.14152) 370 : cephadm 1 Deploying daemon prometheus.a on smithi111 2024-02-13T14:44:05.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.173795+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.184466+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.186843+0000 mon.a (mon.0) 720 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.188670+0000 mon.a (mon.0) 721 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.198883+0000 mon.a (mon.0) 722 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.258907+0000 mgr.y (mgr.14152) 364 : audit 0 from='client.24508 v1:172.21.15.111:0/3245801191' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: cephadm 2024-02-13T14:44:04.263301+0000 mgr.y (mgr.14152) 365 : cephadm 1 Saving service prometheus spec with placement smithi111=a;count:1 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.272720+0000 mon.a (mon.0) 723 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.282076+0000 mon.a (mon.0) 724 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.282973+0000 mgr.y (mgr.14152) 366 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: cephadm 2024-02-13T14:44:04.285007+0000 mgr.y (mgr.14152) 367 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.285617+0000 mon.a (mon.0) 725 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.286191+0000 mgr.y (mgr.14152) 368 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.292843+0000 mon.a (mon.0) 726 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.305048+0000 mon.a (mon.0) 727 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.305938+0000 mgr.y (mgr.14152) 369 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.320940+0000 mon.a (mon.0) 728 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.326033+0000 mon.a (mon.0) 729 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.328820+0000 mon.a (mon.0) 730 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.173795+0000 mon.a (mon.0) 718 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.184466+0000 mon.a (mon.0) 719 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.186843+0000 mon.a (mon.0) 720 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.188670+0000 mon.a (mon.0) 721 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.198883+0000 mon.a (mon.0) 722 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.258907+0000 mgr.y (mgr.14152) 364 : audit 0 from='client.24508 v1:172.21.15.111:0/3245801191' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: cephadm 2024-02-13T14:44:04.263301+0000 mgr.y (mgr.14152) 365 : cephadm 1 Saving service prometheus spec with placement smithi111=a;count:1 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.272720+0000 mon.a (mon.0) 723 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.282076+0000 mon.a (mon.0) 724 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.282973+0000 mgr.y (mgr.14152) 366 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: cephadm 2024-02-13T14:44:04.285007+0000 mgr.y (mgr.14152) 367 : cephadm 1 Adding iSCSI gateway http://:@172.21.15.111:5000 to Dashboard 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.285617+0000 mon.a (mon.0) 725 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.286191+0000 mgr.y (mgr.14152) 368 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.292843+0000 mon.a (mon.0) 726 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.305048+0000 mon.a (mon.0) 727 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.305938+0000 mgr.y (mgr.14152) 369 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi111"}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.320940+0000 mon.a (mon.0) 728 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.326033+0000 mon.a (mon.0) 729 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.328820+0000 mon.a (mon.0) 730 : audit 0 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.330005+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:05.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: audit 2024-02-13T14:44:04.339507+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[28859]: cephadm 2024-02-13T14:44:04.653427+0000 mgr.y (mgr.14152) 370 : cephadm 1 Deploying daemon prometheus.a on smithi111 2024-02-13T14:44:05.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.330005+0000 mon.a (mon.0) 731 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:05.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: audit 2024-02-13T14:44:04.339507+0000 mon.a (mon.0) 732 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:05.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:05 smithi062 bash[21479]: cephadm 2024-02-13T14:44:04.653427+0000 mgr.y (mgr.14152) 370 : cephadm 1 Deploying daemon prometheus.a on smithi111 2024-02-13T14:44:06.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:06 smithi111 bash[23388]: cluster 2024-02-13T14:44:05.163332+0000 mgr.y (mgr.14152) 371 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:06.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:06 smithi062 bash[21479]: cluster 2024-02-13T14:44:05.163332+0000 mgr.y (mgr.14152) 371 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:06.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:06 smithi062 bash[28859]: cluster 2024-02-13T14:44:05.163332+0000 mgr.y (mgr.14152) 371 : cluster 0 pgmap v352: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:08 smithi111 bash[23388]: cluster 2024-02-13T14:44:07.164347+0000 mgr.y (mgr.14152) 372 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:08 smithi062 bash[21479]: cluster 2024-02-13T14:44:07.164347+0000 mgr.y (mgr.14152) 372 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:08.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:08 smithi062 bash[28859]: cluster 2024-02-13T14:44:07.164347+0000 mgr.y (mgr.14152) 372 : cluster 0 pgmap v353: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:09.687 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:44:10.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:09 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:44:10.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:10 smithi062 bash[21479]: cluster 2024-02-13T14:44:09.165523+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:10.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:10 smithi062 bash[28859]: cluster 2024-02-13T14:44:09.165523+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:10 smithi111 bash[23388]: cluster 2024-02-13T14:44:09.165523+0000 mgr.y (mgr.14152) 373 : cluster 0 pgmap v354: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:11.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:11 smithi062 bash[21479]: audit 2024-02-13T14:44:09.871123+0000 mgr.y (mgr.14152) 374 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:11.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:11 smithi062 bash[28859]: audit 2024-02-13T14:44:09.871123+0000 mgr.y (mgr.14152) 374 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:11.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:11 smithi111 bash[23388]: audit 2024-02-13T14:44:09.871123+0000 mgr.y (mgr.14152) 374 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:12.773 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:12 smithi111 bash[23388]: cluster 2024-02-13T14:44:11.166296+0000 mgr.y (mgr.14152) 375 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:12.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:12 smithi062 bash[21479]: cluster 2024-02-13T14:44:11.166296+0000 mgr.y (mgr.14152) 375 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:12.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:12 smithi062 bash[28859]: cluster 2024-02-13T14:44:11.166296+0000 mgr.y (mgr.14152) 375 : cluster 0 pgmap v355: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:14.734 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:14 smithi111 bash[23388]: cluster 2024-02-13T14:44:13.167446+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:14.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:14 smithi062 bash[21479]: cluster 2024-02-13T14:44:13.167446+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:14 smithi062 bash[28859]: cluster 2024-02-13T14:44:13.167446+0000 mgr.y (mgr.14152) 376 : cluster 0 pgmap v356: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:15.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- 172.21.15.111:0/1836518843 >> v1:172.21.15.111:6789/0 conn(0x7f6660109be0 legacy=0x7f666010c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:15.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- 172.21.15.111:0/1836518843 shutdown_connections 2024-02-13T14:44:15.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- 172.21.15.111:0/1836518843 >> 172.21.15.111:0/1836518843 conn(0x7f66600fbf40 msgr2=0x7f66600fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:15.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- 172.21.15.111:0/1836518843 shutdown_connections 2024-02-13T14:44:15.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- 172.21.15.111:0/1836518843 wait complete. 2024-02-13T14:44:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 Processor -- start 2024-02-13T14:44:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- start start 2024-02-13T14:44:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f6660197a00 con 0x7f6660102530 2024-02-13T14:44:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f66601a31f0 con 0x7f6660106040 2024-02-13T14:44:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f66601a4390 con 0x7f6660109be0 2024-02-13T14:44:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f665dd9b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6660106040 0x7f666019d390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:46124/0 (socket says 172.21.15.111:46124) 2024-02-13T14:44:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f665dd9b700 1 -- 172.21.15.111:0/1130030436 learned_addr learned my addr 172.21.15.111:0/1130030436 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:44:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205638221 0 0) 0x7f66601a31f0 con 0x7f6660106040 2024-02-13T14:44:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66480035b0 con 0x7f6660106040 2024-02-13T14:44:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2125095722 0 0) 0x7f66480035b0 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f66601a31f0 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f6654001930 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1179808734 0 0) 0x7f66601a31f0 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 >> v1:172.21.15.62:6790/0 conn(0x7f6660109be0 legacy=0x7f66601a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 >> v1:172.21.15.62:6789/0 conn(0x7f6660102530 legacy=0x7f6660196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66601a5530 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66601a2240 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f66601a2780 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f6654003b30 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.749+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f6654005c90 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.753+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6640005150 con 0x7f6660106040 2024-02-13T14:44:15.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.753+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 16) v1 ==== 91766+0+0 (unknown 34175280 0 0) 0x7f6654003680 con 0x7f6660106040 2024-02-13T14:44:15.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.753+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 5942+0+0 (unknown 235741708 0 0) 0x7f6654089040 con 0x7f6660106040 2024-02-13T14:44:15.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.757+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f6654052310 con 0x7f6660106040 2024-02-13T14:44:15.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:15.985+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi062=a;smithi111=b", "target": ["mon-mgr", ""]}) v1 -- 0x7f6640000bc0 con 0x7f664806ebc0 2024-02-13T14:44:16.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:16.001+0000 7f664f7fe700 1 -- 172.21.15.111:0/1130030436 <== mgr.14152 v1:172.21.15.62:6800/1926838190 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (unknown 0 0 240551134) 0x7f6640000bc0 con 0x7f664806ebc0 2024-02-13T14:44:16.000 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled node-exporter update... 2024-02-13T14:44:16.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:16.005+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 >> v1:172.21.15.62:6800/1926838190 conn(0x7f664806ebc0 legacy=0x7f6648071080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:16.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:16.005+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 >> v1:172.21.15.111:6789/0 conn(0x7f6660106040 legacy=0x7f666019d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:16.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:16.005+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 shutdown_connections 2024-02-13T14:44:16.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:16.005+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 >> 172.21.15.111:0/1130030436 conn(0x7f66600fbf40 msgr2=0x7f66600fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:16.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:16.005+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 shutdown_connections 2024-02-13T14:44:16.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:16.005+0000 7f6664d7c700 1 -- 172.21.15.111:0/1130030436 wait complete. 2024-02-13T14:44:16.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:16 smithi062 bash[21479]: cluster 2024-02-13T14:44:15.168530+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:16.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:16 smithi062 bash[21479]: audit 2024-02-13T14:44:16.001856+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:16.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:16 smithi062 bash[28859]: cluster 2024-02-13T14:44:15.168530+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:16.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:16 smithi062 bash[28859]: audit 2024-02-13T14:44:16.001856+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:16.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:16 smithi111 bash[23388]: cluster 2024-02-13T14:44:15.168530+0000 mgr.y (mgr.14152) 377 : cluster 0 pgmap v357: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 1 op/s 2024-02-13T14:44:16.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:16 smithi111 bash[23388]: audit 2024-02-13T14:44:16.001856+0000 mon.a (mon.0) 733 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:17.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:17 smithi111 bash[23388]: audit 2024-02-13T14:44:15.988951+0000 mgr.y (mgr.14152) 378 : audit 0 from='client.24514 v1:172.21.15.111:0/1130030436' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi062=a;smithi111=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:17.393 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:17 smithi111 bash[23388]: cephadm 2024-02-13T14:44:15.992684+0000 mgr.y (mgr.14152) 379 : cephadm 1 Saving service node-exporter spec with placement smithi062=a;smithi111=b;count:2 2024-02-13T14:44:17.394 DEBUG:teuthology.orchestra.run.smithi062:node-exporter.a> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@node-exporter.a.service 2024-02-13T14:44:17.397 DEBUG:teuthology.orchestra.run.smithi111:node-exporter.b> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@node-exporter.b.service 2024-02-13T14:44:17.399 INFO:tasks.cephadm:Adding alertmanager.a on smithi062 2024-02-13T14:44:17.400 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch apply alertmanager '1;smithi062=a' 2024-02-13T14:44:17.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:17 smithi062 bash[21479]: audit 2024-02-13T14:44:15.988951+0000 mgr.y (mgr.14152) 378 : audit 0 from='client.24514 v1:172.21.15.111:0/1130030436' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi062=a;smithi111=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:17.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:17 smithi062 bash[21479]: cephadm 2024-02-13T14:44:15.992684+0000 mgr.y (mgr.14152) 379 : cephadm 1 Saving service node-exporter spec with placement smithi062=a;smithi111=b;count:2 2024-02-13T14:44:17.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:17 smithi062 bash[28859]: audit 2024-02-13T14:44:15.988951+0000 mgr.y (mgr.14152) 378 : audit 0 from='client.24514 v1:172.21.15.111:0/1130030436' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi062=a;smithi111=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:17.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:17 smithi062 bash[28859]: cephadm 2024-02-13T14:44:15.992684+0000 mgr.y (mgr.14152) 379 : cephadm 1 Saving service node-exporter spec with placement smithi062=a;smithi111=b;count:2 2024-02-13T14:44:18.663 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:18 smithi111 bash[23388]: cluster 2024-02-13T14:44:17.169530+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:18.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:18 smithi062 bash[21479]: cluster 2024-02-13T14:44:17.169530+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:18.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:18 smithi062 bash[28859]: cluster 2024-02-13T14:44:17.169530+0000 mgr.y (mgr.14152) 380 : cluster 0 pgmap v358: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:18.943 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.944 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.944 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.944 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.945 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.945 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.945 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.946 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.946 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.946 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:18.946 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:19.343 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:19.344 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:19.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:19.344 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:19 smithi111 systemd[1]: Started Ceph prometheus.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:44:19.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:19.345 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:19.345 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:18 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:20.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[23388]: audit 2024-02-13T14:44:19.116418+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[23388]: audit 2024-02-13T14:44:19.127038+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.215 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[23388]: audit 2024-02-13T14:44:19.166347+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[23388]: audit 2024-02-13T14:44:19.174409+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-13T14:44:20.216 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[23388]: cluster 2024-02-13T14:44:19.174798+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:20.216 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:19 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:44:20.216 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:19 smithi111 bash[48723]: ts=2024-02-13T14:44:19.997Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-02-13T14:44:20.216 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:19 smithi111 bash[48723]: ts=2024-02-13T14:44:19.997Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-02-13T14:44:20.216 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:19 smithi111 bash[48723]: ts=2024-02-13T14:44:19.997Z caller=main.go:570 level=info host_details="(Linux 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 smithi111 (none))" 2024-02-13T14:44:20.216 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:19 smithi111 bash[48723]: ts=2024-02-13T14:44:19.997Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:19 smithi111 bash[48723]: ts=2024-02-13T14:44:19.997Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:19 smithi111 bash[48723]: ts=2024-02-13T14:44:19.999Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:19 smithi111 bash[48723]: ts=2024-02-13T14:44:19.999Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.001Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.001Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.004Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.004Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.934µs 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.004Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.005Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.005Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=38.381µs wal_replay_duration=427.074µs wbl_replay_duration=146ns total_replay_duration=513.125µs 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.006Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.006Z caller=main.go:1029 level=info msg="TSDB started" 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.006Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-13T14:44:20.217 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.028Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.479677ms db_storage=1.042µs remote_storage=4.632µs web_handler=413ns query_engine=582ns scrape=253.394µs scrape_sd=74.407µs notify=1.241µs notify_sd=2.408µs rules=20.916633ms tracing=6.596µs 2024-02-13T14:44:20.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.028Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-02-13T14:44:20.218 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[48723]: ts=2024-02-13T14:44:20.028Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-02-13T14:44:20.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[21479]: audit 2024-02-13T14:44:19.116418+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[21479]: audit 2024-02-13T14:44:19.127038+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[21479]: audit 2024-02-13T14:44:19.166347+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[21479]: audit 2024-02-13T14:44:19.174409+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-13T14:44:20.392 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[21479]: cluster 2024-02-13T14:44:19.174798+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:20.393 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[21731]: ignoring --setuser ceph since I am not root 2024-02-13T14:44:20.393 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[21731]: ignoring --setgroup ceph since I am not root 2024-02-13T14:44:20.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[28859]: audit 2024-02-13T14:44:19.116418+0000 mon.a (mon.0) 734 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[28859]: audit 2024-02-13T14:44:19.127038+0000 mon.a (mon.0) 735 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[28859]: audit 2024-02-13T14:44:19.166347+0000 mon.a (mon.0) 736 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' 2024-02-13T14:44:20.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[28859]: audit 2024-02-13T14:44:19.174409+0000 mon.a (mon.0) 737 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-13T14:44:20.393 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[28859]: cluster 2024-02-13T14:44:19.174798+0000 mgr.y (mgr.14152) 381 : cluster 0 pgmap v359: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:20.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[24316]: ignoring --setuser ceph since I am not root 2024-02-13T14:44:20.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[24316]: ignoring --setgroup ceph since I am not root 2024-02-13T14:44:20.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[24316]: debug 2024-02-13T14:44:20.233+0000 7f6dad0dd700 1 -- 172.21.15.111:0/2589999987 <== mon.0 v1:172.21.15.62:6789/0 6 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 2717926372 0 0) 0x562b633d2340 con 0x562b64150c00 2024-02-13T14:44:20.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:20 smithi111 bash[24316]: debug 2024-02-13T14:44:20.377+0000 7f6db6eba200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-13T14:44:21.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:20 smithi062 bash[21731]: debug 2024-02-13T14:44:20.388+0000 7f346eb0f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-02-13T14:44:21.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:21 smithi062 bash[21479]: audit 2024-02-13T14:44:20.175170+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-13T14:44:21.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:21 smithi062 bash[21479]: cluster 2024-02-13T14:44:20.187917+0000 mon.a (mon.0) 739 : cluster 0 mgrmap e17: y(active, since 9m), standbys: x 2024-02-13T14:44:21.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:21 smithi062 bash[28859]: audit 2024-02-13T14:44:20.175170+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-13T14:44:21.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:21 smithi062 bash[28859]: cluster 2024-02-13T14:44:20.187917+0000 mon.a (mon.0) 739 : cluster 0 mgrmap e17: y(active, since 9m), standbys: x 2024-02-13T14:44:21.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:21 smithi111 bash[23388]: audit 2024-02-13T14:44:20.175170+0000 mon.a (mon.0) 738 : audit 1 from='mgr.14152 v1:172.21.15.62:0/3676484281' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-13T14:44:21.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:21 smithi111 bash[23388]: cluster 2024-02-13T14:44:20.187917+0000 mon.a (mon.0) 739 : cluster 0 mgrmap e17: y(active, since 9m), standbys: x 2024-02-13T14:44:22.202 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:44:22.224 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:21 smithi111 bash[24316]: debug 2024-02-13T14:44:21.965+0000 7f6db6eba200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T14:44:22.225 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:22 smithi111 bash[24316]: debug 2024-02-13T14:44:22.061+0000 7f6db6eba200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T14:44:22.309 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:22 smithi062 bash[21731]: debug 2024-02-13T14:44:22.024+0000 7f346eb0f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-13T14:44:22.310 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:22 smithi062 bash[21731]: debug 2024-02-13T14:44:22.128+0000 7f346eb0f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-13T14:44:22.592 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:22 smithi111 bash[24316]: debug 2024-02-13T14:44:22.313+0000 7f6db6eba200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T14:44:22.810 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:22 smithi062 bash[21731]: debug 2024-02-13T14:44:22.384+0000 7f346eb0f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-13T14:44:23.338 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:23 smithi111 bash[24316]: debug 2024-02-13T14:44:23.121+0000 7f6db6eba200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T14:44:23.338 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:23 smithi111 bash[24316]: debug 2024-02-13T14:44:23.233+0000 7f6db6eba200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T14:44:23.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:23 smithi062 bash[21731]: debug 2024-02-13T14:44:23.212+0000 7f346eb0f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-13T14:44:23.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:23 smithi062 bash[21731]: debug 2024-02-13T14:44:23.328+0000 7f346eb0f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-13T14:44:23.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:23 smithi062 bash[21731]: debug 2024-02-13T14:44:23.436+0000 7f346eb0f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T14:44:23.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:23 smithi111 bash[24316]: debug 2024-02-13T14:44:23.337+0000 7f6db6eba200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-13T14:44:24.059 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:23 smithi062 bash[21731]: debug 2024-02-13T14:44:23.804+0000 7f346eb0f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-13T14:44:24.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:23 smithi062 bash[21731]: debug 2024-02-13T14:44:23.924+0000 7f346eb0f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T14:44:24.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:24 smithi062 bash[21731]: debug 2024-02-13T14:44:24.032+0000 7f346eb0f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T14:44:24.092 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:23 smithi111 bash[24316]: debug 2024-02-13T14:44:23.693+0000 7f6db6eba200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-02-13T14:44:24.093 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:23 smithi111 bash[24316]: debug 2024-02-13T14:44:23.809+0000 7f6db6eba200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-13T14:44:24.093 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:23 smithi111 bash[24316]: debug 2024-02-13T14:44:23.913+0000 7f6db6eba200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-13T14:44:24.538 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:24 smithi111 bash[24316]: debug 2024-02-13T14:44:24.269+0000 7f6db6eba200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T14:44:24.538 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:24 smithi111 bash[24316]: debug 2024-02-13T14:44:24.509+0000 7f6db6eba200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- 172.21.15.111:0/1109088618 >> v1:172.21.15.111:6789/0 conn(0x7f3478109bf0 legacy=0x7f347810c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- 172.21.15.111:0/1109088618 shutdown_connections 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- 172.21.15.111:0/1109088618 >> 172.21.15.111:0/1109088618 conn(0x7f34780fbf80 msgr2=0x7f34780fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- 172.21.15.111:0/1109088618 shutdown_connections 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- 172.21.15.111:0/1109088618 wait complete. 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 Processor -- start 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- start start 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3478110d40 con 0x7f3478109bf0 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f3478109630 con 0x7f34781025d0 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f34781a6590 con 0x7f34781060e0 2024-02-13T14:44:24.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3477fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f34781025d0 0x7f3478108a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:57720/0 (socket says 172.21.15.111:57720) 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3477fff700 1 -- 172.21.15.111:0/4274954704 learned_addr learned my addr 172.21.15.111:0/4274954704 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425001648 0 0) 0x7f3478109630 con 0x7f34781025d0 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34640035b0 con 0x7f34781025d0 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4197620136 0 0) 0x7f34640035b0 con 0x7f34781025d0 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f3478109630 con 0x7f34781025d0 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f34680018b0 con 0x7f34781025d0 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001927855 0 0) 0x7f34781a6590 con 0x7f34781060e0 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34640035b0 con 0x7f34781060e0 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112068290 0 0) 0x7f3478110d40 con 0x7f3478109bf0 2024-02-13T14:44:24.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34781a6590 con 0x7f3478109bf0 2024-02-13T14:44:24.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2592876183 0 0) 0x7f3478109630 con 0x7f34781025d0 2024-02-13T14:44:24.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6790/0 conn(0x7f34781060e0 legacy=0x7f347819f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:24.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6789/0 conn(0x7f3478109bf0 legacy=0x7f34781a2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:24.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34781a7730 con 0x7f34781025d0 2024-02-13T14:44:24.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34781a6780 con 0x7f34781025d0 2024-02-13T14:44:24.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f34781a6c80 con 0x7f34781025d0 2024-02-13T14:44:24.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f3468001ca0 con 0x7f34781025d0 2024-02-13T14:44:24.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3468005d10 con 0x7f34781025d0 2024-02-13T14:44:24.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.709+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3458005120 con 0x7f34781025d0 2024-02-13T14:44:24.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.713+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 17) v1 ==== 91780+0+0 (unknown 412087907 0 0) 0x7f34680039d0 con 0x7f34781025d0 2024-02-13T14:44:24.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.713+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(71..71 src has 1..71) v4 ==== 5942+0+0 (unknown 235741708 0 0) 0x7f3468088f90 con 0x7f34781025d0 2024-02-13T14:44:24.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.713+0000 7f346f7fe700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6800/1926838190 conn(0x7f346406edf0 legacy=0x7f34640712b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/1926838190 2024-02-13T14:44:24.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.717+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f34680523f0 con 0x7f34781025d0 2024-02-13T14:44:24.810 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:24 smithi062 bash[21731]: debug 2024-02-13T14:44:24.404+0000 7f346eb0f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-13T14:44:24.810 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:24 smithi062 bash[21731]: debug 2024-02-13T14:44:24.652+0000 7f346eb0f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-13T14:44:24.843 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:24 smithi111 bash[24316]: debug 2024-02-13T14:44:24.785+0000 7f6db6eba200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T14:44:24.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.917+0000 7f346f7fe700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6800/1926838190 conn(0x7f346406edf0 legacy=0x7f34640712b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/1926838190 2024-02-13T14:44:24.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:24.941+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.62:6800/1926838190 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi062=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f3458000b90 con 0x7f346406edf0 2024-02-13T14:44:25.173 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:24 smithi111 bash[24316]: debug 2024-02-13T14:44:24.897+0000 7f6db6eba200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T14:44:25.309 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:24 smithi062 bash[21731]: debug 2024-02-13T14:44:24.924+0000 7f346eb0f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-13T14:44:25.310 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:25 smithi062 bash[21731]: debug 2024-02-13T14:44:25.044+0000 7f346eb0f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-13T14:44:25.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:25.321+0000 7f346f7fe700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6800/1926838190 conn(0x7f346406edf0 legacy=0x7f34640712b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/1926838190 2024-02-13T14:44:25.587 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:25 smithi062 bash[21731]: debug 2024-02-13T14:44:25.328+0000 7f346eb0f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T14:44:25.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:25 smithi111 bash[24316]: debug 2024-02-13T14:44:25.173+0000 7f6db6eba200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-13T14:44:25.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:25 smithi111 bash[24316]: debug 2024-02-13T14:44:25.413+0000 7f6db6eba200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:44:26.010 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:25 smithi062 bash[21731]: debug 2024-02-13T14:44:25.584+0000 7f346eb0f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:44:26.093 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:25 smithi111 bash[24316]: debug 2024-02-13T14:44:25.821+0000 7f6db6eba200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T14:44:26.093 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:25 smithi111 bash[24316]: debug 2024-02-13T14:44:25.937+0000 7f6db6eba200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T14:44:26.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:26.125+0000 7f346f7fe700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6800/1926838190 conn(0x7f346406edf0 legacy=0x7f34640712b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/1926838190 2024-02-13T14:44:26.309 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:26 smithi062 bash[21731]: debug 2024-02-13T14:44:26.008+0000 7f346eb0f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-13T14:44:26.310 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:26 smithi062 bash[21731]: debug 2024-02-13T14:44:26.132+0000 7f346eb0f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-13T14:44:26.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:26 smithi111 bash[24316]: debug 2024-02-13T14:44:26.185+0000 7f6db6eba200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:44:26.809 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:26 smithi062 bash[21731]: debug 2024-02-13T14:44:26.392+0000 7f346eb0f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-13T14:44:27.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:27 smithi111 bash[24316]: debug 2024-02-13T14:44:27.189+0000 7f6db6eba200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T14:44:27.593 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:27 smithi111 bash[24316]: debug 2024-02-13T14:44:27.305+0000 7f6db6eba200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T14:44:27.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:27.729+0000 7f346f7fe700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6800/1926838190 conn(0x7f346406edf0 legacy=0x7f34640712b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.62:6800/1926838190 2024-02-13T14:44:27.809 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:27 smithi062 bash[21731]: debug 2024-02-13T14:44:27.440+0000 7f346eb0f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-13T14:44:27.810 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:27 smithi062 bash[21731]: debug 2024-02-13T14:44:27.560+0000 7f346eb0f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-13T14:44:28.094 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:27 smithi111 bash[24316]: debug 2024-02-13T14:44:27.597+0000 7f6db6eba200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T14:44:28.094 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:27 smithi111 bash[24316]: debug 2024-02-13T14:44:27.713+0000 7f6db6eba200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-13T14:44:28.309 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:27 smithi062 bash[21731]: debug 2024-02-13T14:44:27.868+0000 7f346eb0f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-13T14:44:28.309 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:27 smithi062 bash[21731]: debug 2024-02-13T14:44:27.988+0000 7f346eb0f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-02-13T14:44:28.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:28.361+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 10 ==== mgrmap(e 18) v1 ==== 91780+0+0 (unknown 2685905348 0 0) 0x7f3468051ea0 con 0x7f34781025d0 2024-02-13T14:44:28.412 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[24316]: debug 2024-02-13T14:44:28.161+0000 7f6db6eba200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T14:44:28.412 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[24316]: debug 2024-02-13T14:44:28.277+0000 7f6db6eba200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T14:44:28.412 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[24316]: [13/Feb/2024:14:44:28] ENGINE Bus STARTING 2024-02-13T14:44:28.412 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[24316]: CherryPy Checker: 2024-02-13T14:44:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[23388]: cluster 2024-02-13T14:44:28.303980+0000 mon.a (mon.0) 740 : cluster 0 Standby manager daemon x restarted 2024-02-13T14:44:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[23388]: cluster 2024-02-13T14:44:28.304133+0000 mon.a (mon.0) 741 : cluster 0 Standby manager daemon x started 2024-02-13T14:44:28.412 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[23388]: audit 2024-02-13T14:44:28.308397+0000 mon.a (mon.0) 742 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T14:44:28.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[23388]: audit 2024-02-13T14:44:28.309287+0000 mon.a (mon.0) 743 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T14:44:28.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[23388]: audit 2024-02-13T14:44:28.311695+0000 mon.a (mon.0) 744 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T14:44:28.413 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[23388]: audit 2024-02-13T14:44:28.313531+0000 mon.a (mon.0) 745 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T14:44:28.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:28.633+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 11 ==== mgrmap(e 19) v1 ==== 91432+0+0 (unknown 2747879026 0 0) 0x7f34680527c0 con 0x7f34781025d0 2024-02-13T14:44:28.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:28.633+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6800/1926838190 conn(0x7f346406edf0 legacy=0x7f34640712b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-13T14:44:28.753 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21731]: debug 2024-02-13T14:44:28.464+0000 7f346eb0f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-13T14:44:28.753 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21731]: debug 2024-02-13T14:44:28.592+0000 7f346eb0f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21479]: cluster 2024-02-13T14:44:28.303980+0000 mon.a (mon.0) 740 : cluster 0 Standby manager daemon x restarted 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21479]: cluster 2024-02-13T14:44:28.304133+0000 mon.a (mon.0) 741 : cluster 0 Standby manager daemon x started 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21479]: audit 2024-02-13T14:44:28.308397+0000 mon.a (mon.0) 742 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21479]: audit 2024-02-13T14:44:28.309287+0000 mon.a (mon.0) 743 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21479]: audit 2024-02-13T14:44:28.311695+0000 mon.a (mon.0) 744 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21479]: audit 2024-02-13T14:44:28.313531+0000 mon.a (mon.0) 745 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[28859]: cluster 2024-02-13T14:44:28.303980+0000 mon.a (mon.0) 740 : cluster 0 Standby manager daemon x restarted 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[28859]: cluster 2024-02-13T14:44:28.304133+0000 mon.a (mon.0) 741 : cluster 0 Standby manager daemon x started 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[28859]: audit 2024-02-13T14:44:28.308397+0000 mon.a (mon.0) 742 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-13T14:44:28.754 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[28859]: audit 2024-02-13T14:44:28.309287+0000 mon.a (mon.0) 743 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-13T14:44:28.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[28859]: audit 2024-02-13T14:44:28.311695+0000 mon.a (mon.0) 744 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-13T14:44:28.755 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[28859]: audit 2024-02-13T14:44:28.313531+0000 mon.a (mon.0) 745 : audit 0 from='mgr.? v1:172.21.15.111:0/2948558655' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-13T14:44:28.803 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[24316]: The Application mounted at '' has an empty config. 2024-02-13T14:44:28.803 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[24316]: [13/Feb/2024:14:44:28] ENGINE Serving on http://:::9283 2024-02-13T14:44:28.803 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:28 smithi111 bash[24316]: [13/Feb/2024:14:44:28] ENGINE Bus STARTED 2024-02-13T14:44:29.059 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21731]: [13/Feb/2024:14:44:28] ENGINE Bus STARTING 2024-02-13T14:44:29.059 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21731]: CherryPy Checker: 2024-02-13T14:44:29.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21731]: The Application mounted at '' has an empty config. 2024-02-13T14:44:29.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21731]: [13/Feb/2024:14:44:28] ENGINE Serving on http://:::9283 2024-02-13T14:44:29.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:28 smithi062 bash[21731]: [13/Feb/2024:14:44:28] ENGINE Bus STARTED 2024-02-13T14:44:29.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.637+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mon.1 v1:172.21.15.111:6789/0 12 ==== mgrmap(e 20) v1 ==== 91524+0+0 (unknown 637304930 0 0) 0x7f3468053090 con 0x7f34781025d0 2024-02-13T14:44:29.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.637+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 --> v1:172.21.15.62:6800/3802446050 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi062=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f3458000b90 con 0x7f3464038cd0 2024-02-13T14:44:29.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.649+0000 7f3475ffb700 1 -- 172.21.15.111:0/4274954704 <== mgr.14613 v1:172.21.15.62:6800/3802446050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (unknown 0 0 1850065467) 0x7f3458000b90 con 0x7f3464038cd0 2024-02-13T14:44:29.650 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled alertmanager update... 2024-02-13T14:44:29.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.653+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.62:6800/3802446050 conn(0x7f3464038cd0 legacy=0x7f346407af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:29.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.653+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 >> v1:172.21.15.111:6789/0 conn(0x7f34781025d0 legacy=0x7f3478108a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:29.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.653+0000 7f347cfb4700 1 -- 172.21.15.111:0/4274954704 reap_dead start 2024-02-13T14:44:29.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.653+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 shutdown_connections 2024-02-13T14:44:29.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.653+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 >> 172.21.15.111:0/4274954704 conn(0x7f34780fbf80 msgr2=0x7f34781003f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:29.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.653+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 shutdown_connections 2024-02-13T14:44:29.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:29.653+0000 7f347ea17700 1 -- 172.21.15.111:0/4274954704 wait complete. 2024-02-13T14:44:29.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: cluster 2024-02-13T14:44:28.367300+0000 mon.a (mon.0) 746 : cluster 0 mgrmap e18: y(active, since 10m), standbys: x 2024-02-13T14:44:29.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: cluster 2024-02-13T14:44:28.616344+0000 mon.a (mon.0) 747 : cluster 1 Active manager daemon y restarted 2024-02-13T14:44:29.666 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: cluster 2024-02-13T14:44:28.617126+0000 mon.a (mon.0) 748 : cluster 1 Activating manager daemon y 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: cluster 2024-02-13T14:44:28.635880+0000 mon.a (mon.0) 749 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: cluster 2024-02-13T14:44:28.636794+0000 mon.a (mon.0) 750 : cluster 0 mgrmap e19: y(active, starting, since 0.0198682s), standbys: x 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.639509+0000 mon.b (mon.1) 29 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.639874+0000 mon.b (mon.1) 30 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.640173+0000 mon.b (mon.1) 31 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.643156+0000 mon.b (mon.1) 32 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.643642+0000 mon.b (mon.1) 33 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.644060+0000 mon.b (mon.1) 34 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.644561+0000 mon.b (mon.1) 35 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.645215+0000 mon.b (mon.1) 36 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:44:29.667 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.646011+0000 mon.b (mon.1) 37 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.646825+0000 mon.b (mon.1) 38 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.647612+0000 mon.b (mon.1) 39 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.648342+0000 mon.b (mon.1) 40 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.649094+0000 mon.b (mon.1) 41 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.649869+0000 mon.b (mon.1) 42 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.650493+0000 mon.b (mon.1) 43 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.651982+0000 mon.b (mon.1) 44 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: cluster 2024-02-13T14:44:28.682672+0000 mon.a (mon.0) 751 : cluster 1 Manager daemon y is now available 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.718174+0000 mon.b (mon.1) 45 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.720683+0000 mon.b (mon.1) 46 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:29.668 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.748914+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:29.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.754168+0000 mon.b (mon.1) 47 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:29.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.768786+0000 mon.b (mon.1) 48 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:44:29.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.769506+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:44:29.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.786520+0000 mon.b (mon.1) 49 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:44:29.669 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[23388]: audit 2024-02-13T14:44:28.787299+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:44:29.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: cluster 2024-02-13T14:44:28.367300+0000 mon.a (mon.0) 746 : cluster 0 mgrmap e18: y(active, since 10m), standbys: x 2024-02-13T14:44:29.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: cluster 2024-02-13T14:44:28.616344+0000 mon.a (mon.0) 747 : cluster 1 Active manager daemon y restarted 2024-02-13T14:44:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: cluster 2024-02-13T14:44:28.617126+0000 mon.a (mon.0) 748 : cluster 1 Activating manager daemon y 2024-02-13T14:44:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: cluster 2024-02-13T14:44:28.635880+0000 mon.a (mon.0) 749 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-02-13T14:44:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: cluster 2024-02-13T14:44:28.636794+0000 mon.a (mon.0) 750 : cluster 0 mgrmap e19: y(active, starting, since 0.0198682s), standbys: x 2024-02-13T14:44:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.639509+0000 mon.b (mon.1) 29 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:44:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.639874+0000 mon.b (mon.1) 30 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:44:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.640173+0000 mon.b (mon.1) 31 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:44:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.643156+0000 mon.b (mon.1) 32 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T14:44:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.643642+0000 mon.b (mon.1) 33 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T14:44:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.644060+0000 mon.b (mon.1) 34 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:44:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.644561+0000 mon.b (mon.1) 35 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:44:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.645215+0000 mon.b (mon.1) 36 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:44:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.646011+0000 mon.b (mon.1) 37 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:44:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.646825+0000 mon.b (mon.1) 38 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:44:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.647612+0000 mon.b (mon.1) 39 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:44:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.648342+0000 mon.b (mon.1) 40 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:44:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.649094+0000 mon.b (mon.1) 41 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:44:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.649869+0000 mon.b (mon.1) 42 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T14:44:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.650493+0000 mon.b (mon.1) 43 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T14:44:29.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: cluster 2024-02-13T14:44:28.367300+0000 mon.a (mon.0) 746 : cluster 0 mgrmap e18: y(active, since 10m), standbys: x 2024-02-13T14:44:29.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: cluster 2024-02-13T14:44:28.616344+0000 mon.a (mon.0) 747 : cluster 1 Active manager daemon y restarted 2024-02-13T14:44:29.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: cluster 2024-02-13T14:44:28.617126+0000 mon.a (mon.0) 748 : cluster 1 Activating manager daemon y 2024-02-13T14:44:29.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: cluster 2024-02-13T14:44:28.635880+0000 mon.a (mon.0) 749 : cluster 0 osdmap e72: 8 total, 8 up, 8 in 2024-02-13T14:44:29.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: cluster 2024-02-13T14:44:28.636794+0000 mon.a (mon.0) 750 : cluster 0 mgrmap e19: y(active, starting, since 0.0198682s), standbys: x 2024-02-13T14:44:29.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.639509+0000 mon.b (mon.1) 29 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-13T14:44:29.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.639874+0000 mon.b (mon.1) 30 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-13T14:44:29.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.640173+0000 mon.b (mon.1) 31 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-13T14:44:29.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.643156+0000 mon.b (mon.1) 32 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-13T14:44:29.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.643642+0000 mon.b (mon.1) 33 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-13T14:44:29.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.644060+0000 mon.b (mon.1) 34 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-13T14:44:29.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.644561+0000 mon.b (mon.1) 35 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-13T14:44:29.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.645215+0000 mon.b (mon.1) 36 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-13T14:44:29.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.646011+0000 mon.b (mon.1) 37 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-13T14:44:29.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.646825+0000 mon.b (mon.1) 38 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-13T14:44:29.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.647612+0000 mon.b (mon.1) 39 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-13T14:44:29.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.648342+0000 mon.b (mon.1) 40 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-13T14:44:29.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.649094+0000 mon.b (mon.1) 41 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-13T14:44:29.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.649869+0000 mon.b (mon.1) 42 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-13T14:44:29.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.650493+0000 mon.b (mon.1) 43 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-13T14:44:29.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.651982+0000 mon.b (mon.1) 44 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T14:44:29.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: cluster 2024-02-13T14:44:28.682672+0000 mon.a (mon.0) 751 : cluster 1 Manager daemon y is now available 2024-02-13T14:44:29.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.718174+0000 mon.b (mon.1) 45 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:29.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.720683+0000 mon.b (mon.1) 46 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:29.818 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.748914+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:29.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.754168+0000 mon.b (mon.1) 47 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:29.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.768786+0000 mon.b (mon.1) 48 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:44:29.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.769506+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:44:29.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.786520+0000 mon.b (mon.1) 49 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:44:29.819 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[21479]: audit 2024-02-13T14:44:28.787299+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:44:29.820 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.651982+0000 mon.b (mon.1) 44 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-13T14:44:29.820 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: cluster 2024-02-13T14:44:28.682672+0000 mon.a (mon.0) 751 : cluster 1 Manager daemon y is now available 2024-02-13T14:44:29.820 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.718174+0000 mon.b (mon.1) 45 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:29.820 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.720683+0000 mon.b (mon.1) 46 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:29.820 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.748914+0000 mon.a (mon.0) 752 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:29.820 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.754168+0000 mon.b (mon.1) 47 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:29.821 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.768786+0000 mon.b (mon.1) 48 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:44:29.821 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.769506+0000 mon.a (mon.0) 753 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-13T14:44:29.821 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.786520+0000 mon.b (mon.1) 49 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:44:29.821 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:29 smithi062 bash[28859]: audit 2024-02-13T14:44:28.787299+0000 mon.a (mon.0) 754 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-13T14:44:30.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:29 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:44:30.436 DEBUG:teuthology.orchestra.run.smithi062:alertmanager.a> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@alertmanager.a.service 2024-02-13T14:44:30.440 INFO:tasks.cephadm:Adding grafana.a on smithi111 2024-02-13T14:44:30.440 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph orch apply grafana '1;smithi111=a' 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: audit 2024-02-13T14:44:29.578156+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: audit 2024-02-13T14:44:29.595822+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: cluster 2024-02-13T14:44:29.633974+0000 mon.a (mon.0) 757 : cluster 0 mgrmap e20: y(active, since 1.01706s), standbys: x 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: cephadm 2024-02-13T14:44:29.645270+0000 mgr.y (mgr.14613) 3 : cephadm 1 Saving service alertmanager spec with placement smithi062=a;count:1 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: audit 2024-02-13T14:44:29.650307+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: cephadm 2024-02-13T14:44:29.756103+0000 mgr.y (mgr.14613) 4 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Bus STARTING 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: cephadm 2024-02-13T14:44:29.858181+0000 mgr.y (mgr.14613) 5 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Serving on http://172.21.15.62:8765 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: audit 2024-02-13T14:44:29.891018+0000 mgr.y (mgr.14613) 6 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: cephadm 2024-02-13T14:44:29.980436+0000 mgr.y (mgr.14613) 7 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Serving on https://172.21.15.62:7150 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[28859]: cephadm 2024-02-13T14:44:29.980591+0000 mgr.y (mgr.14613) 8 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Bus STARTED 2024-02-13T14:44:30.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: audit 2024-02-13T14:44:29.578156+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: audit 2024-02-13T14:44:29.595822+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: cluster 2024-02-13T14:44:29.633974+0000 mon.a (mon.0) 757 : cluster 0 mgrmap e20: y(active, since 1.01706s), standbys: x 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: cephadm 2024-02-13T14:44:29.645270+0000 mgr.y (mgr.14613) 3 : cephadm 1 Saving service alertmanager spec with placement smithi062=a;count:1 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: audit 2024-02-13T14:44:29.650307+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: cephadm 2024-02-13T14:44:29.756103+0000 mgr.y (mgr.14613) 4 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Bus STARTING 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: cephadm 2024-02-13T14:44:29.858181+0000 mgr.y (mgr.14613) 5 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Serving on http://172.21.15.62:8765 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: audit 2024-02-13T14:44:29.891018+0000 mgr.y (mgr.14613) 6 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: cephadm 2024-02-13T14:44:29.980436+0000 mgr.y (mgr.14613) 7 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Serving on https://172.21.15.62:7150 2024-02-13T14:44:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:30 smithi062 bash[21479]: cephadm 2024-02-13T14:44:29.980591+0000 mgr.y (mgr.14613) 8 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Bus STARTED 2024-02-13T14:44:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: audit 2024-02-13T14:44:29.578156+0000 mon.a (mon.0) 755 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: audit 2024-02-13T14:44:29.595822+0000 mon.a (mon.0) 756 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: cluster 2024-02-13T14:44:29.633974+0000 mon.a (mon.0) 757 : cluster 0 mgrmap e20: y(active, since 1.01706s), standbys: x 2024-02-13T14:44:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: cephadm 2024-02-13T14:44:29.645270+0000 mgr.y (mgr.14613) 3 : cephadm 1 Saving service alertmanager spec with placement smithi062=a;count:1 2024-02-13T14:44:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: audit 2024-02-13T14:44:29.650307+0000 mon.a (mon.0) 758 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: cephadm 2024-02-13T14:44:29.756103+0000 mgr.y (mgr.14613) 4 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Bus STARTING 2024-02-13T14:44:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: cephadm 2024-02-13T14:44:29.858181+0000 mgr.y (mgr.14613) 5 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Serving on http://172.21.15.62:8765 2024-02-13T14:44:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: audit 2024-02-13T14:44:29.891018+0000 mgr.y (mgr.14613) 6 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: cephadm 2024-02-13T14:44:29.980436+0000 mgr.y (mgr.14613) 7 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Serving on https://172.21.15.62:7150 2024-02-13T14:44:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:30 smithi111 bash[23388]: cephadm 2024-02-13T14:44:29.980591+0000 mgr.y (mgr.14613) 8 : cephadm 1 [13/Feb/2024:14:44:29] ENGINE Bus STARTED 2024-02-13T14:44:32.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:31 smithi062 bash[21479]: cluster 2024-02-13T14:44:30.644807+0000 mgr.y (mgr.14613) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:31 smithi062 bash[28859]: cluster 2024-02-13T14:44:30.644807+0000 mgr.y (mgr.14613) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:31 smithi111 bash[23388]: cluster 2024-02-13T14:44:30.644807+0000 mgr.y (mgr.14613) 9 : cluster 0 pgmap v4: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:33.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:32 smithi062 bash[21479]: cluster 2024-02-13T14:44:31.649552+0000 mon.a (mon.0) 759 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-02-13T14:44:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:32 smithi062 bash[28859]: cluster 2024-02-13T14:44:31.649552+0000 mon.a (mon.0) 759 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-02-13T14:44:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:32 smithi111 bash[23388]: cluster 2024-02-13T14:44:31.649552+0000 mon.a (mon.0) 759 : cluster 0 mgrmap e21: y(active, since 3s), standbys: x 2024-02-13T14:44:34.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:33 smithi062 bash[28859]: cluster 2024-02-13T14:44:32.645714+0000 mgr.y (mgr.14613) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:34.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:33 smithi062 bash[21479]: cluster 2024-02-13T14:44:32.645714+0000 mgr.y (mgr.14613) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:33 smithi111 bash[23388]: cluster 2024-02-13T14:44:32.645714+0000 mgr.y (mgr.14613) 10 : cluster 0 pgmap v5: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:44:35.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:34 smithi062 bash[28859]: cluster 2024-02-13T14:44:33.661757+0000 mon.a (mon.0) 760 : cluster 0 mgrmap e22: y(active, since 5s), standbys: x 2024-02-13T14:44:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:34 smithi062 bash[21479]: cluster 2024-02-13T14:44:33.661757+0000 mon.a (mon.0) 760 : cluster 0 mgrmap e22: y(active, since 5s), standbys: x 2024-02-13T14:44:35.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:34 smithi111 bash[23388]: cluster 2024-02-13T14:44:33.661757+0000 mon.a (mon.0) 760 : cluster 0 mgrmap e22: y(active, since 5s), standbys: x 2024-02-13T14:44:35.124 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:44:36.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:35 smithi111 bash[23388]: cluster 2024-02-13T14:44:34.646493+0000 mgr.y (mgr.14613) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-02-13T14:44:36.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:35 smithi111 bash[23388]: audit 2024-02-13T14:44:34.844653+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:35 smithi111 bash[23388]: audit 2024-02-13T14:44:34.856074+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:35 smithi111 bash[23388]: audit 2024-02-13T14:44:35.001547+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:35 smithi111 bash[23388]: audit 2024-02-13T14:44:35.013501+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.228 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[28859]: cluster 2024-02-13T14:44:34.646493+0000 mgr.y (mgr.14613) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[28859]: audit 2024-02-13T14:44:34.844653+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[28859]: audit 2024-02-13T14:44:34.856074+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[28859]: audit 2024-02-13T14:44:35.001547+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[28859]: audit 2024-02-13T14:44:35.013501+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[21479]: cluster 2024-02-13T14:44:34.646493+0000 mgr.y (mgr.14613) 11 : cluster 0 pgmap v6: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 24 op/s 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[21479]: audit 2024-02-13T14:44:34.844653+0000 mon.a (mon.0) 761 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[21479]: audit 2024-02-13T14:44:34.856074+0000 mon.a (mon.0) 762 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[21479]: audit 2024-02-13T14:44:35.001547+0000 mon.a (mon.0) 763 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:35 smithi062 bash[21479]: audit 2024-02-13T14:44:35.013501+0000 mon.a (mon.0) 764 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:36.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:44:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:44:37.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.091141+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.098971+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.101101+0000 mon.b (mon.1) 50 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.101619+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.102445+0000 mon.b (mon.1) 51 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.103062+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.104075+0000 mon.b (mon.1) 52 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.104865+0000 mon.a (mon.0) 769 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.105526+0000 mon.b (mon.1) 53 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.106006+0000 mon.a (mon.0) 770 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.106724+0000 mgr.y (mgr.14613) 12 : cephadm 1 Adjusting osd_memory_target on smithi111 to 3804M 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.110797+0000 mon.a (mon.0) 771 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.116298+0000 mon.a (mon.0) 772 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.125507+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.127470+0000 mon.b (mon.1) 54 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.128091+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.129126+0000 mon.b (mon.1) 55 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.129702+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.130350+0000 mon.b (mon.1) 56 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.130900+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.131678+0000 mon.b (mon.1) 57 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.132244+0000 mon.a (mon.0) 777 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.098 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.133089+0000 mgr.y (mgr.14613) 13 : cephadm 1 Adjusting osd_memory_target on smithi062 to 3804M 2024-02-13T14:44:37.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.137221+0000 mon.a (mon.0) 778 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.139504+0000 mon.b (mon.1) 58 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:37.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.140424+0000 mon.b (mon.1) 59 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:37.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.142497+0000 mgr.y (mgr.14613) 14 : cephadm 1 Updating smithi062:/etc/ceph/ceph.conf 2024-02-13T14:44:37.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.142767+0000 mgr.y (mgr.14613) 15 : cephadm 1 Updating smithi111:/etc/ceph/ceph.conf 2024-02-13T14:44:37.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.809103+0000 mon.a (mon.0) 779 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.099 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.819080+0000 mon.a (mon.0) 780 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.407 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.407 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.091141+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.407 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.098971+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.407 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.101101+0000 mon.b (mon.1) 50 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.407 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.101619+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.407 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.102445+0000 mon.b (mon.1) 51 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.407 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.103062+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.104075+0000 mon.b (mon.1) 52 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.104865+0000 mon.a (mon.0) 769 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.105526+0000 mon.b (mon.1) 53 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.106006+0000 mon.a (mon.0) 770 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.106724+0000 mgr.y (mgr.14613) 12 : cephadm 1 Adjusting osd_memory_target on smithi111 to 3804M 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.110797+0000 mon.a (mon.0) 771 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.116298+0000 mon.a (mon.0) 772 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.125507+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.127470+0000 mon.b (mon.1) 54 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.128091+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.129126+0000 mon.b (mon.1) 55 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.129702+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.408 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.130350+0000 mon.b (mon.1) 56 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.091141+0000 mon.a (mon.0) 765 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.098971+0000 mon.a (mon.0) 766 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.101101+0000 mon.b (mon.1) 50 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.101619+0000 mon.a (mon.0) 767 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.102445+0000 mon.b (mon.1) 51 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.103062+0000 mon.a (mon.0) 768 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.104075+0000 mon.b (mon.1) 52 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.104865+0000 mon.a (mon.0) 769 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.105526+0000 mon.b (mon.1) 53 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.106006+0000 mon.a (mon.0) 770 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.409 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.106724+0000 mgr.y (mgr.14613) 12 : cephadm 1 Adjusting osd_memory_target on smithi111 to 3804M 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.110797+0000 mon.a (mon.0) 771 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.116298+0000 mon.a (mon.0) 772 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.125507+0000 mon.a (mon.0) 773 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.127470+0000 mon.b (mon.1) 54 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.128091+0000 mon.a (mon.0) 774 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.129126+0000 mon.b (mon.1) 55 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.129702+0000 mon.a (mon.0) 775 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.130350+0000 mon.b (mon.1) 56 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.130900+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.410 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.131678+0000 mon.b (mon.1) 57 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.132244+0000 mon.a (mon.0) 777 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.133089+0000 mgr.y (mgr.14613) 13 : cephadm 1 Adjusting osd_memory_target on smithi062 to 3804M 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.137221+0000 mon.a (mon.0) 778 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.139504+0000 mon.b (mon.1) 58 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.140424+0000 mon.b (mon.1) 59 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.142497+0000 mgr.y (mgr.14613) 14 : cephadm 1 Updating smithi062:/etc/ceph/ceph.conf 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.142767+0000 mgr.y (mgr.14613) 15 : cephadm 1 Updating smithi111:/etc/ceph/ceph.conf 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.809103+0000 mon.a (mon.0) 779 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.819080+0000 mon.a (mon.0) 780 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.864427+0000 mon.a (mon.0) 781 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.876016+0000 mon.a (mon.0) 782 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[28859]: audit 2024-02-13T14:44:36.886662+0000 mon.a (mon.0) 783 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.411 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.130900+0000 mon.a (mon.0) 776 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.131678+0000 mon.b (mon.1) 57 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.132244+0000 mon.a (mon.0) 777 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.133089+0000 mgr.y (mgr.14613) 13 : cephadm 1 Adjusting osd_memory_target on smithi062 to 3804M 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.137221+0000 mon.a (mon.0) 778 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.139504+0000 mon.b (mon.1) 58 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.140424+0000 mon.b (mon.1) 59 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.142497+0000 mgr.y (mgr.14613) 14 : cephadm 1 Updating smithi062:/etc/ceph/ceph.conf 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.142767+0000 mgr.y (mgr.14613) 15 : cephadm 1 Updating smithi111:/etc/ceph/ceph.conf 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.809103+0000 mon.a (mon.0) 779 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.819080+0000 mon.a (mon.0) 780 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.864427+0000 mon.a (mon.0) 781 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.876016+0000 mon.a (mon.0) 782 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.412 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[21479]: audit 2024-02-13T14:44:36.886662+0000 mon.a (mon.0) 783 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.864427+0000 mon.a (mon.0) 781 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.640 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.876016+0000 mon.a (mon.0) 782 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.640 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:37 smithi111 bash[23388]: audit 2024-02-13T14:44:36.886662+0000 mon.a (mon.0) 783 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:37.663 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.663 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.663 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.664 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.664 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.664 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.665 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- 172.21.15.111:0/1673263657 >> v1:172.21.15.111:6789/0 conn(0x7f58d410e520 legacy=0x7f58d41109b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:37.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- 172.21.15.111:0/1673263657 shutdown_connections 2024-02-13T14:44:37.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- 172.21.15.111:0/1673263657 >> 172.21.15.111:0/1673263657 conn(0x7f58d40fc430 msgr2=0x7f58d40fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:37.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- 172.21.15.111:0/1673263657 shutdown_connections 2024-02-13T14:44:37.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- 172.21.15.111:0/1673263657 wait complete. 2024-02-13T14:44:37.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 Processor -- start 2024-02-13T14:44:37.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- start start 2024-02-13T14:44:37.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f58d410df20 con 0x7f58d410aa10 2024-02-13T14:44:37.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f58d41a9f20 con 0x7f58d410e520 2024-02-13T14:44:37.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f58d41ab0c0 con 0x7f58d4102c00 2024-02-13T14:44:37.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d8915700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f58d410e520 0x7f58d41a77f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:41650/0 (socket says 172.21.15.111:41650) 2024-02-13T14:44:37.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d8915700 1 -- 172.21.15.111:0/22688017 learned_addr learned my addr 172.21.15.111:0/22688017 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:44:37.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519102213 0 0) 0x7f58d41a9f20 con 0x7f58d410e520 2024-02-13T14:44:37.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58bc0035b0 con 0x7f58d410e520 2024-02-13T14:44:37.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1863388016 0 0) 0x7f58d410df20 con 0x7f58d410aa10 2024-02-13T14:44:37.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d41a9f20 con 0x7f58d410aa10 2024-02-13T14:44:37.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485616682 0 0) 0x7f58d41ab0c0 con 0x7f58d4102c00 2024-02-13T14:44:37.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58d410df20 con 0x7f58d4102c00 2024-02-13T14:44:37.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 686984797 0 0) 0x7f58bc0035b0 con 0x7f58d410e520 2024-02-13T14:44:37.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58d41ab0c0 con 0x7f58d410e520 2024-02-13T14:44:37.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f58cc001da0 con 0x7f58d410e520 2024-02-13T14:44:37.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 544005605 0 0) 0x7f58d410df20 con 0x7f58d4102c00 2024-02-13T14:44:37.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58bc0035b0 con 0x7f58d4102c00 2024-02-13T14:44:37.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f58c40018b0 con 0x7f58d4102c00 2024-02-13T14:44:37.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3614825997 0 0) 0x7f58d41a9f20 con 0x7f58d410aa10 2024-02-13T14:44:37.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f58d410df20 con 0x7f58d410aa10 2024-02-13T14:44:37.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f58c8001770 con 0x7f58d410aa10 2024-02-13T14:44:37.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3182239360 0 0) 0x7f58d41ab0c0 con 0x7f58d410e520 2024-02-13T14:44:37.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 >> v1:172.21.15.62:6790/0 conn(0x7f58d4102c00 legacy=0x7f58d410d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:37.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 >> v1:172.21.15.62:6789/0 conn(0x7f58d410aa10 legacy=0x7f58d41a40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:37.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d41ac2c0 con 0x7f58d410e520 2024-02-13T14:44:37.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d41a8f70 con 0x7f58d410e520 2024-02-13T14:44:37.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d41a93f0 con 0x7f58d410e520 2024-02-13T14:44:37.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f58cc001f00 con 0x7f58d410e520 2024-02-13T14:44:37.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f58cc0051d0 con 0x7f58d410e520 2024-02-13T14:44:37.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c0005120 con 0x7f58d410e520 2024-02-13T14:44:37.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.773+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f58cc005410 con 0x7f58d410e520 2024-02-13T14:44:37.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.777+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6172+0+0 (unknown 2736178325 0 0) 0x7f58cc089510 con 0x7f58d410e520 2024-02-13T14:44:37.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:37.781+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f58cc056320 con 0x7f58d410e520 2024-02-13T14:44:37.935 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.935 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.936 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.936 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.936 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.937 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.937 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.937 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.937 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.937 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: Started Ceph node-exporter.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:44:37.937 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:37.938 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:37 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:38.005+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 --> v1:172.21.15.62:6800/3802446050 -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}) v1 -- 0x7f58c0000b90 con 0x7f58bc06ef40 2024-02-13T14:44:38.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:38.017+0000 7f58d17fa700 1 -- 172.21.15.111:0/22688017 <== mgr.14613 v1:172.21.15.62:6800/3802446050 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (unknown 0 0 664801700) 0x7f58c0000b90 con 0x7f58bc06ef40 2024-02-13T14:44:38.018 INFO:teuthology.orchestra.run.smithi111.stdout:Scheduled grafana update... 2024-02-13T14:44:38.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:38.021+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 >> v1:172.21.15.62:6800/3802446050 conn(0x7f58bc06ef40 legacy=0x7f58bc071400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:38.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:38.021+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 >> v1:172.21.15.111:6789/0 conn(0x7f58d410e520 legacy=0x7f58d41a77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:38.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:38.021+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 shutdown_connections 2024-02-13T14:44:38.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:38.021+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 >> 172.21.15.111:0/22688017 conn(0x7f58d40fc430 msgr2=0x7f58d4102110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:38.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:38.021+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 shutdown_connections 2024-02-13T14:44:38.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:38.021+0000 7f58da378700 1 -- 172.21.15.111:0/22688017 wait complete. 2024-02-13T14:44:38.310 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:37 smithi062 bash[57993]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-02-13T14:44:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.307246+0000 mgr.y (mgr.14613) 16 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:44:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.308203+0000 mgr.y (mgr.14613) 17 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:44:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.472387+0000 mgr.y (mgr.14613) 18 : cephadm 1 Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:44:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.523527+0000 mgr.y (mgr.14613) 19 : cephadm 1 Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:44:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.637387+0000 mgr.y (mgr.14613) 20 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:44:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: cluster 2024-02-13T14:44:36.646919+0000 mgr.y (mgr.14613) 21 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-02-13T14:44:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.689082+0000 mgr.y (mgr.14613) 22 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:44:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: cephadm 2024-02-13T14:44:36.894578+0000 mgr.y (mgr.14613) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi062 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: audit 2024-02-13T14:44:37.937519+0000 mon.a (mon.0) 784 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: audit 2024-02-13T14:44:37.950879+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: audit 2024-02-13T14:44:37.967239+0000 mon.a (mon.0) 786 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[28859]: audit 2024-02-13T14:44:38.017324+0000 mon.a (mon.0) 787 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.307246+0000 mgr.y (mgr.14613) 16 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.308203+0000 mgr.y (mgr.14613) 17 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.472387+0000 mgr.y (mgr.14613) 18 : cephadm 1 Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.523527+0000 mgr.y (mgr.14613) 19 : cephadm 1 Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.637387+0000 mgr.y (mgr.14613) 20 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: cluster 2024-02-13T14:44:36.646919+0000 mgr.y (mgr.14613) 21 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-02-13T14:44:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.689082+0000 mgr.y (mgr.14613) 22 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:44:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: cephadm 2024-02-13T14:44:36.894578+0000 mgr.y (mgr.14613) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi062 2024-02-13T14:44:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: audit 2024-02-13T14:44:37.937519+0000 mon.a (mon.0) 784 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: audit 2024-02-13T14:44:37.950879+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: audit 2024-02-13T14:44:37.967239+0000 mon.a (mon.0) 786 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[21479]: audit 2024-02-13T14:44:38.017324+0000 mon.a (mon.0) 787 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.307246+0000 mgr.y (mgr.14613) 16 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:44:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.308203+0000 mgr.y (mgr.14613) 17 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.conf 2024-02-13T14:44:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.472387+0000 mgr.y (mgr.14613) 18 : cephadm 1 Updating smithi062:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:44:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.523527+0000 mgr.y (mgr.14613) 19 : cephadm 1 Updating smithi111:/etc/ceph/ceph.client.admin.keyring 2024-02-13T14:44:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.637387+0000 mgr.y (mgr.14613) 20 : cephadm 1 Updating smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:44:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: cluster 2024-02-13T14:44:36.646919+0000 mgr.y (mgr.14613) 21 : cluster 0 pgmap v7: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-02-13T14:44:38.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.689082+0000 mgr.y (mgr.14613) 22 : cephadm 1 Updating smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/config/ceph.client.admin.keyring 2024-02-13T14:44:38.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: cephadm 2024-02-13T14:44:36.894578+0000 mgr.y (mgr.14613) 23 : cephadm 1 Deploying daemon node-exporter.a on smithi062 2024-02-13T14:44:38.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: audit 2024-02-13T14:44:37.937519+0000 mon.a (mon.0) 784 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: audit 2024-02-13T14:44:37.950879+0000 mon.a (mon.0) 785 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: audit 2024-02-13T14:44:37.967239+0000 mon.a (mon.0) 786 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 bash[23388]: audit 2024-02-13T14:44:38.017324+0000 mon.a (mon.0) 787 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:38.651 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.773 DEBUG:teuthology.orchestra.run.smithi111:grafana.a> sudo journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@grafana.a.service 2024-02-13T14:44:38.775 INFO:tasks.cephadm:Setting up client nodes... 2024-02-13T14:44:38.776 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-13T14:44:38.786 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[57993]: v1.5.0: Pulling from prometheus/node-exporter 2024-02-13T14:44:38.918 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.918 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.918 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.919 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.919 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.919 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.919 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:38.920 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.053 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.053 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.054 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:38 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.059 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[57993]: 22b70bddd3ac: Pulling fs layer 2024-02-13T14:44:39.059 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[57993]: 5c12815fee55: Pulling fs layer 2024-02-13T14:44:39.059 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:38 smithi062 bash[57993]: c0e87333d380: Pulling fs layer 2024-02-13T14:44:39.174 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.174 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.174 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.175 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.175 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.175 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.176 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.176 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.176 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:39 smithi111 bash[23388]: cephadm 2024-02-13T14:44:37.970341+0000 mgr.y (mgr.14613) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi111 2024-02-13T14:44:39.176 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:39 smithi111 bash[23388]: audit 2024-02-13T14:44:38.008829+0000 mgr.y (mgr.14613) 25 : audit 0 from='client.24559 v1:172.21.15.111:0/22688017' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:39.176 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:39 smithi111 bash[23388]: cephadm 2024-02-13T14:44:38.010751+0000 mgr.y (mgr.14613) 26 : cephadm 1 Saving service grafana spec with placement smithi111=a;count:1 2024-02-13T14:44:39.176 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:39.472 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[21479]: cephadm 2024-02-13T14:44:37.970341+0000 mgr.y (mgr.14613) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi111 2024-02-13T14:44:39.472 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[21479]: audit 2024-02-13T14:44:38.008829+0000 mgr.y (mgr.14613) 25 : audit 0 from='client.24559 v1:172.21.15.111:0/22688017' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:39.472 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[21479]: cephadm 2024-02-13T14:44:38.010751+0000 mgr.y (mgr.14613) 26 : cephadm 1 Saving service grafana spec with placement smithi111=a;count:1 2024-02-13T14:44:39.472 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[28859]: cephadm 2024-02-13T14:44:37.970341+0000 mgr.y (mgr.14613) 24 : cephadm 1 Deploying daemon node-exporter.b on smithi111 2024-02-13T14:44:39.472 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[28859]: audit 2024-02-13T14:44:38.008829+0000 mgr.y (mgr.14613) 25 : audit 0 from='client.24559 v1:172.21.15.111:0/22688017' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi111=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-13T14:44:39.472 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[28859]: cephadm 2024-02-13T14:44:38.010751+0000 mgr.y (mgr.14613) 26 : cephadm 1 Saving service grafana spec with placement smithi111=a;count:1 2024-02-13T14:44:39.473 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[57993]: 5c12815fee55: Verifying Checksum 2024-02-13T14:44:39.473 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[57993]: 5c12815fee55: Download complete 2024-02-13T14:44:39.473 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[57993]: c0e87333d380: Verifying Checksum 2024-02-13T14:44:39.473 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[57993]: c0e87333d380: Download complete 2024-02-13T14:44:39.473 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[57993]: 22b70bddd3ac: Verifying Checksum 2024-02-13T14:44:39.473 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[57993]: 22b70bddd3ac: Download complete 2024-02-13T14:44:39.473 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[57993]: 22b70bddd3ac: Pull complete 2024-02-13T14:44:39.593 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:39 smithi111 systemd[1]: Started Ceph node-exporter.b for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:44:39.593 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:39 smithi111 bash[49755]: Unable to find image 'quay.io/prometheus/node-exporter:v1.5.0' locally 2024-02-13T14:44:40.059 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:39 smithi062 bash[57993]: 5c12815fee55: Pull complete 2024-02-13T14:44:40.060 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:39 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:40.225 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:39 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:44:40.225 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:39 smithi111 bash[49755]: v1.5.0: Pulling from prometheus/node-exporter 2024-02-13T14:44:40.541 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[57993]: c0e87333d380: Pull complete 2024-02-13T14:44:40.541 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[57993]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-02-13T14:44:40.542 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[21479]: cluster 2024-02-13T14:44:38.647599+0000 mgr.y (mgr.14613) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-13T14:44:40.542 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[21479]: audit 2024-02-13T14:44:39.229330+0000 mon.a (mon.0) 788 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.542 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[21479]: audit 2024-02-13T14:44:39.242929+0000 mon.a (mon.0) 789 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.542 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[21479]: audit 2024-02-13T14:44:39.296091+0000 mon.a (mon.0) 790 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.543 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[21479]: audit 2024-02-13T14:44:39.306114+0000 mon.a (mon.0) 791 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.543 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[21479]: audit 2024-02-13T14:44:39.322901+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.543 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[28859]: cluster 2024-02-13T14:44:38.647599+0000 mgr.y (mgr.14613) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-13T14:44:40.543 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[28859]: audit 2024-02-13T14:44:39.229330+0000 mon.a (mon.0) 788 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.543 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[28859]: audit 2024-02-13T14:44:39.242929+0000 mon.a (mon.0) 789 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.544 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[28859]: audit 2024-02-13T14:44:39.296091+0000 mon.a (mon.0) 790 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.544 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[28859]: audit 2024-02-13T14:44:39.306114+0000 mon.a (mon.0) 791 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.544 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[28859]: audit 2024-02-13T14:44:39.322901+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.593 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[49755]: 22b70bddd3ac: Pulling fs layer 2024-02-13T14:44:40.593 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[49755]: 5c12815fee55: Pulling fs layer 2024-02-13T14:44:40.593 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[49755]: c0e87333d380: Pulling fs layer 2024-02-13T14:44:40.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[23388]: cluster 2024-02-13T14:44:38.647599+0000 mgr.y (mgr.14613) 27 : cluster 0 pgmap v8: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-13T14:44:40.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[23388]: audit 2024-02-13T14:44:39.229330+0000 mon.a (mon.0) 788 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[23388]: audit 2024-02-13T14:44:39.242929+0000 mon.a (mon.0) 789 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[23388]: audit 2024-02-13T14:44:39.296091+0000 mon.a (mon.0) 790 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[23388]: audit 2024-02-13T14:44:39.306114+0000 mon.a (mon.0) 791 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[23388]: audit 2024-02-13T14:44:39.322901+0000 mon.a (mon.0) 792 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:40.810 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:40 smithi062 bash[57993]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-02-13T14:44:41.092 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[49755]: 5c12815fee55: Verifying Checksum 2024-02-13T14:44:41.093 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[49755]: 5c12815fee55: Download complete 2024-02-13T14:44:41.093 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[49755]: 22b70bddd3ac: Verifying Checksum 2024-02-13T14:44:41.093 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:40 smithi111 bash[49755]: 22b70bddd3ac: Download complete 2024-02-13T14:44:41.093 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[49755]: 22b70bddd3ac: Pull complete 2024-02-13T14:44:41.433 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[49755]: c0e87333d380: Verifying Checksum 2024-02-13T14:44:41.433 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[49755]: c0e87333d380: Download complete 2024-02-13T14:44:41.434 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[23388]: cephadm 2024-02-13T14:44:39.354804+0000 mgr.y (mgr.14613) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi062 2024-02-13T14:44:41.434 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[23388]: audit 2024-02-13T14:44:39.896487+0000 mgr.y (mgr.14613) 29 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:41.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:41 smithi062 bash[21479]: cephadm 2024-02-13T14:44:39.354804+0000 mgr.y (mgr.14613) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi062 2024-02-13T14:44:41.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:41 smithi062 bash[21479]: audit 2024-02-13T14:44:39.896487+0000 mgr.y (mgr.14613) 29 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:41.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:41 smithi062 bash[28859]: cephadm 2024-02-13T14:44:39.354804+0000 mgr.y (mgr.14613) 28 : cephadm 1 Deploying daemon alertmanager.a on smithi062 2024-02-13T14:44:41.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:41 smithi062 bash[28859]: audit 2024-02-13T14:44:39.896487+0000 mgr.y (mgr.14613) 29 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:41.752 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[49755]: 5c12815fee55: Pull complete 2024-02-13T14:44:42.006 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[49755]: c0e87333d380: Pull complete 2024-02-13T14:44:42.006 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[49755]: Digest: sha256:39c642b2b337e38c18e80266fb14383754178202f40103646337722a594d984c 2024-02-13T14:44:42.006 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:41 smithi111 bash[49755]: Status: Downloaded newer image for quay.io/prometheus/node-exporter:v1.5.0 2024-02-13T14:44:42.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:42 smithi111 bash[23388]: cluster 2024-02-13T14:44:40.649091+0000 mgr.y (mgr.14613) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-13T14:44:42.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[21479]: cluster 2024-02-13T14:44:40.649091+0000 mgr.y (mgr.14613) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-13T14:44:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[28859]: cluster 2024-02-13T14:44:40.649091+0000 mgr.y (mgr.14613) 30 : cluster 0 pgmap v9: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.802Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.802Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.802Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.802Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=arp 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-13T14:44:43.060 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=edac 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-13T14:44:43.061 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.803Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=os 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-13T14:44:43.062 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=stat 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=time 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=uname 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-02-13T14:44:43.063 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:42 smithi062 bash[57993]: ts=2024-02-13T14:44:42.804Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-13T14:44:43.596 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.289Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-02-13T14:44:43.596 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.289Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-02-13T14:44:43.596 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.289Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-13T14:44:43.596 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.289Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-13T14:44:43.596 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-13T14:44:43.596 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=arp 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=edac 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-13T14:44:43.597 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.290Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=os 2024-02-13T14:44:43.598 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=stat 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=time 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=uname 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-13T14:44:43.599 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-13T14:44:43.600 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-02-13T14:44:43.600 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:44:43 smithi111 bash[49755]: ts=2024-02-13T14:44:43.291Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-13T14:44:44.549 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:44:44.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:44 smithi062 bash[21479]: cluster 2024-02-13T14:44:42.649623+0000 mgr.y (mgr.14613) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-13T14:44:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:44 smithi062 bash[21479]: audit 2024-02-13T14:44:43.753168+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:44 smithi062 bash[21479]: audit 2024-02-13T14:44:43.784786+0000 mon.b (mon.1) 60 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:44 smithi062 bash[28859]: cluster 2024-02-13T14:44:42.649623+0000 mgr.y (mgr.14613) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-13T14:44:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:44 smithi062 bash[28859]: audit 2024-02-13T14:44:43.753168+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:44 smithi062 bash[28859]: audit 2024-02-13T14:44:43.784786+0000 mon.b (mon.1) 60 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:44.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:44 smithi111 bash[23388]: cluster 2024-02-13T14:44:42.649623+0000 mgr.y (mgr.14613) 31 : cluster 0 pgmap v10: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-13T14:44:44.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:44 smithi111 bash[23388]: audit 2024-02-13T14:44:43.753168+0000 mon.a (mon.0) 793 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:44.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:44 smithi111 bash[23388]: audit 2024-02-13T14:44:43.784786+0000 mon.b (mon.1) 60 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:46.499 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:46 smithi062 bash[28859]: cluster 2024-02-13T14:44:44.651114+0000 mgr.y (mgr.14613) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-13T14:44:46.499 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:46 smithi062 bash[21479]: cluster 2024-02-13T14:44:44.651114+0000 mgr.y (mgr.14613) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-13T14:44:46.499 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:44:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:44:46.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:46 smithi111 bash[23388]: cluster 2024-02-13T14:44:44.651114+0000 mgr.y (mgr.14613) 32 : cluster 0 pgmap v11: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-13T14:44:48.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:48 smithi062 bash[28859]: cluster 2024-02-13T14:44:46.651802+0000 mgr.y (mgr.14613) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:48.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:48 smithi062 bash[21479]: cluster 2024-02-13T14:44:46.651802+0000 mgr.y (mgr.14613) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:48.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:48 smithi111 bash[23388]: cluster 2024-02-13T14:44:46.651802+0000 mgr.y (mgr.14613) 33 : cluster 0 pgmap v12: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:50.253 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:49 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:44:50.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:50 smithi062 bash[21479]: cluster 2024-02-13T14:44:48.652321+0000 mgr.y (mgr.14613) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:50 smithi062 bash[28859]: cluster 2024-02-13T14:44:48.652321+0000 mgr.y (mgr.14613) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:50.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:50 smithi111 bash[23388]: cluster 2024-02-13T14:44:48.652321+0000 mgr.y (mgr.14613) 34 : cluster 0 pgmap v13: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:50.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- 172.21.15.62:0/3670705998 >> v1:172.21.15.62:6790/0 conn(0x7f6138108ff0 legacy=0x7f613810b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:50.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- 172.21.15.62:0/3670705998 shutdown_connections 2024-02-13T14:44:50.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- 172.21.15.62:0/3670705998 >> 172.21.15.62:0/3670705998 conn(0x7f6138075cc0 msgr2=0x7f61380760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:50.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- 172.21.15.62:0/3670705998 shutdown_connections 2024-02-13T14:44:50.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- 172.21.15.62:0/3670705998 wait complete. 2024-02-13T14:44:50.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 Processor -- start 2024-02-13T14:44:50.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- start start 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f61381a8ae0 con 0x7f61381004a0 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f61381a9cc0 con 0x7f613810cb90 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613fbc8700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f61381aaec0 con 0x7f6138108ff0 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613d964700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f61381004a0 0x7f6138101d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:40068/0 (socket says 172.21.15.62:40068) 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f613d964700 1 -- 172.21.15.62:0/27474348 learned_addr learned my addr 172.21.15.62:0/27474348 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176990746 0 0) 0x7f61381a8ae0 con 0x7f61381004a0 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61240046c0 con 0x7f61381004a0 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910724622 0 0) 0x7f61381aaec0 con 0x7f6138108ff0 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61381a8ae0 con 0x7f6138108ff0 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058335798 0 0) 0x7f61381a9cc0 con 0x7f613810cb90 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61381aaec0 con 0x7f613810cb90 2024-02-13T14:44:50.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3209949895 0 0) 0x7f61240046c0 con 0x7f61381004a0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61381a9cc0 con 0x7f61381004a0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1041621593 0 0) 0x7f61381a8ae0 con 0x7f6138108ff0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f61240046c0 con 0x7f6138108ff0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f6134001930 con 0x7f61381004a0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.732+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f61280043e0 con 0x7f6138108ff0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 425940294 0 0) 0x7f61381a9cc0 con 0x7f61381004a0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 >> v1:172.21.15.62:6790/0 conn(0x7f6138108ff0 legacy=0x7f6138102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 >> v1:172.21.15.111:6789/0 conn(0x7f613810cb90 legacy=0x7f61381a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61381ac0c0 con 0x7f61381004a0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61381ab0b0 con 0x7f61381004a0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f61381ab530 con 0x7f61381004a0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f6134001b20 con 0x7f61381004a0 2024-02-13T14:44:50.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f6134005cc0 con 0x7f61381004a0 2024-02-13T14:44:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611c005120 con 0x7f61381004a0 2024-02-13T14:44:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f6134003950 con 0x7f61381004a0 2024-02-13T14:44:50.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.736+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6172+0+0 (unknown 2736178325 0 0) 0x7f6134088fe0 con 0x7f61381004a0 2024-02-13T14:44:50.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:50.740+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f6134055df0 con 0x7f61381004a0 2024-02-13T14:44:51.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:51.044+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f611c0053d0 con 0x7f61381004a0 2024-02-13T14:44:51.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:51.048+0000 7f612effd700 1 -- 172.21.15.62:0/27474348 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) v1 ==== 170+0+59 (unknown 2200942065 0 1037105621) 0x7f61340044d0 con 0x7f61381004a0 2024-02-13T14:44:51.049 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-02-13T14:44:51.049 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBjgMtlZD4CAxAA+uZll1hoIEwClUufBqFT+A== 2024-02-13T14:44:51.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:51.052+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 >> v1:172.21.15.62:6800/3802446050 conn(0x7f612406f030 legacy=0x7f61240714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:51.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:51.052+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 >> v1:172.21.15.62:6789/0 conn(0x7f61381004a0 legacy=0x7f6138101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:51.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:51.052+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 shutdown_connections 2024-02-13T14:44:51.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:51.052+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 >> 172.21.15.62:0/27474348 conn(0x7f6138075cc0 msgr2=0x7f6138113230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:51.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:51.052+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 shutdown_connections 2024-02-13T14:44:51.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:44:51.052+0000 7f613fbc8700 1 -- 172.21.15.62:0/27474348 wait complete. 2024-02-13T14:44:51.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:51 smithi062 bash[21479]: audit 2024-02-13T14:44:49.904611+0000 mgr.y (mgr.14613) 35 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:51 smithi062 bash[21479]: audit 2024-02-13T14:44:51.050303+0000 mon.a (mon.0) 794 : audit 1 from='client.? v1:172.21.15.62:0/27474348' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:44:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:51 smithi062 bash[21479]: audit 2024-02-13T14:44:51.052265+0000 mon.a (mon.0) 795 : audit 1 from='client.? v1:172.21.15.62:0/27474348' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T14:44:51.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:51 smithi062 bash[28859]: audit 2024-02-13T14:44:49.904611+0000 mgr.y (mgr.14613) 35 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:51.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:51 smithi062 bash[28859]: audit 2024-02-13T14:44:51.050303+0000 mon.a (mon.0) 794 : audit 1 from='client.? v1:172.21.15.62:0/27474348' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:44:51.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:51 smithi062 bash[28859]: audit 2024-02-13T14:44:51.052265+0000 mon.a (mon.0) 795 : audit 1 from='client.? v1:172.21.15.62:0/27474348' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T14:44:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:51 smithi111 bash[23388]: audit 2024-02-13T14:44:49.904611+0000 mgr.y (mgr.14613) 35 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:44:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:51 smithi111 bash[23388]: audit 2024-02-13T14:44:51.050303+0000 mon.a (mon.0) 794 : audit 1 from='client.? v1:172.21.15.62:0/27474348' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:44:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:51 smithi111 bash[23388]: audit 2024-02-13T14:44:51.052265+0000 mon.a (mon.0) 795 : audit 1 from='client.? v1:172.21.15.62:0/27474348' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T14:44:52.430 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:44:52.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-13T14:44:52.430 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-13T14:44:52.492 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-13T14:44:52.553 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:52 smithi062 bash[21479]: cluster 2024-02-13T14:44:50.653274+0000 mgr.y (mgr.14613) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:52.554 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:52 smithi062 bash[28859]: cluster 2024-02-13T14:44:50.653274+0000 mgr.y (mgr.14613) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:52 smithi111 bash[23388]: cluster 2024-02-13T14:44:50.653274+0000 mgr.y (mgr.14613) 36 : cluster 0 pgmap v14: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:52.681 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.681 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.682 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.682 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.682 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.683 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.683 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.683 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.683 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.683 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.684 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.804 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.804 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.804 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.805 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.805 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.805 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.806 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:52.806 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:53.060 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:53.060 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:52 smithi062 systemd[1]: Started Ceph alertmanager.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:44:54.217 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[28859]: cluster 2024-02-13T14:44:52.653792+0000 mgr.y (mgr.14613) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:54.217 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[28859]: audit 2024-02-13T14:44:52.946681+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.217 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[28859]: audit 2024-02-13T14:44:52.957894+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.217 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[28859]: audit 2024-02-13T14:44:52.987481+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.217 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[28859]: audit 2024-02-13T14:44:52.997499+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.217 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[28859]: audit 2024-02-13T14:44:53.049213+0000 mon.b (mon.1) 61 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:54.217 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[28859]: audit 2024-02-13T14:44:53.767637+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.218 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[21479]: cluster 2024-02-13T14:44:52.653792+0000 mgr.y (mgr.14613) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:54.218 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[21479]: audit 2024-02-13T14:44:52.946681+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.218 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[21479]: audit 2024-02-13T14:44:52.957894+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.218 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[21479]: audit 2024-02-13T14:44:52.987481+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.218 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[21479]: audit 2024-02-13T14:44:52.997499+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.218 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[21479]: audit 2024-02-13T14:44:53.049213+0000 mon.b (mon.1) 61 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:54.218 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:53 smithi062 bash[21479]: audit 2024-02-13T14:44:53.767637+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:53 smithi111 bash[23388]: cluster 2024-02-13T14:44:52.653792+0000 mgr.y (mgr.14613) 37 : cluster 0 pgmap v15: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:53 smithi111 bash[23388]: audit 2024-02-13T14:44:52.946681+0000 mon.a (mon.0) 796 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:53 smithi111 bash[23388]: audit 2024-02-13T14:44:52.957894+0000 mon.a (mon.0) 797 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:53 smithi111 bash[23388]: audit 2024-02-13T14:44:52.987481+0000 mon.a (mon.0) 798 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:53 smithi111 bash[23388]: audit 2024-02-13T14:44:52.997499+0000 mon.a (mon.0) 799 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:53 smithi111 bash[23388]: audit 2024-02-13T14:44:53.049213+0000 mon.b (mon.1) 61 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:44:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:53 smithi111 bash[23388]: audit 2024-02-13T14:44:53.767637+0000 mon.a (mon.0) 800 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:54.560 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:54 smithi062 bash[58548]: ts=2024-02-13T14:44:54.284Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-02-13T14:44:54.560 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:54 smithi062 bash[58548]: ts=2024-02-13T14:44:54.284Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-02-13T14:44:54.560 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:54 smithi062 bash[58548]: ts=2024-02-13T14:44:54.285Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.62 port=9094 2024-02-13T14:44:54.560 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:54 smithi062 bash[58548]: ts=2024-02-13T14:44:54.286Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-13T14:44:54.561 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:54 smithi062 bash[58548]: ts=2024-02-13T14:44:54.317Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-13T14:44:54.561 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:54 smithi062 bash[58548]: ts=2024-02-13T14:44:54.318Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-13T14:44:54.561 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:54 smithi062 bash[58548]: ts=2024-02-13T14:44:54.321Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-02-13T14:44:54.561 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:54 smithi062 bash[58548]: ts=2024-02-13T14:44:54.321Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-13T14:44:56.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:55 smithi062 bash[28859]: cluster 2024-02-13T14:44:54.655199+0000 mgr.y (mgr.14613) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:56.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:55 smithi062 bash[21479]: cluster 2024-02-13T14:44:54.655199+0000 mgr.y (mgr.14613) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:56.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:55 smithi111 bash[23388]: cluster 2024-02-13T14:44:54.655199+0000 mgr.y (mgr.14613) 38 : cluster 0 pgmap v16: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:44:56.559 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:44:56 smithi062 bash[58548]: ts=2024-02-13T14:44:56.287Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000747263s 2024-02-13T14:44:56.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:44:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:44:57.276 INFO:teuthology.orchestra.run.smithi111.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.b/config 2024-02-13T14:44:58.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:57 smithi111 bash[23388]: cluster 2024-02-13T14:44:56.655955+0000 mgr.y (mgr.14613) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:58.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:57 smithi062 bash[28859]: cluster 2024-02-13T14:44:56.655955+0000 mgr.y (mgr.14613) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:58.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:57 smithi062 bash[21479]: cluster 2024-02-13T14:44:56.655955+0000 mgr.y (mgr.14613) 39 : cluster 0 pgmap v17: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:44:59.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:58 smithi062 bash[21731]: [13/Feb/2024:14:44:58] ENGINE Bus STOPPING 2024-02-13T14:44:59.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:58 smithi062 bash[21731]: [13/Feb/2024:14:44:58] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T14:44:59.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:58 smithi062 bash[21731]: [13/Feb/2024:14:44:58] ENGINE Bus STOPPED 2024-02-13T14:44:59.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:58 smithi062 bash[21731]: [13/Feb/2024:14:44:58] ENGINE Bus STARTING 2024-02-13T14:44:59.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:58 smithi062 bash[21731]: [13/Feb/2024:14:44:58] ENGINE Serving on http://:::9283 2024-02-13T14:44:59.060 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:44:58 smithi062 bash[21731]: [13/Feb/2024:14:44:58] ENGINE Bus STARTED 2024-02-13T14:44:59.185 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.186190+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.185 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.194812+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.186 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.637992+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.186 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.651295+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.186 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.655688+0000 mon.b (mon.1) 62 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:59.186 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.656733+0000 mon.b (mon.1) 63 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.186190+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.194812+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.637992+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.651295+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.655688+0000 mon.b (mon.1) 62 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.656733+0000 mon.b (mon.1) 63 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.664395+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.733634+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.743641+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.748627+0000 mon.b (mon.1) 64 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:58.759451+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[21479]: audit 2024-02-13T14:44:59.170511+0000 mon.b (mon.1) 65 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.186190+0000 mon.a (mon.0) 801 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.194812+0000 mon.a (mon.0) 802 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.637992+0000 mon.a (mon.0) 803 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.651295+0000 mon.a (mon.0) 804 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.655688+0000 mon.b (mon.1) 62 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.656733+0000 mon.b (mon.1) 63 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.664395+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.733634+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.743641+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.748627+0000 mon.b (mon.1) 64 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T14:44:59.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:58.759451+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:44:59 smithi062 bash[28859]: audit 2024-02-13T14:44:59.170511+0000 mon.b (mon.1) 65 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:59.569 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.664395+0000 mon.a (mon.0) 805 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.569 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.733634+0000 mon.a (mon.0) 806 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.569 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.743641+0000 mon.a (mon.0) 807 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.569 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.748627+0000 mon.b (mon.1) 64 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T14:44:59.569 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:58.759451+0000 mon.a (mon.0) 808 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:44:59.569 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[23388]: audit 2024-02-13T14:44:59.170511+0000 mon.b (mon.1) 65 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:44:59.569 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:44:59 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:44:59.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- 172.21.15.111:0/2188994835 >> v1:172.21.15.111:6789/0 conn(0x7fc38410e5e0 legacy=0x7fc384110aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:59.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- 172.21.15.111:0/2188994835 shutdown_connections 2024-02-13T14:44:59.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- 172.21.15.111:0/2188994835 >> 172.21.15.111:0/2188994835 conn(0x7fc384075c60 msgr2=0x7fc384076070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:44:59.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- 172.21.15.111:0/2188994835 shutdown_connections 2024-02-13T14:44:59.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- 172.21.15.111:0/2188994835 wait complete. 2024-02-13T14:44:59.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 Processor -- start 2024-02-13T14:44:59.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- start start 2024-02-13T14:44:59.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc3841a6b70 con 0x7fc38410a9e0 2024-02-13T14:44:59.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc3841a7d50 con 0x7fc384107be0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc389cbc700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fc3841a8f50 con 0x7fc38410e5e0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc3837fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fc384107be0 0x7fc384100aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43602/0 (socket says 172.21.15.111:43602) 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.716+0000 7fc3837fe700 1 -- 172.21.15.111:0/2206293303 learned_addr learned my addr 172.21.15.111:0/2206293303 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371873531 0 0) 0x7fc3841a7d50 con 0x7fc384107be0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3700035b0 con 0x7fc384107be0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1988117038 0 0) 0x7fc3700035b0 con 0x7fc384107be0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fc3841a7d50 con 0x7fc384107be0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fc374001930 con 0x7fc384107be0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257292556 0 0) 0x7fc3841a6b70 con 0x7fc38410a9e0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3700035b0 con 0x7fc38410a9e0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4125326989 0 0) 0x7fc3841a8f50 con 0x7fc38410e5e0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3841a6b70 con 0x7fc38410e5e0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3353291947 0 0) 0x7fc3841a7d50 con 0x7fc384107be0 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 >> v1:172.21.15.62:6790/0 conn(0x7fc38410e5e0 legacy=0x7fc3841a5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:59.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 >> v1:172.21.15.62:6789/0 conn(0x7fc38410a9e0 legacy=0x7fc3841a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:44:59.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3841aa150 con 0x7fc384107be0 2024-02-13T14:44:59.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3841a6d60 con 0x7fc384107be0 2024-02-13T14:44:59.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3841a71e0 con 0x7fc384107be0 2024-02-13T14:44:59.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fc374001d00 con 0x7fc384107be0 2024-02-13T14:44:59.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fc374005d80 con 0x7fc384107be0 2024-02-13T14:44:59.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc364005120 con 0x7fc384107be0 2024-02-13T14:44:59.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fc3740040f0 con 0x7fc384107be0 2024-02-13T14:44:59.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.720+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6172+0+0 (unknown 2736178325 0 0) 0x7fc3740890b0 con 0x7fc384107be0 2024-02-13T14:44:59.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:44:59.724+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fc374056150 con 0x7fc384107be0 2024-02-13T14:45:00.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:45:00.020+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fc3640053d0 con 0x7fc384107be0 2024-02-13T14:45:00.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:45:00.028+0000 7fc380ff9700 1 -- 172.21.15.111:0/2206293303 <== mon.1 v1:172.21.15.111:6789/0 10 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) v1 ==== 170+0+59 (unknown 1383567223 0 2722352425) 0x7fc374050e60 con 0x7fc384107be0 2024-02-13T14:45:00.029 INFO:teuthology.orchestra.run.smithi111.stdout:[client.1] 2024-02-13T14:45:00.029 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQBsgMtlqbxvARAA54g5+hTfv6ROJSJDlaSkbQ== 2024-02-13T14:45:00.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:45:00.028+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 >> v1:172.21.15.62:6800/3802446050 conn(0x7fc37006edb0 legacy=0x7fc370071270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:00.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:45:00.028+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 >> v1:172.21.15.111:6789/0 conn(0x7fc384107be0 legacy=0x7fc384100aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:00.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:45:00.028+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 shutdown_connections 2024-02-13T14:45:00.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:45:00.028+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 >> 172.21.15.111:0/2206293303 conn(0x7fc384075c60 msgr2=0x7fc384110a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:00.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:45:00.028+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 shutdown_connections 2024-02-13T14:45:00.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-02-13T14:45:00.028+0000 7fc389cbc700 1 -- 172.21.15.111:0/2206293303 wait complete. 2024-02-13T14:45:00.199 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:44:59 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:45:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[21479]: cluster 2024-02-13T14:44:58.656320+0000 mgr.y (mgr.14613) 40 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[21479]: cephadm 2024-02-13T14:44:58.680966+0000 mgr.y (mgr.14613) 41 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-02-13T14:45:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[21479]: audit 2024-02-13T14:44:58.750005+0000 mgr.y (mgr.14613) 42 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T14:45:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[21479]: cephadm 2024-02-13T14:44:58.769751+0000 mgr.y (mgr.14613) 43 : cephadm 1 Deploying daemon grafana.a on smithi111 2024-02-13T14:45:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[21479]: audit 2024-02-13T14:45:00.022798+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.111:0/2206293303' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:45:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[21479]: audit 2024-02-13T14:45:00.023737+0000 mon.a (mon.0) 809 : audit 1 from='client.24571 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:45:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[21479]: audit 2024-02-13T14:45:00.027263+0000 mon.a (mon.0) 810 : audit 1 from='client.24571 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T14:45:00.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[28859]: cluster 2024-02-13T14:44:58.656320+0000 mgr.y (mgr.14613) 40 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:00.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[28859]: cephadm 2024-02-13T14:44:58.680966+0000 mgr.y (mgr.14613) 41 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-02-13T14:45:00.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[28859]: audit 2024-02-13T14:44:58.750005+0000 mgr.y (mgr.14613) 42 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T14:45:00.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[28859]: cephadm 2024-02-13T14:44:58.769751+0000 mgr.y (mgr.14613) 43 : cephadm 1 Deploying daemon grafana.a on smithi111 2024-02-13T14:45:00.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[28859]: audit 2024-02-13T14:45:00.022798+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.111:0/2206293303' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:45:00.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[28859]: audit 2024-02-13T14:45:00.023737+0000 mon.a (mon.0) 809 : audit 1 from='client.24571 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:45:00.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:00 smithi062 bash[28859]: audit 2024-02-13T14:45:00.027263+0000 mon.a (mon.0) 810 : audit 1 from='client.24571 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T14:45:00.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:00 smithi111 bash[23388]: cluster 2024-02-13T14:44:58.656320+0000 mgr.y (mgr.14613) 40 : cluster 0 pgmap v18: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:00.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:00 smithi111 bash[23388]: cephadm 2024-02-13T14:44:58.680966+0000 mgr.y (mgr.14613) 41 : cephadm 1 Regenerating cephadm self-signed grafana TLS certificates 2024-02-13T14:45:00.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:00 smithi111 bash[23388]: audit 2024-02-13T14:44:58.750005+0000 mgr.y (mgr.14613) 42 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-13T14:45:00.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:00 smithi111 bash[23388]: cephadm 2024-02-13T14:44:58.769751+0000 mgr.y (mgr.14613) 43 : cephadm 1 Deploying daemon grafana.a on smithi111 2024-02-13T14:45:00.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:00 smithi111 bash[23388]: audit 2024-02-13T14:45:00.022798+0000 mon.b (mon.1) 66 : audit 1 from='client.? v1:172.21.15.111:0/2206293303' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:45:00.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:00 smithi111 bash[23388]: audit 2024-02-13T14:45:00.023737+0000 mon.a (mon.0) 809 : audit 1 from='client.24571 ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-13T14:45:00.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:00 smithi111 bash[23388]: audit 2024-02-13T14:45:00.027263+0000 mon.a (mon.0) 810 : audit 1 from='client.24571 ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-13T14:45:00.849 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-02-13T14:45:00.849 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-13T14:45:00.849 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-13T14:45:00.871 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-13T14:45:00.871 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-13T14:45:00.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph mgr dump --format=json 2024-02-13T14:45:01.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:01 smithi062 bash[28859]: audit 2024-02-13T14:44:59.914896+0000 mgr.y (mgr.14613) 44 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:01.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:01 smithi062 bash[21479]: audit 2024-02-13T14:44:59.914896+0000 mgr.y (mgr.14613) 44 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:01 smithi111 bash[23388]: audit 2024-02-13T14:44:59.914896+0000 mgr.y (mgr.14613) 44 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:02 smithi111 bash[23388]: cluster 2024-02-13T14:45:00.658143+0000 mgr.y (mgr.14613) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:02.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:02 smithi062 bash[21479]: cluster 2024-02-13T14:45:00.658143+0000 mgr.y (mgr.14613) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:02 smithi062 bash[28859]: cluster 2024-02-13T14:45:00.658143+0000 mgr.y (mgr.14613) 45 : cluster 0 pgmap v19: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:04.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:04 smithi062 bash[21479]: cluster 2024-02-13T14:45:02.658900+0000 mgr.y (mgr.14613) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:04.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:04 smithi062 bash[28859]: cluster 2024-02-13T14:45:02.658900+0000 mgr.y (mgr.14613) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:04.560 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:04 smithi062 bash[58548]: ts=2024-02-13T14:45:04.289Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.002288821s 2024-02-13T14:45:04.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:04 smithi111 bash[23388]: cluster 2024-02-13T14:45:02.658900+0000 mgr.y (mgr.14613) 46 : cluster 0 pgmap v20: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:05.659 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:06.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:06 smithi062 bash[28859]: cluster 2024-02-13T14:45:04.660377+0000 mgr.y (mgr.14613) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:06 smithi062 bash[21479]: cluster 2024-02-13T14:45:04.660377+0000 mgr.y (mgr.14613) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:06.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:45:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:45:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:45:06.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:06 smithi111 bash[23388]: cluster 2024-02-13T14:45:04.660377+0000 mgr.y (mgr.14613) 47 : cluster 0 pgmap v21: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:08.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:08 smithi062 bash[21479]: cluster 2024-02-13T14:45:06.661056+0000 mgr.y (mgr.14613) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:08 smithi062 bash[28859]: cluster 2024-02-13T14:45:06.661056+0000 mgr.y (mgr.14613) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:08 smithi111 bash[23388]: cluster 2024-02-13T14:45:06.661056+0000 mgr.y (mgr.14613) 48 : cluster 0 pgmap v22: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:08.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- 172.21.15.62:0/1253382804 >> v1:172.21.15.62:6789/0 conn(0x7fa73c102bf0 legacy=0x7fa73c102fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:08.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- 172.21.15.62:0/1253382804 shutdown_connections 2024-02-13T14:45:08.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- 172.21.15.62:0/1253382804 >> 172.21.15.62:0/1253382804 conn(0x7fa73c0fc480 msgr2=0x7fa73c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:08.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- 172.21.15.62:0/1253382804 shutdown_connections 2024-02-13T14:45:08.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- 172.21.15.62:0/1253382804 wait complete. 2024-02-13T14:45:08.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 Processor -- start 2024-02-13T14:45:08.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- start start 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa73c10a410 con 0x7fa73c10e510 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa73c10a5e0 con 0x7fa73c102bf0 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa73c10a7b0 con 0x7fa73c10aa00 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa73b7fe700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fa73c10aa00 0x7fa73c100f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:43106/0 (socket says 172.21.15.62:43106) 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa73b7fe700 1 -- 172.21.15.62:0/381452594 learned_addr learned my addr 172.21.15.62:0/381452594 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa740a0f700 1 --1- 172.21.15.62:0/381452594 >> v1:172.21.15.62:6789/0 conn(0x7fa73c10e510 0x7fa73c1a7c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53750/0 (socket says 172.21.15.62:53750) 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1713652476 0 0) 0x7fa73c10a7b0 con 0x7fa73c10aa00 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7280037f0 con 0x7fa73c10aa00 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281997974 0 0) 0x7fa73c10a410 con 0x7fa73c10e510 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa73c10a7b0 con 0x7fa73c10e510 2024-02-13T14:45:08.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052662095 0 0) 0x7fa73c10a5e0 con 0x7fa73c102bf0 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa73c10a410 con 0x7fa73c102bf0 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3186403223 0 0) 0x7fa7280037f0 con 0x7fa73c10aa00 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa73c10a5e0 con 0x7fa73c10aa00 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fa72c001c90 con 0x7fa73c10aa00 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2667626537 0 0) 0x7fa73c10a7b0 con 0x7fa73c10e510 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7280037f0 con 0x7fa73c10e510 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fa7340017a0 con 0x7fa73c10e510 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3235517260 0 0) 0x7fa73c10a410 con 0x7fa73c102bf0 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa73c10a7b0 con 0x7fa73c102bf0 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fa724001880 con 0x7fa73c102bf0 2024-02-13T14:45:08.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 516962015 0 0) 0x7fa73c10a5e0 con 0x7fa73c10aa00 2024-02-13T14:45:08.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 >> v1:172.21.15.111:6789/0 conn(0x7fa73c102bf0 legacy=0x7fa73c100850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:08.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 >> v1:172.21.15.62:6789/0 conn(0x7fa73c10e510 legacy=0x7fa73c1a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:08.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c1ac3a0 con 0x7fa73c10aa00 2024-02-13T14:45:08.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa73c1a93d0 con 0x7fa73c10aa00 2024-02-13T14:45:08.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa73c1a9850 con 0x7fa73c10aa00 2024-02-13T14:45:08.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fa72c003eb0 con 0x7fa73c10aa00 2024-02-13T14:45:08.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.600+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fa72c006020 con 0x7fa73c10aa00 2024-02-13T14:45:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.604+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c005120 con 0x7fa73c10aa00 2024-02-13T14:45:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.604+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fa72c003a20 con 0x7fa73c10aa00 2024-02-13T14:45:08.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.604+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6172+0+0 (unknown 2736178325 0 0) 0x7fa72c0892e0 con 0x7fa73c10aa00 2024-02-13T14:45:08.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.608+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fa72c0563c0 con 0x7fa73c10aa00 2024-02-13T14:45:08.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.880+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa71c0053d0 con 0x7fa73c10aa00 2024-02-13T14:45:08.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.888+0000 7fa7397fa700 1 -- 172.21.15.62:0/381452594 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v22) v1 ==== 74+0+175329 (unknown 3269696449 0 457563673) 0x7fa72c054730 con 0x7fa73c10aa00 2024-02-13T14:45:08.892 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:45:08.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.896+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 >> v1:172.21.15.62:6800/3802446050 conn(0x7fa72806f130 legacy=0x7fa7280715f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:08.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.896+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 >> v1:172.21.15.62:6790/0 conn(0x7fa73c10aa00 legacy=0x7fa73c100f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:08.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.896+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 shutdown_connections 2024-02-13T14:45:08.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.896+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 >> 172.21.15.62:0/381452594 conn(0x7fa73c0fc480 msgr2=0x7fa73c102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:08.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.896+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 shutdown_connections 2024-02-13T14:45:08.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:08.896+0000 7fa742472700 1 -- 172.21.15.62:0/381452594 wait complete. 2024-02-13T14:45:09.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:09 smithi062 bash[21479]: audit 2024-02-13T14:45:08.885644+0000 mon.c (mon.2) 24 : audit 0 from='client.? v1:172.21.15.62:0/381452594' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-13T14:45:09.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:09 smithi062 bash[28859]: audit 2024-02-13T14:45:08.885644+0000 mon.c (mon.2) 24 : audit 0 from='client.? v1:172.21.15.62:0/381452594' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-13T14:45:09.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:09 smithi111 bash[23388]: audit 2024-02-13T14:45:08.885644+0000 mon.c (mon.2) 24 : audit 0 from='client.? v1:172.21.15.62:0/381452594' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-13T14:45:09.699 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"flags":0,"active_gid":14613,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6800","nonce":3802446050}]},"active_addr":"172.21.15.62:6800/3802446050","active_change":"2024-02-13T14:44:28.616896+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14607,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.62:8443/","prometheus":"http://172.21.15.62:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":72,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1745822855}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1826877293}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1949650014}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.62:0","nonce":1341235283}]}]} 2024-02-13T14:45:09.703 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-13T14:45:09.703 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-13T14:45:09.704 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-13T14:45:10.221 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:45:09 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:45:10.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:10 smithi062 bash[28859]: cluster 2024-02-13T14:45:08.661585+0000 mgr.y (mgr.14613) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:10 smithi062 bash[21479]: cluster 2024-02-13T14:45:08.661585+0000 mgr.y (mgr.14613) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:10.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:10 smithi111 bash[23388]: cluster 2024-02-13T14:45:08.661585+0000 mgr.y (mgr.14613) 49 : cluster 0 pgmap v23: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:11.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:11 smithi062 bash[21479]: audit 2024-02-13T14:45:09.925806+0000 mgr.y (mgr.14613) 50 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:11.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:11 smithi062 bash[28859]: audit 2024-02-13T14:45:09.925806+0000 mgr.y (mgr.14613) 50 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:11.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:11 smithi111 bash[23388]: audit 2024-02-13T14:45:09.925806+0000 mgr.y (mgr.14613) 50 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:12.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:12 smithi062 bash[21479]: cluster 2024-02-13T14:45:10.663060+0000 mgr.y (mgr.14613) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:12.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:12 smithi062 bash[28859]: cluster 2024-02-13T14:45:10.663060+0000 mgr.y (mgr.14613) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:12.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:12 smithi111 bash[23388]: cluster 2024-02-13T14:45:10.663060+0000 mgr.y (mgr.14613) 51 : cluster 0 pgmap v24: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:14.487 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:14.510 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:14 smithi062 bash[28859]: cluster 2024-02-13T14:45:12.663766+0000 mgr.y (mgr.14613) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:14.511 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:14 smithi062 bash[28859]: audit 2024-02-13T14:45:14.206341+0000 mon.b (mon.1) 67 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:14.511 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:14 smithi062 bash[21479]: cluster 2024-02-13T14:45:12.663766+0000 mgr.y (mgr.14613) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:14.511 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:14 smithi062 bash[21479]: audit 2024-02-13T14:45:14.206341+0000 mon.b (mon.1) 67 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:14.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:14 smithi111 bash[23388]: cluster 2024-02-13T14:45:12.663766+0000 mgr.y (mgr.14613) 52 : cluster 0 pgmap v25: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:14.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:14 smithi111 bash[23388]: audit 2024-02-13T14:45:14.206341+0000 mon.b (mon.1) 67 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:16.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:16 smithi062 bash[21479]: cluster 2024-02-13T14:45:14.665164+0000 mgr.y (mgr.14613) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:16.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:16 smithi062 bash[28859]: cluster 2024-02-13T14:45:14.665164+0000 mgr.y (mgr.14613) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:16.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:45:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:45:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:45:16.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:16 smithi111 bash[23388]: cluster 2024-02-13T14:45:14.665164+0000 mgr.y (mgr.14613) 53 : cluster 0 pgmap v26: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- 172.21.15.62:0/1489168203 >> v1:172.21.15.62:6790/0 conn(0x7fe760101360 legacy=0x7fe76010ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:17.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- 172.21.15.62:0/1489168203 shutdown_connections 2024-02-13T14:45:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- 172.21.15.62:0/1489168203 >> 172.21.15.62:0/1489168203 conn(0x7fe7600fc480 msgr2=0x7fe7600fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- 172.21.15.62:0/1489168203 shutdown_connections 2024-02-13T14:45:17.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- 172.21.15.62:0/1489168203 wait complete. 2024-02-13T14:45:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 Processor -- start 2024-02-13T14:45:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- start start 2024-02-13T14:45:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe7601a8c00 con 0x7fe7601106b0 2024-02-13T14:45:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe7601a9de0 con 0x7fe760101360 2024-02-13T14:45:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe764bf1700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe7601aafe0 con 0x7fe760100780 2024-02-13T14:45:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe75e59c700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fe760100780 0x7fe76010ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:47378/0 (socket says 172.21.15.62:47378) 2024-02-13T14:45:17.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe75ed9d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe7601106b0 0x7fe7601a72c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:59820/0 (socket says 172.21.15.62:59820) 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe75e59c700 1 -- 172.21.15.62:0/2352811198 learned_addr learned my addr 172.21.15.62:0/2352811198 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3983717495 0 0) 0x7fe7601aafe0 con 0x7fe760100780 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7480035b0 con 0x7fe760100780 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3975514069 0 0) 0x7fe7601a8c00 con 0x7fe7601106b0 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7601aafe0 con 0x7fe7601106b0 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419372458 0 0) 0x7fe7601a9de0 con 0x7fe760101360 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7601a8c00 con 0x7fe760101360 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4190765265 0 0) 0x7fe7480035b0 con 0x7fe760100780 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe7601a9de0 con 0x7fe760100780 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe750001930 con 0x7fe760100780 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2333969354 0 0) 0x7fe7601aafe0 con 0x7fe7601106b0 2024-02-13T14:45:17.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe7480035b0 con 0x7fe7601106b0 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe758001c50 con 0x7fe7601106b0 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 751807337 0 0) 0x7fe7601a9de0 con 0x7fe760100780 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 >> v1:172.21.15.111:6789/0 conn(0x7fe760101360 legacy=0x7fe7601a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 >> v1:172.21.15.62:6789/0 conn(0x7fe7601106b0 legacy=0x7fe7601a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.336+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7601ac1e0 con 0x7fe760100780 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.340+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7601a8df0 con 0x7fe760100780 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.340+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7601a9270 con 0x7fe760100780 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.340+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fe750003b30 con 0x7fe760100780 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.340+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe750005ca0 con 0x7fe760100780 2024-02-13T14:45:17.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.340+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe740005120 con 0x7fe760100780 2024-02-13T14:45:17.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.340+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fe7500036a0 con 0x7fe760100780 2024-02-13T14:45:17.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.340+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6172+0+0 (unknown 2736178325 0 0) 0x7fe750089090 con 0x7fe760100780 2024-02-13T14:45:17.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.344+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fe750056130 con 0x7fe760100780 2024-02-13T14:45:17.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.556+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7400053d0 con 0x7fe760100780 2024-02-13T14:45:17.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:17 smithi062 bash[21479]: cluster 2024-02-13T14:45:16.665871+0000 mgr.y (mgr.14613) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:17.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:17 smithi062 bash[28859]: cluster 2024-02-13T14:45:16.665871+0000 mgr.y (mgr.14613) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:17.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.560+0000 7fe74f7fe700 1 -- 172.21.15.62:0/2352811198 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20896 (unknown 1686360691 0 2845530237) 0x7fe7500544a0 con 0x7fe760100780 2024-02-13T14:45:17.561 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:45:17.561 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":72,"fsid":"9cdb3692-ca7c-11ee-95b9-87774f69a715","created":"2024-02-13T14:33:15.381692+0000","modified":"2024-02-13T14:44:28.616533+0000","last_up_change":"2024-02-13T14:42:51.147139+0000","last_in_change":"2024-02-13T14:42:26.263327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-13T14:38:35.651796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-13T14:43:33.034718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-02-13T14:43:34.938508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"datapool","create_time":"2024-02-13T14:43:36.283555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-13T14:43:36.885694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-13T14:43:39.166504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eacc17ac-916e-4f02-9a42-5de004ec7580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":143174597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":143174597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":143174597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":143174597}]},"public_addr":"172.21.15.62:6801/143174597","cluster_addr":"172.21.15.62:6802/143174597","heartbeat_back_addr":"172.21.15.62:6804/143174597","heartbeat_front_addr":"172.21.15.62:6803/143174597","state":["exists","up"]},{"osd":1,"uuid":"21062ebc-0d8d-481b-95b0-1b10c843bcab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":3280693362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":3280693362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":3280693362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":3280693362}]},"public_addr":"172.21.15.62:6805/3280693362","cluster_addr":"172.21.15.62:6806/3280693362","heartbeat_back_addr":"172.21.15.62:6808/3280693362","heartbeat_front_addr":"172.21.15.62:6807/3280693362","state":["exists","up"]},{"osd":2,"uuid":"932f8b3b-9b78-4433-9c7d-fe36ee894656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":1346690857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":1346690857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":1346690857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":1346690857}]},"public_addr":"172.21.15.62:6809/1346690857","cluster_addr":"172.21.15.62:6810/1346690857","heartbeat_back_addr":"172.21.15.62:6812/1346690857","heartbeat_front_addr":"172.21.15.62:6811/1346690857","state":["exists","up"]},{"osd":3,"uuid":"7eca01f3-8960-425b-887d-20f66959978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":1701426775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":1701426775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6816","nonce":1701426775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":1701426775}]},"public_addr":"172.21.15.62:6813/1701426775","cluster_addr":"172.21.15.62:6814/1701426775","heartbeat_back_addr":"172.21.15.62:6816/1701426775","heartbeat_front_addr":"172.21.15.62:6815/1701426775","state":["exists","up"]},{"osd":4,"uuid":"e55ae8d9-af71-443f-b9e0-0a59ceb52b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":1278246464}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":1278246464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":1278246464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":1278246464}]},"public_addr":"172.21.15.111:6800/1278246464","cluster_addr":"172.21.15.111:6801/1278246464","heartbeat_back_addr":"172.21.15.111:6803/1278246464","heartbeat_front_addr":"172.21.15.111:6802/1278246464","state":["exists","up"]},{"osd":5,"uuid":"b5b44f2d-fb54-4f64-b523-7ff9f373ec4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":575601374}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":575601374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":575601374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":575601374}]},"public_addr":"172.21.15.111:6804/575601374","cluster_addr":"172.21.15.111:6805/575601374","heartbeat_back_addr":"172.21.15.111:6807/575601374","heartbeat_front_addr":"172.21.15.111:6806/575601374","state":["exists","up"]},{"osd":6,"uuid":"e4d903d9-30df-41ef-b09e-651111416a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":2146440304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":2146440304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":2146440304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":2146440304}]},"public_addr":"172.21.15.111:6808/2146440304","cluster_addr":"172.21.15.111:6809/2146440304","heartbeat_back_addr":"172.21.15.111:6811/2146440304","heartbeat_front_addr":"172.21.15.111:6810/2146440304","state":["exists","up"]},{"osd":7,"uuid":"2b696400-d368-44a0-b57a-71c31e8292f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":1629494259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":1629494259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":1629494259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":1629494259}]},"public_addr":"172.21.15.111:6812/1629494259","cluster_addr":"172.21.15.111:6813/1629494259","heartbeat_back_addr":"172.21.15.111:6815/1629494259","heartbeat_front_addr":"172.21.15.111:6814/1629494259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:36:49.319298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:37:40.712051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:38:33.151039+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:39:26.430970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:40:15.952959+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:41:06.923868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:41:58.150572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:42:50.081684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:0/1613663194":"2024-02-14T14:44:28.616395+0000","172.21.15.62:0/473627328":"2024-02-14T14:44:28.616395+0000","172.21.15.62:6800/1926838190":"2024-02-14T14:44:28.616395+0000","172.21.15.62:0/1002099295":"2024-02-14T14:44:28.616395+0000","172.21.15.62:0/3993759757":"2024-02-14T14:44:28.616395+0000","172.21.15.62:6800/70089425":"2024-02-14T14:34:23.004283+0000","172.21.15.62:0/1058538806":"2024-02-14T14:44:28.616395+0000","172.21.15.62:0/384574915":"2024-02-14T14:34:23.004283+0000","172.21.15.62:6800/3755300204":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/1390781974":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/501986268":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/2037740662":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/807021312":"2024-02-14T14:34:23.004283+0000","172.21.15.62:0/1160844063":"2024-02-14T14:34:23.004283+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-13T14:45:17.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.560+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 >> v1:172.21.15.62:6800/3802446050 conn(0x7fe74806ee70 legacy=0x7fe748071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:17.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.560+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 >> v1:172.21.15.62:6790/0 conn(0x7fe760100780 legacy=0x7fe76010ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:17.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.560+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 shutdown_connections 2024-02-13T14:45:17.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.560+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 >> 172.21.15.62:0/2352811198 conn(0x7fe7600fc480 msgr2=0x7fe76010f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:17.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.564+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 shutdown_connections 2024-02-13T14:45:17.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:17.564+0000 7fe764bf1700 1 -- 172.21.15.62:0/2352811198 wait complete. 2024-02-13T14:45:17.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:17 smithi111 bash[23388]: cluster 2024-02-13T14:45:16.665871+0000 mgr.y (mgr.14613) 54 : cluster 0 pgmap v27: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:18.311 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-13T14:45:18.312 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd dump --format=json 2024-02-13T14:45:18.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:18 smithi111 bash[23388]: audit 2024-02-13T14:45:17.562009+0000 mon.c (mon.2) 25 : audit 0 from='client.? v1:172.21.15.62:0/2352811198' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:45:18.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:18 smithi062 bash[28859]: audit 2024-02-13T14:45:17.562009+0000 mon.c (mon.2) 25 : audit 0 from='client.? v1:172.21.15.62:0/2352811198' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:45:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:18 smithi062 bash[21479]: audit 2024-02-13T14:45:17.562009+0000 mon.c (mon.2) 25 : audit 0 from='client.? v1:172.21.15.62:0/2352811198' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:45:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:19 smithi111 bash[23388]: cluster 2024-02-13T14:45:18.666675+0000 mgr.y (mgr.14613) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:19.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:19 smithi062 bash[28859]: cluster 2024-02-13T14:45:18.666675+0000 mgr.y (mgr.14613) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:19.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:19 smithi062 bash[21479]: cluster 2024-02-13T14:45:18.666675+0000 mgr.y (mgr.14613) 55 : cluster 0 pgmap v28: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:20.333 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:45:19 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:45:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:20 smithi111 bash[23388]: audit 2024-02-13T14:45:19.935027+0000 mgr.y (mgr.14613) 56 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:20.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:20 smithi062 bash[21479]: audit 2024-02-13T14:45:19.935027+0000 mgr.y (mgr.14613) 56 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:20.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:20 smithi062 bash[28859]: audit 2024-02-13T14:45:19.935027+0000 mgr.y (mgr.14613) 56 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:21.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:21 smithi111 bash[23388]: cluster 2024-02-13T14:45:20.668093+0000 mgr.y (mgr.14613) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:21.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:21 smithi062 bash[21479]: cluster 2024-02-13T14:45:20.668093+0000 mgr.y (mgr.14613) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:21.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:21 smithi062 bash[28859]: cluster 2024-02-13T14:45:20.668093+0000 mgr.y (mgr.14613) 57 : cluster 0 pgmap v29: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:23.106 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:23.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:23 smithi111 bash[23388]: cluster 2024-02-13T14:45:22.668839+0000 mgr.y (mgr.14613) 58 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:24.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:23 smithi062 bash[21479]: cluster 2024-02-13T14:45:22.668839+0000 mgr.y (mgr.14613) 58 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:24.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:23 smithi062 bash[28859]: cluster 2024-02-13T14:45:22.668839+0000 mgr.y (mgr.14613) 58 : cluster 0 pgmap v30: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:25.693 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.694 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.694 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.694 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.695 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.695 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.695 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.696 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.696 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.696 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.963 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.963 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.964 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.964 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.964 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.965 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:25 smithi111 bash[23388]: cluster 2024-02-13T14:45:24.670318+0000 mgr.y (mgr.14613) 59 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:25.965 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.965 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.966 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.966 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.966 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.966 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T14:45:25.966 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:25 smithi111 systemd[1]: Started Ceph grafana.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:45:26.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:25 smithi062 bash[21479]: cluster 2024-02-13T14:45:24.670318+0000 mgr.y (mgr.14613) 59 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:26.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:25 smithi062 bash[28859]: cluster 2024-02-13T14:45:24.670318+0000 mgr.y (mgr.14613) 59 : cluster 0 pgmap v31: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:26.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- 172.21.15.62:0/655443202 >> v1:172.21.15.62:6789/0 conn(0x7f78b410a8f0 legacy=0x7f78b410cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- 172.21.15.62:0/655443202 shutdown_connections 2024-02-13T14:45:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- 172.21.15.62:0/655443202 >> 172.21.15.62:0/655443202 conn(0x7f78b40fd550 msgr2=0x7f78b40ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- 172.21.15.62:0/655443202 shutdown_connections 2024-02-13T14:45:26.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- 172.21.15.62:0/655443202 wait complete. 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 Processor -- start 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- start start 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f78b41a6840 con 0x7f78b4107a40 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f78b41a7a20 con 0x7f78b410e4c0 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f78b41a8c20 con 0x7f78b410a8f0 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78b9574700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f78b4107a40 0x7f78b410dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37592/0 (socket says 172.21.15.62:37592) 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78b9574700 1 -- 172.21.15.62:0/679772215 learned_addr learned my addr 172.21.15.62:0/679772215 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78b8d73700 1 --1- 172.21.15.62:0/679772215 >> v1:172.21.15.62:6790/0 conn(0x7f78b410a8f0 0x7f78b41a1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:51204/0 (socket says 172.21.15.62:51204) 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243451793 0 0) 0x7f78b41a6840 con 0x7f78b4107a40 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78a00035b0 con 0x7f78b4107a40 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1189362221 0 0) 0x7f78b41a8c20 con 0x7f78b410a8f0 2024-02-13T14:45:26.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b41a6840 con 0x7f78b410a8f0 2024-02-13T14:45:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2195629539 0 0) 0x7f78b41a7a20 con 0x7f78b410e4c0 2024-02-13T14:45:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78b41a8c20 con 0x7f78b410e4c0 2024-02-13T14:45:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1774199365 0 0) 0x7f78a00035b0 con 0x7f78b4107a40 2024-02-13T14:45:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78b41a7a20 con 0x7f78b4107a40 2024-02-13T14:45:26.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f78b00018b0 con 0x7f78b4107a40 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3193329318 0 0) 0x7f78b41a6840 con 0x7f78b410a8f0 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f78a00035b0 con 0x7f78b410a8f0 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f78a40042f0 con 0x7f78b410a8f0 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1924175754 0 0) 0x7f78b41a7a20 con 0x7f78b4107a40 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 >> v1:172.21.15.62:6790/0 conn(0x7f78b410a8f0 legacy=0x7f78b41a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 >> v1:172.21.15.111:6789/0 conn(0x7f78b410e4c0 legacy=0x7f78b41a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b41a9e20 con 0x7f78b4107a40 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b41a6a30 con 0x7f78b4107a40 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b41a6eb0 con 0x7f78b4107a40 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f78b0003b30 con 0x7f78b4107a40 2024-02-13T14:45:26.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.108+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f78b0005c30 con 0x7f78b4107a40 2024-02-13T14:45:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.112+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7898005150 con 0x7f78b4107a40 2024-02-13T14:45:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.112+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f78b00036a0 con 0x7f78b4107a40 2024-02-13T14:45:26.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.112+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(72..72 src has 1..72) v4 ==== 6172+0+0 (unknown 2736178325 0 0) 0x7f78b0088d40 con 0x7f78b4107a40 2024-02-13T14:45:26.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.120+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f78b0055f20 con 0x7f78b4107a40 2024-02-13T14:45:26.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.328+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7898005400 con 0x7f78b4107a40 2024-02-13T14:45:26.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.332+0000 7f78aa7fc700 1 -- 172.21.15.62:0/679772215 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+20896 (unknown 1686360691 0 2845530237) 0x7f78b0054290 con 0x7f78b4107a40 2024-02-13T14:45:26.333 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:45:26.333 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":72,"fsid":"9cdb3692-ca7c-11ee-95b9-87774f69a715","created":"2024-02-13T14:33:15.381692+0000","modified":"2024-02-13T14:44:28.616533+0000","last_up_change":"2024-02-13T14:42:51.147139+0000","last_in_change":"2024-02-13T14:42:26.263327+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-13T14:38:35.651796+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".rgw.root","create_time":"2024-02-13T14:43:33.034718+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"61","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.log","create_time":"2024-02-13T14:43:34.938508+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"datapool","create_time":"2024-02-13T14:43:36.283555+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":70,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.6500000953674316,"score_stable":2.6500000953674316,"optimal_score":0.87999999523162842,"raw_score_acting":2.3299999237060547,"raw_score_stable":2.3299999237060547,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2024-02-13T14:43:36.885694+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2024-02-13T14:43:39.166504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"67","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"eacc17ac-916e-4f02-9a42-5de004ec7580","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6801","nonce":143174597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6802","nonce":143174597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6804","nonce":143174597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6803","nonce":143174597}]},"public_addr":"172.21.15.62:6801/143174597","cluster_addr":"172.21.15.62:6802/143174597","heartbeat_back_addr":"172.21.15.62:6804/143174597","heartbeat_front_addr":"172.21.15.62:6803/143174597","state":["exists","up"]},{"osd":1,"uuid":"21062ebc-0d8d-481b-95b0-1b10c843bcab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6805","nonce":3280693362}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6806","nonce":3280693362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6808","nonce":3280693362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6807","nonce":3280693362}]},"public_addr":"172.21.15.62:6805/3280693362","cluster_addr":"172.21.15.62:6806/3280693362","heartbeat_back_addr":"172.21.15.62:6808/3280693362","heartbeat_front_addr":"172.21.15.62:6807/3280693362","state":["exists","up"]},{"osd":2,"uuid":"932f8b3b-9b78-4433-9c7d-fe36ee894656","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6809","nonce":1346690857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6810","nonce":1346690857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6812","nonce":1346690857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6811","nonce":1346690857}]},"public_addr":"172.21.15.62:6809/1346690857","cluster_addr":"172.21.15.62:6810/1346690857","heartbeat_back_addr":"172.21.15.62:6812/1346690857","heartbeat_front_addr":"172.21.15.62:6811/1346690857","state":["exists","up"]},{"osd":3,"uuid":"7eca01f3-8960-425b-887d-20f66959978e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6813","nonce":1701426775}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6814","nonce":1701426775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6816","nonce":1701426775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.62:6815","nonce":1701426775}]},"public_addr":"172.21.15.62:6813/1701426775","cluster_addr":"172.21.15.62:6814/1701426775","heartbeat_back_addr":"172.21.15.62:6816/1701426775","heartbeat_front_addr":"172.21.15.62:6815/1701426775","state":["exists","up"]},{"osd":4,"uuid":"e55ae8d9-af71-443f-b9e0-0a59ceb52b0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":1278246464}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":1278246464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":1278246464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":1278246464}]},"public_addr":"172.21.15.111:6800/1278246464","cluster_addr":"172.21.15.111:6801/1278246464","heartbeat_back_addr":"172.21.15.111:6803/1278246464","heartbeat_front_addr":"172.21.15.111:6802/1278246464","state":["exists","up"]},{"osd":5,"uuid":"b5b44f2d-fb54-4f64-b523-7ff9f373ec4d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":575601374}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":575601374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":575601374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":575601374}]},"public_addr":"172.21.15.111:6804/575601374","cluster_addr":"172.21.15.111:6805/575601374","heartbeat_back_addr":"172.21.15.111:6807/575601374","heartbeat_front_addr":"172.21.15.111:6806/575601374","state":["exists","up"]},{"osd":6,"uuid":"e4d903d9-30df-41ef-b09e-651111416a2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":2146440304}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":2146440304}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":2146440304}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":2146440304}]},"public_addr":"172.21.15.111:6808/2146440304","cluster_addr":"172.21.15.111:6809/2146440304","heartbeat_back_addr":"172.21.15.111:6811/2146440304","heartbeat_front_addr":"172.21.15.111:6810/2146440304","state":["exists","up"]},{"osd":7,"uuid":"2b696400-d368-44a0-b57a-71c31e8292f0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":65,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":1629494259}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":1629494259}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":1629494259}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":1629494259}]},"public_addr":"172.21.15.111:6812/1629494259","cluster_addr":"172.21.15.111:6813/1629494259","heartbeat_back_addr":"172.21.15.111:6815/1629494259","heartbeat_front_addr":"172.21.15.111:6814/1629494259","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:36:49.319298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:37:40.712051+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:38:33.151039+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:39:26.430970+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:40:15.952959+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:41:06.923868+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:41:58.150572+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-13T14:42:50.081684+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.62:0/1613663194":"2024-02-14T14:44:28.616395+0000","172.21.15.62:0/473627328":"2024-02-14T14:44:28.616395+0000","172.21.15.62:6800/1926838190":"2024-02-14T14:44:28.616395+0000","172.21.15.62:0/1002099295":"2024-02-14T14:44:28.616395+0000","172.21.15.62:0/3993759757":"2024-02-14T14:44:28.616395+0000","172.21.15.62:6800/70089425":"2024-02-14T14:34:23.004283+0000","172.21.15.62:0/1058538806":"2024-02-14T14:44:28.616395+0000","172.21.15.62:0/384574915":"2024-02-14T14:34:23.004283+0000","172.21.15.62:6800/3755300204":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/1390781974":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/501986268":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/2037740662":"2024-02-14T14:33:47.040641+0000","172.21.15.62:0/807021312":"2024-02-14T14:34:23.004283+0000","172.21.15.62:0/1160844063":"2024-02-14T14:34:23.004283+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-13T14:45:26.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.336+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 >> v1:172.21.15.62:6800/3802446050 conn(0x7f78a006ec00 legacy=0x7f78a00710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:26.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.336+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 >> v1:172.21.15.62:6789/0 conn(0x7f78b4107a40 legacy=0x7f78b410dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:26.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.336+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 shutdown_connections 2024-02-13T14:45:26.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.336+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 >> 172.21.15.62:0/679772215 conn(0x7f78b40fd550 msgr2=0x7f78b4100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:26.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.336+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 shutdown_connections 2024-02-13T14:45:26.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:26.336+0000 7f78bb7d8700 1 -- 172.21.15.62:0/679772215 wait complete. 2024-02-13T14:45:26.541 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:45:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:45:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:45:27.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[23388]: audit 2024-02-13T14:45:26.008308+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[23388]: audit 2024-02-13T14:45:26.016289+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[23388]: audit 2024-02-13T14:45:26.070156+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[23388]: audit 2024-02-13T14:45:26.080394+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[23388]: audit 2024-02-13T14:45:26.146509+0000 mon.b (mon.1) 68 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:45:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[23388]: audit 2024-02-13T14:45:26.333890+0000 mon.a (mon.0) 815 : audit 0 from='client.? v1:172.21.15.62:0/679772215' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:45:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[23388]: audit 2024-02-13T14:45:26.673236+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[23388]: audit 2024-02-13T14:45:26.687020+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-13T14:45:27.099 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-13T14:45:27.100 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-13T14:45:27.101 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-13T14:45:27.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-13T14:45:27.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-13T14:45:27.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-13T14:45:27.103 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-13T14:45:27.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[28859]: audit 2024-02-13T14:45:26.008308+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[28859]: audit 2024-02-13T14:45:26.016289+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[28859]: audit 2024-02-13T14:45:26.070156+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[28859]: audit 2024-02-13T14:45:26.080394+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[28859]: audit 2024-02-13T14:45:26.146509+0000 mon.b (mon.1) 68 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:45:27.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[28859]: audit 2024-02-13T14:45:26.333890+0000 mon.a (mon.0) 815 : audit 0 from='client.? v1:172.21.15.62:0/679772215' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:45:27.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[28859]: audit 2024-02-13T14:45:26.673236+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[28859]: audit 2024-02-13T14:45:26.687020+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[21479]: audit 2024-02-13T14:45:26.008308+0000 mon.a (mon.0) 811 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[21479]: audit 2024-02-13T14:45:26.016289+0000 mon.a (mon.0) 812 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[21479]: audit 2024-02-13T14:45:26.070156+0000 mon.a (mon.0) 813 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[21479]: audit 2024-02-13T14:45:26.080394+0000 mon.a (mon.0) 814 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[21479]: audit 2024-02-13T14:45:26.146509+0000 mon.b (mon.1) 68 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:45:27.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[21479]: audit 2024-02-13T14:45:26.333890+0000 mon.a (mon.0) 815 : audit 0 from='client.? v1:172.21.15.62:0/679772215' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-13T14:45:27.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[21479]: audit 2024-02-13T14:45:26.673236+0000 mon.a (mon.0) 816 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:27 smithi062 bash[21479]: audit 2024-02-13T14:45:26.687020+0000 mon.a (mon.0) 817 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:27.359 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.098759934Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-02-13T14:45:27.359 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.098993935Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-02-13T14:45:27.359 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099023385Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-02-13T14:45:27.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099037976Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-02-13T14:45:27.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099050191Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-13T14:45:27.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099069713Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-13T14:45:27.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099084361Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-13T14:45:27.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099097743Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-13T14:45:27.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099109044Z level=info msg="Path Home" path=/usr/share/grafana 2024-02-13T14:45:27.360 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099121349Z level=info msg="Path Data" path=/var/lib/grafana 2024-02-13T14:45:27.361 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099132732Z level=info msg="Path Logs" path=/var/log/grafana 2024-02-13T14:45:27.361 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099143816Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-02-13T14:45:27.361 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099156185Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-02-13T14:45:27.361 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=settings t=2024-02-13T14:45:27.099173225Z level=info msg="App mode production" 2024-02-13T14:45:27.361 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=sqlstore t=2024-02-13T14:45:27.099269079Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-02-13T14:45:27.361 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=sqlstore t=2024-02-13T14:45:27.099304924Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-02-13T14:45:27.361 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.100778701Z level=info msg="Starting DB migrations" 2024-02-13T14:45:27.362 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.100879315Z level=info msg="Executing migration" id="create migration_log table" 2024-02-13T14:45:27.362 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.13379242Z level=info msg="Executing migration" id="create user table" 2024-02-13T14:45:27.362 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.175758762Z level=info msg="Executing migration" id="add unique index user.login" 2024-02-13T14:45:27.362 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.226297331Z level=info msg="Executing migration" id="add unique index user.email" 2024-02-13T14:45:27.362 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.251472378Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" 2024-02-13T14:45:27.363 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.293411132Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" 2024-02-13T14:45:27.363 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.335319033Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" 2024-02-13T14:45:27.363 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.360641604Z level=info msg="Executing migration" id="create user table v2" 2024-02-13T14:45:27.636 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.402584115Z level=info msg="Executing migration" id="create index UQE_user_login - v2" 2024-02-13T14:45:27.636 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.427802183Z level=info msg="Executing migration" id="create index UQE_user_email - v2" 2024-02-13T14:45:27.636 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.45313249Z level=info msg="Executing migration" id="copy data_source v1 to v2" 2024-02-13T14:45:27.636 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.495024909Z level=info msg="Executing migration" id="Drop old table user_v1" 2024-02-13T14:45:27.637 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.520358232Z level=info msg="Executing migration" id="Add column help_flags1 to user table" 2024-02-13T14:45:27.637 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.545561814Z level=info msg="Executing migration" id="Update user table charset" 2024-02-13T14:45:27.637 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.570767533Z level=info msg="Executing migration" id="Add last_seen_at column to user" 2024-02-13T14:45:27.637 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.59602559Z level=info msg="Executing migration" id="Add missing user data" 2024-02-13T14:45:27.905 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.638015594Z level=info msg="Executing migration" id="Add is_disabled column to user" 2024-02-13T14:45:27.905 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.663260803Z level=info msg="Executing migration" id="Add index user.login/user.email" 2024-02-13T14:45:27.905 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.705245467Z level=info msg="Executing migration" id="Add is_service_account column to user" 2024-02-13T14:45:27.905 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.73901576Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-02-13T14:45:27.905 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.764418869Z level=info msg="Executing migration" id="create temp user table v1-7" 2024-02-13T14:45:27.905 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.789670101Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" 2024-02-13T14:45:27.906 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.823332828Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" 2024-02-13T14:45:27.906 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.856982798Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" 2024-02-13T14:45:27.906 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.882239916Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" 2024-02-13T14:45:27.906 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.907477514Z level=info msg="Executing migration" id="Update temp_user table charset" 2024-02-13T14:45:28.165 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[23388]: cluster 2024-02-13T14:45:26.671024+0000 mgr.y (mgr.14613) 60 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:28.166 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.93264998Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" 2024-02-13T14:45:28.166 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:27 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.957929947Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" 2024-02-13T14:45:28.166 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:27.999875445Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" 2024-02-13T14:45:28.166 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.058632366Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" 2024-02-13T14:45:28.166 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.083832125Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-02-13T14:45:28.166 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.125993709Z level=info msg="Executing migration" id="create temp_user v2" 2024-02-13T14:45:28.166 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.15099684Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" 2024-02-13T14:45:28.166 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.168001214Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" 2024-02-13T14:45:28.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:28 smithi062 bash[21479]: cluster 2024-02-13T14:45:26.671024+0000 mgr.y (mgr.14613) 60 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:28.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:28 smithi062 bash[28859]: cluster 2024-02-13T14:45:26.671024+0000 mgr.y (mgr.14613) 60 : cluster 0 pgmap v32: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:28.428 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.184852044Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" 2024-02-13T14:45:28.428 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.201754006Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" 2024-02-13T14:45:28.428 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.218744377Z level=info msg="Executing migration" id="copy temp_user v1 to v2" 2024-02-13T14:45:28.428 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.235644177Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" 2024-02-13T14:45:28.428 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.252582752Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" 2024-02-13T14:45:28.428 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.286077177Z level=info msg="Executing migration" id="create star table" 2024-02-13T14:45:28.428 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.311473368Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" 2024-02-13T14:45:28.429 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.336876627Z level=info msg="Executing migration" id="create org table v1" 2024-02-13T14:45:28.429 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.353767392Z level=info msg="Executing migration" id="create index UQE_org_name - v1" 2024-02-13T14:45:28.429 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.387448976Z level=info msg="Executing migration" id="create org_user table v1" 2024-02-13T14:45:28.429 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.429779539Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" 2024-02-13T14:45:28.705 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.454765117Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" 2024-02-13T14:45:28.705 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.480087115Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" 2024-02-13T14:45:28.705 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.505301293Z level=info msg="Executing migration" id="Update org table charset" 2024-02-13T14:45:28.705 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.530537606Z level=info msg="Executing migration" id="Update org_user table charset" 2024-02-13T14:45:28.705 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.572763427Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" 2024-02-13T14:45:28.705 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.598114291Z level=info msg="Executing migration" id="create dashboard table" 2024-02-13T14:45:28.706 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.640070169Z level=info msg="Executing migration" id="add index dashboard.account_id" 2024-02-13T14:45:28.706 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.665305071Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" 2024-02-13T14:45:28.706 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.707334305Z level=info msg="Executing migration" id="create dashboard_tag table" 2024-02-13T14:45:28.991 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.724175863Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" 2024-02-13T14:45:28.991 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.757961867Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-13T14:45:28.991 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.799941615Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" 2024-02-13T14:45:28.991 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.841944722Z level=info msg="Executing migration" id="create dashboard v2" 2024-02-13T14:45:28.991 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.867104945Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" 2024-02-13T14:45:28.991 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.909188509Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" 2024-02-13T14:45:28.991 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.951175193Z level=info msg="Executing migration" id="copy dashboard v1 to v2" 2024-02-13T14:45:29.260 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[23388]: audit 2024-02-13T14:45:28.697181+0000 mon.b (mon.1) 69 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-13T14:45:29.260 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[23388]: audit 2024-02-13T14:45:28.698294+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-13T14:45:29.260 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[23388]: audit 2024-02-13T14:45:28.788755+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:29.260 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:28 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:28.993228551Z level=info msg="Executing migration" id="drop table dashboard_v1" 2024-02-13T14:45:29.260 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.035304118Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" 2024-02-13T14:45:29.260 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.077349536Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" 2024-02-13T14:45:29.260 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.102616357Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" 2024-02-13T14:45:29.261 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.127820267Z level=info msg="Executing migration" id="Add column gnetId in dashboard" 2024-02-13T14:45:29.261 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.169732829Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" 2024-02-13T14:45:29.261 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.194969121Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" 2024-02-13T14:45:29.261 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.220289915Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" 2024-02-13T14:45:29.261 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.262166882Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" 2024-02-13T14:45:29.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:29 smithi062 bash[28859]: audit 2024-02-13T14:45:28.697181+0000 mon.b (mon.1) 69 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-13T14:45:29.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:29 smithi062 bash[28859]: audit 2024-02-13T14:45:28.698294+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-13T14:45:29.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:29 smithi062 bash[28859]: audit 2024-02-13T14:45:28.788755+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:29.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:29 smithi062 bash[21479]: audit 2024-02-13T14:45:28.697181+0000 mon.b (mon.1) 69 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-13T14:45:29.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:29 smithi062 bash[21479]: audit 2024-02-13T14:45:28.698294+0000 mon.a (mon.0) 818 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-13T14:45:29.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:29 smithi062 bash[21479]: audit 2024-02-13T14:45:28.788755+0000 mon.a (mon.0) 819 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:29.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.30421268Z level=info msg="Executing migration" id="Update dashboard table charset" 2024-02-13T14:45:29.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.329498468Z level=info msg="Executing migration" id="Update dashboard_tag table charset" 2024-02-13T14:45:29.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.37143806Z level=info msg="Executing migration" id="Add column folder_id in dashboard" 2024-02-13T14:45:29.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.418666701Z level=info msg="Executing migration" id="Add column isFolder in dashboard" 2024-02-13T14:45:29.529 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.455448714Z level=info msg="Executing migration" id="Add column has_acl in dashboard" 2024-02-13T14:45:29.530 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.480629365Z level=info msg="Executing migration" id="Add column uid in dashboard" 2024-02-13T14:45:29.530 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.506148261Z level=info msg="Executing migration" id="Update uid column values in dashboard" 2024-02-13T14:45:29.530 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.531428062Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.556715081Z level=info msg="Executing migration" id="Remove unique index org_id_slug" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.598678466Z level=info msg="Executing migration" id="Update dashboard title length" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.640707412Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.674514007Z level=info msg="Executing migration" id="create dashboard_provisioning" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.691317083Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.708391498Z level=info msg="Executing migration" id="create dashboard_provisioning v2" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.725247063Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.750380971Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.775789894Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" 2024-02-13T14:45:29.799 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.800958087Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" 2024-02-13T14:45:30.051 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:45:30.051 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.826285152Z level=info msg="Executing migration" id="Add check_sum column" 2024-02-13T14:45:30.051 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.86825699Z level=info msg="Executing migration" id="Add index for dashboard_title" 2024-02-13T14:45:30.051 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.893569035Z level=info msg="Executing migration" id="delete tags for deleted dashboards" 2024-02-13T14:45:30.051 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.918767293Z level=info msg="Executing migration" id="delete stars for deleted dashboards" 2024-02-13T14:45:30.051 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.943962253Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" 2024-02-13T14:45:30.052 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:29 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:29.969347913Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-02-13T14:45:30.052 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.011403624Z level=info msg="Executing migration" id="create data_source table" 2024-02-13T14:45:30.052 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.053417616Z level=info msg="Executing migration" id="add index data_source.account_id" 2024-02-13T14:45:30.052 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[23388]: cluster 2024-02-13T14:45:28.671722+0000 mgr.y (mgr.14613) 61 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:30.052 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[23388]: audit 2024-02-13T14:45:29.019127+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-13T14:45:30.052 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[23388]: cluster 2024-02-13T14:45:29.025777+0000 mon.a (mon.0) 821 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-02-13T14:45:30.052 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[23388]: audit 2024-02-13T14:45:29.237117+0000 mon.b (mon.1) 70 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:30 smithi062 bash[21479]: cluster 2024-02-13T14:45:28.671722+0000 mgr.y (mgr.14613) 61 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:30 smithi062 bash[21479]: audit 2024-02-13T14:45:29.019127+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-13T14:45:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:30 smithi062 bash[21479]: cluster 2024-02-13T14:45:29.025777+0000 mon.a (mon.0) 821 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-02-13T14:45:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:30 smithi062 bash[21479]: audit 2024-02-13T14:45:29.237117+0000 mon.b (mon.1) 70 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:30.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:30 smithi062 bash[28859]: cluster 2024-02-13T14:45:28.671722+0000 mgr.y (mgr.14613) 61 : cluster 0 pgmap v33: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:30.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:30 smithi062 bash[28859]: audit 2024-02-13T14:45:29.019127+0000 mon.a (mon.0) 820 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]': finished 2024-02-13T14:45:30.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:30 smithi062 bash[28859]: cluster 2024-02-13T14:45:29.025777+0000 mon.a (mon.0) 821 : cluster 0 osdmap e73: 8 total, 8 up, 8 in 2024-02-13T14:45:30.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:30 smithi062 bash[28859]: audit 2024-02-13T14:45:29.237117+0000 mon.b (mon.1) 70 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:30.320 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.087040572Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" 2024-02-13T14:45:30.320 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.129260215Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" 2024-02-13T14:45:30.320 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.154386655Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" 2024-02-13T14:45:30.320 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.179546584Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" 2024-02-13T14:45:30.320 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.204864905Z level=info msg="Executing migration" id="create data_source table v2" 2024-02-13T14:45:30.321 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.230150407Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" 2024-02-13T14:45:30.321 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.272056864Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" 2024-02-13T14:45:30.321 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.297381015Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" 2024-02-13T14:45:30.321 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.322533125Z level=info msg="Executing migration" id="Add column with_credentials" 2024-02-13T14:45:30.572 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.373042765Z level=info msg="Executing migration" id="Add secure json data column" 2024-02-13T14:45:30.572 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.398340903Z level=info msg="Executing migration" id="Update data_source table charset" 2024-02-13T14:45:30.573 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.423575599Z level=info msg="Executing migration" id="Update initial version to 1" 2024-02-13T14:45:30.573 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.448854301Z level=info msg="Executing migration" id="Add read_only data column" 2024-02-13T14:45:30.573 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.507527414Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" 2024-02-13T14:45:30.573 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.549498224Z level=info msg="Executing migration" id="Update json_data with nulls" 2024-02-13T14:45:30.573 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.574820761Z level=info msg="Executing migration" id="Add uid column" 2024-02-13T14:45:30.825 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.616748814Z level=info msg="Executing migration" id="Update uid value" 2024-02-13T14:45:30.825 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.642223317Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" 2024-02-13T14:45:30.825 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.684187526Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" 2024-02-13T14:45:30.825 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.709439994Z level=info msg="Executing migration" id="create api_key table" 2024-02-13T14:45:30.825 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.734606161Z level=info msg="Executing migration" id="add index api_key.account_id" 2024-02-13T14:45:30.825 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.759845382Z level=info msg="Executing migration" id="add index api_key.key" 2024-02-13T14:45:30.825 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.785025418Z level=info msg="Executing migration" id="add index api_key.account_id_name" 2024-02-13T14:45:30.825 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.827059852Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" 2024-02-13T14:45:31.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[23388]: audit 2024-02-13T14:45:29.943050+0000 mgr.y (mgr.14613) 62 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:31.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[23388]: cluster 2024-02-13T14:45:30.028864+0000 mon.a (mon.0) 822 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-02-13T14:45:31.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.852292191Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" 2024-02-13T14:45:31.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.894321329Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" 2024-02-13T14:45:31.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.936209886Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" 2024-02-13T14:45:31.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:30 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:30.961500524Z level=info msg="Executing migration" id="create api_key table v2" 2024-02-13T14:45:31.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.00347333Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" 2024-02-13T14:45:31.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.02871495Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" 2024-02-13T14:45:31.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.070854591Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" 2024-02-13T14:45:31.177 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:31.178 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:31.180 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:31.181 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:31.183 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:31.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:31 smithi062 bash[28859]: audit 2024-02-13T14:45:29.943050+0000 mgr.y (mgr.14613) 62 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:31.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:31 smithi062 bash[28859]: cluster 2024-02-13T14:45:30.028864+0000 mon.a (mon.0) 822 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-02-13T14:45:31.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:31 smithi062 bash[21479]: audit 2024-02-13T14:45:29.943050+0000 mgr.y (mgr.14613) 62 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:31.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:31 smithi062 bash[21479]: cluster 2024-02-13T14:45:30.028864+0000 mon.a (mon.0) 822 : cluster 0 osdmap e74: 8 total, 8 up, 8 in 2024-02-13T14:45:31.363 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.112901856Z level=info msg="Executing migration" id="copy api_key v1 to v2" 2024-02-13T14:45:31.363 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.138091409Z level=info msg="Executing migration" id="Drop old table api_key_v1" 2024-02-13T14:45:31.363 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.179973006Z level=info msg="Executing migration" id="Update api_key table charset" 2024-02-13T14:45:31.363 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.221997822Z level=info msg="Executing migration" id="Add expires to api_key table" 2024-02-13T14:45:31.363 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.24723923Z level=info msg="Executing migration" id="Add service account foreign key" 2024-02-13T14:45:31.364 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.289144173Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-02-13T14:45:31.364 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.306475026Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-02-13T14:45:31.364 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.323326991Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-02-13T14:45:31.364 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.340315575Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" 2024-02-13T14:45:31.364 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.365484408Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" 2024-02-13T14:45:31.648 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.407454742Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" 2024-02-13T14:45:31.649 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.432680021Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_key - v5" 2024-02-13T14:45:31.649 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.457922776Z level=info msg="Executing migration" id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-13T14:45:31.649 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.483119075Z level=info msg="Executing migration" id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-13T14:45:31.649 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.566901044Z level=info msg="Executing migration" id="alter dashboard_snapshot to mediumtext v2" 2024-02-13T14:45:31.649 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.609030485Z level=info msg="Executing migration" id="Update dashboard_snapshot table charset" 2024-02-13T14:45:31.649 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.650907592Z level=info msg="Executing migration" id="Add column external_delete_url to dashboard_snapshots table" 2024-02-13T14:45:31.917 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.676241487Z level=info msg="Executing migration" id="Add encrypted dashboard json column" 2024-02-13T14:45:31.918 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.701515983Z level=info msg="Executing migration" id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-02-13T14:45:31.918 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.726589325Z level=info msg="Executing migration" id="create quota table v1" 2024-02-13T14:45:31.918 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.757836795Z level=info msg="Executing migration" id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-13T14:45:31.918 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.802487672Z level=info msg="Executing migration" id="Update quota table charset" 2024-02-13T14:45:31.918 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.844318187Z level=info msg="Executing migration" id="create plugin_setting table" 2024-02-13T14:45:31.918 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.869510015Z level=info msg="Executing migration" id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-13T14:45:31.918 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.894770499Z level=info msg="Executing migration" id="Add column plugin_version to plugin_settings" 2024-02-13T14:45:32.178 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[23388]: cluster 2024-02-13T14:45:30.672423+0000 mgr.y (mgr.14613) 63 : cluster 0 pgmap v36: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:32.178 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[23388]: cluster 2024-02-13T14:45:31.036037+0000 mon.a (mon.0) 823 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-13T14:45:32.178 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[23388]: audit 2024-02-13T14:45:31.936971+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:32.178 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[23388]: audit 2024-02-13T14:45:31.945691+0000 mon.a (mon.0) 825 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:32.178 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.920068346Z level=info msg="Executing migration" id="Update plugin_setting table charset" 2024-02-13T14:45:32.179 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:31 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:31.961964773Z level=info msg="Executing migration" id="create session table" 2024-02-13T14:45:32.179 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.004021216Z level=info msg="Executing migration" id="Drop old table playlist table" 2024-02-13T14:45:32.179 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.029161961Z level=info msg="Executing migration" id="Drop old table playlist_item table" 2024-02-13T14:45:32.179 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.07124799Z level=info msg="Executing migration" id="create playlist table v2" 2024-02-13T14:45:32.179 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.113395128Z level=info msg="Executing migration" id="create playlist item table v2" 2024-02-13T14:45:32.179 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.138596749Z level=info msg="Executing migration" id="Update playlist table charset" 2024-02-13T14:45:32.179 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.18067776Z level=info msg="Executing migration" id="Update playlist_item table charset" 2024-02-13T14:45:32.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:32 smithi062 bash[21479]: cluster 2024-02-13T14:45:30.672423+0000 mgr.y (mgr.14613) 63 : cluster 0 pgmap v36: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:32.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:32 smithi062 bash[21479]: cluster 2024-02-13T14:45:31.036037+0000 mon.a (mon.0) 823 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-13T14:45:32.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:32 smithi062 bash[21479]: audit 2024-02-13T14:45:31.936971+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:32.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:32 smithi062 bash[21479]: audit 2024-02-13T14:45:31.945691+0000 mon.a (mon.0) 825 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:32.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:32 smithi062 bash[28859]: cluster 2024-02-13T14:45:30.672423+0000 mgr.y (mgr.14613) 63 : cluster 0 pgmap v36: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:32.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:32 smithi062 bash[28859]: cluster 2024-02-13T14:45:31.036037+0000 mon.a (mon.0) 823 : cluster 3 Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-02-13T14:45:32.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:32 smithi062 bash[28859]: audit 2024-02-13T14:45:31.936971+0000 mon.a (mon.0) 824 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:32.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:32 smithi062 bash[28859]: audit 2024-02-13T14:45:31.945691+0000 mon.a (mon.0) 825 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:32.447 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.231268684Z level=info msg="Executing migration" id="drop preferences table v2" 2024-02-13T14:45:32.447 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.256551291Z level=info msg="Executing migration" id="drop preferences table v3" 2024-02-13T14:45:32.447 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.298431252Z level=info msg="Executing migration" id="create preferences table v3" 2024-02-13T14:45:32.447 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.340561261Z level=info msg="Executing migration" id="Update preferences table charset" 2024-02-13T14:45:32.448 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.382583137Z level=info msg="Executing migration" id="Add column team_id in preferences" 2024-02-13T14:45:32.448 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.407883309Z level=info msg="Executing migration" id="Update team_id column values in preferences" 2024-02-13T14:45:32.448 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.449913019Z level=info msg="Executing migration" id="Add column week_start in preferences" 2024-02-13T14:45:32.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.491937831Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-02-13T14:45:32.716 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.517178054Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-02-13T14:45:32.717 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.559296049Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-02-13T14:45:32.717 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.601391879Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-02-13T14:45:32.717 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.643388658Z level=info msg="Executing migration" id="create alert table v1" 2024-02-13T14:45:32.717 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.677036765Z level=info msg="Executing migration" id="add index alert org_id & id " 2024-02-13T14:45:32.717 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.719174179Z level=info msg="Executing migration" id="add index alert state" 2024-02-13T14:45:32.994 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.752998649Z level=info msg="Executing migration" id="add index alert dashboard_id" 2024-02-13T14:45:32.994 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.778107636Z level=info msg="Executing migration" id="Create alert_rule_tag table v1" 2024-02-13T14:45:32.994 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.819780734Z level=info msg="Executing migration" id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-13T14:45:32.994 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.862081383Z level=info msg="Executing migration" id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-02-13T14:45:32.994 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.887154296Z level=info msg="Executing migration" id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-02-13T14:45:32.994 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.912381951Z level=info msg="Executing migration" id="Create alert_rule_tag table v2" 2024-02-13T14:45:32.994 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.954416242Z level=info msg="Executing migration" id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-02-13T14:45:32.994 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:32 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:32.996457512Z level=info msg="Executing migration" id="copy alert_rule_tag v1 to v2" 2024-02-13T14:45:33.247 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.038555785Z level=info msg="Executing migration" id="drop table alert_rule_tag_v1" 2024-02-13T14:45:33.247 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.080441426Z level=info msg="Executing migration" id="create alert_notification table v1" 2024-02-13T14:45:33.247 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.105850241Z level=info msg="Executing migration" id="Add column is_default" 2024-02-13T14:45:33.247 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.131028477Z level=info msg="Executing migration" id="Add column frequency" 2024-02-13T14:45:33.247 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.156640006Z level=info msg="Executing migration" id="Add column send_reminder" 2024-02-13T14:45:33.247 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.198579774Z level=info msg="Executing migration" id="Add column disable_resolve_message" 2024-02-13T14:45:33.247 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.22388487Z level=info msg="Executing migration" id="add index alert_notification org_id & name" 2024-02-13T14:45:33.247 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.249045994Z level=info msg="Executing migration" id="Update alert table charset" 2024-02-13T14:45:33.516 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.290912622Z level=info msg="Executing migration" id="Update alert_notification table charset" 2024-02-13T14:45:33.516 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.316265677Z level=info msg="Executing migration" id="create notification_journal table v1" 2024-02-13T14:45:33.516 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.358390282Z level=info msg="Executing migration" id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-13T14:45:33.516 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.375206305Z level=info msg="Executing migration" id="drop alert_notification_journal" 2024-02-13T14:45:33.516 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.417250635Z level=info msg="Executing migration" id="create alert_notification_state table v1" 2024-02-13T14:45:33.516 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.442550051Z level=info msg="Executing migration" id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-13T14:45:33.516 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.467747265Z level=info msg="Executing migration" id="Add for to alert table" 2024-02-13T14:45:33.516 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.492986774Z level=info msg="Executing migration" id="Add column uid in alert_notification" 2024-02-13T14:45:33.517 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.5181712Z level=info msg="Executing migration" id="Update uid column values in alert_notification" 2024-02-13T14:45:33.776 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.543361928Z level=info msg="Executing migration" id="Add unique index alert_notification_org_id_uid" 2024-02-13T14:45:33.777 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.568663357Z level=info msg="Executing migration" id="Remove unique index org_id_name" 2024-02-13T14:45:33.777 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.593862693Z level=info msg="Executing migration" id="Add column secure_settings in alert_notification" 2024-02-13T14:45:33.777 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.635791098Z level=info msg="Executing migration" id="alter alert.settings to mediumtext" 2024-02-13T14:45:33.777 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.661059391Z level=info msg="Executing migration" id="Add non-unique index alert_notification_state_alert_id" 2024-02-13T14:45:33.777 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.686319634Z level=info msg="Executing migration" id="Add non-unique index alert_rule_tag_alert_id" 2024-02-13T14:45:33.777 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.711563124Z level=info msg="Executing migration" id="Drop old annotation table v4" 2024-02-13T14:45:33.777 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.753547883Z level=info msg="Executing migration" id="create annotation table v5" 2024-02-13T14:45:33.777 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.778885495Z level=info msg="Executing migration" id="add index annotation 0 v3" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.820899902Z level=info msg="Executing migration" id="add index annotation 1 v3" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.846216191Z level=info msg="Executing migration" id="add index annotation 2 v3" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.871452557Z level=info msg="Executing migration" id="add index annotation 3 v3" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.913483811Z level=info msg="Executing migration" id="add index annotation 4 v3" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.938674804Z level=info msg="Executing migration" id="Update annotation table charset" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:33.963895831Z level=info msg="Executing migration" id="Add column region_id to annotation table" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.005824254Z level=info msg="Executing migration" id="Drop category_id index" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.031006919Z level=info msg="Executing migration" id="Add column tags to annotation table" 2024-02-13T14:45:34.029 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[23388]: cluster 2024-02-13T14:45:32.672886+0000 mgr.y (mgr.14613) 64 : cluster 0 pgmap v37: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:45:34.029 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[23388]: audit 2024-02-13T14:45:32.790905+0000 mon.a (mon.0) 826 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.029 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[23388]: audit 2024-02-13T14:45:32.803967+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.030 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[23388]: audit 2024-02-13T14:45:32.806139+0000 mon.b (mon.1) 71 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:45:34.030 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[23388]: audit 2024-02-13T14:45:32.807522+0000 mon.b (mon.1) 72 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:45:34.030 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[23388]: audit 2024-02-13T14:45:32.818018+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.030 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[23388]: cephadm 2024-02-13T14:45:32.898593+0000 mgr.y (mgr.14613) 65 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-02-13T14:45:34.030 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:33 smithi111 bash[23388]: cephadm 2024-02-13T14:45:32.907424+0000 mgr.y (mgr.14613) 66 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi062 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[28859]: cluster 2024-02-13T14:45:32.672886+0000 mgr.y (mgr.14613) 64 : cluster 0 pgmap v37: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[28859]: audit 2024-02-13T14:45:32.790905+0000 mon.a (mon.0) 826 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[28859]: audit 2024-02-13T14:45:32.803967+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[28859]: audit 2024-02-13T14:45:32.806139+0000 mon.b (mon.1) 71 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[28859]: audit 2024-02-13T14:45:32.807522+0000 mon.b (mon.1) 72 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[28859]: audit 2024-02-13T14:45:32.818018+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[28859]: cephadm 2024-02-13T14:45:32.898593+0000 mgr.y (mgr.14613) 65 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[28859]: cephadm 2024-02-13T14:45:32.907424+0000 mgr.y (mgr.14613) 66 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi062 2024-02-13T14:45:34.075 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[21479]: cluster 2024-02-13T14:45:32.672886+0000 mgr.y (mgr.14613) 64 : cluster 0 pgmap v37: 132 pgs: 1 peering, 131 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:45:34.076 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[21479]: audit 2024-02-13T14:45:32.790905+0000 mon.a (mon.0) 826 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.076 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[21479]: audit 2024-02-13T14:45:32.803967+0000 mon.a (mon.0) 827 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.076 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[21479]: audit 2024-02-13T14:45:32.806139+0000 mon.b (mon.1) 71 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:45:34.076 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[21479]: audit 2024-02-13T14:45:32.807522+0000 mon.b (mon.1) 72 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:45:34.076 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[21479]: audit 2024-02-13T14:45:32.818018+0000 mon.a (mon.0) 828 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:34.076 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[21479]: cephadm 2024-02-13T14:45:32.898593+0000 mgr.y (mgr.14613) 65 : cephadm 1 Reconfiguring alertmanager.a (dependencies changed)... 2024-02-13T14:45:34.076 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:33 smithi062 bash[21479]: cephadm 2024-02-13T14:45:32.907424+0000 mgr.y (mgr.14613) 66 : cephadm 1 Reconfiguring daemon alertmanager.a on smithi062 2024-02-13T14:45:34.289 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.106395603Z level=info msg="Executing migration" id="Create annotation_tag table v2" 2024-02-13T14:45:34.289 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.140248946Z level=info msg="Executing migration" id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-13T14:45:34.289 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.165492563Z level=info msg="Executing migration" id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-02-13T14:45:34.289 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.207436561Z level=info msg="Executing migration" id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-02-13T14:45:34.289 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.240963062Z level=info msg="Executing migration" id="Create annotation_tag table v3" 2024-02-13T14:45:34.289 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.26613216Z level=info msg="Executing migration" id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-02-13T14:45:34.289 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.291485972Z level=info msg="Executing migration" id="copy annotation_tag v2 to v3" 2024-02-13T14:45:34.550 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.316650736Z level=info msg="Executing migration" id="drop table annotation_tag_v2" 2024-02-13T14:45:34.550 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.341975221Z level=info msg="Executing migration" id="Update alert annotations and set TEXT to empty" 2024-02-13T14:45:34.550 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.38389025Z level=info msg="Executing migration" id="Add created time to annotation table" 2024-02-13T14:45:34.550 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.425796348Z level=info msg="Executing migration" id="Add updated time to annotation table" 2024-02-13T14:45:34.550 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.451187836Z level=info msg="Executing migration" id="Add index for created in annotation table" 2024-02-13T14:45:34.550 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.476493043Z level=info msg="Executing migration" id="Add index for updated in annotation table" 2024-02-13T14:45:34.550 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.50166119Z level=info msg="Executing migration" id="Convert existing annotations from seconds to milliseconds" 2024-02-13T14:45:34.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.526816317Z level=info msg="Executing migration" id="Add epoch_end column" 2024-02-13T14:45:34.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.55210979Z level=info msg="Executing migration" id="Add index for epoch_end" 2024-02-13T14:45:34.827 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.594208033Z level=info msg="Executing migration" id="Make epoch_end the same as epoch" 2024-02-13T14:45:34.827 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.636141151Z level=info msg="Executing migration" id="Move region to single row" 2024-02-13T14:45:34.827 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.678399719Z level=info msg="Executing migration" id="Remove index org_id_epoch from annotation table" 2024-02-13T14:45:34.827 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.72031885Z level=info msg="Executing migration" id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-13T14:45:34.827 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.745543213Z level=info msg="Executing migration" id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-13T14:45:34.827 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.787447482Z level=info msg="Executing migration" id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-13T14:45:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[23388]: cluster 2024-02-13T14:45:34.790539+0000 mon.a (mon.0) 829 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-13T14:45:35.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[23388]: cluster 2024-02-13T14:45:34.790596+0000 mon.a (mon.0) 830 : cluster 1 Cluster is now healthy 2024-02-13T14:45:35.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.829426679Z level=info msg="Executing migration" id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-13T14:45:35.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.8714735Z level=info msg="Executing migration" id="Add index for alert_id on annotation table" 2024-02-13T14:45:35.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.913440138Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-02-13T14:45:35.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.938613655Z level=info msg="Executing migration" id="create test_data table" 2024-02-13T14:45:35.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:34 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:34.981080921Z level=info msg="Executing migration" id="create dashboard_version table v1" 2024-02-13T14:45:35.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.022713815Z level=info msg="Executing migration" id="add index dashboard_version.dashboard_id" 2024-02-13T14:45:35.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.047971586Z level=info msg="Executing migration" id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-13T14:45:35.094 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.073174833Z level=info msg="Executing migration" id="Set dashboard version to 1 where 0" 2024-02-13T14:45:35.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:34 smithi062 bash[21479]: cluster 2024-02-13T14:45:34.790539+0000 mon.a (mon.0) 829 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-13T14:45:35.096 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:34 smithi062 bash[21479]: cluster 2024-02-13T14:45:34.790596+0000 mon.a (mon.0) 830 : cluster 1 Cluster is now healthy 2024-02-13T14:45:35.096 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:34 smithi062 bash[28859]: cluster 2024-02-13T14:45:34.790539+0000 mon.a (mon.0) 829 : cluster 1 Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-13T14:45:35.096 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:34 smithi062 bash[28859]: cluster 2024-02-13T14:45:34.790596+0000 mon.a (mon.0) 830 : cluster 1 Cluster is now healthy 2024-02-13T14:45:35.381 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.123651073Z level=info msg="Executing migration" id="save existing dashboard data in dashboard_version table v1" 2024-02-13T14:45:35.382 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.165690634Z level=info msg="Executing migration" id="alter dashboard_version.data to mediumtext v1" 2024-02-13T14:45:35.382 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.207836637Z level=info msg="Executing migration" id="create team table" 2024-02-13T14:45:35.382 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.249779191Z level=info msg="Executing migration" id="add index team.org_id" 2024-02-13T14:45:35.382 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.291707934Z level=info msg="Executing migration" id="add unique index team_org_id_name" 2024-02-13T14:45:35.382 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.333659272Z level=info msg="Executing migration" id="create team member table" 2024-02-13T14:45:35.382 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.383974815Z level=info msg="Executing migration" id="add index team_member.org_id" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.409238967Z level=info msg="Executing migration" id="add unique index team_member_org_id_team_id_user_id" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.434513071Z level=info msg="Executing migration" id="add index team_member.team_id" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.459745258Z level=info msg="Executing migration" id="Add column email to team table" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.501724943Z level=info msg="Executing migration" id="Add column external to team_member table" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.526976466Z level=info msg="Executing migration" id="Add column permission to team_member table" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.552307305Z level=info msg="Executing migration" id="create dashboard acl table" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.569229997Z level=info msg="Executing migration" id="add index dashboard_acl_dashboard_id" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.586181399Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-13T14:45:35.643 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.602982566Z level=info msg="Executing migration" id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-13T14:45:35.644 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.645012111Z level=info msg="Executing migration" id="add index dashboard_acl_user_id" 2024-02-13T14:45:35.911 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[23388]: cluster 2024-02-13T14:45:34.674246+0000 mgr.y (mgr.14613) 67 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:35.912 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.67035963Z level=info msg="Executing migration" id="add index dashboard_acl_team_id" 2024-02-13T14:45:35.912 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.712257709Z level=info msg="Executing migration" id="add index dashboard_acl_org_id_role" 2024-02-13T14:45:35.912 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.75419961Z level=info msg="Executing migration" id="add index dashboard_permission" 2024-02-13T14:45:35.912 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.779444838Z level=info msg="Executing migration" id="save default acl rules in dashboard_acl table" 2024-02-13T14:45:35.912 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.821364866Z level=info msg="Executing migration" id="delete acl rules for deleted dashboards and folders" 2024-02-13T14:45:35.912 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.86343475Z level=info msg="Executing migration" id="create tag table" 2024-02-13T14:45:35.912 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.888744426Z level=info msg="Executing migration" id="add index tag.key_value" 2024-02-13T14:45:35.912 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.913949036Z level=info msg="Executing migration" id="create login attempt table" 2024-02-13T14:45:36.164 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.939120714Z level=info msg="Executing migration" id="add index login_attempt.username" 2024-02-13T14:45:36.164 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:35 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:35.964382097Z level=info msg="Executing migration" id="drop index IDX_login_attempt_username - v1" 2024-02-13T14:45:36.164 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.006460938Z level=info msg="Executing migration" id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-13T14:45:36.165 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.040359049Z level=info msg="Executing migration" id="create login_attempt v2" 2024-02-13T14:45:36.165 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.065607775Z level=info msg="Executing migration" id="create index IDX_login_attempt_username - v2" 2024-02-13T14:45:36.165 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.09076273Z level=info msg="Executing migration" id="copy login_attempt v1 to v2" 2024-02-13T14:45:36.165 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.116016774Z level=info msg="Executing migration" id="drop login_attempt_tmp_qwerty" 2024-02-13T14:45:36.165 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.141260168Z level=info msg="Executing migration" id="create user auth table" 2024-02-13T14:45:36.167 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:35 smithi062 bash[21479]: cluster 2024-02-13T14:45:34.674246+0000 mgr.y (mgr.14613) 67 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:36.167 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:35 smithi062 bash[28859]: cluster 2024-02-13T14:45:34.674246+0000 mgr.y (mgr.14613) 67 : cluster 0 pgmap v38: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:36.417 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.166497258Z level=info msg="Executing migration" id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-13T14:45:36.417 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.191821708Z level=info msg="Executing migration" id="alter user_auth.auth_id to length 190" 2024-02-13T14:45:36.417 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.233699547Z level=info msg="Executing migration" id="Add OAuth access token to user_auth" 2024-02-13T14:45:36.417 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.258903778Z level=info msg="Executing migration" id="Add OAuth refresh token to user_auth" 2024-02-13T14:45:36.417 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.300928196Z level=info msg="Executing migration" id="Add OAuth token type to user_auth" 2024-02-13T14:45:36.417 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.326212753Z level=info msg="Executing migration" id="Add OAuth expiry to user_auth" 2024-02-13T14:45:36.417 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.351411291Z level=info msg="Executing migration" id="Add index to user_id column in user_auth" 2024-02-13T14:45:36.417 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.376694937Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-02-13T14:45:36.576 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:45:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:45:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:45:36.694 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.418681336Z level=info msg="Executing migration" id="create server_lock table" 2024-02-13T14:45:36.694 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.46075719Z level=info msg="Executing migration" id="add index server_lock.operation_uid" 2024-02-13T14:45:36.694 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.502795667Z level=info msg="Executing migration" id="create user auth token table" 2024-02-13T14:45:36.694 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.52815892Z level=info msg="Executing migration" id="add unique index user_auth_token.auth_token" 2024-02-13T14:45:36.694 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.570117982Z level=info msg="Executing migration" id="add unique index user_auth_token.prev_auth_token" 2024-02-13T14:45:36.694 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.595457101Z level=info msg="Executing migration" id="add index user_auth_token.user_id" 2024-02-13T14:45:36.694 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.696052514Z level=info msg="Executing migration" id="Add revoked_at to the user auth token" 2024-02-13T14:45:36.969 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.775589922Z level=info msg="Executing migration" id="create cache_data table" 2024-02-13T14:45:36.970 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.846549971Z level=info msg="Executing migration" id="add unique index cache_data.cache_key" 2024-02-13T14:45:37.239 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:36 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:36.972035382Z level=info msg="Executing migration" id="create short_url table v1" 2024-02-13T14:45:37.239 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.022514076Z level=info msg="Executing migration" id="add index short_url.org_id-uid" 2024-02-13T14:45:37.239 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.047769827Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-02-13T14:45:37.239 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.072915839Z level=info msg="Executing migration" id="delete alert_definition table" 2024-02-13T14:45:37.239 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.098226726Z level=info msg="Executing migration" id="recreate alert_definition table" 2024-02-13T14:45:37.239 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.123783963Z level=info msg="Executing migration" id="add index in alert_definition on org_id and title columns" 2024-02-13T14:45:37.239 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.14897783Z level=info msg="Executing migration" id="add index in alert_definition on org_id and uid columns" 2024-02-13T14:45:37.240 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.174176391Z level=info msg="Executing migration" id="alter alert_definition table data column to mediumtext in mysql" 2024-02-13T14:45:37.240 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.216116498Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and title columns" 2024-02-13T14:45:37.240 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.241477747Z level=info msg="Executing migration" id="drop index in alert_definition on org_id and uid columns" 2024-02-13T14:45:37.491 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.283416377Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and title columns" 2024-02-13T14:45:37.491 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.325365169Z level=info msg="Executing migration" id="add unique index in alert_definition on org_id and uid columns" 2024-02-13T14:45:37.491 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.367349145Z level=info msg="Executing migration" id="Add column paused in alert_definition" 2024-02-13T14:45:37.491 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.392588015Z level=info msg="Executing migration" id="drop alert_definition table" 2024-02-13T14:45:37.491 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.417810103Z level=info msg="Executing migration" id="delete alert_definition_version table" 2024-02-13T14:45:37.492 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.44302878Z level=info msg="Executing migration" id="recreate alert_definition_version table" 2024-02-13T14:45:37.492 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.468284768Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-02-13T14:45:37.492 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.493592311Z level=info msg="Executing migration" id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-02-13T14:45:37.743 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.518735053Z level=info msg="Executing migration" id="alter alert_definition_version table data column to mediumtext in mysql" 2024-02-13T14:45:37.743 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.544030797Z level=info msg="Executing migration" id="drop alert_definition_version table" 2024-02-13T14:45:37.744 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.569313207Z level=info msg="Executing migration" id="create alert_instance table" 2024-02-13T14:45:37.744 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.611330529Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-02-13T14:45:37.744 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.669948367Z level=info msg="Executing migration" id="add index in alert_instance table on def_org_id, current_state columns" 2024-02-13T14:45:37.744 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.695287463Z level=info msg="Executing migration" id="add column current_state_end to alert_instance" 2024-02-13T14:45:37.744 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.720513041Z level=info msg="Executing migration" id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-02-13T14:45:37.744 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.745726145Z level=info msg="Executing migration" id="remove index def_org_id, current_state on alert_instance" 2024-02-13T14:45:38.020 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[23388]: cluster 2024-02-13T14:45:36.674895+0000 mgr.y (mgr.14613) 68 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:38.020 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.770873823Z level=info msg="Executing migration" id="rename def_org_id to rule_org_id in alert_instance" 2024-02-13T14:45:38.021 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.829544171Z level=info msg="Executing migration" id="rename def_uid to rule_uid in alert_instance" 2024-02-13T14:45:38.021 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.888355614Z level=info msg="Executing migration" id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-02-13T14:45:38.021 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.913646211Z level=info msg="Executing migration" id="add index rule_org_id, current_state on alert_instance" 2024-02-13T14:45:38.021 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.938792333Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-02-13T14:45:38.021 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:37 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:37.980888691Z level=info msg="Executing migration" id="create alert_rule table" 2024-02-13T14:45:38.021 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.022817936Z level=info msg="Executing migration" id="add index in alert_rule on org_id and title columns" 2024-02-13T14:45:38.290 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.039783592Z level=info msg="Executing migration" id="add index in alert_rule on org_id and uid columns" 2024-02-13T14:45:38.290 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.090509885Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-02-13T14:45:38.290 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.124107661Z level=info msg="Executing migration" id="alter alert_rule table data column to mediumtext in mysql" 2024-02-13T14:45:38.290 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.149368864Z level=info msg="Executing migration" id="add column for to alert_rule" 2024-02-13T14:45:38.290 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.174631185Z level=info msg="Executing migration" id="add column annotations to alert_rule" 2024-02-13T14:45:38.290 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.19987219Z level=info msg="Executing migration" id="add column labels to alert_rule" 2024-02-13T14:45:38.290 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.22512107Z level=info msg="Executing migration" id="remove unique index from alert_rule on org_id, title columns" 2024-02-13T14:45:38.290 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.267061797Z level=info msg="Executing migration" id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-02-13T14:45:38.291 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.292324225Z level=info msg="Executing migration" id="add dashboard_uid column to alert_rule" 2024-02-13T14:45:38.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:37 smithi062 bash[21479]: cluster 2024-02-13T14:45:36.674895+0000 mgr.y (mgr.14613) 68 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:37 smithi062 bash[28859]: cluster 2024-02-13T14:45:36.674895+0000 mgr.y (mgr.14613) 68 : cluster 0 pgmap v39: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:38.550 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.334285107Z level=info msg="Executing migration" id="add panel_id column to alert_rule" 2024-02-13T14:45:38.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.376162071Z level=info msg="Executing migration" id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-02-13T14:45:38.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.401528811Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-02-13T14:45:38.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.426793865Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-02-13T14:45:38.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.451951647Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-02-13T14:45:38.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.477326817Z level=info msg="Executing migration" id="create alert_rule_version table" 2024-02-13T14:45:38.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.502521138Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-02-13T14:45:38.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.527799868Z level=info msg="Executing migration" id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-02-13T14:45:38.551 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.55296314Z level=info msg="Executing migration" id="alter alert_rule_version table data column to mediumtext in mysql" 2024-02-13T14:45:38.820 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.578240865Z level=info msg="Executing migration" id="add column for to alert_rule_version" 2024-02-13T14:45:38.820 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.620227557Z level=info msg="Executing migration" id="add column annotations to alert_rule_version" 2024-02-13T14:45:38.820 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.662267735Z level=info msg="Executing migration" id="add column labels to alert_rule_version" 2024-02-13T14:45:38.820 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.704308751Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-02-13T14:45:38.820 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.729554979Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-02-13T14:45:38.820 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.754776453Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-02-13T14:45:38.820 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.78007014Z level=info msg="Executing migration" id=create_alert_configuration_table 2024-02-13T14:45:38.820 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.822094465Z level=info msg="Executing migration" id="Add column default in alert_configuration" 2024-02-13T14:45:39.072 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.847363096Z level=info msg="Executing migration" id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-02-13T14:45:39.073 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.889330399Z level=info msg="Executing migration" id="add column org_id in alert_configuration" 2024-02-13T14:45:39.073 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.91466688Z level=info msg="Executing migration" id="add index in alert_configuration table on org_id column" 2024-02-13T14:45:39.073 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.939905327Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-02-13T14:45:39.073 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:38 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:38.965175494Z level=info msg="Executing migration" id=create_ngalert_configuration_table 2024-02-13T14:45:39.073 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.00746025Z level=info msg="Executing migration" id="add index in ngalert_configuration on org_id column" 2024-02-13T14:45:39.073 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.049378034Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-02-13T14:45:39.073 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.074656618Z level=info msg="Executing migration" id="create provenance_type table" 2024-02-13T14:45:39.333 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.099919213Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-02-13T14:45:39.333 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.125260963Z level=info msg="Executing migration" id="create alert_image table" 2024-02-13T14:45:39.333 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.150535416Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-02-13T14:45:39.333 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.175769125Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-02-13T14:45:39.333 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.201076122Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-02-13T14:45:39.333 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.242972826Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-02-13T14:45:39.334 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.285043668Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-02-13T14:45:39.334 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.285354901Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-02-13T14:45:39.334 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.310302213Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-02-13T14:45:39.334 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.33555805Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.360769792Z level=info msg="Executing migration" id="clear migration entry \"remove unified alerting data\"" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.361353649Z level=info msg="Executing migration" id="move dashboard alerts to unified alerting" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.361824757Z level=info msg="alerts found to migrate" alerts=0 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.386070692Z level=info msg="Executing migration" id="create library_element table v1" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.428015826Z level=info msg="Executing migration" id="add index library_element org_id-folder_id-name-kind" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.45330419Z level=info msg="Executing migration" id="create library_element_connection table v1" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.478488339Z level=info msg="Executing migration" id="add index library_element_connection element_id-kind-connection_id" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.50375987Z level=info msg="Executing migration" id="add unique index library_element org_id_uid" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.528971092Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-02-13T14:45:39.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.545829229Z level=info msg="Executing migration" id="clone move dashboard alerts to unified alerting" 2024-02-13T14:45:39.594 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.562778758Z level=info msg="Executing migration" id="create data_keys table" 2024-02-13T14:45:39.855 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.596491612Z level=info msg="Executing migration" id="create secrets table" 2024-02-13T14:45:39.855 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.638545264Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-02-13T14:45:39.855 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.680507038Z level=info msg="Executing migration" id="add name column into data_keys" 2024-02-13T14:45:39.855 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.705756603Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-02-13T14:45:39.855 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.730936962Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-02-13T14:45:39.855 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.77302102Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-02-13T14:45:39.856 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.831747181Z level=info msg="Executing migration" id="create kv_store table v1" 2024-02-13T14:45:40.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:39 smithi062 bash[21479]: cluster 2024-02-13T14:45:38.675323+0000 mgr.y (mgr.14613) 69 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T14:45:40.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:39 smithi062 bash[28859]: cluster 2024-02-13T14:45:38.675323+0000 mgr.y (mgr.14613) 69 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T14:45:40.115 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[23388]: cluster 2024-02-13T14:45:38.675323+0000 mgr.y (mgr.14613) 69 : cluster 0 pgmap v40: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T14:45:40.115 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:45:40.116 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.873779844Z level=info msg="Executing migration" id="add index kv_store.org_id-namespace-key" 2024-02-13T14:45:40.116 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.915964708Z level=info msg="Executing migration" id="update dashboard_uid and panel_id from existing annotations" 2024-02-13T14:45:40.116 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.941173763Z level=info msg="Executing migration" id="create permission table" 2024-02-13T14:45:40.116 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:39 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:39.983191349Z level=info msg="Executing migration" id="add unique index permission.role_id" 2024-02-13T14:45:40.116 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.025217579Z level=info msg="Executing migration" id="add unique index role_id_action_scope" 2024-02-13T14:45:40.116 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.05050742Z level=info msg="Executing migration" id="create role table" 2024-02-13T14:45:40.116 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.075730771Z level=info msg="Executing migration" id="add column display_name" 2024-02-13T14:45:40.116 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.117711652Z level=info msg="Executing migration" id="add column group_name" 2024-02-13T14:45:40.393 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.142832681Z level=info msg="Executing migration" id="add index role.org_id" 2024-02-13T14:45:40.393 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.168128779Z level=info msg="Executing migration" id="add unique index role_org_id_name" 2024-02-13T14:45:40.393 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.19343014Z level=info msg="Executing migration" id="add index role_org_id_uid" 2024-02-13T14:45:40.393 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.218758934Z level=info msg="Executing migration" id="create team role table" 2024-02-13T14:45:40.393 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.243947092Z level=info msg="Executing migration" id="add index team_role.org_id" 2024-02-13T14:45:40.394 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.260887248Z level=info msg="Executing migration" id="add unique index team_role_org_id_team_id_role_id" 2024-02-13T14:45:40.394 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.294437972Z level=info msg="Executing migration" id="add index team_role.team_id" 2024-02-13T14:45:40.394 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.328091668Z level=info msg="Executing migration" id="create user role table" 2024-02-13T14:45:40.394 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.361871568Z level=info msg="Executing migration" id="add index user_role.org_id" 2024-02-13T14:45:40.394 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.395471347Z level=info msg="Executing migration" id="add unique index user_role_org_id_user_id_role_id" 2024-02-13T14:45:40.679 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.437493624Z level=info msg="Executing migration" id="add index user_role.user_id" 2024-02-13T14:45:40.679 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.462816051Z level=info msg="Executing migration" id="create builtin role table" 2024-02-13T14:45:40.679 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.488082962Z level=info msg="Executing migration" id="add index builtin_role.role_id" 2024-02-13T14:45:40.679 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.530076739Z level=info msg="Executing migration" id="add index builtin_role.name" 2024-02-13T14:45:40.680 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.555333477Z level=info msg="Executing migration" id="Add column org_id to builtin_role table" 2024-02-13T14:45:40.680 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.597252888Z level=info msg="Executing migration" id="add index builtin_role.org_id" 2024-02-13T14:45:40.680 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.639433529Z level=info msg="Executing migration" id="add unique index builtin_role_org_id_role_id_role" 2024-02-13T14:45:40.680 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.681463379Z level=info msg="Executing migration" id="Remove unique index role_org_id_uid" 2024-02-13T14:45:40.940 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[23388]: audit 2024-02-13T14:45:39.951449+0000 mgr.y (mgr.14613) 70 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.706781337Z level=info msg="Executing migration" id="add unique index role.uid" 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.732003252Z level=info msg="Executing migration" id="create seed assignment table" 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.757624535Z level=info msg="Executing migration" id="add unique index builtin_role_role_name" 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.799530553Z level=info msg="Executing migration" id="add column hidden to role table" 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.824801911Z level=info msg="Executing migration" id="create query_history table v1" 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.850073372Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.892156431Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.917409589Z level=info msg="Executing migration" id="teams permissions migration" 2024-02-13T14:45:40.941 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.942693407Z level=info msg="Executing migration" id="dashboard permissions" 2024-02-13T14:45:41.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:40 smithi062 bash[21479]: audit 2024-02-13T14:45:39.951449+0000 mgr.y (mgr.14613) 70 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:41.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:40 smithi062 bash[28859]: audit 2024-02-13T14:45:39.951449+0000 mgr.y (mgr.14613) 70 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:41.192 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:40 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:40.967916266Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-02-13T14:45:41.193 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.009872343Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-02-13T14:45:41.193 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.051865267Z level=info msg="Executing migration" id="alerting notification permissions" 2024-02-13T14:45:41.193 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.093906457Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-02-13T14:45:41.193 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.11926855Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-02-13T14:45:41.193 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.144559881Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-02-13T14:45:41.193 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.169776823Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.194939483Z level=info msg="Executing migration" id="create correlation table v1" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.26199629Z level=info msg="Executing migration" id="add index correlations.uid" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.303961975Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.34584732Z level=info msg="Executing migration" id="add correlation config column" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.371159364Z level=info msg="Executing migration" id="create entity_events table" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.396494315Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.421829053Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.422174366Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-02-13T14:45:41.470 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.438922245Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-02-13T14:45:41.471 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.43928526Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-02-13T14:45:41.471 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.472219174Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.497670424Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.522845693Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.548012612Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.590036303Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.615381876Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.665917249Z level=info msg="Executing migration" id="Drop public config table" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.691230947Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.716460822Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-02-13T14:45:41.773 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.775334794Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-02-13T14:45:42.059 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[23388]: cluster 2024-02-13T14:45:40.676731+0000 mgr.y (mgr.14613) 71 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 961 B/s rd, 0 op/s 2024-02-13T14:45:42.059 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.800675755Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-02-13T14:45:42.059 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.825815156Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-02-13T14:45:42.059 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.859519729Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-02-13T14:45:42.059 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.901555935Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-02-13T14:45:42.059 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.926754698Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-02-13T14:45:42.059 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.951985843Z level=info msg="Executing migration" id="add share column" 2024-02-13T14:45:42.059 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:41 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:41.9939831Z level=info msg="Executing migration" id="create default alerting folders" 2024-02-13T14:45:42.059 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.019304651Z level=info msg="Executing migration" id="create file table" 2024-02-13T14:45:42.060 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.061312195Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-02-13T14:45:42.171 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:41 smithi062 bash[21479]: cluster 2024-02-13T14:45:40.676731+0000 mgr.y (mgr.14613) 71 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 961 B/s rd, 0 op/s 2024-02-13T14:45:42.171 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:41 smithi062 bash[28859]: cluster 2024-02-13T14:45:40.676731+0000 mgr.y (mgr.14613) 71 : cluster 0 pgmap v41: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 961 B/s rd, 0 op/s 2024-02-13T14:45:42.311 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.119986166Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-02-13T14:45:42.311 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.145362823Z level=info msg="Executing migration" id="create file_meta table" 2024-02-13T14:45:42.312 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.17053666Z level=info msg="Executing migration" id="file table idx: path key" 2024-02-13T14:45:42.312 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.195796802Z level=info msg="Executing migration" id="set path collation in file table" 2024-02-13T14:45:42.312 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.221013087Z level=info msg="Executing migration" id="managed permissions migration" 2024-02-13T14:45:42.312 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.246308098Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-02-13T14:45:42.312 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.288237933Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-02-13T14:45:42.312 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.313705183Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-02-13T14:45:42.580 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.338793777Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-02-13T14:45:42.581 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.364054222Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-02-13T14:45:42.581 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.414464624Z level=info msg="Executing migration" id="update group index for alert rules" 2024-02-13T14:45:42.581 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.456430885Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-02-13T14:45:42.581 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.481805079Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-02-13T14:45:42.581 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.507001485Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-02-13T14:45:42.581 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.532354002Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-02-13T14:45:42.581 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.557901575Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-02-13T14:45:42.581 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.583080757Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-02-13T14:45:42.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- 172.21.15.62:0/2637682174 >> v1:172.21.15.62:6789/0 conn(0x7ff830108fd0 legacy=0x7ff83010b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:42.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- 172.21.15.62:0/2637682174 shutdown_connections 2024-02-13T14:45:42.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- 172.21.15.62:0/2637682174 >> 172.21.15.62:0/2637682174 conn(0x7ff830075c60 msgr2=0x7ff830076070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:42.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- 172.21.15.62:0/2637682174 shutdown_connections 2024-02-13T14:45:42.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- 172.21.15.62:0/2637682174 wait complete. 2024-02-13T14:45:42.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 Processor -- start 2024-02-13T14:45:42.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- start start 2024-02-13T14:45:42.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff8301a67d0 con 0x7ff8301004a0 2024-02-13T14:45:42.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff8301a79b0 con 0x7ff83010cb70 2024-02-13T14:45:42.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.627+0000 7ff8367c8700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff8301a8bb0 con 0x7ff830108fd0 2024-02-13T14:45:42.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82ffff700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff8301004a0 0x7ff830103f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44032/0 (socket says 172.21.15.62:44032) 2024-02-13T14:45:42.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82ffff700 1 -- 172.21.15.62:0/1811790176 learned_addr learned my addr 172.21.15.62:0/1811790176 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:42.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82f7fe700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7ff830108fd0 0x7ff830104630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:54948/0 (socket says 172.21.15.62:54948) 2024-02-13T14:45:42.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184287654 0 0) 0x7ff8301a67d0 con 0x7ff8301004a0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8180046c0 con 0x7ff8301004a0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662786702 0 0) 0x7ff8301a8bb0 con 0x7ff830108fd0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8301a67d0 con 0x7ff830108fd0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382369753 0 0) 0x7ff8301a79b0 con 0x7ff83010cb70 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8301a8bb0 con 0x7ff83010cb70 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4006358682 0 0) 0x7ff8180046c0 con 0x7ff8301004a0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8301a79b0 con 0x7ff8301004a0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff8200019d0 con 0x7ff8301004a0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3827659504 0 0) 0x7ff8301a67d0 con 0x7ff830108fd0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff8180046c0 con 0x7ff830108fd0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff824001370 con 0x7ff830108fd0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2852216165 0 0) 0x7ff8301a79b0 con 0x7ff8301004a0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 >> v1:172.21.15.62:6790/0 conn(0x7ff830108fd0 legacy=0x7ff830104630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 >> v1:172.21.15.111:6789/0 conn(0x7ff83010cb70 legacy=0x7ff8301a4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8301a9db0 con 0x7ff8301004a0 2024-02-13T14:45:42.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8301a8da0 con 0x7ff8301004a0 2024-02-13T14:45:42.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8301a9220 con 0x7ff8301004a0 2024-02-13T14:45:42.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7ff820003b10 con 0x7ff8301004a0 2024-02-13T14:45:42.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff820005c60 con 0x7ff8301004a0 2024-02-13T14:45:42.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff81c000f80 con 0x7ff8301004a0 2024-02-13T14:45:42.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7ff820003680 con 0x7ff8301004a0 2024-02-13T14:45:42.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7ff820088ee0 con 0x7ff8301004a0 2024-02-13T14:45:42.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6809/1346690857 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff81807d390 con 0x7ff8180796c0 2024-02-13T14:45:42.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.631+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7ff8200892b0 con 0x7ff8301004a0 2024-02-13T14:45:42.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.635+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== osd.2 v1:172.21.15.62:6809/1346690857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff81807d390 con 0x7ff8180796c0 2024-02-13T14:45:42.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 --> v1:172.21.15.62:6809/1346690857 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff81c002c40 con 0x7ff8180796c0 2024-02-13T14:45:42.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff82d7fa700 1 -- 172.21.15.62:0/1811790176 <== osd.2 v1:172.21.15.62:6809/1346690857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2135799674) 0x7ff81c002c40 con 0x7ff8180796c0 2024-02-13T14:45:42.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 >> v1:172.21.15.62:6809/1346690857 conn(0x7ff8180796c0 legacy=0x7ff81807bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:42.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 >> v1:172.21.15.62:6800/3802446050 conn(0x7ff81806efb0 legacy=0x7ff818071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:42.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 >> v1:172.21.15.62:6789/0 conn(0x7ff8301004a0 legacy=0x7ff830103f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:42.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff834d65700 1 -- 172.21.15.62:0/1811790176 reap_dead start 2024-02-13T14:45:42.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 shutdown_connections 2024-02-13T14:45:42.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 >> 172.21.15.62:0/1811790176 conn(0x7ff830075c60 msgr2=0x7ff83010f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:42.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 shutdown_connections 2024-02-13T14:45:42.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:42.651+0000 7ff8367c8700 1 -- 172.21.15.62:0/1811790176 wait complete. 2024-02-13T14:45:42.832 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.666833572Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-02-13T14:45:42.832 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.708806153Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-02-13T14:45:42.833 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.734090108Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-02-13T14:45:42.833 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.792781641Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-02-13T14:45:42.833 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.834721977Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-02-13T14:45:43.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.860060034Z level=info msg="Executing migration" id="create folder table" 2024-02-13T14:45:43.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.90193617Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-02-13T14:45:43.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.927274465Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-02-13T14:45:43.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:42 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:42.960920284Z level=info msg="Executing migration" id="Update folder title length" 2024-02-13T14:45:43.094 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:43.00277992Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-02-13T14:45:43.094 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=migrator t=2024-02-13T14:45:43.028148267Z level=info msg="migrations completed" performed=485 skipped=0 duration=15.927265723s 2024-02-13T14:45:43.094 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=sqlstore t=2024-02-13T14:45:43.029456856Z level=info msg="Created default organization" 2024-02-13T14:45:43.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=plugin.loader t=2024-02-13T14:45:43.182824558Z level=info msg="Plugin registered" pluginID=input 2024-02-13T14:45:43.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=plugin.loader t=2024-02-13T14:45:43.255906184Z level=info msg="Plugin registered" pluginID=grafana-piechart-panel 2024-02-13T14:45:43.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=plugin.loader t=2024-02-13T14:45:43.255956589Z level=info msg="Plugin registered" pluginID=vonage-status-panel 2024-02-13T14:45:43.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=secrets t=2024-02-13T14:45:43.256032014Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-02-13T14:45:43.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=query_data t=2024-02-13T14:45:43.260083354Z level=info msg="Query Service initialization" 2024-02-13T14:45:43.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[50603]: logger=live.push_http t=2024-02-13T14:45:43.264719979Z level=info msg="Live Push Gateway initialization" 2024-02-13T14:45:44.283 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:43 smithi111 bash[23388]: cluster 2024-02-13T14:45:42.677201+0000 mgr.y (mgr.14613) 72 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:44.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:43 smithi062 bash[21479]: cluster 2024-02-13T14:45:42.677201+0000 mgr.y (mgr.14613) 72 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:44.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:43 smithi062 bash[28859]: cluster 2024-02-13T14:45:42.677201+0000 mgr.y (mgr.14613) 72 : cluster 0 pgmap v42: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=infra.usagestats.collector t=2024-02-13T14:45:44.285819051Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=provisioning.datasources t=2024-02-13T14:45:44.287017967Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=provisioning.datasources t=2024-02-13T14:45:44.329171558Z level=info msg="inserting datasource from configuration " name=Loki uid=P8E80F9AEF21F6940 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=provisioning.alerting t=2024-02-13T14:45:44.354799925Z level=info msg="starting to provision alerting" 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=provisioning.alerting t=2024-02-13T14:45:44.354823278Z level=info msg="finished to provision alerting" 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=grafanaStorageLogger t=2024-02-13T14:45:44.354984794Z level=info msg="storage starting" 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=ngalert.state.manager t=2024-02-13T14:45:44.355581563Z level=info msg="Warming state cache for startup" 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=ngalert.state.manager t=2024-02-13T14:45:44.355834397Z level=info msg="State cache has been initialized" states=0 duration=251.341µs 2024-02-13T14:45:44.593 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=ticker t=2024-02-13T14:45:44.355901347Z level=info msg=starting first_tick=2024-02-13T14:45:50Z 2024-02-13T14:45:44.594 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=ngalert.multiorg.alertmanager t=2024-02-13T14:45:44.355926966Z level=info msg="starting MultiOrg Alertmanager" 2024-02-13T14:45:44.594 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=http.server t=2024-02-13T14:45:44.357525178Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-02-13T14:45:44.594 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[50603]: logger=sqlstore.transactions t=2024-02-13T14:45:44.452969644Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-02-13T14:45:45.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- 172.21.15.62:0/906229022 >> v1:172.21.15.62:6789/0 conn(0x7f268010e4f0 legacy=0x7f26801109b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:45.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- 172.21.15.62:0/906229022 shutdown_connections 2024-02-13T14:45:45.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- 172.21.15.62:0/906229022 >> 172.21.15.62:0/906229022 conn(0x7f26800fd580 msgr2=0x7f26800ff9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:45.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- 172.21.15.62:0/906229022 shutdown_connections 2024-02-13T14:45:45.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- 172.21.15.62:0/906229022 wait complete. 2024-02-13T14:45:45.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 Processor -- start 2024-02-13T14:45:45.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- start start 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f26801a8db0 con 0x7f268010e4f0 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f26801a9f90 con 0x7f268010a920 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f26801ab190 con 0x7f2680107a70 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f267f7fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f268010e4f0 0x7f26801a7470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44042/0 (socket says 172.21.15.62:44042) 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f267effd700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f2680107a70 0x7f2680075860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:54952/0 (socket says 172.21.15.62:54952) 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f267f7fe700 1 -- 172.21.15.62:0/2828383067 learned_addr learned my addr 172.21.15.62:0/2828383067 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401167842 0 0) 0x7f26801a8db0 con 0x7f268010e4f0 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f266c0037f0 con 0x7f268010e4f0 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069287627 0 0) 0x7f26801ab190 con 0x7f2680107a70 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26801a8db0 con 0x7f2680107a70 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3366308146 0 0) 0x7f26801a9f90 con 0x7f268010a920 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26801ab190 con 0x7f268010a920 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 16987318 0 0) 0x7f266c0037f0 con 0x7f268010e4f0 2024-02-13T14:45:45.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f26801a9f90 con 0x7f268010e4f0 2024-02-13T14:45:45.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f2678001c00 con 0x7f268010e4f0 2024-02-13T14:45:45.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2584460813 0 0) 0x7f26801a8db0 con 0x7f2680107a70 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f266c0037f0 con 0x7f2680107a70 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f26700017a0 con 0x7f2680107a70 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1869052528 0 0) 0x7f26801a9f90 con 0x7f268010e4f0 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 >> v1:172.21.15.62:6790/0 conn(0x7f2680107a70 legacy=0x7f2680075860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 >> v1:172.21.15.111:6789/0 conn(0x7f268010a920 legacy=0x7f26801a3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26801ac390 con 0x7f268010e4f0 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26801ab380 con 0x7f268010e4f0 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f26801ab800 con 0x7f268010e4f0 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f2678004b10 con 0x7f268010e4f0 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.043+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f26780050d0 con 0x7f268010e4f0 2024-02-13T14:45:45.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.047+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.62:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2660000fb0 con 0x7f268010e4f0 2024-02-13T14:45:45.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.047+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f2678003c80 con 0x7f268010e4f0 2024-02-13T14:45:45.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.047+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f2678089500 con 0x7f268010e4f0 2024-02-13T14:45:45.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.047+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.111:6812/1629494259 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f266c07d460 con 0x7f266c079830 2024-02-13T14:45:45.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.047+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f26780898a0 con 0x7f268010e4f0 2024-02-13T14:45:45.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.051+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== osd.7 v1:172.21.15.111:6812/1629494259 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f266c07d460 con 0x7f266c079830 2024-02-13T14:45:45.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 --> v1:172.21.15.111:6812/1629494259 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2660002c70 con 0x7f266c079830 2024-02-13T14:45:45.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2684922700 1 -- 172.21.15.62:0/2828383067 <== osd.7 v1:172.21.15.111:6812/1629494259 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2917140414) 0x7f2660002c70 con 0x7f266c079830 2024-02-13T14:45:45.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 >> v1:172.21.15.111:6812/1629494259 conn(0x7f266c079830 legacy=0x7f266c07bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:45.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 >> v1:172.21.15.62:6800/3802446050 conn(0x7f266c06f0a0 legacy=0x7f266c071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 >> v1:172.21.15.62:6789/0 conn(0x7f268010e4f0 legacy=0x7f26801a7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f267f7fe700 1 -- 172.21.15.62:0/2828383067 reap_dead start 2024-02-13T14:45:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 shutdown_connections 2024-02-13T14:45:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 >> 172.21.15.62:0/2828383067 conn(0x7f26800fd580 msgr2=0x7f268010a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 shutdown_connections 2024-02-13T14:45:45.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:45.067+0000 7f2685924700 1 -- 172.21.15.62:0/2828383067 wait complete. 2024-02-13T14:45:45.116 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:44 smithi062 bash[28859]: audit 2024-02-13T14:45:44.259308+0000 mon.b (mon.1) 73 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:45.116 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:44 smithi062 bash[21479]: audit 2024-02-13T14:45:44.259308+0000 mon.b (mon.1) 73 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:44 smithi111 bash[23388]: audit 2024-02-13T14:45:44.259308+0000 mon.b (mon.1) 73 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:46.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:45 smithi062 bash[21479]: cluster 2024-02-13T14:45:44.678685+0000 mgr.y (mgr.14613) 73 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:46.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:45 smithi062 bash[28859]: cluster 2024-02-13T14:45:44.678685+0000 mgr.y (mgr.14613) 73 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:46.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:45 smithi111 bash[23388]: cluster 2024-02-13T14:45:44.678685+0000 mgr.y (mgr.14613) 73 : cluster 0 pgmap v43: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:46.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:45:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:45:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:45:48.051 INFO:teuthology.orchestra.run.smithi062.stdout:77309411414 2024-02-13T14:45:48.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-13T14:45:48.190 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:47 smithi062 bash[28859]: cluster 2024-02-13T14:45:46.679265+0000 mgr.y (mgr.14613) 74 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:48.191 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:47 smithi062 bash[21479]: cluster 2024-02-13T14:45:46.679265+0000 mgr.y (mgr.14613) 74 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:48.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:47 smithi111 bash[23388]: cluster 2024-02-13T14:45:46.679265+0000 mgr.y (mgr.14613) 74 : cluster 0 pgmap v44: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.367+0000 7f405e1e5700 1 -- 172.21.15.62:0/1966434188 >> v1:172.21.15.62:6789/0 conn(0x7f4058074b90 legacy=0x7f405810ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.367+0000 7f405e1e5700 1 -- 172.21.15.62:0/1966434188 shutdown_connections 2024-02-13T14:45:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.367+0000 7f405e1e5700 1 -- 172.21.15.62:0/1966434188 >> 172.21.15.62:0/1966434188 conn(0x7f40580fd560 msgr2=0x7f40580ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.367+0000 7f405e1e5700 1 -- 172.21.15.62:0/1966434188 shutdown_connections 2024-02-13T14:45:48.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.367+0000 7f405e1e5700 1 -- 172.21.15.62:0/1966434188 wait complete. 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f405e1e5700 1 Processor -- start 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f405e1e5700 1 -- start start 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f405e1e5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f40581a8c10 con 0x7f40580740a0 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f405e1e5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f40581a9df0 con 0x7f4058110710 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f405e1e5700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f40581aaff0 con 0x7f4058074b90 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f40577fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f40580740a0 0x7f405810c550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44056/0 (socket says 172.21.15.62:44056) 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f40577fe700 1 -- 172.21.15.62:0/4101331458 learned_addr learned my addr 172.21.15.62:0/4101331458 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850087814 0 0) 0x7f40581a8c10 con 0x7f40580740a0 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40440035b0 con 0x7f40580740a0 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481318300 0 0) 0x7f40581aaff0 con 0x7f4058074b90 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40581a8c10 con 0x7f4058074b90 2024-02-13T14:45:48.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 903022872 0 0) 0x7f40440035b0 con 0x7f40580740a0 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f40581aaff0 con 0x7f40580740a0 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f40480018d0 con 0x7f40580740a0 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 198436947 0 0) 0x7f40581a8c10 con 0x7f4058074b90 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f40440035b0 con 0x7f4058074b90 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935403109 0 0) 0x7f40581a9df0 con 0x7f4058110710 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40581a8c10 con 0x7f4058110710 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f40400047c0 con 0x7f4058074b90 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3844042964 0 0) 0x7f40581aaff0 con 0x7f40580740a0 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 >> v1:172.21.15.62:6790/0 conn(0x7f4058074b90 legacy=0x7f40581a3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 >> v1:172.21.15.111:6789/0 conn(0x7f4058110710 legacy=0x7f40581a72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40581ac1f0 con 0x7f40580740a0 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40581ab1e0 con 0x7f40580740a0 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f40581ab660 con 0x7f40580740a0 2024-02-13T14:45:48.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f4048003b30 con 0x7f40580740a0 2024-02-13T14:45:48.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f4048005c00 con 0x7f40580740a0 2024-02-13T14:45:48.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.62:6789/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4038000f80 con 0x7f40580740a0 2024-02-13T14:45:48.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f40480036a0 con 0x7f40580740a0 2024-02-13T14:45:48.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f4048088fe0 con 0x7f40580740a0 2024-02-13T14:45:48.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.111:6808/2146440304 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f404407ce80 con 0x7f40440791b0 2024-02-13T14:45:48.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.371+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f4048089330 con 0x7f40580740a0 2024-02-13T14:45:48.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.375+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== osd.6 v1:172.21.15.111:6808/2146440304 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f404407ce80 con 0x7f40440791b0 2024-02-13T14:45:48.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.391+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 --> v1:172.21.15.111:6808/2146440304 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4038002c40 con 0x7f40440791b0 2024-02-13T14:45:48.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f4054ff9700 1 -- 172.21.15.62:0/4101331458 <== osd.6 v1:172.21.15.111:6808/2146440304 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3806739625) 0x7f4038002c40 con 0x7f40440791b0 2024-02-13T14:45:48.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 >> v1:172.21.15.111:6808/2146440304 conn(0x7f40440791b0 legacy=0x7f404407b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 >> v1:172.21.15.62:6800/3802446050 conn(0x7f404406eca0 legacy=0x7f4044071160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 >> v1:172.21.15.62:6789/0 conn(0x7f40580740a0 legacy=0x7f405810c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f4057fff700 1 -- 172.21.15.62:0/4101331458 reap_dead start 2024-02-13T14:45:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 shutdown_connections 2024-02-13T14:45:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 >> 172.21.15.62:0/4101331458 conn(0x7f40580fd560 msgr2=0x7f405810fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 shutdown_connections 2024-02-13T14:45:48.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:48.395+0000 7f405e1e5700 1 -- 172.21.15.62:0/4101331458 wait complete. 2024-02-13T14:45:50.249 INFO:teuthology.orchestra.run.smithi062.stdout:231928234020 2024-02-13T14:45:50.249 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-13T14:45:50.256 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:49 smithi062 bash[21479]: cluster 2024-02-13T14:45:48.679785+0000 mgr.y (mgr.14613) 75 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:50.256 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:49 smithi062 bash[28859]: cluster 2024-02-13T14:45:48.679785+0000 mgr.y (mgr.14613) 75 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:50.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:49 smithi111 bash[23388]: cluster 2024-02-13T14:45:48.679785+0000 mgr.y (mgr.14613) 75 : cluster 0 pgmap v45: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:50.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:45:49 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:45:51.250 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:50 smithi062 bash[21479]: audit 2024-02-13T14:45:49.962786+0000 mgr.y (mgr.14613) 76 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:51.250 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:50 smithi062 bash[28859]: audit 2024-02-13T14:45:49.962786+0000 mgr.y (mgr.14613) 76 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:50 smithi111 bash[23388]: audit 2024-02-13T14:45:49.962786+0000 mgr.y (mgr.14613) 76 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:45:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- 172.21.15.62:0/2482655330 >> v1:172.21.15.62:6789/0 conn(0x7f9cc0074b90 legacy=0x7f9cc010ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- 172.21.15.62:0/2482655330 shutdown_connections 2024-02-13T14:45:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- 172.21.15.62:0/2482655330 >> 172.21.15.62:0/2482655330 conn(0x7f9cc00fd550 msgr2=0x7f9cc00ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- 172.21.15.62:0/2482655330 shutdown_connections 2024-02-13T14:45:51.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- 172.21.15.62:0/2482655330 wait complete. 2024-02-13T14:45:51.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 Processor -- start 2024-02-13T14:45:51.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- start start 2024-02-13T14:45:51.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cc01a8aa0 con 0x7f9cc0074b90 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cc01a9c80 con 0x7f9cc0110700 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cc5698700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f9cc01aae80 con 0x7f9cc00740a0 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cbe7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9cc0074b90 0x7f9cc01a3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:44072/0 (socket says 172.21.15.62:44072) 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cbeffd700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f9cc00740a0 0x7f9cc010c3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:54994/0 (socket says 172.21.15.62:54994) 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9cbe7fc700 1 -- 172.21.15.62:0/2699495555 learned_addr learned my addr 172.21.15.62:0/2699495555 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684220549 0 0) 0x7f9cc01aae80 con 0x7f9cc00740a0 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca80035b0 con 0x7f9cc00740a0 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440119588 0 0) 0x7f9cc01a8aa0 con 0x7f9cc0074b90 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc01aae80 con 0x7f9cc0074b90 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 359615799 0 0) 0x7f9ca80035b0 con 0x7f9cc00740a0 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9cc01a8aa0 con 0x7f9cc00740a0 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f9cb00018b0 con 0x7f9cc00740a0 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3803030134 0 0) 0x7f9cc01aae80 con 0x7f9cc0074b90 2024-02-13T14:45:51.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9ca80035b0 con 0x7f9cc0074b90 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4112350141 0 0) 0x7f9cc01a9c80 con 0x7f9cc0110700 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc01aae80 con 0x7f9cc0110700 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.415+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f9cb40044f0 con 0x7f9cc0074b90 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1185032965 0 0) 0x7f9cc01a8aa0 con 0x7f9cc00740a0 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 >> v1:172.21.15.111:6789/0 conn(0x7f9cc0110700 legacy=0x7f9cc01a7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 >> v1:172.21.15.62:6789/0 conn(0x7f9cc0074b90 legacy=0x7f9cc01a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc01ac080 con 0x7f9cc00740a0 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc01a8c90 con 0x7f9cc00740a0 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01a9110 con 0x7f9cc00740a0 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f9cb0003b30 con 0x7f9cc00740a0 2024-02-13T14:45:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f9cb0005bc0 con 0x7f9cc00740a0 2024-02-13T14:45:51.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9cac000f80 con 0x7f9cc00740a0 2024-02-13T14:45:51.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f9cb001c3b0 con 0x7f9cc00740a0 2024-02-13T14:45:51.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f9cb0088e40 con 0x7f9cc00740a0 2024-02-13T14:45:51.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6801/143174597 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ca807d3e0 con 0x7f9ca8079710 2024-02-13T14:45:51.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f9cb0089210 con 0x7f9cc00740a0 2024-02-13T14:45:51.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.419+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== osd.0 v1:172.21.15.62:6801/143174597 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f9ca807d3e0 con 0x7f9ca8079710 2024-02-13T14:45:51.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 --> v1:172.21.15.62:6801/143174597 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9cac002c40 con 0x7f9ca8079710 2024-02-13T14:45:51.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9ca7fff700 1 -- 172.21.15.62:0/2699495555 <== osd.0 v1:172.21.15.62:6801/143174597 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 4262362321) 0x7f9cac002c40 con 0x7f9ca8079710 2024-02-13T14:45:51.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 >> v1:172.21.15.62:6801/143174597 conn(0x7f9ca8079710 legacy=0x7f9ca807bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 >> v1:172.21.15.62:6800/3802446050 conn(0x7f9ca806ef10 legacy=0x7f9ca80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 >> v1:172.21.15.62:6790/0 conn(0x7f9cc00740a0 legacy=0x7f9cc010c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cbf7fe700 1 -- 172.21.15.62:0/2699495555 reap_dead start 2024-02-13T14:45:51.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 shutdown_connections 2024-02-13T14:45:51.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 >> 172.21.15.62:0/2699495555 conn(0x7f9cc00fd550 msgr2=0x7f9cc010ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:51.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 shutdown_connections 2024-02-13T14:45:51.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.439+0000 7f9cc5698700 1 -- 172.21.15.62:0/2699495555 wait complete. 2024-02-13T14:45:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- 172.21.15.62:0/92616319 >> v1:172.21.15.62:6789/0 conn(0x7f3960109900 legacy=0x7f396010bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- 172.21.15.62:0/92616319 shutdown_connections 2024-02-13T14:45:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- 172.21.15.62:0/92616319 >> 172.21.15.62:0/92616319 conn(0x7f3960076510 msgr2=0x7f3960076920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:51.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- 172.21.15.62:0/92616319 shutdown_connections 2024-02-13T14:45:51.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- 172.21.15.62:0/92616319 wait complete. 2024-02-13T14:45:51.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 Processor -- start 2024-02-13T14:45:51.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- start start 2024-02-13T14:45:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f39601a6b10 con 0x7f396010d4d0 2024-02-13T14:45:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f39601a7cf0 con 0x7f3960109900 2024-02-13T14:45:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f39669e5700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f39601a8ef0 con 0x7f3960102790 2024-02-13T14:45:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f395ffff700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f3960102790 0x7f3960101370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:43792/0 (socket says 172.21.15.62:43792) 2024-02-13T14:45:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f3964f82700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f396010d4d0 0x7f39601a51d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33040/0 (socket says 172.21.15.62:33040) 2024-02-13T14:45:51.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.471+0000 7f395ffff700 1 -- 172.21.15.62:0/4252100231 learned_addr learned my addr 172.21.15.62:0/4252100231 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010228617 0 0) 0x7f39601a8ef0 con 0x7f3960102790 2024-02-13T14:45:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39480035b0 con 0x7f3960102790 2024-02-13T14:45:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1039145531 0 0) 0x7f39601a6b10 con 0x7f396010d4d0 2024-02-13T14:45:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39601a8ef0 con 0x7f396010d4d0 2024-02-13T14:45:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4026640801 0 0) 0x7f39601a7cf0 con 0x7f3960109900 2024-02-13T14:45:51.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39601a6b10 con 0x7f3960109900 2024-02-13T14:45:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4227493211 0 0) 0x7f39601a8ef0 con 0x7f396010d4d0 2024-02-13T14:45:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f39601a7cf0 con 0x7f396010d4d0 2024-02-13T14:45:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3958001b70 con 0x7f396010d4d0 2024-02-13T14:45:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3270168409 0 0) 0x7f39480035b0 con 0x7f3960102790 2024-02-13T14:45:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f39601a8ef0 con 0x7f3960102790 2024-02-13T14:45:51.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3950001850 con 0x7f3960102790 2024-02-13T14:45:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2861078965 0 0) 0x7f39601a8ef0 con 0x7f3960102790 2024-02-13T14:45:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 >> v1:172.21.15.111:6789/0 conn(0x7f3960109900 legacy=0x7f39601a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 >> v1:172.21.15.62:6789/0 conn(0x7f396010d4d0 legacy=0x7f39601a51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39601aa0f0 con 0x7f3960102790 2024-02-13T14:45:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39601a6d00 con 0x7f3960102790 2024-02-13T14:45:51.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f3950001d60 con 0x7f3960102790 2024-02-13T14:45:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3950005be0 con 0x7f3960102790 2024-02-13T14:45:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f39601a7180 con 0x7f3960102790 2024-02-13T14:45:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.62:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3960111490 con 0x7f3960102790 2024-02-13T14:45:51.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f39500036a0 con 0x7f3960102790 2024-02-13T14:45:51.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f3950087780 con 0x7f3960102790 2024-02-13T14:45:51.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.111:6800/1278246464 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f394807cde0 con 0x7f3948079110 2024-02-13T14:45:51.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.475+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f3950087a80 con 0x7f3960102790 2024-02-13T14:45:51.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.479+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== osd.4 v1:172.21.15.111:6800/1278246464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f394807cde0 con 0x7f3948079110 2024-02-13T14:45:51.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 --> v1:172.21.15.111:6800/1278246464 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3960069e50 con 0x7f3948079110 2024-02-13T14:45:51.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f395d7fa700 1 -- 172.21.15.62:0/4252100231 <== osd.4 v1:172.21.15.111:6800/1278246464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3439995595) 0x7f3960069e50 con 0x7f3948079110 2024-02-13T14:45:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 >> v1:172.21.15.111:6800/1278246464 conn(0x7f3948079110 legacy=0x7f394807b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 >> v1:172.21.15.62:6800/3802446050 conn(0x7f394806ea90 legacy=0x7f3948070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 >> v1:172.21.15.62:6790/0 conn(0x7f3960102790 legacy=0x7f3960101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f3964f82700 1 -- 172.21.15.62:0/4252100231 reap_dead start 2024-02-13T14:45:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 shutdown_connections 2024-02-13T14:45:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 >> 172.21.15.62:0/4252100231 conn(0x7f3960076510 msgr2=0x7f39600694f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 shutdown_connections 2024-02-13T14:45:51.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.499+0000 7f39669e5700 1 -- 172.21.15.62:0/4252100231 wait complete. 2024-02-13T14:45:51.564 INFO:teuthology.orchestra.run.smithi062.stdout:197568495661 2024-02-13T14:45:51.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-13T14:45:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- 172.21.15.62:0/4197761391 >> v1:172.21.15.62:6789/0 conn(0x7fab3c10e5e0 legacy=0x7fab3c110a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- 172.21.15.62:0/4197761391 shutdown_connections 2024-02-13T14:45:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- 172.21.15.62:0/4197761391 >> 172.21.15.62:0/4197761391 conn(0x7fab3c076510 msgr2=0x7fab3c076920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- 172.21.15.62:0/4197761391 shutdown_connections 2024-02-13T14:45:51.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- 172.21.15.62:0/4197761391 wait complete. 2024-02-13T14:45:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 Processor -- start 2024-02-13T14:45:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- start start 2024-02-13T14:45:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fab3c1a8c80 con 0x7fab3c10aa10 2024-02-13T14:45:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fab3c1a9e80 con 0x7fab3c103900 2024-02-13T14:45:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fab3c1ab080 con 0x7fab3c10e5e0 2024-02-13T14:45:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab3a7fc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fab3c10aa10 0x7fab3c1a3d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33054/0 (socket says 172.21.15.62:33054) 2024-02-13T14:45:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab3a7fc700 1 -- 172.21.15.62:0/2694535133 learned_addr learned my addr 172.21.15.62:0/2694535133 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:51.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838520054 0 0) 0x7fab3c1a8c80 con 0x7fab3c10aa10 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab240031f0 con 0x7fab3c10aa10 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3994435381 0 0) 0x7fab3c1ab080 con 0x7fab3c10e5e0 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab3c1a8c80 con 0x7fab3c10e5e0 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1617338957 0 0) 0x7fab3c1a8c80 con 0x7fab3c10e5e0 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fab3c1ab080 con 0x7fab3c10e5e0 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1428249991 0 0) 0x7fab240031f0 con 0x7fab3c10aa10 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fab3c1a8c80 con 0x7fab3c10aa10 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fab34001730 con 0x7fab3c10e5e0 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fab30001870 con 0x7fab3c10aa10 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993766544 0 0) 0x7fab3c1a9e80 con 0x7fab3c103900 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab240031f0 con 0x7fab3c103900 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3962654139 0 0) 0x7fab3c1ab080 con 0x7fab3c10e5e0 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 >> v1:172.21.15.111:6789/0 conn(0x7fab3c103900 legacy=0x7fab3c102280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 >> v1:172.21.15.62:6789/0 conn(0x7fab3c10aa10 legacy=0x7fab3c1a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3c1ac280 con 0x7fab3c10e5e0 2024-02-13T14:45:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c1ab270 con 0x7fab3c10e5e0 2024-02-13T14:45:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c1ab6f0 con 0x7fab3c10e5e0 2024-02-13T14:45:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fab34001890 con 0x7fab3c10e5e0 2024-02-13T14:45:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fab34005080 con 0x7fab3c10e5e0 2024-02-13T14:45:51.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.815+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.62:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab28000f80 con 0x7fab3c10e5e0 2024-02-13T14:45:51.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.819+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fab34003a00 con 0x7fab3c10e5e0 2024-02-13T14:45:51.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.819+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7fab340882a0 con 0x7fab3c10e5e0 2024-02-13T14:45:51.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.819+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.111:6804/575601374 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab2407d170 con 0x7fab240794a0 2024-02-13T14:45:51.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.819+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7fab34088630 con 0x7fab3c10e5e0 2024-02-13T14:45:51.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.819+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== osd.5 v1:172.21.15.111:6804/575601374 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fab2407d170 con 0x7fab240794a0 2024-02-13T14:45:51.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.835+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 --> v1:172.21.15.111:6804/575601374 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab28002c40 con 0x7fab240794a0 2024-02-13T14:45:51.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab23fff700 1 -- 172.21.15.62:0/2694535133 <== osd.5 v1:172.21.15.111:6804/575601374 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3370281916) 0x7fab28002c40 con 0x7fab240794a0 2024-02-13T14:45:51.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 >> v1:172.21.15.111:6804/575601374 conn(0x7fab240794a0 legacy=0x7fab2407b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 >> v1:172.21.15.62:6800/3802446050 conn(0x7fab2406ee20 legacy=0x7fab240712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 >> v1:172.21.15.62:6790/0 conn(0x7fab3c10e5e0 legacy=0x7fab3c1a7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab3b7fe700 1 -- 172.21.15.62:0/2694535133 reap_dead start 2024-02-13T14:45:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 shutdown_connections 2024-02-13T14:45:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 >> 172.21.15.62:0/2694535133 conn(0x7fab3c076510 msgr2=0x7fab3c110a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 shutdown_connections 2024-02-13T14:45:51.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:51.839+0000 7fab412be700 1 -- 172.21.15.62:0/2694535133 wait complete. 2024-02-13T14:45:52.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.139+0000 7f70cf0b2700 1 -- 172.21.15.62:0/3028491670 >> v1:172.21.15.62:6789/0 conn(0x7f70c8114b20 legacy=0x7f70c8116fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.139+0000 7f70cf0b2700 1 -- 172.21.15.62:0/3028491670 shutdown_connections 2024-02-13T14:45:52.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.139+0000 7f70cf0b2700 1 -- 172.21.15.62:0/3028491670 >> 172.21.15.62:0/3028491670 conn(0x7f70c80778a0 msgr2=0x7f70c8079cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:52.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.139+0000 7f70cf0b2700 1 -- 172.21.15.62:0/3028491670 shutdown_connections 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.139+0000 7f70cf0b2700 1 -- 172.21.15.62:0/3028491670 wait complete. 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.139+0000 7f70cf0b2700 1 Processor -- start 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cf0b2700 1 -- start start 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cf0b2700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f70c81ace80 con 0x7f70c810e160 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cf0b2700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f70c81ae060 con 0x7f70c8114b20 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cf0b2700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f70c81af260 con 0x7f70c8110ef0 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cce4e700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f70c810e160 0x7f70c810d300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:33068/0 (socket says 172.21.15.62:33068) 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bffff700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f70c8110ef0 0x7f70c81a7e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:43822/0 (socket says 172.21.15.62:43822) 2024-02-13T14:45:52.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cce4e700 1 -- 172.21.15.62:0/17309535 learned_addr learned my addr 172.21.15.62:0/17309535 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:52.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3631148250 0 0) 0x7f70c81af260 con 0x7f70c8110ef0 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b00035b0 con 0x7f70c8110ef0 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135184304 0 0) 0x7f70c81ace80 con 0x7f70c810e160 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c81af260 con 0x7f70c810e160 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2802389212 0 0) 0x7f70b00035b0 con 0x7f70c8110ef0 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f70c81ace80 con 0x7f70c8110ef0 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f70b80019f0 con 0x7f70c8110ef0 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 812811376 0 0) 0x7f70c81af260 con 0x7f70c810e160 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f70b00035b0 con 0x7f70c810e160 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f70c4001c30 con 0x7f70c810e160 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830336791 0 0) 0x7f70c81ae060 con 0x7f70c8114b20 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70c81af260 con 0x7f70c8114b20 2024-02-13T14:45:52.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2901042696 0 0) 0x7f70c81ace80 con 0x7f70c8110ef0 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 >> v1:172.21.15.111:6789/0 conn(0x7f70c8114b20 legacy=0x7f70c81ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 >> v1:172.21.15.62:6789/0 conn(0x7f70c810e160 legacy=0x7f70c810d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c81b0460 con 0x7f70c8110ef0 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c81ad070 con 0x7f70c8110ef0 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c81ad570 con 0x7f70c8110ef0 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f70b8003b10 con 0x7f70c8110ef0 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f70b8005bf0 con 0x7f70c8110ef0 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70b4000f80 con 0x7f70c8110ef0 2024-02-13T14:45:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f70b8003680 con 0x7f70c8110ef0 2024-02-13T14:45:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f70b8088f20 con 0x7f70c8110ef0 2024-02-13T14:45:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6813/1701426775 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70b007d240 con 0x7f70b0079570 2024-02-13T14:45:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.143+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7f70b80892f0 con 0x7f70c8110ef0 2024-02-13T14:45:52.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.147+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== osd.3 v1:172.21.15.62:6813/1701426775 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f70b007d240 con 0x7f70b0079570 2024-02-13T14:45:52.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 --> v1:172.21.15.62:6813/1701426775 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70b4002c40 con 0x7f70b0079570 2024-02-13T14:45:52.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70bdffb700 1 -- 172.21.15.62:0/17309535 <== osd.3 v1:172.21.15.62:6813/1701426775 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3804687086) 0x7f70b4002c40 con 0x7f70b0079570 2024-02-13T14:45:52.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 >> v1:172.21.15.62:6813/1701426775 conn(0x7f70b0079570 legacy=0x7f70b007b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 >> v1:172.21.15.62:6800/3802446050 conn(0x7f70b006ee70 legacy=0x7f70b0071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 >> v1:172.21.15.62:6790/0 conn(0x7f70c8110ef0 legacy=0x7f70c81a7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cd64f700 1 -- 172.21.15.62:0/17309535 reap_dead start 2024-02-13T14:45:52.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 shutdown_connections 2024-02-13T14:45:52.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 >> 172.21.15.62:0/17309535 conn(0x7f70c80778a0 msgr2=0x7f70c8118020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:52.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 shutdown_connections 2024-02-13T14:45:52.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.163+0000 7f70cf0b2700 1 -- 172.21.15.62:0/17309535 wait complete. 2024-02-13T14:45:52.210 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:51 smithi062 bash[28859]: cluster 2024-02-13T14:45:50.681145+0000 mgr.y (mgr.14613) 77 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:52.210 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:51 smithi062 bash[21479]: cluster 2024-02-13T14:45:50.681145+0000 mgr.y (mgr.14613) 77 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:52.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:51 smithi111 bash[23388]: cluster 2024-02-13T14:45:50.681145+0000 mgr.y (mgr.14613) 77 : cluster 0 pgmap v46: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:52.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.547+0000 7fe2940fe700 1 -- 172.21.15.62:0/887091434 >> v1:172.21.15.62:6790/0 conn(0x7fe28c10d3d0 legacy=0x7fe28c10f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.547+0000 7fe2940fe700 1 -- 172.21.15.62:0/887091434 shutdown_connections 2024-02-13T14:45:52.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.547+0000 7fe2940fe700 1 -- 172.21.15.62:0/887091434 >> 172.21.15.62:0/887091434 conn(0x7fe28c0fc480 msgr2=0x7fe28c0fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:52.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.547+0000 7fe2940fe700 1 -- 172.21.15.62:0/887091434 shutdown_connections 2024-02-13T14:45:52.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.547+0000 7fe2940fe700 1 -- 172.21.15.62:0/887091434 wait complete. 2024-02-13T14:45:52.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe2940fe700 1 Processor -- start 2024-02-13T14:45:52.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe2940fe700 1 -- start start 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe291e9a700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fe28c106950 0x7fe28c10ca80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:43844/0 (socket says 172.21.15.62:43844) 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe2940fe700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe28c1a8bf0 con 0x7fe28c10d3d0 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe291e9a700 1 -- 172.21.15.62:0/3204830533 learned_addr learned my addr 172.21.15.62:0/3204830533 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe28c1a9dd0 con 0x7fe28c109800 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fe28c1aafd0 con 0x7fe28c106950 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693066468 0 0) 0x7fe28c1a8bf0 con 0x7fe28c10d3d0 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2780035b0 con 0x7fe28c10d3d0 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664355570 0 0) 0x7fe28c1aafd0 con 0x7fe28c106950 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe28c1a8bf0 con 0x7fe28c106950 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4024338499 0 0) 0x7fe2780035b0 con 0x7fe28c10d3d0 2024-02-13T14:45:52.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe28c1aafd0 con 0x7fe28c10d3d0 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe2840047b0 con 0x7fe28c10d3d0 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3235929324 0 0) 0x7fe28c1a8bf0 con 0x7fe28c106950 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fe2780035b0 con 0x7fe28c106950 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe288001830 con 0x7fe28c106950 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2937353599 0 0) 0x7fe28c1a9dd0 con 0x7fe28c109800 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe28c1a8bf0 con 0x7fe28c109800 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3785651364 0 0) 0x7fe2780035b0 con 0x7fe28c106950 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 >> v1:172.21.15.111:6789/0 conn(0x7fe28c109800 legacy=0x7fe28c1a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 >> v1:172.21.15.62:6789/0 conn(0x7fe28c10d3d0 legacy=0x7fe28c1a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe28c1ac1d0 con 0x7fe28c106950 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe28c1ab1c0 con 0x7fe28c106950 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fe28c1ab640 con 0x7fe28c106950 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fe288003b30 con 0x7fe28c106950 2024-02-13T14:45:52.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fe288005ba0 con 0x7fe28c106950 2024-02-13T14:45:52.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6790/0 -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe270000f80 con 0x7fe28c106950 2024-02-13T14:45:52.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.551+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fe288006dd0 con 0x7fe28c106950 2024-02-13T14:45:52.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.555+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7fe288088e60 con 0x7fe28c106950 2024-02-13T14:45:52.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.555+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6805/3280693362 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe27807d3c0 con 0x7fe2780796f0 2024-02-13T14:45:52.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.555+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (unknown 3287965567 0 0) 0x7fe288089280 con 0x7fe28c106950 2024-02-13T14:45:52.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.555+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== osd.1 v1:172.21.15.62:6805/3280693362 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fe27807d3c0 con 0x7fe2780796f0 2024-02-13T14:45:52.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 --> v1:172.21.15.62:6805/3280693362 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe270002c40 con 0x7fe2780796f0 2024-02-13T14:45:52.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe282ffd700 1 -- 172.21.15.62:0/3204830533 <== osd.1 v1:172.21.15.62:6805/3280693362 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1488573032) 0x7fe270002c40 con 0x7fe2780796f0 2024-02-13T14:45:52.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 >> v1:172.21.15.62:6805/3280693362 conn(0x7fe2780796f0 legacy=0x7fe27807bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 >> v1:172.21.15.62:6800/3802446050 conn(0x7fe27806ef70 legacy=0x7fe278071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 >> v1:172.21.15.62:6790/0 conn(0x7fe28c106950 legacy=0x7fe28c10ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:45:52.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe29269b700 1 -- 172.21.15.62:0/3204830533 reap_dead start 2024-02-13T14:45:52.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 shutdown_connections 2024-02-13T14:45:52.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 >> 172.21.15.62:0/3204830533 conn(0x7fe28c0fc480 msgr2=0x7fe28c0ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:45:52.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 shutdown_connections 2024-02-13T14:45:52.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:45:52.571+0000 7fe2940fe700 1 -- 172.21.15.62:0/3204830533 wait complete. 2024-02-13T14:45:54.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:53 smithi062 bash[28859]: cluster 2024-02-13T14:45:52.681942+0000 mgr.y (mgr.14613) 78 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T14:45:54.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:53 smithi062 bash[21479]: cluster 2024-02-13T14:45:52.681942+0000 mgr.y (mgr.14613) 78 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T14:45:54.132 INFO:teuthology.orchestra.run.smithi062.stdout:34359738476 2024-02-13T14:45:54.133 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-13T14:45:54.147 INFO:teuthology.orchestra.run.smithi062.stdout:128849018947 2024-02-13T14:45:54.148 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-13T14:45:54.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:53 smithi111 bash[23388]: cluster 2024-02-13T14:45:52.681942+0000 mgr.y (mgr.14613) 78 : cluster 0 pgmap v47: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T14:45:54.444 INFO:teuthology.orchestra.run.smithi062.stdout:163208757305 2024-02-13T14:45:54.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-13T14:45:55.584 INFO:teuthology.orchestra.run.smithi062.stdout:107374182479 2024-02-13T14:45:55.584 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-13T14:45:55.679 INFO:teuthology.orchestra.run.smithi062.stdout:55834574946 2024-02-13T14:45:55.679 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-13T14:45:55.906 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:55 smithi062 systemd[1]: Stopping Ceph alertmanager.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T14:45:55.907 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:55 smithi062 bash[58548]: ts=2024-02-13T14:45:55.736Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-13T14:45:56.224 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:55 smithi062 bash[21479]: cluster 2024-02-13T14:45:54.682637+0000 mgr.y (mgr.14613) 79 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:56.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:55 smithi062 bash[28859]: cluster 2024-02-13T14:45:54.682637+0000 mgr.y (mgr.14613) 79 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:55 smithi111 bash[23388]: cluster 2024-02-13T14:45:54.682637+0000 mgr.y (mgr.14613) 79 : cluster 0 pgmap v48: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:45:56.556 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:56 smithi062 bash[61760]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-alertmanager-a 2024-02-13T14:45:56.557 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:45:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:45:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:45:56.809 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:56 smithi062 bash[61912]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-alertmanager-a 2024-02-13T14:45:56.810 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:56 smithi062 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-02-13T14:45:56.810 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:56 smithi062 systemd[1]: Stopped Ceph alertmanager.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:45:56.810 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:56 smithi062 systemd[1]: Started Ceph alertmanager.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:45:57.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[21479]: audit 2024-02-13T14:45:56.624362+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:57.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[21479]: audit 2024-02-13T14:45:56.635937+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:57.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[21479]: cephadm 2024-02-13T14:45:56.670889+0000 mgr.y (mgr.14613) 80 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-02-13T14:45:57.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[21479]: cluster 2024-02-13T14:45:56.683059+0000 mgr.y (mgr.14613) 81 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:57.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[21479]: cephadm 2024-02-13T14:45:56.926600+0000 mgr.y (mgr.14613) 82 : cephadm 1 Reconfiguring daemon prometheus.a on smithi111 2024-02-13T14:45:57.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[28859]: audit 2024-02-13T14:45:56.624362+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:57.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[28859]: audit 2024-02-13T14:45:56.635937+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:57.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[28859]: cephadm 2024-02-13T14:45:56.670889+0000 mgr.y (mgr.14613) 80 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-02-13T14:45:57.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[28859]: cluster 2024-02-13T14:45:56.683059+0000 mgr.y (mgr.14613) 81 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[28859]: cephadm 2024-02-13T14:45:56.926600+0000 mgr.y (mgr.14613) 82 : cephadm 1 Reconfiguring daemon prometheus.a on smithi111 2024-02-13T14:45:57.812 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[61938]: ts=2024-02-13T14:45:57.620Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-02-13T14:45:57.812 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[61938]: ts=2024-02-13T14:45:57.620Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-02-13T14:45:57.812 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[61938]: ts=2024-02-13T14:45:57.621Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.62 port=9094 2024-02-13T14:45:57.812 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[61938]: ts=2024-02-13T14:45:57.622Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-13T14:45:57.812 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[61938]: ts=2024-02-13T14:45:57.654Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-13T14:45:57.812 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[61938]: ts=2024-02-13T14:45:57.655Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-13T14:45:57.812 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[61938]: ts=2024-02-13T14:45:57.659Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-02-13T14:45:57.812 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:57 smithi062 bash[61938]: ts=2024-02-13T14:45:57.659Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-13T14:45:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:58.065 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:58.066 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:45:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:57 smithi111 bash[23388]: audit 2024-02-13T14:45:56.624362+0000 mon.a (mon.0) 831 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:58.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:57 smithi111 bash[23388]: audit 2024-02-13T14:45:56.635937+0000 mon.a (mon.0) 832 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:45:58.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:57 smithi111 bash[23388]: cephadm 2024-02-13T14:45:56.670889+0000 mgr.y (mgr.14613) 80 : cephadm 1 Reconfiguring prometheus.a (dependencies changed)... 2024-02-13T14:45:58.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:57 smithi111 bash[23388]: cluster 2024-02-13T14:45:56.683059+0000 mgr.y (mgr.14613) 81 : cluster 0 pgmap v49: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:45:58.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:57 smithi111 bash[23388]: cephadm 2024-02-13T14:45:56.926600+0000 mgr.y (mgr.14613) 82 : cephadm 1 Reconfiguring daemon prometheus.a on smithi111 2024-02-13T14:45:59.678 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:45:59 smithi062 bash[61938]: ts=2024-02-13T14:45:59.622Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000070949s 2024-02-13T14:45:59.972 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:59 smithi062 bash[21479]: cluster 2024-02-13T14:45:58.683430+0000 mgr.y (mgr.14613) 83 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:45:59.973 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:45:59 smithi062 bash[21479]: audit 2024-02-13T14:45:59.290165+0000 mon.b (mon.1) 74 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:59.973 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:59 smithi062 bash[28859]: cluster 2024-02-13T14:45:58.683430+0000 mgr.y (mgr.14613) 83 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:45:59.973 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:45:59 smithi062 bash[28859]: audit 2024-02-13T14:45:59.290165+0000 mon.b (mon.1) 74 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:45:59.996 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:45:59 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:45:59.996 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:59 smithi111 bash[23388]: cluster 2024-02-13T14:45:58.683430+0000 mgr.y (mgr.14613) 83 : cluster 0 pgmap v50: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:45:59.997 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:45:59 smithi111 bash[23388]: audit 2024-02-13T14:45:59.290165+0000 mon.b (mon.1) 74 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:00.092 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:46:00.093 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:46:00.094 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:46:00.104 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:46:00.105 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:46:01.047 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:00 smithi062 bash[28859]: audit 2024-02-13T14:45:59.970686+0000 mgr.y (mgr.14613) 84 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:01.047 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:00 smithi062 bash[21479]: audit 2024-02-13T14:45:59.970686+0000 mgr.y (mgr.14613) 84 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:01.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[23388]: audit 2024-02-13T14:45:59.970686+0000 mgr.y (mgr.14613) 84 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 systemd[1]: Stopping Ceph prometheus.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-02-13T14:46:01.093 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-02-13T14:46:01.094 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-02-13T14:46:01.094 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-02-13T14:46:01.094 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.697Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-02-13T14:46:01.094 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:00 smithi111 bash[48723]: ts=2024-02-13T14:46:00.698Z caller=main.go:1147 level=info msg="See you next time!" 2024-02-13T14:46:01.592 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[51261]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-prometheus-a 2024-02-13T14:46:01.593 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[51322]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-prometheus-a 2024-02-13T14:46:01.593 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:01 smithi111 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@prometheus.a.service: Deactivated successfully. 2024-02-13T14:46:01.593 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:01 smithi111 systemd[1]: Stopped Ceph prometheus.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:46:01.593 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:01 smithi111 systemd[1]: Started Ceph prometheus.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T14:46:01.832 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STOPPING 2024-02-13T14:46:01.832 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T14:46:01.832 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STOPPED 2024-02-13T14:46:01.832 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STARTING 2024-02-13T14:46:01.832 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Serving on http://:::9283 2024-02-13T14:46:01.832 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STARTED 2024-02-13T14:46:01.832 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STOPPING 2024-02-13T14:46:01.832 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T14:46:01.833 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STOPPED 2024-02-13T14:46:01.833 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STARTING 2024-02-13T14:46:02.063 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: cluster 2024-02-13T14:46:00.684826+0000 mgr.y (mgr.14613) 85 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:02.063 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.354563+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.063 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.368380+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.063 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.427236+0000 mon.b (mon.1) 75 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T14:46:02.063 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.430445+0000 mon.b (mon.1) 76 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T14:46:02.064 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.438527+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.064 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.467237+0000 mon.b (mon.1) 77 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T14:46:02.064 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.470285+0000 mon.b (mon.1) 78 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T14:46:02.064 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.478177+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.064 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.501176+0000 mon.b (mon.1) 79 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T14:46:02.065 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.505178+0000 mon.b (mon.1) 80 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T14:46:02.065 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.514504+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.065 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:01 smithi111 bash[23388]: audit 2024-02-13T14:46:01.539055+0000 mon.b (mon.1) 81 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:46:02.197 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: cluster 2024-02-13T14:46:00.684826+0000 mgr.y (mgr.14613) 85 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:02.197 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.354563+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.197 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.368380+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.198 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.427236+0000 mon.b (mon.1) 75 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T14:46:02.198 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.430445+0000 mon.b (mon.1) 76 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T14:46:02.198 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.438527+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.198 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.467237+0000 mon.b (mon.1) 77 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T14:46:02.198 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.470285+0000 mon.b (mon.1) 78 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T14:46:02.199 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.478177+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.199 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.501176+0000 mon.b (mon.1) 79 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T14:46:02.199 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.505178+0000 mon.b (mon.1) 80 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T14:46:02.199 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:01 smithi062 bash[28859]: audit 2024-02-13T14:46:01.514504+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.343 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.172Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-02-13T14:46:02.343 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.172Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-02-13T14:46:02.344 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.172Z caller=main.go:570 level=info host_details="(Linux 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 smithi111 (none))" 2024-02-13T14:46:02.344 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.172Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-13T14:46:02.344 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.172Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-13T14:46:02.344 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.174Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-02-13T14:46:02.344 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.174Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-02-13T14:46:02.345 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.176Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-02-13T14:46:02.345 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.176Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-13T14:46:02.345 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.178Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-13T14:46:02.345 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.178Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.168µs 2024-02-13T14:46:02.345 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.179Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-13T14:46:02.345 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.179Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-02-13T14:46:02.346 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.179Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-02-13T14:46:02.346 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.179Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=23.966µs wal_replay_duration=749.358µs wbl_replay_duration=101ns total_replay_duration=793.803µs 2024-02-13T14:46:02.346 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.180Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-02-13T14:46:02.346 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.180Z caller=main.go:1029 level=info msg="TSDB started" 2024-02-13T14:46:02.346 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.180Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-13T14:46:02.346 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.202Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.508549ms db_storage=933ns remote_storage=1.367µs web_handler=640ns query_engine=690ns scrape=324.706µs scrape_sd=151.008µs notify=12.91µs notify_sd=23.409µs rules=20.662104ms tracing=6.071µs 2024-02-13T14:46:02.347 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.202Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-02-13T14:46:02.347 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[51351]: ts=2024-02-13T14:46:02.202Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-02-13T14:46:02.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[28859]: audit 2024-02-13T14:46:01.539055+0000 mon.b (mon.1) 81 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Serving on http://:::9283 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STARTED 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STOPPING 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STOPPED 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STARTING 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Serving on http://:::9283 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21731]: [13/Feb/2024:14:46:01] ENGINE Bus STARTED 2024-02-13T14:46:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: cluster 2024-02-13T14:46:00.684826+0000 mgr.y (mgr.14613) 85 : cluster 0 pgmap v51: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.354563+0000 mon.a (mon.0) 833 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.368380+0000 mon.a (mon.0) 834 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.427236+0000 mon.b (mon.1) 75 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.430445+0000 mon.b (mon.1) 76 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.438527+0000 mon.a (mon.0) 835 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.467237+0000 mon.b (mon.1) 77 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.470285+0000 mon.b (mon.1) 78 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.478177+0000 mon.a (mon.0) 836 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.501176+0000 mon.b (mon.1) 79 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.505178+0000 mon.b (mon.1) 80 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.514504+0000 mon.a (mon.0) 837 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.539055+0000 mon.b (mon.1) 81 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:46:03.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[23388]: audit 2024-02-13T14:46:01.428210+0000 mgr.y (mgr.14613) 86 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T14:46:03.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[23388]: audit 2024-02-13T14:46:01.431200+0000 mgr.y (mgr.14613) 87 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T14:46:03.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[23388]: audit 2024-02-13T14:46:01.467986+0000 mgr.y (mgr.14613) 88 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T14:46:03.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[23388]: audit 2024-02-13T14:46:01.470909+0000 mgr.y (mgr.14613) 89 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T14:46:03.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[23388]: audit 2024-02-13T14:46:01.502350+0000 mgr.y (mgr.14613) 90 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T14:46:03.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:02 smithi111 bash[23388]: audit 2024-02-13T14:46:01.505802+0000 mgr.y (mgr.14613) 91 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T14:46:03.134 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.428210+0000 mgr.y (mgr.14613) 86 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T14:46:03.134 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.431200+0000 mgr.y (mgr.14613) 87 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T14:46:03.134 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.467986+0000 mgr.y (mgr.14613) 88 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T14:46:03.134 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.470909+0000 mgr.y (mgr.14613) 89 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T14:46:03.134 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.502350+0000 mgr.y (mgr.14613) 90 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T14:46:03.134 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[21479]: audit 2024-02-13T14:46:01.505802+0000 mgr.y (mgr.14613) 91 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T14:46:03.135 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[28859]: audit 2024-02-13T14:46:01.428210+0000 mgr.y (mgr.14613) 86 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-13T14:46:03.135 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[28859]: audit 2024-02-13T14:46:01.431200+0000 mgr.y (mgr.14613) 87 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi062.front.sepia.ceph.com:9093"}]: dispatch 2024-02-13T14:46:03.135 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[28859]: audit 2024-02-13T14:46:01.467986+0000 mgr.y (mgr.14613) 88 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-13T14:46:03.135 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[28859]: audit 2024-02-13T14:46:01.470909+0000 mgr.y (mgr.14613) 89 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi111.front.sepia.ceph.com:9095"}]: dispatch 2024-02-13T14:46:03.135 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[28859]: audit 2024-02-13T14:46:01.502350+0000 mgr.y (mgr.14613) 90 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-13T14:46:03.136 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:02 smithi062 bash[28859]: audit 2024-02-13T14:46:01.505802+0000 mgr.y (mgr.14613) 91 : audit 0 from='mon.? v1:172.21.15.111:0/2120247681' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi111.front.sepia.ceph.com:3000"}]: dispatch 2024-02-13T14:46:04.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:03 smithi111 bash[23388]: cluster 2024-02-13T14:46:02.685630+0000 mgr.y (mgr.14613) 92 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:04.125 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:03 smithi062 bash[21479]: cluster 2024-02-13T14:46:02.685630+0000 mgr.y (mgr.14613) 92 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:04.126 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:03 smithi062 bash[28859]: cluster 2024-02-13T14:46:02.685630+0000 mgr.y (mgr.14613) 92 : cluster 0 pgmap v52: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:05.924 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:05 smithi062 bash[21479]: cluster 2024-02-13T14:46:04.687026+0000 mgr.y (mgr.14613) 93 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:46:05.924 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:05 smithi062 bash[28859]: cluster 2024-02-13T14:46:04.687026+0000 mgr.y (mgr.14613) 93 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:46:06.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:05 smithi111 bash[23388]: cluster 2024-02-13T14:46:04.687026+0000 mgr.y (mgr.14613) 93 : cluster 0 pgmap v53: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:46:07.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- 172.21.15.62:0/3116413366 >> v1:172.21.15.62:6790/0 conn(0x7fa76810a8f0 legacy=0x7fa76810cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:07.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- 172.21.15.62:0/3116413366 shutdown_connections 2024-02-13T14:46:07.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- 172.21.15.62:0/3116413366 >> 172.21.15.62:0/3116413366 conn(0x7fa7680fd550 msgr2=0x7fa7680ff970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:07.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- 172.21.15.62:0/3116413366 shutdown_connections 2024-02-13T14:46:07.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- 172.21.15.62:0/3116413366 wait complete. 2024-02-13T14:46:07.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 Processor -- start 2024-02-13T14:46:07.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- start start 2024-02-13T14:46:07.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa7681a6790 con 0x7fa768107a40 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa7681a7970 con 0x7fa76810e4c0 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76d806700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fa7681a8b50 con 0x7fa76810a8f0 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa766ffd700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa768107a40 0x7fa76810d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35514/0 (socket says 172.21.15.62:35514) 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa766ffd700 1 -- 172.21.15.62:0/424513421 learned_addr learned my addr 172.21.15.62:0/424513421 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313486238 0 0) 0x7fa7681a6790 con 0x7fa768107a40 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7500035b0 con 0x7fa768107a40 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3250629062 0 0) 0x7fa7681a7970 con 0x7fa76810e4c0 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7681a6790 con 0x7fa76810e4c0 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625752583 0 0) 0x7fa7681a8b50 con 0x7fa76810a8f0 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.191+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7681a7970 con 0x7fa76810a8f0 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1647702100 0 0) 0x7fa7681a6790 con 0x7fa76810e4c0 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.111:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7681a8b50 con 0x7fa76810e4c0 2024-02-13T14:46:07.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fa7600013a0 con 0x7fa76810e4c0 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2166876560 0 0) 0x7fa7500035b0 con 0x7fa768107a40 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fa7681a6790 con 0x7fa768107a40 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fa758001990 con 0x7fa768107a40 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3091976212 0 0) 0x7fa7681a8b50 con 0x7fa76810e4c0 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 >> v1:172.21.15.62:6790/0 conn(0x7fa76810a8f0 legacy=0x7fa7681a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 >> v1:172.21.15.62:6789/0 conn(0x7fa768107a40 legacy=0x7fa76810d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7681a9d70 con 0x7fa76810e4c0 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.111:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7681a7b60 con 0x7fa76810e4c0 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.111:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7681a7fe0 con 0x7fa76810e4c0 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fa760001870 con 0x7fa76810e4c0 2024-02-13T14:46:07.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fa760004b80 con 0x7fa76810e4c0 2024-02-13T14:46:07.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa754005120 con 0x7fa76810e4c0 2024-02-13T14:46:07.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fa760003a00 con 0x7fa76810e4c0 2024-02-13T14:46:07.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.195+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7fa760087ec0 con 0x7fa76810e4c0 2024-02-13T14:46:07.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.199+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fa760054fa0 con 0x7fa76810e4c0 2024-02-13T14:46:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.407+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 --> v1:172.21.15.111:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa7540053d0 con 0x7fa76810e4c0 2024-02-13T14:46:07.410 INFO:teuthology.orchestra.run.smithi062.stdout:77309411419 2024-02-13T14:46:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.407+0000 7fa76c804700 1 -- 172.21.15.62:0/424513421 <== mon.1 v1:172.21.15.111:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (unknown 92182286 0 2983928745) 0x7fa760053310 con 0x7fa76810e4c0 2024-02-13T14:46:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.411+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 >> v1:172.21.15.62:6800/3802446050 conn(0x7fa75006ef00 legacy=0x7fa7500713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.411+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 >> v1:172.21.15.111:6789/0 conn(0x7fa76810e4c0 legacy=0x7fa7681a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.411+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 shutdown_connections 2024-02-13T14:46:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.411+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 >> 172.21.15.62:0/424513421 conn(0x7fa7680fd550 msgr2=0x7fa768111150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.411+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 shutdown_connections 2024-02-13T14:46:07.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:07.411+0000 7fa76d806700 1 -- 172.21.15.62:0/424513421 wait complete. 2024-02-13T14:46:07.769 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[61938]: ts=2024-02-13T14:46:07.625Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.003048395s 2024-02-13T14:46:08.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[28859]: cluster 2024-02-13T14:46:06.687727+0000 mgr.y (mgr.14613) 94 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:08.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[28859]: audit 2024-02-13T14:46:07.413035+0000 mon.b (mon.1) 82 : audit 0 from='client.? v1:172.21.15.62:0/424513421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-13T14:46:08.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[28859]: audit 2024-02-13T14:46:07.683273+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:08.044 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[28859]: audit 2024-02-13T14:46:07.700669+0000 mon.a (mon.0) 839 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:08.044 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[21479]: cluster 2024-02-13T14:46:06.687727+0000 mgr.y (mgr.14613) 94 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:08.045 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[21479]: audit 2024-02-13T14:46:07.413035+0000 mon.b (mon.1) 82 : audit 0 from='client.? v1:172.21.15.62:0/424513421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-13T14:46:08.045 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[21479]: audit 2024-02-13T14:46:07.683273+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:08.045 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:07 smithi062 bash[21479]: audit 2024-02-13T14:46:07.700669+0000 mon.a (mon.0) 839 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:08.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:07 smithi111 bash[23388]: cluster 2024-02-13T14:46:06.687727+0000 mgr.y (mgr.14613) 94 : cluster 0 pgmap v54: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:08.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:07 smithi111 bash[23388]: audit 2024-02-13T14:46:07.413035+0000 mon.b (mon.1) 82 : audit 0 from='client.? v1:172.21.15.62:0/424513421' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-13T14:46:08.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:07 smithi111 bash[23388]: audit 2024-02-13T14:46:07.683273+0000 mon.a (mon.0) 838 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:08.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:07 smithi111 bash[23388]: audit 2024-02-13T14:46:07.700669+0000 mon.a (mon.0) 839 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:10.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:09 smithi062 bash[28859]: cluster 2024-02-13T14:46:08.688261+0000 mgr.y (mgr.14613) 95 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:10.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:09 smithi062 bash[21479]: cluster 2024-02-13T14:46:08.688261+0000 mgr.y (mgr.14613) 95 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:10.092 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:46:09 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:46:10.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:09 smithi111 bash[23388]: cluster 2024-02-13T14:46:08.688261+0000 mgr.y (mgr.14613) 95 : cluster 0 pgmap v55: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- 172.21.15.62:0/3177102971 >> v1:172.21.15.62:6790/0 conn(0x7ff13010cb60 legacy=0x7ff13010ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- 172.21.15.62:0/3177102971 shutdown_connections 2024-02-13T14:46:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- 172.21.15.62:0/3177102971 >> 172.21.15.62:0/3177102971 conn(0x7ff1300ff760 msgr2=0x7ff130101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- 172.21.15.62:0/3177102971 shutdown_connections 2024-02-13T14:46:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- 172.21.15.62:0/3177102971 wait complete. 2024-02-13T14:46:10.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 Processor -- start 2024-02-13T14:46:10.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- start start 2024-02-13T14:46:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1301a8c70 con 0x7ff130110700 2024-02-13T14:46:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1301a9e50 con 0x7ff13010cb60 2024-02-13T14:46:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff13823e700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1301ab050 con 0x7ff130103ed0 2024-02-13T14:46:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff135fda700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7ff130103ed0 0x7ff130109200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:34512/0 (socket says 172.21.15.62:34512) 2024-02-13T14:46:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff135fda700 1 -- 172.21.15.62:0/1680269254 learned_addr learned my addr 172.21.15.62:0/1680269254 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584235839 0 0) 0x7ff1301ab050 con 0x7ff130103ed0 2024-02-13T14:46:10.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff11c0035b0 con 0x7ff130103ed0 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238275176 0 0) 0x7ff1301a8c70 con 0x7ff130110700 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.135+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1301ab050 con 0x7ff130110700 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1144308113 0 0) 0x7ff1301ab050 con 0x7ff130110700 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1301a8c70 con 0x7ff130110700 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3479749206 0 0) 0x7ff11c0035b0 con 0x7ff130103ed0 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1301ab050 con 0x7ff130103ed0 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff128001b70 con 0x7ff130110700 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff12c0019f0 con 0x7ff130103ed0 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070692441 0 0) 0x7ff1301a9e50 con 0x7ff13010cb60 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff11c0035b0 con 0x7ff13010cb60 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3685223539 0 0) 0x7ff1301a8c70 con 0x7ff130110700 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 >> v1:172.21.15.62:6790/0 conn(0x7ff130103ed0 legacy=0x7ff130109200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 >> v1:172.21.15.111:6789/0 conn(0x7ff13010cb60 legacy=0x7ff1301a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1301ac250 con 0x7ff130110700 2024-02-13T14:46:10.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1301a8e60 con 0x7ff130110700 2024-02-13T14:46:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1301a92e0 con 0x7ff130110700 2024-02-13T14:46:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7ff128001d20 con 0x7ff130110700 2024-02-13T14:46:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff128004dd0 con 0x7ff130110700 2024-02-13T14:46:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff114005120 con 0x7ff130110700 2024-02-13T14:46:10.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7ff128003a20 con 0x7ff130110700 2024-02-13T14:46:10.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.139+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7ff128087fc0 con 0x7ff130110700 2024-02-13T14:46:10.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.147+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7ff1280550a0 con 0x7ff130110700 2024-02-13T14:46:10.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.359+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ff1140053d0 con 0x7ff130110700 2024-02-13T14:46:10.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.359+0000 7ff126ffd700 1 -- 172.21.15.62:0/1680269254 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (unknown 1482059429 0 1000891405) 0x7ff128053410 con 0x7ff130110700 2024-02-13T14:46:10.362 INFO:teuthology.orchestra.run.smithi062.stdout:231928234024 2024-02-13T14:46:10.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.363+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 >> v1:172.21.15.62:6800/3802446050 conn(0x7ff11c06ef20 legacy=0x7ff11c0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:10.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.363+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 >> v1:172.21.15.62:6789/0 conn(0x7ff130110700 legacy=0x7ff1301a7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:10.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.363+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 shutdown_connections 2024-02-13T14:46:10.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.363+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 >> 172.21.15.62:0/1680269254 conn(0x7ff1300ff760 msgr2=0x7ff130113350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:10.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.363+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 shutdown_connections 2024-02-13T14:46:10.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.363+0000 7ff13823e700 1 -- 172.21.15.62:0/1680269254 wait complete. 2024-02-13T14:46:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- 172.21.15.62:0/648515121 >> v1:172.21.15.62:6790/0 conn(0x7f3668102bf0 legacy=0x7f3668102fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- 172.21.15.62:0/648515121 shutdown_connections 2024-02-13T14:46:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- 172.21.15.62:0/648515121 >> 172.21.15.62:0/648515121 conn(0x7f36680fc480 msgr2=0x7f36680fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- 172.21.15.62:0/648515121 shutdown_connections 2024-02-13T14:46:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- 172.21.15.62:0/648515121 wait complete. 2024-02-13T14:46:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 Processor -- start 2024-02-13T14:46:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- start start 2024-02-13T14:46:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f366810dcd0 con 0x7f366810aa00 2024-02-13T14:46:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f36681a9dd0 con 0x7f3668102bf0 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f366e445700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f36681aaf70 con 0x7f366810e510 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36677fe700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f366810aa00 0x7f36681a3f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:35554/0 (socket says 172.21.15.62:35554) 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36677fe700 1 -- 172.21.15.62:0/3617951598 learned_addr learned my addr 172.21.15.62:0/3617951598 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2609508099 0 0) 0x7f366810dcd0 con 0x7f366810aa00 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36540035b0 con 0x7f366810aa00 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396052622 0 0) 0x7f36681aaf70 con 0x7f366810e510 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f366810dcd0 con 0x7f366810e510 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1269238739 0 0) 0x7f36540035b0 con 0x7f366810aa00 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f36681aaf70 con 0x7f366810aa00 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3650001930 con 0x7f366810aa00 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 481265295 0 0) 0x7f366810dcd0 con 0x7f366810e510 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f36540035b0 con 0x7f366810e510 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3658001070 con 0x7f366810e510 2024-02-13T14:46:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066543132 0 0) 0x7f36681a9dd0 con 0x7f3668102bf0 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f366810dcd0 con 0x7f3668102bf0 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1339878923 0 0) 0x7f36681aaf70 con 0x7f366810aa00 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 >> v1:172.21.15.62:6790/0 conn(0x7f366810e510 legacy=0x7f36681a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 >> v1:172.21.15.111:6789/0 conn(0x7f3668102bf0 legacy=0x7f366810d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.927+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36681ac170 con 0x7f366810aa00 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.931+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36681ab160 con 0x7f366810aa00 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.931+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f36681ab620 con 0x7f366810aa00 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.931+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f3650003b30 con 0x7f366810aa00 2024-02-13T14:46:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.931+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f3650005d10 con 0x7f366810aa00 2024-02-13T14:46:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.931+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3648005120 con 0x7f366810aa00 2024-02-13T14:46:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.931+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f36500036a0 con 0x7f366810aa00 2024-02-13T14:46:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.931+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f3650088ff0 con 0x7f366810aa00 2024-02-13T14:46:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:10.935+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f3650056070 con 0x7f366810aa00 2024-02-13T14:46:11.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:10 smithi062 bash[28859]: audit 2024-02-13T14:46:09.981727+0000 mgr.y (mgr.14613) 96 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:10 smithi062 bash[28859]: audit 2024-02-13T14:46:10.365135+0000 mon.a (mon.0) 840 : audit 0 from='client.? v1:172.21.15.62:0/1680269254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-13T14:46:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:10 smithi062 bash[21479]: audit 2024-02-13T14:46:09.981727+0000 mgr.y (mgr.14613) 96 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:10 smithi062 bash[21479]: audit 2024-02-13T14:46:10.365135+0000 mon.a (mon.0) 840 : audit 0 from='client.? v1:172.21.15.62:0/1680269254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-13T14:46:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:10 smithi111 bash[23388]: audit 2024-02-13T14:46:09.981727+0000 mgr.y (mgr.14613) 96 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:11.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:10 smithi111 bash[23388]: audit 2024-02-13T14:46:10.365135+0000 mon.a (mon.0) 840 : audit 0 from='client.? v1:172.21.15.62:0/1680269254' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-13T14:46:11.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:11.147+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f36480053d0 con 0x7f366810aa00 2024-02-13T14:46:11.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:11.151+0000 7f36657fa700 1 -- 172.21.15.62:0/3617951598 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (unknown 1274345170 0 3415501099) 0x7f36500543e0 con 0x7f366810aa00 2024-02-13T14:46:11.151 INFO:teuthology.orchestra.run.smithi062.stdout:197568495666 2024-02-13T14:46:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:11.151+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 >> v1:172.21.15.62:6800/3802446050 conn(0x7f365406ef50 legacy=0x7f3654071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:11.151+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 >> v1:172.21.15.62:6789/0 conn(0x7f366810aa00 legacy=0x7f36681a3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:11.151+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 shutdown_connections 2024-02-13T14:46:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:11.151+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 >> 172.21.15.62:0/3617951598 conn(0x7f36680fc480 msgr2=0x7f36680fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:11.151+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 shutdown_connections 2024-02-13T14:46:11.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:11.151+0000 7f366e445700 1 -- 172.21.15.62:0/3617951598 wait complete. 2024-02-13T14:46:12.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:11 smithi062 bash[21479]: cluster 2024-02-13T14:46:10.689675+0000 mgr.y (mgr.14613) 97 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:12.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:11 smithi062 bash[21479]: audit 2024-02-13T14:46:11.154420+0000 mon.a (mon.0) 841 : audit 0 from='client.? v1:172.21.15.62:0/3617951598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-13T14:46:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:11 smithi062 bash[28859]: cluster 2024-02-13T14:46:10.689675+0000 mgr.y (mgr.14613) 97 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:11 smithi062 bash[28859]: audit 2024-02-13T14:46:11.154420+0000 mon.a (mon.0) 841 : audit 0 from='client.? v1:172.21.15.62:0/3617951598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-13T14:46:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:11 smithi111 bash[23388]: cluster 2024-02-13T14:46:10.689675+0000 mgr.y (mgr.14613) 97 : cluster 0 pgmap v56: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:11 smithi111 bash[23388]: audit 2024-02-13T14:46:11.154420+0000 mon.a (mon.0) 841 : audit 0 from='client.? v1:172.21.15.62:0/3617951598' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-13T14:46:12.718 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411414 got 77309411419 for osd.2 2024-02-13T14:46:12.718 DEBUG:teuthology.parallel:result is None 2024-02-13T14:46:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- 172.21.15.62:0/2880038311 >> v1:172.21.15.62:6790/0 conn(0x7fba1810d410 legacy=0x7fba1810f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- 172.21.15.62:0/2880038311 shutdown_connections 2024-02-13T14:46:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- 172.21.15.62:0/2880038311 >> 172.21.15.62:0/2880038311 conn(0x7fba18075cc0 msgr2=0x7fba180760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:13.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- 172.21.15.62:0/2880038311 shutdown_connections 2024-02-13T14:46:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- 172.21.15.62:0/2880038311 wait complete. 2024-02-13T14:46:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 Processor -- start 2024-02-13T14:46:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- start start 2024-02-13T14:46:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fba181a6a10 con 0x7fba181015b0 2024-02-13T14:46:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fba181a7bf0 con 0x7fba18109870 2024-02-13T14:46:13.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ecc6700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fba181a8df0 con 0x7fba1810d410 2024-02-13T14:46:13.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1d263700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fba1810d410 0x7fba181a50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:45458/0 (socket says 172.21.15.62:45458) 2024-02-13T14:46:13.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1ca62700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fba181015b0 0x7fba18100b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48198/0 (socket says 172.21.15.62:48198) 2024-02-13T14:46:13.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.767+0000 7fba1d263700 1 -- 172.21.15.62:0/775544578 learned_addr learned my addr 172.21.15.62:0/775544578 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:13.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298467310 0 0) 0x7fba181a6a10 con 0x7fba181015b0 2024-02-13T14:46:13.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba080035b0 con 0x7fba181015b0 2024-02-13T14:46:13.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567566705 0 0) 0x7fba181a8df0 con 0x7fba1810d410 2024-02-13T14:46:13.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba181a6a10 con 0x7fba1810d410 2024-02-13T14:46:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 429482703 0 0) 0x7fba080035b0 con 0x7fba181015b0 2024-02-13T14:46:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba181a8df0 con 0x7fba181015b0 2024-02-13T14:46:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fba0c0019f0 con 0x7fba181015b0 2024-02-13T14:46:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052351434 0 0) 0x7fba181a7bf0 con 0x7fba18109870 2024-02-13T14:46:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba080035b0 con 0x7fba18109870 2024-02-13T14:46:13.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3594490008 0 0) 0x7fba181a6a10 con 0x7fba1810d410 2024-02-13T14:46:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fba181a7bf0 con 0x7fba1810d410 2024-02-13T14:46:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fba10004800 con 0x7fba1810d410 2024-02-13T14:46:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 904043174 0 0) 0x7fba181a8df0 con 0x7fba181015b0 2024-02-13T14:46:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 >> v1:172.21.15.62:6790/0 conn(0x7fba1810d410 legacy=0x7fba181a50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 >> v1:172.21.15.111:6789/0 conn(0x7fba18109870 legacy=0x7fba181a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba181a9ff0 con 0x7fba181015b0 2024-02-13T14:46:13.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba181a8fe0 con 0x7fba181015b0 2024-02-13T14:46:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fba0c001c60 con 0x7fba181015b0 2024-02-13T14:46:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fba0c005c80 con 0x7fba181015b0 2024-02-13T14:46:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fba181a9460 con 0x7fba181015b0 2024-02-13T14:46:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba18069d00 con 0x7fba181015b0 2024-02-13T14:46:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fba0c003930 con 0x7fba181015b0 2024-02-13T14:46:13.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.771+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7fba0c089020 con 0x7fba181015b0 2024-02-13T14:46:13.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.775+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fba0c0560e0 con 0x7fba181015b0 2024-02-13T14:46:13.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.991+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fba18100360 con 0x7fba181015b0 2024-02-13T14:46:13.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.995+0000 7fba15ffb700 1 -- 172.21.15.62:0/775544578 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (unknown 574334944 0 1875529586) 0x7fba0c054450 con 0x7fba181015b0 2024-02-13T14:46:13.996 INFO:teuthology.orchestra.run.smithi062.stdout:34359738480 2024-02-13T14:46:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.995+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 >> v1:172.21.15.62:6800/3802446050 conn(0x7fba0806ee70 legacy=0x7fba08071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.995+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 >> v1:172.21.15.62:6789/0 conn(0x7fba181015b0 legacy=0x7fba18100b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.995+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 shutdown_connections 2024-02-13T14:46:13.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.995+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 >> 172.21.15.62:0/775544578 conn(0x7fba18075cc0 msgr2=0x7fba1810f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.995+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 shutdown_connections 2024-02-13T14:46:13.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:13.995+0000 7fba1ecc6700 1 -- 172.21.15.62:0/775544578 wait complete. 2024-02-13T14:46:14.010 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:13 smithi062 bash[28859]: cluster 2024-02-13T14:46:12.690163+0000 mgr.y (mgr.14613) 98 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:14.010 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:13 smithi062 bash[21479]: cluster 2024-02-13T14:46:12.690163+0000 mgr.y (mgr.14613) 98 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:13 smithi111 bash[23388]: cluster 2024-02-13T14:46:12.690163+0000 mgr.y (mgr.14613) 98 : cluster 0 pgmap v57: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:15.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:14 smithi062 bash[28859]: audit 2024-02-13T14:46:13.998649+0000 mon.a (mon.0) 842 : audit 0 from='client.? v1:172.21.15.62:0/775544578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-13T14:46:15.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:14 smithi062 bash[28859]: audit 2024-02-13T14:46:14.322337+0000 mon.b (mon.1) 83 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:14 smithi062 bash[21479]: audit 2024-02-13T14:46:13.998649+0000 mon.a (mon.0) 842 : audit 0 from='client.? v1:172.21.15.62:0/775544578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-13T14:46:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:14 smithi062 bash[21479]: audit 2024-02-13T14:46:14.322337+0000 mon.b (mon.1) 83 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:14 smithi111 bash[23388]: audit 2024-02-13T14:46:13.998649+0000 mon.a (mon.0) 842 : audit 0 from='client.? v1:172.21.15.62:0/775544578' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-13T14:46:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:14 smithi111 bash[23388]: audit 2024-02-13T14:46:14.322337+0000 mon.b (mon.1) 83 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:15.275 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234020 got 231928234024 for osd.7 2024-02-13T14:46:15.276 DEBUG:teuthology.parallel:result is None 2024-02-13T14:46:15.822 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495661 got 197568495666 for osd.6 2024-02-13T14:46:15.822 DEBUG:teuthology.parallel:result is None 2024-02-13T14:46:16.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:15 smithi062 bash[21479]: cluster 2024-02-13T14:46:14.691544+0000 mgr.y (mgr.14613) 99 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:15 smithi062 bash[28859]: cluster 2024-02-13T14:46:14.691544+0000 mgr.y (mgr.14613) 99 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:15 smithi111 bash[23388]: cluster 2024-02-13T14:46:14.691544+0000 mgr.y (mgr.14613) 99 : cluster 0 pgmap v58: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:16.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:46:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:46:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- 172.21.15.62:0/935486786 >> v1:172.21.15.62:6789/0 conn(0x7f20a810e4d0 legacy=0x7f20a8110990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- 172.21.15.62:0/935486786 shutdown_connections 2024-02-13T14:46:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- 172.21.15.62:0/935486786 >> 172.21.15.62:0/935486786 conn(0x7f20a80fd560 msgr2=0x7f20a80ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- 172.21.15.62:0/935486786 shutdown_connections 2024-02-13T14:46:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- 172.21.15.62:0/935486786 wait complete. 2024-02-13T14:46:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 Processor -- start 2024-02-13T14:46:16.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- start start 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f20a81a6990 con 0x7f20a810e4d0 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f20a81a7b90 con 0x7f20a8107a50 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f20a81a8d90 con 0x7f20a810a900 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20ad7da700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f20a810a900 0x7f20a81a1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:45470/0 (socket says 172.21.15.62:45470) 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20ad7da700 1 -- 172.21.15.62:0/3316312186 learned_addr learned my addr 172.21.15.62:0/3316312186 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20ae7dc700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f20a810e4d0 0x7f20a81a5090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48224/0 (socket says 172.21.15.62:48224) 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447831179 0 0) 0x7f20a81a6990 con 0x7f20a810e4d0 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20940031f0 con 0x7f20a810e4d0 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214600524 0 0) 0x7f20a81a8d90 con 0x7f20a810a900 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a81a6990 con 0x7f20a810a900 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1999786354 0 0) 0x7f20a81a7b90 con 0x7f20a8107a50 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20a81a8d90 con 0x7f20a8107a50 2024-02-13T14:46:16.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 646289029 0 0) 0x7f20a81a6990 con 0x7f20a810a900 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f20a81a7b90 con 0x7f20a810a900 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f209c0018f0 con 0x7f20a810a900 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1088663279 0 0) 0x7f20940031f0 con 0x7f20a810e4d0 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f20a81a6990 con 0x7f20a810e4d0 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1978818567 0 0) 0x7f20a81a7b90 con 0x7f20a810a900 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 >> v1:172.21.15.111:6789/0 conn(0x7f20a8107a50 legacy=0x7f20a810dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 >> v1:172.21.15.62:6789/0 conn(0x7f20a810e4d0 legacy=0x7f20a81a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a81a9f90 con 0x7f20a810a900 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a81a8f80 con 0x7f20a810a900 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a81a9400 con 0x7f20a810a900 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f209c003b30 con 0x7f20a810a900 2024-02-13T14:46:16.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f209c005c20 con 0x7f20a810a900 2024-02-13T14:46:16.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.987+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c005150 con 0x7f20a810a900 2024-02-13T14:46:16.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.991+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f209c01c410 con 0x7f20a810a900 2024-02-13T14:46:16.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.991+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f209c088f80 con 0x7f20a810a900 2024-02-13T14:46:16.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:16.995+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f209c055db0 con 0x7f20a810a900 2024-02-13T14:46:17.216 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738476 got 34359738480 for osd.0 2024-02-13T14:46:17.216 DEBUG:teuthology.parallel:result is None 2024-02-13T14:46:17.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.231+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f208c005400 con 0x7f20a810a900 2024-02-13T14:46:17.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.231+0000 7f209affd700 1 -- 172.21.15.62:0/3316312186 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (unknown 2131975755 0 1813322911) 0x7f209c0543b0 con 0x7f20a810a900 2024-02-13T14:46:17.234 INFO:teuthology.orchestra.run.smithi062.stdout:163208757310 2024-02-13T14:46:17.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.235+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 >> v1:172.21.15.62:6800/3802446050 conn(0x7f209406ee60 legacy=0x7f2094071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.235+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 >> v1:172.21.15.62:6790/0 conn(0x7f20a810a900 legacy=0x7f20a81a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.235+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 shutdown_connections 2024-02-13T14:46:17.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.235+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 >> 172.21.15.62:0/3316312186 conn(0x7f20a80fd560 msgr2=0x7f20a80ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:17.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.235+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 shutdown_connections 2024-02-13T14:46:17.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.235+0000 7f20b023f700 1 -- 172.21.15.62:0/3316312186 wait complete. 2024-02-13T14:46:17.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- 172.21.15.62:0/1781941932 >> v1:172.21.15.62:6790/0 conn(0x7fcd3410aa20 legacy=0x7fcd3410ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- 172.21.15.62:0/1781941932 shutdown_connections 2024-02-13T14:46:17.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- 172.21.15.62:0/1781941932 >> 172.21.15.62:0/1781941932 conn(0x7fcd340fc480 msgr2=0x7fcd340fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:17.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- 172.21.15.62:0/1781941932 shutdown_connections 2024-02-13T14:46:17.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- 172.21.15.62:0/1781941932 wait complete. 2024-02-13T14:46:17.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 Processor -- start 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- start start 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcd3410a580 con 0x7fcd3410e530 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcd3410a750 con 0x7fcd3410aa20 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcd341a8fc0 con 0x7fcd34102c10 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd39eb9700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fcd34102c10 0x7fcd341073d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:45496/0 (socket says 172.21.15.62:45496) 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd39eb9700 1 -- 172.21.15.62:0/751708286 learned_addr learned my addr 172.21.15.62:0/751708286 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147350644 0 0) 0x7fcd3410a580 con 0x7fcd3410e530 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd200037f0 con 0x7fcd3410e530 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842312995 0 0) 0x7fcd341a8fc0 con 0x7fcd34102c10 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd3410a580 con 0x7fcd34102c10 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1982476592 0 0) 0x7fcd200037f0 con 0x7fcd3410e530 2024-02-13T14:46:17.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd341a8fc0 con 0x7fcd3410e530 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2975692806 0 0) 0x7fcd3410a580 con 0x7fcd34102c10 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcd200037f0 con 0x7fcd34102c10 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fcd2c001c80 con 0x7fcd3410e530 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fcd24001930 con 0x7fcd34102c10 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27217361 0 0) 0x7fcd3410a750 con 0x7fcd3410aa20 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd3410a580 con 0x7fcd3410aa20 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1066107631 0 0) 0x7fcd200037f0 con 0x7fcd34102c10 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 >> v1:172.21.15.111:6789/0 conn(0x7fcd3410aa20 legacy=0x7fcd34107ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 >> v1:172.21.15.62:6789/0 conn(0x7fcd3410e530 legacy=0x7fcd341a5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd341aa160 con 0x7fcd34102c10 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd341a91b0 con 0x7fcd34102c10 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd341a9630 con 0x7fcd34102c10 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fcd24001c70 con 0x7fcd34102c10 2024-02-13T14:46:17.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fcd24005d10 con 0x7fcd34102c10 2024-02-13T14:46:17.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.291+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd18005120 con 0x7fcd34102c10 2024-02-13T14:46:17.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.295+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fcd24003950 con 0x7fcd34102c10 2024-02-13T14:46:17.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.295+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7fcd24088e90 con 0x7fcd34102c10 2024-02-13T14:46:17.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.299+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fcd24055f10 con 0x7fcd34102c10 2024-02-13T14:46:17.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.511+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fcd180053d0 con 0x7fcd34102c10 2024-02-13T14:46:17.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.511+0000 7fcd2affd700 1 -- 172.21.15.62:0/751708286 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (unknown 1823589948 0 3376596024) 0x7fcd24054280 con 0x7fcd34102c10 2024-02-13T14:46:17.513 INFO:teuthology.orchestra.run.smithi062.stdout:128849018952 2024-02-13T14:46:17.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.515+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 >> v1:172.21.15.62:6800/3802446050 conn(0x7fcd2006ef90 legacy=0x7fcd20071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.515+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 >> v1:172.21.15.62:6790/0 conn(0x7fcd34102c10 legacy=0x7fcd341073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.515+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 shutdown_connections 2024-02-13T14:46:17.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.515+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 >> 172.21.15.62:0/751708286 conn(0x7fcd340fc480 msgr2=0x7fcd34110980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:17.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.515+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 shutdown_connections 2024-02-13T14:46:17.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.515+0000 7fcd3c11d700 1 -- 172.21.15.62:0/751708286 wait complete. 2024-02-13T14:46:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- 172.21.15.62:0/845425619 >> v1:172.21.15.62:6790/0 conn(0x7f1424107a50 legacy=0x7f1424107e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- 172.21.15.62:0/845425619 shutdown_connections 2024-02-13T14:46:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- 172.21.15.62:0/845425619 >> 172.21.15.62:0/845425619 conn(0x7f14240fd540 msgr2=0x7f14240ff960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- 172.21.15.62:0/845425619 shutdown_connections 2024-02-13T14:46:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- 172.21.15.62:0/845425619 wait complete. 2024-02-13T14:46:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 Processor -- start 2024-02-13T14:46:17.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- start start 2024-02-13T14:46:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f14241a6af0 con 0x7f1424107a50 2024-02-13T14:46:17.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f14241a7cd0 con 0x7f142410a900 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f14241a8ed0 con 0x7f142410e4d0 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f1429708700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1424107a50 0x7f142410dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48272/0 (socket says 172.21.15.62:48272) 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f1429708700 1 -- 172.21.15.62:0/3883223687 learned_addr learned my addr 172.21.15.62:0/3883223687 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923768660 0 0) 0x7f14241a8ed0 con 0x7f142410e4d0 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14100035b0 con 0x7f142410e4d0 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621586545 0 0) 0x7f14241a6af0 con 0x7f1424107a50 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14241a8ed0 con 0x7f1424107a50 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 785587845 0 0) 0x7f14100035b0 con 0x7f142410e4d0 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f14241a6af0 con 0x7f142410e4d0 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f141c001b70 con 0x7f142410e4d0 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 123558839 0 0) 0x7f14241a8ed0 con 0x7f1424107a50 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f14100035b0 con 0x7f1424107a50 2024-02-13T14:46:17.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176942410 0 0) 0x7f14241a7cd0 con 0x7f142410a900 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14241a8ed0 con 0x7f142410a900 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f14200018f0 con 0x7f1424107a50 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3301107595 0 0) 0x7f14241a6af0 con 0x7f142410e4d0 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 >> v1:172.21.15.111:6789/0 conn(0x7f142410a900 legacy=0x7f14241a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 >> v1:172.21.15.62:6789/0 conn(0x7f1424107a50 legacy=0x7f142410dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14241aa0d0 con 0x7f142410e4d0 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.679+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14241a90c0 con 0x7f142410e4d0 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.683+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f14241a9540 con 0x7f142410e4d0 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.683+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f141c0020e0 con 0x7f142410e4d0 2024-02-13T14:46:17.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.683+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f141c004d00 con 0x7f142410e4d0 2024-02-13T14:46:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.683+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1408005120 con 0x7f142410e4d0 2024-02-13T14:46:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.683+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f141c003a00 con 0x7f142410e4d0 2024-02-13T14:46:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.683+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f141c087fb0 con 0x7f142410e4d0 2024-02-13T14:46:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.687+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f141c054da0 con 0x7f142410e4d0 2024-02-13T14:46:17.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- 172.21.15.62:0/140879362 >> v1:172.21.15.62:6789/0 conn(0x7f930c103ea0 legacy=0x7f930c104280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- 172.21.15.62:0/140879362 shutdown_connections 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- 172.21.15.62:0/140879362 >> 172.21.15.62:0/140879362 conn(0x7f930c0ff710 msgr2=0x7f930c101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- 172.21.15.62:0/140879362 shutdown_connections 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- 172.21.15.62:0/140879362 wait complete. 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 Processor -- start 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- start start 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f930c1a8af0 con 0x7f930c103ea0 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f930c1a9cd0 con 0x7f930c1106d0 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f931393c700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f930c1aaed0 con 0x7f930c10cb30 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f93116d8700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f930c103ea0 0x7f930c109080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48286/0 (socket says 172.21.15.62:48286) 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f93116d8700 1 -- 172.21.15.62:0/4158847142 learned_addr learned my addr 172.21.15.62:0/4158847142 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911898182 0 0) 0x7f930c1aaed0 con 0x7f930c10cb30 2024-02-13T14:46:17.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f80035b0 con 0x7f930c10cb30 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375192001 0 0) 0x7f930c1a8af0 con 0x7f930c103ea0 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.747+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f930c1aaed0 con 0x7f930c103ea0 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 798119998 0 0) 0x7f92f80035b0 con 0x7f930c10cb30 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f930c1a8af0 con 0x7f930c10cb30 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f93080018d0 con 0x7f930c10cb30 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3386577261 0 0) 0x7f930c1aaed0 con 0x7f930c103ea0 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f92f80035b0 con 0x7f930c103ea0 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f93000015d0 con 0x7f930c103ea0 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664372502 0 0) 0x7f930c1a9cd0 con 0x7f930c1106d0 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f930c1aaed0 con 0x7f930c1106d0 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 955386883 0 0) 0x7f930c1a8af0 con 0x7f930c10cb30 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 >> v1:172.21.15.111:6789/0 conn(0x7f930c1106d0 legacy=0x7f930c1a71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 >> v1:172.21.15.62:6789/0 conn(0x7f930c103ea0 legacy=0x7f930c109080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930c1ac0d0 con 0x7f930c10cb30 2024-02-13T14:46:17.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f930c1ab0c0 con 0x7f930c10cb30 2024-02-13T14:46:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f930c1ab540 con 0x7f930c10cb30 2024-02-13T14:46:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f9308003b10 con 0x7f930c10cb30 2024-02-13T14:46:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f9308004910 con 0x7f930c10cb30 2024-02-13T14:46:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f0005120 con 0x7f930c10cb30 2024-02-13T14:46:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f9308003680 con 0x7f930c10cb30 2024-02-13T14:46:17.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.751+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f9308087c70 con 0x7f930c10cb30 2024-02-13T14:46:17.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.755+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f9308054d30 con 0x7f930c10cb30 2024-02-13T14:46:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.903+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f14080053d0 con 0x7f142410e4d0 2024-02-13T14:46:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.903+0000 7f141a7fc700 1 -- 172.21.15.62:0/3883223687 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (unknown 383520633 0 2832570704) 0x7f141c0533a0 con 0x7f142410e4d0 2024-02-13T14:46:17.905 INFO:teuthology.orchestra.run.smithi062.stdout:107374182484 2024-02-13T14:46:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.907+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 >> v1:172.21.15.62:6800/3802446050 conn(0x7f141006ee70 legacy=0x7f1410071330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.907+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 >> v1:172.21.15.62:6790/0 conn(0x7f142410e4d0 legacy=0x7f14241a51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.907+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 shutdown_connections 2024-02-13T14:46:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.907+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 >> 172.21.15.62:0/3883223687 conn(0x7f14240fd540 msgr2=0x7f1424100780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.907+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 shutdown_connections 2024-02-13T14:46:17.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.907+0000 7f142b96c700 1 -- 172.21.15.62:0/3883223687 wait complete. 2024-02-13T14:46:17.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.967+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f92f00053d0 con 0x7f930c10cb30 2024-02-13T14:46:17.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.967+0000 7f92fe7fc700 1 -- 172.21.15.62:0/4158847142 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (unknown 832126871 0 1602814332) 0x7f93080530a0 con 0x7f930c10cb30 2024-02-13T14:46:17.970 INFO:teuthology.orchestra.run.smithi062.stdout:55834574951 2024-02-13T14:46:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.971+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 >> v1:172.21.15.62:6800/3802446050 conn(0x7f92f806eee0 legacy=0x7f92f80713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.971+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 >> v1:172.21.15.62:6790/0 conn(0x7f930c10cb30 legacy=0x7f930c1a3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.971+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 shutdown_connections 2024-02-13T14:46:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.971+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 >> 172.21.15.62:0/4158847142 conn(0x7f930c0ff710 msgr2=0x7f930c113bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.971+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 shutdown_connections 2024-02-13T14:46:17.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:17.971+0000 7f931393c700 1 -- 172.21.15.62:0/4158847142 wait complete. 2024-02-13T14:46:18.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:17 smithi062 bash[21479]: cluster 2024-02-13T14:46:16.692181+0000 mgr.y (mgr.14613) 100 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:18.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:17 smithi062 bash[21479]: audit 2024-02-13T14:46:17.237364+0000 mon.c (mon.2) 26 : audit 0 from='client.? v1:172.21.15.62:0/3316312186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-13T14:46:18.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:17 smithi062 bash[21479]: audit 2024-02-13T14:46:17.516484+0000 mon.c (mon.2) 27 : audit 0 from='client.? v1:172.21.15.62:0/751708286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-13T14:46:18.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:17 smithi062 bash[28859]: cluster 2024-02-13T14:46:16.692181+0000 mgr.y (mgr.14613) 100 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:18.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:17 smithi062 bash[28859]: audit 2024-02-13T14:46:17.237364+0000 mon.c (mon.2) 26 : audit 0 from='client.? v1:172.21.15.62:0/3316312186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-13T14:46:18.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:17 smithi062 bash[28859]: audit 2024-02-13T14:46:17.516484+0000 mon.c (mon.2) 27 : audit 0 from='client.? v1:172.21.15.62:0/751708286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-13T14:46:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:17 smithi111 bash[23388]: cluster 2024-02-13T14:46:16.692181+0000 mgr.y (mgr.14613) 100 : cluster 0 pgmap v59: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:17 smithi111 bash[23388]: audit 2024-02-13T14:46:17.237364+0000 mon.c (mon.2) 26 : audit 0 from='client.? v1:172.21.15.62:0/3316312186' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-13T14:46:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:17 smithi111 bash[23388]: audit 2024-02-13T14:46:17.516484+0000 mon.c (mon.2) 27 : audit 0 from='client.? v1:172.21.15.62:0/751708286' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-13T14:46:19.070 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:18 smithi062 bash[28859]: audit 2024-02-13T14:46:17.908210+0000 mon.c (mon.2) 28 : audit 0 from='client.? v1:172.21.15.62:0/3883223687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-13T14:46:19.070 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:18 smithi062 bash[28859]: audit 2024-02-13T14:46:17.972717+0000 mon.c (mon.2) 29 : audit 0 from='client.? v1:172.21.15.62:0/4158847142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-13T14:46:19.071 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:18 smithi062 bash[21479]: audit 2024-02-13T14:46:17.908210+0000 mon.c (mon.2) 28 : audit 0 from='client.? v1:172.21.15.62:0/3883223687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-13T14:46:19.071 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:18 smithi062 bash[21479]: audit 2024-02-13T14:46:17.972717+0000 mon.c (mon.2) 29 : audit 0 from='client.? v1:172.21.15.62:0/4158847142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-13T14:46:19.072 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757305 got 163208757310 for osd.5 2024-02-13T14:46:19.072 DEBUG:teuthology.parallel:result is None 2024-02-13T14:46:19.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:18 smithi111 bash[23388]: audit 2024-02-13T14:46:17.908210+0000 mon.c (mon.2) 28 : audit 0 from='client.? v1:172.21.15.62:0/3883223687' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-13T14:46:19.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:18 smithi111 bash[23388]: audit 2024-02-13T14:46:17.972717+0000 mon.c (mon.2) 29 : audit 0 from='client.? v1:172.21.15.62:0/4158847142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-13T14:46:19.119 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018947 got 128849018952 for osd.4 2024-02-13T14:46:19.120 DEBUG:teuthology.parallel:result is None 2024-02-13T14:46:20.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574946 got 55834574951 for osd.1 2024-02-13T14:46:20.004 DEBUG:teuthology.parallel:result is None 2024-02-13T14:46:20.011 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182479 got 107374182484 for osd.3 2024-02-13T14:46:20.011 DEBUG:teuthology.parallel:result is None 2024-02-13T14:46:20.011 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-13T14:46:20.012 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph pg dump --format=json 2024-02-13T14:46:20.065 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:19 smithi062 bash[21479]: cluster 2024-02-13T14:46:18.692880+0000 mgr.y (mgr.14613) 101 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:20.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:19 smithi062 bash[28859]: cluster 2024-02-13T14:46:18.692880+0000 mgr.y (mgr.14613) 101 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:20.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:46:19 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:46:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:19 smithi111 bash[23388]: cluster 2024-02-13T14:46:18.692880+0000 mgr.y (mgr.14613) 101 : cluster 0 pgmap v60: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:21.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:20 smithi111 bash[23388]: audit 2024-02-13T14:46:19.988873+0000 mgr.y (mgr.14613) 102 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:21.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:20 smithi062 bash[21479]: audit 2024-02-13T14:46:19.988873+0000 mgr.y (mgr.14613) 102 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:21.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:20 smithi062 bash[28859]: audit 2024-02-13T14:46:19.988873+0000 mgr.y (mgr.14613) 102 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:22.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[28859]: cluster 2024-02-13T14:46:20.693594+0000 mgr.y (mgr.14613) 103 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[28859]: audit 2024-02-13T14:46:21.061065+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[28859]: audit 2024-02-13T14:46:21.073626+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[28859]: audit 2024-02-13T14:46:21.653326+0000 mon.b (mon.1) 84 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[28859]: audit 2024-02-13T14:46:21.655530+0000 mon.b (mon.1) 85 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[28859]: audit 2024-02-13T14:46:21.666553+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[21479]: cluster 2024-02-13T14:46:20.693594+0000 mgr.y (mgr.14613) 103 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[21479]: audit 2024-02-13T14:46:21.061065+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[21479]: audit 2024-02-13T14:46:21.073626+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[21479]: audit 2024-02-13T14:46:21.653326+0000 mon.b (mon.1) 84 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[21479]: audit 2024-02-13T14:46:21.655530+0000 mon.b (mon.1) 85 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:46:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:22 smithi062 bash[21479]: audit 2024-02-13T14:46:21.666553+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:22 smithi111 bash[23388]: cluster 2024-02-13T14:46:20.693594+0000 mgr.y (mgr.14613) 103 : cluster 0 pgmap v61: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:22 smithi111 bash[23388]: audit 2024-02-13T14:46:21.061065+0000 mon.a (mon.0) 843 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:22 smithi111 bash[23388]: audit 2024-02-13T14:46:21.073626+0000 mon.a (mon.0) 844 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:22 smithi111 bash[23388]: audit 2024-02-13T14:46:21.653326+0000 mon.b (mon.1) 84 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:46:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:22 smithi111 bash[23388]: audit 2024-02-13T14:46:21.655530+0000 mon.b (mon.1) 85 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:46:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:22 smithi111 bash[23388]: audit 2024-02-13T14:46:21.666553+0000 mon.a (mon.0) 845 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:46:24.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:24 smithi111 bash[23388]: cluster 2024-02-13T14:46:22.694201+0000 mgr.y (mgr.14613) 104 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:24.542 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:46:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:24 smithi062 bash[28859]: cluster 2024-02-13T14:46:22.694201+0000 mgr.y (mgr.14613) 104 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:24.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:24 smithi062 bash[21479]: cluster 2024-02-13T14:46:22.694201+0000 mgr.y (mgr.14613) 104 : cluster 0 pgmap v62: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:26.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:26 smithi062 bash[21479]: cluster 2024-02-13T14:46:24.695640+0000 mgr.y (mgr.14613) 105 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:26.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:26 smithi062 bash[28859]: cluster 2024-02-13T14:46:24.695640+0000 mgr.y (mgr.14613) 105 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:26.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:26 smithi111 bash[23388]: cluster 2024-02-13T14:46:24.695640+0000 mgr.y (mgr.14613) 105 : cluster 0 pgmap v63: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:26.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:46:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:46:27.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- 172.21.15.62:0/1085467273 >> v1:172.21.15.62:6790/0 conn(0x7fb188107a50 legacy=0x7fb188107e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:27.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- 172.21.15.62:0/1085467273 shutdown_connections 2024-02-13T14:46:27.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- 172.21.15.62:0/1085467273 >> 172.21.15.62:0/1085467273 conn(0x7fb1880fd560 msgr2=0x7fb1880ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:27.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- 172.21.15.62:0/1085467273 shutdown_connections 2024-02-13T14:46:27.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- 172.21.15.62:0/1085467273 wait complete. 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 Processor -- start 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- start start 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb1881a8b50 con 0x7fb18810a900 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb1881a9d30 con 0x7fb188107a50 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb1881aaf10 con 0x7fb18810e4d0 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18d50d700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb18810a900 0x7fb1881a3c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:47986/0 (socket says 172.21.15.62:47986) 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18d50d700 1 -- 172.21.15.62:0/2653582307 learned_addr learned my addr 172.21.15.62:0/2653582307 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18e50f700 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fb18810e4d0 0x7fb1881a73a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:52274/0 (socket says 172.21.15.62:52274) 2024-02-13T14:46:27.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154011418 0 0) 0x7fb1881a8b50 con 0x7fb18810a900 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1740031f0 con 0x7fb18810a900 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488375899 0 0) 0x7fb1881aaf10 con 0x7fb18810e4d0 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1881a8b50 con 0x7fb18810e4d0 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339502937 0 0) 0x7fb1881a9d30 con 0x7fb188107a50 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1881aaf10 con 0x7fb188107a50 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4220030404 0 0) 0x7fb1740031f0 con 0x7fb18810a900 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb1881a9d30 con 0x7fb18810a900 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb1780019f0 con 0x7fb18810a900 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3942478621 0 0) 0x7fb1881a8b50 con 0x7fb18810e4d0 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb1740031f0 con 0x7fb18810e4d0 2024-02-13T14:46:27.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb180001af0 con 0x7fb18810e4d0 2024-02-13T14:46:27.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1733216790 0 0) 0x7fb1881a9d30 con 0x7fb18810a900 2024-02-13T14:46:27.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 >> v1:172.21.15.62:6790/0 conn(0x7fb18810e4d0 legacy=0x7fb1881a73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:27.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 >> v1:172.21.15.111:6789/0 conn(0x7fb188107a50 legacy=0x7fb188075870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:27.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1881ac110 con 0x7fb18810a900 2024-02-13T14:46:27.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.559+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1881a8d40 con 0x7fb18810a900 2024-02-13T14:46:27.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.563+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1881a91c0 con 0x7fb18810a900 2024-02-13T14:46:27.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.563+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fb178001c60 con 0x7fb18810a900 2024-02-13T14:46:27.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.563+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb178005c10 con 0x7fb18810a900 2024-02-13T14:46:27.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.563+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16c005150 con 0x7fb18810a900 2024-02-13T14:46:27.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.563+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fb178003930 con 0x7fb18810a900 2024-02-13T14:46:27.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.563+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7fb178088ee0 con 0x7fb18810a900 2024-02-13T14:46:27.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.567+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fb178055fa0 con 0x7fb18810a900 2024-02-13T14:46:27.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.775+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 --> v1:172.21.15.62:6800/3802446050 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb16c000bc0 con 0x7fb17406ee30 2024-02-13T14:46:27.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.815+0000 7fb17effd700 1 -- 172.21.15.62:0/2653582307 <== mgr.14613 v1:172.21.15.62:6800/3802446050 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+381827 (unknown 2965378022 0 436619292) 0x7fb16c000bc0 con 0x7fb17406ee30 2024-02-13T14:46:27.822 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:46:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.819+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 >> v1:172.21.15.62:6800/3802446050 conn(0x7fb17406ee30 legacy=0x7fb1740712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:27.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.819+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 >> v1:172.21.15.62:6789/0 conn(0x7fb18810a900 legacy=0x7fb1881a3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.819+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 shutdown_connections 2024-02-13T14:46:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.819+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 >> 172.21.15.62:0/2653582307 conn(0x7fb1880fd560 msgr2=0x7fb188100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.819+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 shutdown_connections 2024-02-13T14:46:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:27.819+0000 7fb18ff72700 1 -- 172.21.15.62:0/2653582307 wait complete. 2024-02-13T14:46:27.826 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-13T14:46:28.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:28 smithi062 bash[21479]: cluster 2024-02-13T14:46:26.696324+0000 mgr.y (mgr.14613) 106 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:28.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:28 smithi062 bash[28859]: cluster 2024-02-13T14:46:26.696324+0000 mgr.y (mgr.14613) 106 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:28.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:28 smithi111 bash[23388]: cluster 2024-02-13T14:46:26.696324+0000 mgr.y (mgr.14613) 106 : cluster 0 pgmap v64: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:28.553 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2024-02-13T14:46:26.695931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596316,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1100,"num_read_kb":946,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":626,"ondisk_log_size":626,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":244548,"kb_used_data":7580,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749716668,"statfs":{"total":767960285184,"available":767709868032,"internally_reserved":0,"allocated":7761920,"data_stored":4129756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005523"},"pg_stats":[{"pgid":"6.1b","version":"67'1","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025551+0000","last_change":"2024-02-13T14:43:41.077576+0000","last_active":"2024-02-13T14:45:30.025551+0000","last_peered":"2024-02-13T14:45:30.025551+0000","last_clean":"2024-02-13T14:45:30.025551+0000","last_became_active":"2024-02-13T14:43:41.075640+0000","last_became_peered":"2024-02-13T14:43:41.075640+0000","last_unstale":"2024-02-13T14:45:30.025551+0000","last_undegraded":"2024-02-13T14:45:30.025551+0000","last_fullsized":"2024-02-13T14:45:30.025551+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:19:15.831296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025133+0000","last_change":"2024-02-13T14:43:38.585426+0000","last_active":"2024-02-13T14:45:30.025133+0000","last_peered":"2024-02-13T14:45:30.025133+0000","last_clean":"2024-02-13T14:45:30.025133+0000","last_became_active":"2024-02-13T14:43:38.584997+0000","last_became_peered":"2024-02-13T14:43:38.584997+0000","last_unstale":"2024-02-13T14:45:30.025133+0000","last_undegraded":"2024-02-13T14:45:30.025133+0000","last_fullsized":"2024-02-13T14:45:30.025133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:11:39.641463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035489+0000","last_change":"2024-02-13T14:43:34.397455+0000","last_active":"2024-02-13T14:45:30.035489+0000","last_peered":"2024-02-13T14:45:30.035489+0000","last_clean":"2024-02-13T14:45:30.035489+0000","last_became_active":"2024-02-13T14:43:34.397092+0000","last_became_peered":"2024-02-13T14:43:34.397092+0000","last_unstale":"2024-02-13T14:45:30.035489+0000","last_undegraded":"2024-02-13T14:45:30.035489+0000","last_fullsized":"2024-02-13T14:45:30.035489+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:48:47.259278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'10","reported_seq":50,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031095+0000","last_change":"2024-02-13T14:43:36.548135+0000","last_active":"2024-02-13T14:45:30.031095+0000","last_peered":"2024-02-13T14:45:30.031095+0000","last_clean":"2024-02-13T14:45:30.031095+0000","last_became_active":"2024-02-13T14:43:36.547737+0000","last_became_peered":"2024-02-13T14:43:36.547737+0000","last_unstale":"2024-02-13T14:45:30.031095+0000","last_undegraded":"2024-02-13T14:45:30.031095+0000","last_fullsized":"2024-02-13T14:45:30.031095+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:04:20.538260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025447+0000","last_change":"2024-02-13T14:43:40.639107+0000","last_active":"2024-02-13T14:45:30.025447+0000","last_peered":"2024-02-13T14:45:30.025447+0000","last_clean":"2024-02-13T14:45:30.025447+0000","last_became_active":"2024-02-13T14:43:40.636514+0000","last_became_peered":"2024-02-13T14:43:40.636514+0000","last_unstale":"2024-02-13T14:45:30.025447+0000","last_undegraded":"2024-02-13T14:45:30.025447+0000","last_fullsized":"2024-02-13T14:45:30.025447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:35:18.185885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026418+0000","last_change":"2024-02-13T14:43:38.601065+0000","last_active":"2024-02-13T14:45:30.026418+0000","last_peered":"2024-02-13T14:45:30.026418+0000","last_clean":"2024-02-13T14:45:30.026418+0000","last_became_active":"2024-02-13T14:43:38.600530+0000","last_became_peered":"2024-02-13T14:43:38.600530+0000","last_unstale":"2024-02-13T14:45:30.026418+0000","last_undegraded":"2024-02-13T14:45:30.026418+0000","last_fullsized":"2024-02-13T14:45:30.026418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:53:58.732553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031670+0000","last_change":"2024-02-13T14:43:34.402344+0000","last_active":"2024-02-13T14:45:30.031670+0000","last_peered":"2024-02-13T14:45:30.031670+0000","last_clean":"2024-02-13T14:45:30.031670+0000","last_became_active":"2024-02-13T14:43:34.401846+0000","last_became_peered":"2024-02-13T14:43:34.401846+0000","last_unstale":"2024-02-13T14:45:30.031670+0000","last_undegraded":"2024-02-13T14:45:30.031670+0000","last_fullsized":"2024-02-13T14:45:30.031670+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:49:31.325733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035406+0000","last_change":"2024-02-13T14:43:36.548122+0000","last_active":"2024-02-13T14:45:30.035406+0000","last_peered":"2024-02-13T14:45:30.035406+0000","last_clean":"2024-02-13T14:45:30.035406+0000","last_became_active":"2024-02-13T14:43:36.547716+0000","last_became_peered":"2024-02-13T14:43:36.547716+0000","last_unstale":"2024-02-13T14:45:30.035406+0000","last_undegraded":"2024-02-13T14:45:30.035406+0000","last_fullsized":"2024-02-13T14:45:30.035406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:08:54.967282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101128+0000","last_change":"2024-02-13T14:43:40.660449+0000","last_active":"2024-02-13T14:45:30.101128+0000","last_peered":"2024-02-13T14:45:30.101128+0000","last_clean":"2024-02-13T14:45:30.101128+0000","last_became_active":"2024-02-13T14:43:40.659543+0000","last_became_peered":"2024-02-13T14:43:40.659543+0000","last_unstale":"2024-02-13T14:45:30.101128+0000","last_undegraded":"2024-02-13T14:45:30.101128+0000","last_fullsized":"2024-02-13T14:45:30.101128+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:17:22.125224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098174+0000","last_change":"2024-02-13T14:43:38.598047+0000","last_active":"2024-02-13T14:45:30.098174+0000","last_peered":"2024-02-13T14:45:30.098174+0000","last_clean":"2024-02-13T14:45:30.098174+0000","last_became_active":"2024-02-13T14:43:38.596306+0000","last_became_peered":"2024-02-13T14:43:38.596306+0000","last_unstale":"2024-02-13T14:45:30.098174+0000","last_undegraded":"2024-02-13T14:45:30.098174+0000","last_fullsized":"2024-02-13T14:45:30.098174+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:13:26.845570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"60'1","reported_seq":47,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100930+0000","last_change":"2024-02-13T14:43:34.409085+0000","last_active":"2024-02-13T14:45:30.100930+0000","last_peered":"2024-02-13T14:45:30.100930+0000","last_clean":"2024-02-13T14:45:30.100930+0000","last_became_active":"2024-02-13T14:43:34.408077+0000","last_became_peered":"2024-02-13T14:43:34.408077+0000","last_unstale":"2024-02-13T14:45:30.100930+0000","last_undegraded":"2024-02-13T14:45:30.100930+0000","last_fullsized":"2024-02-13T14:45:30.100930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:32:57.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104089+0000","last_change":"2024-02-13T14:43:36.414326+0000","last_active":"2024-02-13T14:45:30.104089+0000","last_peered":"2024-02-13T14:45:30.104089+0000","last_clean":"2024-02-13T14:45:30.104089+0000","last_became_active":"2024-02-13T14:43:36.413940+0000","last_became_peered":"2024-02-13T14:43:36.413940+0000","last_unstale":"2024-02-13T14:45:30.104089+0000","last_undegraded":"2024-02-13T14:45:30.104089+0000","last_fullsized":"2024-02-13T14:45:30.104089+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:00:14.848648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033370+0000","last_change":"2024-02-13T14:43:40.654415+0000","last_active":"2024-02-13T14:45:30.033370+0000","last_peered":"2024-02-13T14:45:30.033370+0000","last_clean":"2024-02-13T14:45:30.033370+0000","last_became_active":"2024-02-13T14:43:40.653117+0000","last_became_peered":"2024-02-13T14:43:40.653117+0000","last_unstale":"2024-02-13T14:45:30.033370+0000","last_undegraded":"2024-02-13T14:45:30.033370+0000","last_fullsized":"2024-02-13T14:45:30.033370+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:52:11.182928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.102338+0000","last_change":"2024-02-13T14:43:38.610948+0000","last_active":"2024-02-13T14:45:30.102338+0000","last_peered":"2024-02-13T14:45:30.102338+0000","last_clean":"2024-02-13T14:45:30.102338+0000","last_became_active":"2024-02-13T14:43:38.610145+0000","last_became_peered":"2024-02-13T14:43:38.610145+0000","last_unstale":"2024-02-13T14:45:30.102338+0000","last_undegraded":"2024-02-13T14:45:30.102338+0000","last_fullsized":"2024-02-13T14:45:30.102338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:45:15.767650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100499+0000","last_change":"2024-02-13T14:43:34.405952+0000","last_active":"2024-02-13T14:45:30.100499+0000","last_peered":"2024-02-13T14:45:30.100499+0000","last_clean":"2024-02-13T14:45:30.100499+0000","last_became_active":"2024-02-13T14:43:34.405079+0000","last_became_peered":"2024-02-13T14:43:34.405079+0000","last_unstale":"2024-02-13T14:45:30.100499+0000","last_undegraded":"2024-02-13T14:45:30.100499+0000","last_fullsized":"2024-02-13T14:45:30.100499+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:14:16.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.103509+0000","last_change":"2024-02-13T14:43:36.407371+0000","last_active":"2024-02-13T14:45:30.103509+0000","last_peered":"2024-02-13T14:45:30.103509+0000","last_clean":"2024-02-13T14:45:30.103509+0000","last_became_active":"2024-02-13T14:43:36.406930+0000","last_became_peered":"2024-02-13T14:43:36.406930+0000","last_unstale":"2024-02-13T14:45:30.103509+0000","last_undegraded":"2024-02-13T14:45:30.103509+0000","last_fullsized":"2024-02-13T14:45:30.103509+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:00:46.211437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.032521+0000","last_change":"2024-02-13T14:43:41.071540+0000","last_active":"2024-02-13T14:45:30.032521+0000","last_peered":"2024-02-13T14:45:30.032521+0000","last_clean":"2024-02-13T14:45:30.032521+0000","last_became_active":"2024-02-13T14:43:41.070169+0000","last_became_peered":"2024-02-13T14:43:41.070169+0000","last_unstale":"2024-02-13T14:45:30.032521+0000","last_undegraded":"2024-02-13T14:45:30.032521+0000","last_fullsized":"2024-02-13T14:45:30.032521+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:22:14.394810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026547+0000","last_change":"2024-02-13T14:43:38.610170+0000","last_active":"2024-02-13T14:45:30.026547+0000","last_peered":"2024-02-13T14:45:30.026547+0000","last_clean":"2024-02-13T14:45:30.026547+0000","last_became_active":"2024-02-13T14:43:38.609739+0000","last_became_peered":"2024-02-13T14:43:38.609739+0000","last_unstale":"2024-02-13T14:45:30.026547+0000","last_undegraded":"2024-02-13T14:45:30.026547+0000","last_fullsized":"2024-02-13T14:45:30.026547+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:04:51.304582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104469+0000","last_change":"2024-02-13T14:45:30.103672+0000","last_active":"2024-02-13T14:45:30.104469+0000","last_peered":"2024-02-13T14:45:30.104469+0000","last_clean":"2024-02-13T14:45:30.104469+0000","last_became_active":"2024-02-13T14:45:30.102564+0000","last_became_peered":"2024-02-13T14:45:30.102564+0000","last_unstale":"2024-02-13T14:45:30.104469+0000","last_undegraded":"2024-02-13T14:45:30.104469+0000","last_fullsized":"2024-02-13T14:45:30.104469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:26:21.462462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026534+0000","last_change":"2024-02-13T14:43:36.547956+0000","last_active":"2024-02-13T14:45:30.026534+0000","last_peered":"2024-02-13T14:45:30.026534+0000","last_clean":"2024-02-13T14:45:30.026534+0000","last_became_active":"2024-02-13T14:43:36.547533+0000","last_became_peered":"2024-02-13T14:43:36.547533+0000","last_unstale":"2024-02-13T14:45:30.026534+0000","last_undegraded":"2024-02-13T14:45:30.026534+0000","last_fullsized":"2024-02-13T14:45:30.026534+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:16:00.036174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027529+0000","last_change":"2024-02-13T14:43:41.071345+0000","last_active":"2024-02-13T14:45:30.027529+0000","last_peered":"2024-02-13T14:45:30.027529+0000","last_clean":"2024-02-13T14:45:30.027529+0000","last_became_active":"2024-02-13T14:43:41.070508+0000","last_became_peered":"2024-02-13T14:43:41.070508+0000","last_unstale":"2024-02-13T14:45:30.027529+0000","last_undegraded":"2024-02-13T14:45:30.027529+0000","last_fullsized":"2024-02-13T14:45:30.027529+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:35:27.630663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027786+0000","last_change":"2024-02-13T14:43:38.604772+0000","last_active":"2024-02-13T14:45:30.027786+0000","last_peered":"2024-02-13T14:45:30.027786+0000","last_clean":"2024-02-13T14:45:30.027786+0000","last_became_active":"2024-02-13T14:43:38.604230+0000","last_became_peered":"2024-02-13T14:43:38.604230+0000","last_unstale":"2024-02-13T14:45:30.027786+0000","last_undegraded":"2024-02-13T14:45:30.027786+0000","last_fullsized":"2024-02-13T14:45:30.027786+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:19:40.846301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099329+0000","last_change":"2024-02-13T14:43:34.416593+0000","last_active":"2024-02-13T14:45:30.099329+0000","last_peered":"2024-02-13T14:45:30.099329+0000","last_clean":"2024-02-13T14:45:30.099329+0000","last_became_active":"2024-02-13T14:43:34.415883+0000","last_became_peered":"2024-02-13T14:43:34.415883+0000","last_unstale":"2024-02-13T14:45:30.099329+0000","last_undegraded":"2024-02-13T14:45:30.099329+0000","last_fullsized":"2024-02-13T14:45:30.099329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:12:21.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'5","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035670+0000","last_change":"2024-02-13T14:43:36.420806+0000","last_active":"2024-02-13T14:45:30.035670+0000","last_peered":"2024-02-13T14:45:30.035670+0000","last_clean":"2024-02-13T14:45:30.035670+0000","last_became_active":"2024-02-13T14:43:36.416670+0000","last_became_peered":"2024-02-13T14:43:36.416670+0000","last_unstale":"2024-02-13T14:45:30.035670+0000","last_undegraded":"2024-02-13T14:45:30.035670+0000","last_fullsized":"2024-02-13T14:45:30.035670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:08:31.828307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.028054+0000","last_change":"2024-02-13T14:43:40.644411+0000","last_active":"2024-02-13T14:45:30.028054+0000","last_peered":"2024-02-13T14:45:30.028054+0000","last_clean":"2024-02-13T14:45:30.028054+0000","last_became_active":"2024-02-13T14:43:40.643570+0000","last_became_peered":"2024-02-13T14:43:40.643570+0000","last_unstale":"2024-02-13T14:45:30.028054+0000","last_undegraded":"2024-02-13T14:45:30.028054+0000","last_fullsized":"2024-02-13T14:45:30.028054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:41:19.571448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035263+0000","last_change":"2024-02-13T14:43:38.585484+0000","last_active":"2024-02-13T14:45:30.035263+0000","last_peered":"2024-02-13T14:45:30.035263+0000","last_clean":"2024-02-13T14:45:30.035263+0000","last_became_active":"2024-02-13T14:43:38.584143+0000","last_became_peered":"2024-02-13T14:43:38.584143+0000","last_unstale":"2024-02-13T14:45:30.035263+0000","last_undegraded":"2024-02-13T14:45:30.035263+0000","last_fullsized":"2024-02-13T14:45:30.035263+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:39:30.445955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"60'1","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025989+0000","last_change":"2024-02-13T14:43:34.412618+0000","last_active":"2024-02-13T14:45:30.025989+0000","last_peered":"2024-02-13T14:45:30.025989+0000","last_clean":"2024-02-13T14:45:30.025989+0000","last_became_active":"2024-02-13T14:43:34.412308+0000","last_became_peered":"2024-02-13T14:43:34.412308+0000","last_unstale":"2024-02-13T14:45:30.025989+0000","last_undegraded":"2024-02-13T14:45:30.025989+0000","last_fullsized":"2024-02-13T14:45:30.025989+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:59:28.336275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'9","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.029379+0000","last_change":"2024-02-13T14:43:36.418590+0000","last_active":"2024-02-13T14:45:30.029379+0000","last_peered":"2024-02-13T14:45:30.029379+0000","last_clean":"2024-02-13T14:45:30.029379+0000","last_became_active":"2024-02-13T14:43:36.414905+0000","last_became_peered":"2024-02-13T14:43:36.414905+0000","last_unstale":"2024-02-13T14:45:30.029379+0000","last_undegraded":"2024-02-13T14:45:30.029379+0000","last_fullsized":"2024-02-13T14:45:30.029379+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:00:53.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101922+0000","last_change":"2024-02-13T14:43:40.651423+0000","last_active":"2024-02-13T14:45:30.101922+0000","last_peered":"2024-02-13T14:45:30.101922+0000","last_clean":"2024-02-13T14:45:30.101922+0000","last_became_active":"2024-02-13T14:43:40.650649+0000","last_became_peered":"2024-02-13T14:43:40.650649+0000","last_unstale":"2024-02-13T14:45:30.101922+0000","last_undegraded":"2024-02-13T14:45:30.101922+0000","last_fullsized":"2024-02-13T14:45:30.101922+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:13:56.120241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"67'11","reported_seq":83,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607815+0000","last_change":"2024-02-13T14:43:38.594934+0000","last_active":"2024-02-13T14:46:19.607815+0000","last_peered":"2024-02-13T14:46:19.607815+0000","last_clean":"2024-02-13T14:46:19.607815+0000","last_became_active":"2024-02-13T14:43:38.594407+0000","last_became_peered":"2024-02-13T14:43:38.594407+0000","last_unstale":"2024-02-13T14:46:19.607815+0000","last_undegraded":"2024-02-13T14:46:19.607815+0000","last_fullsized":"2024-02-13T14:46:19.607815+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:00:57.577752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100303+0000","last_change":"2024-02-13T14:43:34.409165+0000","last_active":"2024-02-13T14:45:30.100303+0000","last_peered":"2024-02-13T14:45:30.100303+0000","last_clean":"2024-02-13T14:45:30.100303+0000","last_became_active":"2024-02-13T14:43:34.408187+0000","last_became_peered":"2024-02-13T14:43:34.408187+0000","last_unstale":"2024-02-13T14:45:30.100303+0000","last_undegraded":"2024-02-13T14:45:30.100303+0000","last_fullsized":"2024-02-13T14:45:30.100303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:11:50.089140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025985+0000","last_change":"2024-02-13T14:43:36.411974+0000","last_active":"2024-02-13T14:45:30.025985+0000","last_peered":"2024-02-13T14:45:30.025985+0000","last_clean":"2024-02-13T14:45:30.025985+0000","last_became_active":"2024-02-13T14:43:36.411078+0000","last_became_peered":"2024-02-13T14:43:36.411078+0000","last_unstale":"2024-02-13T14:45:30.025985+0000","last_undegraded":"2024-02-13T14:45:30.025985+0000","last_fullsized":"2024-02-13T14:45:30.025985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:58:28.871172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031518+0000","last_change":"2024-02-13T14:43:41.077014+0000","last_active":"2024-02-13T14:45:30.031518+0000","last_peered":"2024-02-13T14:45:30.031518+0000","last_clean":"2024-02-13T14:45:30.031518+0000","last_became_active":"2024-02-13T14:43:41.075559+0000","last_became_peered":"2024-02-13T14:43:41.075559+0000","last_unstale":"2024-02-13T14:45:30.031518+0000","last_undegraded":"2024-02-13T14:45:30.031518+0000","last_fullsized":"2024-02-13T14:45:30.031518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:59:07.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097975+0000","last_change":"2024-02-13T14:43:38.606016+0000","last_active":"2024-02-13T14:45:30.097975+0000","last_peered":"2024-02-13T14:45:30.097975+0000","last_clean":"2024-02-13T14:45:30.097975+0000","last_became_active":"2024-02-13T14:43:38.605511+0000","last_became_peered":"2024-02-13T14:43:38.605511+0000","last_unstale":"2024-02-13T14:45:30.097975+0000","last_undegraded":"2024-02-13T14:45:30.097975+0000","last_fullsized":"2024-02-13T14:45:30.097975+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:08:05.814881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101628+0000","last_change":"2024-02-13T14:43:34.423921+0000","last_active":"2024-02-13T14:45:30.101628+0000","last_peered":"2024-02-13T14:45:30.101628+0000","last_clean":"2024-02-13T14:45:30.101628+0000","last_became_active":"2024-02-13T14:43:34.423178+0000","last_became_peered":"2024-02-13T14:43:34.423178+0000","last_unstale":"2024-02-13T14:45:30.101628+0000","last_undegraded":"2024-02-13T14:45:30.101628+0000","last_fullsized":"2024-02-13T14:45:30.101628+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:29:56.629846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.103298+0000","last_change":"2024-02-13T14:43:36.414138+0000","last_active":"2024-02-13T14:45:30.103298+0000","last_peered":"2024-02-13T14:45:30.103298+0000","last_clean":"2024-02-13T14:45:30.103298+0000","last_became_active":"2024-02-13T14:43:36.413048+0000","last_became_peered":"2024-02-13T14:43:36.413048+0000","last_unstale":"2024-02-13T14:45:30.103298+0000","last_undegraded":"2024-02-13T14:45:30.103298+0000","last_fullsized":"2024-02-13T14:45:30.103298+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:10:46.093288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097716+0000","last_change":"2024-02-13T14:43:40.649345+0000","last_active":"2024-02-13T14:45:30.097716+0000","last_peered":"2024-02-13T14:45:30.097716+0000","last_clean":"2024-02-13T14:45:30.097716+0000","last_became_active":"2024-02-13T14:43:40.648303+0000","last_became_peered":"2024-02-13T14:43:40.648303+0000","last_unstale":"2024-02-13T14:45:30.097716+0000","last_undegraded":"2024-02-13T14:45:30.097716+0000","last_fullsized":"2024-02-13T14:45:30.097716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:41:39.558579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098979+0000","last_change":"2024-02-13T14:43:38.590758+0000","last_active":"2024-02-13T14:45:30.098979+0000","last_peered":"2024-02-13T14:45:30.098979+0000","last_clean":"2024-02-13T14:45:30.098979+0000","last_became_active":"2024-02-13T14:43:38.589655+0000","last_became_peered":"2024-02-13T14:43:38.589655+0000","last_unstale":"2024-02-13T14:45:30.098979+0000","last_undegraded":"2024-02-13T14:45:30.098979+0000","last_fullsized":"2024-02-13T14:45:30.098979+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:26:04.863247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104173+0000","last_change":"2024-02-13T14:43:34.396569+0000","last_active":"2024-02-13T14:45:30.104173+0000","last_peered":"2024-02-13T14:45:30.104173+0000","last_clean":"2024-02-13T14:45:30.104173+0000","last_became_active":"2024-02-13T14:43:34.394454+0000","last_became_peered":"2024-02-13T14:43:34.394454+0000","last_unstale":"2024-02-13T14:45:30.104173+0000","last_undegraded":"2024-02-13T14:45:30.104173+0000","last_fullsized":"2024-02-13T14:45:30.104173+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:11:14.981297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"67'6","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035232+0000","last_change":"2024-02-13T14:43:36.427172+0000","last_active":"2024-02-13T14:45:30.035232+0000","last_peered":"2024-02-13T14:45:30.035232+0000","last_clean":"2024-02-13T14:45:30.035232+0000","last_became_active":"2024-02-13T14:43:36.426157+0000","last_became_peered":"2024-02-13T14:43:36.426157+0000","last_unstale":"2024-02-13T14:45:30.035232+0000","last_undegraded":"2024-02-13T14:45:30.035232+0000","last_fullsized":"2024-02-13T14:45:30.035232+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:11:26.475496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025718+0000","last_change":"2024-02-13T14:43:40.654721+0000","last_active":"2024-02-13T14:45:30.025718+0000","last_peered":"2024-02-13T14:45:30.025718+0000","last_clean":"2024-02-13T14:45:30.025718+0000","last_became_active":"2024-02-13T14:43:40.653912+0000","last_became_peered":"2024-02-13T14:43:40.653912+0000","last_unstale":"2024-02-13T14:45:30.025718+0000","last_undegraded":"2024-02-13T14:45:30.025718+0000","last_fullsized":"2024-02-13T14:45:30.025718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:43:47.477628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027426+0000","last_change":"2024-02-13T14:43:38.609232+0000","last_active":"2024-02-13T14:45:30.027426+0000","last_peered":"2024-02-13T14:45:30.027426+0000","last_clean":"2024-02-13T14:45:30.027426+0000","last_became_active":"2024-02-13T14:43:38.608315+0000","last_became_peered":"2024-02-13T14:43:38.608315+0000","last_unstale":"2024-02-13T14:45:30.027426+0000","last_undegraded":"2024-02-13T14:45:30.027426+0000","last_fullsized":"2024-02-13T14:45:30.027426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:57:38.062519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026918+0000","last_change":"2024-02-13T14:43:34.398663+0000","last_active":"2024-02-13T14:45:30.026918+0000","last_peered":"2024-02-13T14:45:30.026918+0000","last_clean":"2024-02-13T14:45:30.026918+0000","last_became_active":"2024-02-13T14:43:34.398287+0000","last_became_peered":"2024-02-13T14:43:34.398287+0000","last_unstale":"2024-02-13T14:45:30.026918+0000","last_undegraded":"2024-02-13T14:45:30.026918+0000","last_fullsized":"2024-02-13T14:45:30.026918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:30:30.050584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026085+0000","last_change":"2024-02-13T14:43:36.408314+0000","last_active":"2024-02-13T14:45:30.026085+0000","last_peered":"2024-02-13T14:45:30.026085+0000","last_clean":"2024-02-13T14:45:30.026085+0000","last_became_active":"2024-02-13T14:43:36.407891+0000","last_became_peered":"2024-02-13T14:43:36.407891+0000","last_unstale":"2024-02-13T14:45:30.026085+0000","last_undegraded":"2024-02-13T14:45:30.026085+0000","last_fullsized":"2024-02-13T14:45:30.026085+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:20:51.354944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033092+0000","last_change":"2024-02-13T14:43:40.664206+0000","last_active":"2024-02-13T14:45:30.033092+0000","last_peered":"2024-02-13T14:45:30.033092+0000","last_clean":"2024-02-13T14:45:30.033092+0000","last_became_active":"2024-02-13T14:43:40.654663+0000","last_became_peered":"2024-02-13T14:43:40.654663+0000","last_unstale":"2024-02-13T14:45:30.033092+0000","last_undegraded":"2024-02-13T14:45:30.033092+0000","last_fullsized":"2024-02-13T14:45:30.033092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:59:26.438166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031079+0000","last_change":"2024-02-13T14:43:38.604703+0000","last_active":"2024-02-13T14:45:30.031079+0000","last_peered":"2024-02-13T14:45:30.031079+0000","last_clean":"2024-02-13T14:45:30.031079+0000","last_became_active":"2024-02-13T14:43:38.603902+0000","last_became_peered":"2024-02-13T14:43:38.603902+0000","last_unstale":"2024-02-13T14:45:30.031079+0000","last_undegraded":"2024-02-13T14:45:30.031079+0000","last_fullsized":"2024-02-13T14:45:30.031079+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:33:41.346058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100828+0000","last_change":"2024-02-13T14:43:34.421243+0000","last_active":"2024-02-13T14:45:30.100828+0000","last_peered":"2024-02-13T14:45:30.100828+0000","last_clean":"2024-02-13T14:45:30.100828+0000","last_became_active":"2024-02-13T14:43:34.420558+0000","last_became_peered":"2024-02-13T14:43:34.420558+0000","last_unstale":"2024-02-13T14:45:30.100828+0000","last_undegraded":"2024-02-13T14:45:30.100828+0000","last_fullsized":"2024-02-13T14:45:30.100828+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:55:12.994592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"67'9","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101201+0000","last_change":"2024-02-13T14:43:36.408106+0000","last_active":"2024-02-13T14:45:30.101201+0000","last_peered":"2024-02-13T14:45:30.101201+0000","last_clean":"2024-02-13T14:45:30.101201+0000","last_became_active":"2024-02-13T14:43:36.407838+0000","last_became_peered":"2024-02-13T14:43:36.407838+0000","last_unstale":"2024-02-13T14:45:30.101201+0000","last_undegraded":"2024-02-13T14:45:30.101201+0000","last_fullsized":"2024-02-13T14:45:30.101201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:46:29.140052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027423+0000","last_change":"2024-02-13T14:43:40.645153+0000","last_active":"2024-02-13T14:45:30.027423+0000","last_peered":"2024-02-13T14:45:30.027423+0000","last_clean":"2024-02-13T14:45:30.027423+0000","last_became_active":"2024-02-13T14:43:40.644206+0000","last_became_peered":"2024-02-13T14:43:40.644206+0000","last_unstale":"2024-02-13T14:45:30.027423+0000","last_undegraded":"2024-02-13T14:45:30.027423+0000","last_fullsized":"2024-02-13T14:45:30.027423+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:29:56.638474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.608348+0000","last_change":"2024-02-13T14:43:38.604997+0000","last_active":"2024-02-13T14:46:19.608348+0000","last_peered":"2024-02-13T14:46:19.608348+0000","last_clean":"2024-02-13T14:46:19.608348+0000","last_became_active":"2024-02-13T14:43:38.604048+0000","last_became_peered":"2024-02-13T14:43:38.604048+0000","last_unstale":"2024-02-13T14:46:19.608348+0000","last_undegraded":"2024-02-13T14:46:19.608348+0000","last_fullsized":"2024-02-13T14:46:19.608348+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:51:09.297727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035834+0000","last_change":"2024-02-13T14:43:34.395935+0000","last_active":"2024-02-13T14:45:30.035834+0000","last_peered":"2024-02-13T14:45:30.035834+0000","last_clean":"2024-02-13T14:45:30.035834+0000","last_became_active":"2024-02-13T14:43:34.394891+0000","last_became_peered":"2024-02-13T14:43:34.394891+0000","last_unstale":"2024-02-13T14:45:30.035834+0000","last_undegraded":"2024-02-13T14:45:30.035834+0000","last_fullsized":"2024-02-13T14:45:30.035834+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:54:20.234779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.034526+0000","last_change":"2024-02-13T14:43:36.425566+0000","last_active":"2024-02-13T14:45:30.034526+0000","last_peered":"2024-02-13T14:45:30.034526+0000","last_clean":"2024-02-13T14:45:30.034526+0000","last_became_active":"2024-02-13T14:43:36.424693+0000","last_became_peered":"2024-02-13T14:43:36.424693+0000","last_unstale":"2024-02-13T14:45:30.034526+0000","last_undegraded":"2024-02-13T14:45:30.034526+0000","last_fullsized":"2024-02-13T14:45:30.034526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:11:09.257409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.034931+0000","last_change":"2024-02-13T14:43:40.655616+0000","last_active":"2024-02-13T14:45:30.034931+0000","last_peered":"2024-02-13T14:45:30.034931+0000","last_clean":"2024-02-13T14:45:30.034931+0000","last_became_active":"2024-02-13T14:43:40.654559+0000","last_became_peered":"2024-02-13T14:43:40.654559+0000","last_unstale":"2024-02-13T14:45:30.034931+0000","last_undegraded":"2024-02-13T14:45:30.034931+0000","last_fullsized":"2024-02-13T14:45:30.034931+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:34:04.826689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607683+0000","last_change":"2024-02-13T14:43:38.613232+0000","last_active":"2024-02-13T14:46:19.607683+0000","last_peered":"2024-02-13T14:46:19.607683+0000","last_clean":"2024-02-13T14:46:19.607683+0000","last_became_active":"2024-02-13T14:43:38.612636+0000","last_became_peered":"2024-02-13T14:43:38.612636+0000","last_unstale":"2024-02-13T14:46:19.607683+0000","last_undegraded":"2024-02-13T14:46:19.607683+0000","last_fullsized":"2024-02-13T14:46:19.607683+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:36:57.002295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100187+0000","last_change":"2024-02-13T14:43:34.411694+0000","last_active":"2024-02-13T14:45:30.100187+0000","last_peered":"2024-02-13T14:45:30.100187+0000","last_clean":"2024-02-13T14:45:30.100187+0000","last_became_active":"2024-02-13T14:43:34.410711+0000","last_became_peered":"2024-02-13T14:43:34.410711+0000","last_unstale":"2024-02-13T14:45:30.100187+0000","last_undegraded":"2024-02-13T14:45:30.100187+0000","last_fullsized":"2024-02-13T14:45:30.100187+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:35:37.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101897+0000","last_change":"2024-02-13T14:43:36.550281+0000","last_active":"2024-02-13T14:45:30.101897+0000","last_peered":"2024-02-13T14:45:30.101897+0000","last_clean":"2024-02-13T14:45:30.101897+0000","last_became_active":"2024-02-13T14:43:36.549769+0000","last_became_peered":"2024-02-13T14:43:36.549769+0000","last_unstale":"2024-02-13T14:45:30.101897+0000","last_undegraded":"2024-02-13T14:45:30.101897+0000","last_fullsized":"2024-02-13T14:45:30.101897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:42:36.018067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100646+0000","last_change":"2024-02-13T14:43:41.073322+0000","last_active":"2024-02-13T14:45:30.100646+0000","last_peered":"2024-02-13T14:45:30.100646+0000","last_clean":"2024-02-13T14:45:30.100646+0000","last_became_active":"2024-02-13T14:43:41.072424+0000","last_became_peered":"2024-02-13T14:43:41.072424+0000","last_unstale":"2024-02-13T14:45:30.100646+0000","last_undegraded":"2024-02-13T14:45:30.100646+0000","last_fullsized":"2024-02-13T14:45:30.100646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:58:53.528233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104452+0000","last_change":"2024-02-13T14:43:38.606673+0000","last_active":"2024-02-13T14:45:30.104452+0000","last_peered":"2024-02-13T14:45:30.104452+0000","last_clean":"2024-02-13T14:45:30.104452+0000","last_became_active":"2024-02-13T14:43:38.605756+0000","last_became_peered":"2024-02-13T14:43:38.605756+0000","last_unstale":"2024-02-13T14:45:30.104452+0000","last_undegraded":"2024-02-13T14:45:30.104452+0000","last_fullsized":"2024-02-13T14:45:30.104452+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:28:46.776873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099349+0000","last_change":"2024-02-13T14:43:34.412693+0000","last_active":"2024-02-13T14:45:30.099349+0000","last_peered":"2024-02-13T14:45:30.099349+0000","last_clean":"2024-02-13T14:45:30.099349+0000","last_became_active":"2024-02-13T14:43:34.410736+0000","last_became_peered":"2024-02-13T14:43:34.410736+0000","last_unstale":"2024-02-13T14:45:30.099349+0000","last_undegraded":"2024-02-13T14:45:30.099349+0000","last_fullsized":"2024-02-13T14:45:30.099349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:27:02.711192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099138+0000","last_change":"2024-02-13T14:43:36.413948+0000","last_active":"2024-02-13T14:45:30.099138+0000","last_peered":"2024-02-13T14:45:30.099138+0000","last_clean":"2024-02-13T14:45:30.099138+0000","last_became_active":"2024-02-13T14:43:36.413615+0000","last_became_peered":"2024-02-13T14:43:36.413615+0000","last_unstale":"2024-02-13T14:45:30.099138+0000","last_undegraded":"2024-02-13T14:45:30.099138+0000","last_fullsized":"2024-02-13T14:45:30.099138+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:51:20.009395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098961+0000","last_change":"2024-02-13T14:43:40.651699+0000","last_active":"2024-02-13T14:45:30.098961+0000","last_peered":"2024-02-13T14:45:30.098961+0000","last_clean":"2024-02-13T14:45:30.098961+0000","last_became_active":"2024-02-13T14:43:40.648932+0000","last_became_peered":"2024-02-13T14:43:40.648932+0000","last_unstale":"2024-02-13T14:45:30.098961+0000","last_undegraded":"2024-02-13T14:45:30.098961+0000","last_fullsized":"2024-02-13T14:45:30.098961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:35:29.596675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.032774+0000","last_change":"2024-02-13T14:43:38.605336+0000","last_active":"2024-02-13T14:45:30.032774+0000","last_peered":"2024-02-13T14:45:30.032774+0000","last_clean":"2024-02-13T14:45:30.032774+0000","last_became_active":"2024-02-13T14:43:38.604782+0000","last_became_peered":"2024-02-13T14:43:38.604782+0000","last_unstale":"2024-02-13T14:45:30.032774+0000","last_undegraded":"2024-02-13T14:45:30.032774+0000","last_fullsized":"2024-02-13T14:45:30.032774+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:33:01.139138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097823+0000","last_change":"2024-02-13T14:43:34.390068+0000","last_active":"2024-02-13T14:45:30.097823+0000","last_peered":"2024-02-13T14:45:30.097823+0000","last_clean":"2024-02-13T14:45:30.097823+0000","last_became_active":"2024-02-13T14:43:34.389268+0000","last_became_peered":"2024-02-13T14:43:34.389268+0000","last_unstale":"2024-02-13T14:45:30.097823+0000","last_undegraded":"2024-02-13T14:45:30.097823+0000","last_fullsized":"2024-02-13T14:45:30.097823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:07:23.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"67'11","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097797+0000","last_change":"2024-02-13T14:43:36.407382+0000","last_active":"2024-02-13T14:45:30.097797+0000","last_peered":"2024-02-13T14:45:30.097797+0000","last_clean":"2024-02-13T14:45:30.097797+0000","last_became_active":"2024-02-13T14:43:36.406992+0000","last_became_peered":"2024-02-13T14:43:36.406992+0000","last_unstale":"2024-02-13T14:45:30.097797+0000","last_undegraded":"2024-02-13T14:45:30.097797+0000","last_fullsized":"2024-02-13T14:45:30.097797+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:06:52.980265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031359+0000","last_change":"2024-02-13T14:43:40.657649+0000","last_active":"2024-02-13T14:45:30.031359+0000","last_peered":"2024-02-13T14:45:30.031359+0000","last_clean":"2024-02-13T14:45:30.031359+0000","last_became_active":"2024-02-13T14:43:40.656546+0000","last_became_peered":"2024-02-13T14:43:40.656546+0000","last_unstale":"2024-02-13T14:45:30.031359+0000","last_undegraded":"2024-02-13T14:45:30.031359+0000","last_fullsized":"2024-02-13T14:45:30.031359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:27:59.696610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026708+0000","last_change":"2024-02-13T14:43:34.396569+0000","last_active":"2024-02-13T14:45:30.026708+0000","last_peered":"2024-02-13T14:45:30.026708+0000","last_clean":"2024-02-13T14:45:30.026708+0000","last_became_active":"2024-02-13T14:43:34.395778+0000","last_became_peered":"2024-02-13T14:43:34.395778+0000","last_unstale":"2024-02-13T14:45:30.026708+0000","last_undegraded":"2024-02-13T14:45:30.026708+0000","last_fullsized":"2024-02-13T14:45:30.026708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:45:48.160852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"67'11","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101554+0000","last_change":"2024-02-13T14:43:36.408462+0000","last_active":"2024-02-13T14:45:30.101554+0000","last_peered":"2024-02-13T14:45:30.101554+0000","last_clean":"2024-02-13T14:45:30.101554+0000","last_became_active":"2024-02-13T14:43:36.408080+0000","last_became_peered":"2024-02-13T14:43:36.408080+0000","last_unstale":"2024-02-13T14:45:30.101554+0000","last_undegraded":"2024-02-13T14:45:30.101554+0000","last_fullsized":"2024-02-13T14:45:30.101554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:53:38.807867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097760+0000","last_change":"2024-02-13T14:43:38.604548+0000","last_active":"2024-02-13T14:45:30.097760+0000","last_peered":"2024-02-13T14:45:30.097760+0000","last_clean":"2024-02-13T14:45:30.097760+0000","last_became_active":"2024-02-13T14:43:38.603700+0000","last_became_peered":"2024-02-13T14:43:38.603700+0000","last_unstale":"2024-02-13T14:45:30.097760+0000","last_undegraded":"2024-02-13T14:45:30.097760+0000","last_fullsized":"2024-02-13T14:45:30.097760+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:38:40.371320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033272+0000","last_change":"2024-02-13T14:43:40.664806+0000","last_active":"2024-02-13T14:45:30.033272+0000","last_peered":"2024-02-13T14:45:30.033272+0000","last_clean":"2024-02-13T14:45:30.033272+0000","last_became_active":"2024-02-13T14:43:40.656591+0000","last_became_peered":"2024-02-13T14:43:40.656591+0000","last_unstale":"2024-02-13T14:45:30.033272+0000","last_undegraded":"2024-02-13T14:45:30.033272+0000","last_fullsized":"2024-02-13T14:45:30.033272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:28:50.932219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027687+0000","last_change":"2024-02-13T14:43:34.394680+0000","last_active":"2024-02-13T14:45:30.027687+0000","last_peered":"2024-02-13T14:45:30.027687+0000","last_clean":"2024-02-13T14:45:30.027687+0000","last_became_active":"2024-02-13T14:43:34.393886+0000","last_became_peered":"2024-02-13T14:43:34.393886+0000","last_unstale":"2024-02-13T14:45:30.027687+0000","last_undegraded":"2024-02-13T14:45:30.027687+0000","last_fullsized":"2024-02-13T14:45:30.027687+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:39:29.821411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'16","reported_seq":93,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607811+0000","last_change":"2024-02-13T14:43:36.547863+0000","last_active":"2024-02-13T14:46:19.607811+0000","last_peered":"2024-02-13T14:46:19.607811+0000","last_clean":"2024-02-13T14:46:19.607811+0000","last_became_active":"2024-02-13T14:43:36.547476+0000","last_became_peered":"2024-02-13T14:43:36.547476+0000","last_unstale":"2024-02-13T14:46:19.607811+0000","last_undegraded":"2024-02-13T14:46:19.607811+0000","last_fullsized":"2024-02-13T14:46:19.607811+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:20:06.215661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"70'2","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027165+0000","last_change":"2024-02-13T14:43:46.668483+0000","last_active":"2024-02-13T14:45:30.027165+0000","last_peered":"2024-02-13T14:45:30.027165+0000","last_clean":"2024-02-13T14:45:30.027165+0000","last_became_active":"2024-02-13T14:43:37.581652+0000","last_became_peered":"2024-02-13T14:43:37.581652+0000","last_unstale":"2024-02-13T14:45:30.027165+0000","last_undegraded":"2024-02-13T14:45:30.027165+0000","last_fullsized":"2024-02-13T14:45:30.027165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_clean_scrub_stamp":"2024-02-13T14:43:36.381263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:57:31.733417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041123319999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607568+0000","last_change":"2024-02-13T14:43:38.592776+0000","last_active":"2024-02-13T14:46:19.607568+0000","last_peered":"2024-02-13T14:46:19.607568+0000","last_clean":"2024-02-13T14:46:19.607568+0000","last_became_active":"2024-02-13T14:43:38.592175+0000","last_became_peered":"2024-02-13T14:43:38.592175+0000","last_unstale":"2024-02-13T14:46:19.607568+0000","last_undegraded":"2024-02-13T14:46:19.607568+0000","last_fullsized":"2024-02-13T14:46:19.607568+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:19:43.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031404+0000","last_change":"2024-02-13T14:43:40.641330+0000","last_active":"2024-02-13T14:45:30.031404+0000","last_peered":"2024-02-13T14:45:30.031404+0000","last_clean":"2024-02-13T14:45:30.031404+0000","last_became_active":"2024-02-13T14:43:40.640185+0000","last_became_peered":"2024-02-13T14:43:40.640185+0000","last_unstale":"2024-02-13T14:45:30.031404+0000","last_undegraded":"2024-02-13T14:45:30.031404+0000","last_fullsized":"2024-02-13T14:45:30.031404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:52:08.724355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100436+0000","last_change":"2024-02-13T14:43:34.421845+0000","last_active":"2024-02-13T14:45:30.100436+0000","last_peered":"2024-02-13T14:45:30.100436+0000","last_clean":"2024-02-13T14:45:30.100436+0000","last_became_active":"2024-02-13T14:43:34.421011+0000","last_became_peered":"2024-02-13T14:43:34.421011+0000","last_unstale":"2024-02-13T14:45:30.100436+0000","last_undegraded":"2024-02-13T14:45:30.100436+0000","last_fullsized":"2024-02-13T14:45:30.100436+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:51:52.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'19","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026744+0000","last_change":"2024-02-13T14:43:36.421879+0000","last_active":"2024-02-13T14:45:30.026744+0000","last_peered":"2024-02-13T14:45:30.026744+0000","last_clean":"2024-02-13T14:45:30.026744+0000","last_became_active":"2024-02-13T14:43:36.421567+0000","last_became_peered":"2024-02-13T14:43:36.421567+0000","last_unstale":"2024-02-13T14:45:30.026744+0000","last_undegraded":"2024-02-13T14:45:30.026744+0000","last_fullsized":"2024-02-13T14:45:30.026744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:10:20.385410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035544+0000","last_change":"2024-02-13T14:43:38.578518+0000","last_active":"2024-02-13T14:45:30.035544+0000","last_peered":"2024-02-13T14:45:30.035544+0000","last_clean":"2024-02-13T14:45:30.035544+0000","last_became_active":"2024-02-13T14:43:38.577579+0000","last_became_peered":"2024-02-13T14:43:38.577579+0000","last_unstale":"2024-02-13T14:45:30.035544+0000","last_undegraded":"2024-02-13T14:45:30.035544+0000","last_fullsized":"2024-02-13T14:45:30.035544+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:16:51.058286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100524+0000","last_change":"2024-02-13T14:43:41.074165+0000","last_active":"2024-02-13T14:45:30.100524+0000","last_peered":"2024-02-13T14:45:30.100524+0000","last_clean":"2024-02-13T14:45:30.100524+0000","last_became_active":"2024-02-13T14:43:41.073113+0000","last_became_peered":"2024-02-13T14:43:41.073113+0000","last_unstale":"2024-02-13T14:45:30.100524+0000","last_undegraded":"2024-02-13T14:45:30.100524+0000","last_fullsized":"2024-02-13T14:45:30.100524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:35:18.795875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'18","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025745+0000","last_change":"2024-02-13T14:43:36.548185+0000","last_active":"2024-02-13T14:45:30.025745+0000","last_peered":"2024-02-13T14:45:30.025745+0000","last_clean":"2024-02-13T14:45:30.025745+0000","last_became_active":"2024-02-13T14:43:36.547862+0000","last_became_peered":"2024-02-13T14:43:36.547862+0000","last_unstale":"2024-02-13T14:45:30.025745+0000","last_undegraded":"2024-02-13T14:45:30.025745+0000","last_fullsized":"2024-02-13T14:45:30.025745+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:16:37.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098038+0000","last_change":"2024-02-13T14:43:34.392258+0000","last_active":"2024-02-13T14:45:30.098038+0000","last_peered":"2024-02-13T14:45:30.098038+0000","last_clean":"2024-02-13T14:45:30.098038+0000","last_became_active":"2024-02-13T14:43:34.391877+0000","last_became_peered":"2024-02-13T14:43:34.391877+0000","last_unstale":"2024-02-13T14:45:30.098038+0000","last_undegraded":"2024-02-13T14:45:30.098038+0000","last_fullsized":"2024-02-13T14:45:30.098038+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:11:43.876933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098806+0000","last_change":"2024-02-13T14:43:38.600288+0000","last_active":"2024-02-13T14:45:30.098806+0000","last_peered":"2024-02-13T14:45:30.098806+0000","last_clean":"2024-02-13T14:45:30.098806+0000","last_became_active":"2024-02-13T14:43:38.599299+0000","last_became_peered":"2024-02-13T14:43:38.599299+0000","last_unstale":"2024-02-13T14:45:30.098806+0000","last_undegraded":"2024-02-13T14:45:30.098806+0000","last_fullsized":"2024-02-13T14:45:30.098806+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:57:12.807763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104395+0000","last_change":"2024-02-13T14:43:40.659717+0000","last_active":"2024-02-13T14:45:30.104395+0000","last_peered":"2024-02-13T14:45:30.104395+0000","last_clean":"2024-02-13T14:45:30.104395+0000","last_became_active":"2024-02-13T14:43:40.658899+0000","last_became_peered":"2024-02-13T14:43:40.658899+0000","last_unstale":"2024-02-13T14:45:30.104395+0000","last_undegraded":"2024-02-13T14:45:30.104395+0000","last_fullsized":"2024-02-13T14:45:30.104395+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:38:33.801424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":50,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027795+0000","last_change":"2024-02-13T14:43:36.406123+0000","last_active":"2024-02-13T14:45:30.027795+0000","last_peered":"2024-02-13T14:45:30.027795+0000","last_clean":"2024-02-13T14:45:30.027795+0000","last_became_active":"2024-02-13T14:43:36.404405+0000","last_became_peered":"2024-02-13T14:43:36.404405+0000","last_unstale":"2024-02-13T14:45:30.027795+0000","last_undegraded":"2024-02-13T14:45:30.027795+0000","last_fullsized":"2024-02-13T14:45:30.027795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:18:57.260874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.102062+0000","last_change":"2024-02-13T14:43:34.398613+0000","last_active":"2024-02-13T14:45:30.102062+0000","last_peered":"2024-02-13T14:45:30.102062+0000","last_clean":"2024-02-13T14:45:30.102062+0000","last_became_active":"2024-02-13T14:43:34.396302+0000","last_became_peered":"2024-02-13T14:43:34.396302+0000","last_unstale":"2024-02-13T14:45:30.102062+0000","last_undegraded":"2024-02-13T14:45:30.102062+0000","last_fullsized":"2024-02-13T14:45:30.102062+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:39:27.898608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":282,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097359+0000","last_change":"2024-02-13T14:42:55.184522+0000","last_active":"2024-02-13T14:45:30.097359+0000","last_peered":"2024-02-13T14:45:30.097359+0000","last_clean":"2024-02-13T14:45:30.097359+0000","last_became_active":"2024-02-13T14:42:55.183484+0000","last_became_peered":"2024-02-13T14:42:55.183484+0000","last_unstale":"2024-02-13T14:45:30.097359+0000","last_undegraded":"2024-02-13T14:45:30.097359+0000","last_fullsized":"2024-02-13T14:45:30.097359+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:38:35.991267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:38:35.991267+0000","last_clean_scrub_stamp":"2024-02-13T14:38:35.991267+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:02:03.166622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101357+0000","last_change":"2024-02-13T14:43:38.604455+0000","last_active":"2024-02-13T14:45:30.101357+0000","last_peered":"2024-02-13T14:45:30.101357+0000","last_clean":"2024-02-13T14:45:30.101357+0000","last_became_active":"2024-02-13T14:43:38.599873+0000","last_became_peered":"2024-02-13T14:43:38.599873+0000","last_unstale":"2024-02-13T14:45:30.101357+0000","last_undegraded":"2024-02-13T14:45:30.101357+0000","last_fullsized":"2024-02-13T14:45:30.101357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:17:21.648043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026839+0000","last_change":"2024-02-13T14:43:40.661480+0000","last_active":"2024-02-13T14:45:30.026839+0000","last_peered":"2024-02-13T14:45:30.026839+0000","last_clean":"2024-02-13T14:45:30.026839+0000","last_became_active":"2024-02-13T14:43:40.660782+0000","last_became_peered":"2024-02-13T14:43:40.660782+0000","last_unstale":"2024-02-13T14:45:30.026839+0000","last_undegraded":"2024-02-13T14:45:30.026839+0000","last_fullsized":"2024-02-13T14:45:30.026839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:53:58.613662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"67'14","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033910+0000","last_change":"2024-02-13T14:43:36.426090+0000","last_active":"2024-02-13T14:45:30.033910+0000","last_peered":"2024-02-13T14:45:30.033910+0000","last_clean":"2024-02-13T14:45:30.033910+0000","last_became_active":"2024-02-13T14:43:36.424878+0000","last_became_peered":"2024-02-13T14:43:36.424878+0000","last_unstale":"2024-02-13T14:45:30.033910+0000","last_undegraded":"2024-02-13T14:45:30.033910+0000","last_fullsized":"2024-02-13T14:45:30.033910+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:26:23.105032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097399+0000","last_change":"2024-02-13T14:43:34.403512+0000","last_active":"2024-02-13T14:45:30.097399+0000","last_peered":"2024-02-13T14:45:30.097399+0000","last_clean":"2024-02-13T14:45:30.097399+0000","last_became_active":"2024-02-13T14:43:34.402014+0000","last_became_peered":"2024-02-13T14:43:34.402014+0000","last_unstale":"2024-02-13T14:45:30.097399+0000","last_undegraded":"2024-02-13T14:45:30.097399+0000","last_fullsized":"2024-02-13T14:45:30.097399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:37:45.500784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104081+0000","last_change":"2024-02-13T14:43:38.604096+0000","last_active":"2024-02-13T14:45:30.104081+0000","last_peered":"2024-02-13T14:45:30.104081+0000","last_clean":"2024-02-13T14:45:30.104081+0000","last_became_active":"2024-02-13T14:43:38.603337+0000","last_became_peered":"2024-02-13T14:43:38.603337+0000","last_unstale":"2024-02-13T14:45:30.104081+0000","last_undegraded":"2024-02-13T14:45:30.104081+0000","last_fullsized":"2024-02-13T14:45:30.104081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:18:15.924642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025454+0000","last_change":"2024-02-13T14:43:41.071103+0000","last_active":"2024-02-13T14:45:30.025454+0000","last_peered":"2024-02-13T14:45:30.025454+0000","last_clean":"2024-02-13T14:45:30.025454+0000","last_became_active":"2024-02-13T14:43:41.069657+0000","last_became_peered":"2024-02-13T14:43:41.069657+0000","last_unstale":"2024-02-13T14:45:30.025454+0000","last_undegraded":"2024-02-13T14:45:30.025454+0000","last_fullsized":"2024-02-13T14:45:30.025454+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:23:57.812208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100839+0000","last_change":"2024-02-13T14:43:34.407497+0000","last_active":"2024-02-13T14:45:30.100839+0000","last_peered":"2024-02-13T14:45:30.100839+0000","last_clean":"2024-02-13T14:45:30.100839+0000","last_became_active":"2024-02-13T14:43:34.406594+0000","last_became_peered":"2024-02-13T14:43:34.406594+0000","last_unstale":"2024-02-13T14:45:30.100839+0000","last_undegraded":"2024-02-13T14:45:30.100839+0000","last_fullsized":"2024-02-13T14:45:30.100839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:48:56.771416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"67'30","reported_seq":121,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607614+0000","last_change":"2024-02-13T14:43:36.548166+0000","last_active":"2024-02-13T14:46:19.607614+0000","last_peered":"2024-02-13T14:46:19.607614+0000","last_clean":"2024-02-13T14:46:19.607614+0000","last_became_active":"2024-02-13T14:43:36.547814+0000","last_became_peered":"2024-02-13T14:43:36.547814+0000","last_unstale":"2024-02-13T14:46:19.607614+0000","last_undegraded":"2024-02-13T14:46:19.607614+0000","last_fullsized":"2024-02-13T14:46:19.607614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:37:22.327007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099582+0000","last_change":"2024-02-13T14:43:38.601053+0000","last_active":"2024-02-13T14:45:30.099582+0000","last_peered":"2024-02-13T14:45:30.099582+0000","last_clean":"2024-02-13T14:45:30.099582+0000","last_became_active":"2024-02-13T14:43:38.600149+0000","last_became_peered":"2024-02-13T14:43:38.600149+0000","last_unstale":"2024-02-13T14:45:30.099582+0000","last_undegraded":"2024-02-13T14:45:30.099582+0000","last_fullsized":"2024-02-13T14:45:30.099582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:57:41.161430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025506+0000","last_change":"2024-02-13T14:43:40.644975+0000","last_active":"2024-02-13T14:45:30.025506+0000","last_peered":"2024-02-13T14:45:30.025506+0000","last_clean":"2024-02-13T14:45:30.025506+0000","last_became_active":"2024-02-13T14:43:40.644123+0000","last_became_peered":"2024-02-13T14:43:40.644123+0000","last_unstale":"2024-02-13T14:45:30.025506+0000","last_undegraded":"2024-02-13T14:45:30.025506+0000","last_fullsized":"2024-02-13T14:45:30.025506+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:27:41.842411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.029089+0000","last_change":"2024-02-13T14:43:34.403854+0000","last_active":"2024-02-13T14:45:30.029089+0000","last_peered":"2024-02-13T14:45:30.029089+0000","last_clean":"2024-02-13T14:45:30.029089+0000","last_became_active":"2024-02-13T14:43:34.403502+0000","last_became_peered":"2024-02-13T14:43:34.403502+0000","last_unstale":"2024-02-13T14:45:30.029089+0000","last_undegraded":"2024-02-13T14:45:30.029089+0000","last_fullsized":"2024-02-13T14:45:30.029089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:43:44.971087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"67'13","reported_seq":62,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033051+0000","last_change":"2024-02-13T14:43:36.425810+0000","last_active":"2024-02-13T14:45:30.033051+0000","last_peered":"2024-02-13T14:45:30.033051+0000","last_clean":"2024-02-13T14:45:30.033051+0000","last_became_active":"2024-02-13T14:43:36.424613+0000","last_became_peered":"2024-02-13T14:43:36.424613+0000","last_unstale":"2024-02-13T14:45:30.033051+0000","last_undegraded":"2024-02-13T14:45:30.033051+0000","last_fullsized":"2024-02-13T14:45:30.033051+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:38:33.422831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"71'5","reported_seq":192,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:23.171025+0000","last_change":"2024-02-13T14:43:47.052444+0000","last_active":"2024-02-13T14:46:23.171025+0000","last_peered":"2024-02-13T14:46:23.171025+0000","last_clean":"2024-02-13T14:46:23.171025+0000","last_became_active":"2024-02-13T14:43:37.585093+0000","last_became_peered":"2024-02-13T14:43:37.585093+0000","last_unstale":"2024-02-13T14:46:23.171025+0000","last_undegraded":"2024-02-13T14:46:23.171025+0000","last_fullsized":"2024-02-13T14:46:23.171025+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_clean_scrub_stamp":"2024-02-13T14:43:36.381263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:34:26.420455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002500979,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025384+0000","last_change":"2024-02-13T14:43:38.610656+0000","last_active":"2024-02-13T14:45:30.025384+0000","last_peered":"2024-02-13T14:45:30.025384+0000","last_clean":"2024-02-13T14:45:30.025384+0000","last_became_active":"2024-02-13T14:43:38.609882+0000","last_became_peered":"2024-02-13T14:43:38.609882+0000","last_unstale":"2024-02-13T14:45:30.025384+0000","last_undegraded":"2024-02-13T14:45:30.025384+0000","last_fullsized":"2024-02-13T14:45:30.025384+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:57:43.502668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097901+0000","last_change":"2024-02-13T14:43:41.075605+0000","last_active":"2024-02-13T14:45:30.097901+0000","last_peered":"2024-02-13T14:45:30.097901+0000","last_clean":"2024-02-13T14:45:30.097901+0000","last_became_active":"2024-02-13T14:43:41.074764+0000","last_became_peered":"2024-02-13T14:43:41.074764+0000","last_unstale":"2024-02-13T14:45:30.097901+0000","last_undegraded":"2024-02-13T14:45:30.097901+0000","last_fullsized":"2024-02-13T14:45:30.097901+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:16:11.427147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101456+0000","last_change":"2024-02-13T14:43:34.414179+0000","last_active":"2024-02-13T14:45:30.101456+0000","last_peered":"2024-02-13T14:45:30.101456+0000","last_clean":"2024-02-13T14:45:30.101456+0000","last_became_active":"2024-02-13T14:43:34.413109+0000","last_became_peered":"2024-02-13T14:43:34.413109+0000","last_unstale":"2024-02-13T14:45:30.101456+0000","last_undegraded":"2024-02-13T14:45:30.101456+0000","last_fullsized":"2024-02-13T14:45:30.101456+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:33:59.460484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035482+0000","last_change":"2024-02-13T14:43:36.421569+0000","last_active":"2024-02-13T14:45:30.035482+0000","last_peered":"2024-02-13T14:45:30.035482+0000","last_clean":"2024-02-13T14:45:30.035482+0000","last_became_active":"2024-02-13T14:43:36.419949+0000","last_became_peered":"2024-02-13T14:43:36.419949+0000","last_unstale":"2024-02-13T14:45:30.035482+0000","last_undegraded":"2024-02-13T14:45:30.035482+0000","last_fullsized":"2024-02-13T14:45:30.035482+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:16:06.601230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025732+0000","last_change":"2024-02-13T14:43:46.676861+0000","last_active":"2024-02-13T14:45:30.025732+0000","last_peered":"2024-02-13T14:45:30.025732+0000","last_clean":"2024-02-13T14:45:30.025732+0000","last_became_active":"2024-02-13T14:43:37.586167+0000","last_became_peered":"2024-02-13T14:43:37.586167+0000","last_unstale":"2024-02-13T14:45:30.025732+0000","last_undegraded":"2024-02-13T14:45:30.025732+0000","last_fullsized":"2024-02-13T14:45:30.025732+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_clean_scrub_stamp":"2024-02-13T14:43:36.381263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:13:22.397017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013756389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607847+0000","last_change":"2024-02-13T14:43:38.607992+0000","last_active":"2024-02-13T14:46:19.607847+0000","last_peered":"2024-02-13T14:46:19.607847+0000","last_clean":"2024-02-13T14:46:19.607847+0000","last_became_active":"2024-02-13T14:43:38.607202+0000","last_became_peered":"2024-02-13T14:43:38.607202+0000","last_unstale":"2024-02-13T14:46:19.607847+0000","last_undegraded":"2024-02-13T14:46:19.607847+0000","last_fullsized":"2024-02-13T14:46:19.607847+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:54:34.580156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.030845+0000","last_change":"2024-02-13T14:43:41.071027+0000","last_active":"2024-02-13T14:45:30.030845+0000","last_peered":"2024-02-13T14:45:30.030845+0000","last_clean":"2024-02-13T14:45:30.030845+0000","last_became_active":"2024-02-13T14:43:41.070122+0000","last_became_peered":"2024-02-13T14:43:41.070122+0000","last_unstale":"2024-02-13T14:45:30.030845+0000","last_undegraded":"2024-02-13T14:45:30.030845+0000","last_fullsized":"2024-02-13T14:45:30.030845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:42:40.177804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104252+0000","last_change":"2024-02-13T14:43:38.593228+0000","last_active":"2024-02-13T14:45:30.104252+0000","last_peered":"2024-02-13T14:45:30.104252+0000","last_clean":"2024-02-13T14:45:30.104252+0000","last_became_active":"2024-02-13T14:43:38.592691+0000","last_became_peered":"2024-02-13T14:43:38.592691+0000","last_unstale":"2024-02-13T14:45:30.104252+0000","last_undegraded":"2024-02-13T14:45:30.104252+0000","last_fullsized":"2024-02-13T14:45:30.104252+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:42:03.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097665+0000","last_change":"2024-02-13T14:43:34.402874+0000","last_active":"2024-02-13T14:45:30.097665+0000","last_peered":"2024-02-13T14:45:30.097665+0000","last_clean":"2024-02-13T14:45:30.097665+0000","last_became_active":"2024-02-13T14:43:34.400940+0000","last_became_peered":"2024-02-13T14:43:34.400940+0000","last_unstale":"2024-02-13T14:45:30.097665+0000","last_undegraded":"2024-02-13T14:45:30.097665+0000","last_fullsized":"2024-02-13T14:45:30.097665+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:53:46.812675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025427+0000","last_change":"2024-02-13T14:43:36.550772+0000","last_active":"2024-02-13T14:45:30.025427+0000","last_peered":"2024-02-13T14:45:30.025427+0000","last_clean":"2024-02-13T14:45:30.025427+0000","last_became_active":"2024-02-13T14:43:36.549740+0000","last_became_peered":"2024-02-13T14:43:36.549740+0000","last_unstale":"2024-02-13T14:45:30.025427+0000","last_undegraded":"2024-02-13T14:45:30.025427+0000","last_fullsized":"2024-02-13T14:45:30.025427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:15:11.976606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.102038+0000","last_change":"2024-02-13T14:43:40.665579+0000","last_active":"2024-02-13T14:45:30.102038+0000","last_peered":"2024-02-13T14:45:30.102038+0000","last_clean":"2024-02-13T14:45:30.102038+0000","last_became_active":"2024-02-13T14:43:40.665009+0000","last_became_peered":"2024-02-13T14:43:40.665009+0000","last_unstale":"2024-02-13T14:45:30.102038+0000","last_undegraded":"2024-02-13T14:45:30.102038+0000","last_fullsized":"2024-02-13T14:45:30.102038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:04:30.263937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607675+0000","last_change":"2024-02-13T14:43:38.586567+0000","last_active":"2024-02-13T14:46:19.607675+0000","last_peered":"2024-02-13T14:46:19.607675+0000","last_clean":"2024-02-13T14:46:19.607675+0000","last_became_active":"2024-02-13T14:43:38.586101+0000","last_became_peered":"2024-02-13T14:43:38.586101+0000","last_unstale":"2024-02-13T14:46:19.607675+0000","last_undegraded":"2024-02-13T14:46:19.607675+0000","last_fullsized":"2024-02-13T14:46:19.607675+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:55:40.141731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025716+0000","last_change":"2024-02-13T14:43:34.394560+0000","last_active":"2024-02-13T14:45:30.025716+0000","last_peered":"2024-02-13T14:45:30.025716+0000","last_clean":"2024-02-13T14:45:30.025716+0000","last_became_active":"2024-02-13T14:43:34.393449+0000","last_became_peered":"2024-02-13T14:43:34.393449+0000","last_unstale":"2024-02-13T14:45:30.025716+0000","last_undegraded":"2024-02-13T14:45:30.025716+0000","last_fullsized":"2024-02-13T14:45:30.025716+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:31:54.994823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"67'15","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.029082+0000","last_change":"2024-02-13T14:43:36.411693+0000","last_active":"2024-02-13T14:45:30.029082+0000","last_peered":"2024-02-13T14:45:30.029082+0000","last_clean":"2024-02-13T14:45:30.029082+0000","last_became_active":"2024-02-13T14:43:36.408550+0000","last_became_peered":"2024-02-13T14:43:36.408550+0000","last_unstale":"2024-02-13T14:45:30.029082+0000","last_undegraded":"2024-02-13T14:45:30.029082+0000","last_fullsized":"2024-02-13T14:45:30.029082+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:01:07.801006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027371+0000","last_change":"2024-02-13T14:43:40.645020+0000","last_active":"2024-02-13T14:45:30.027371+0000","last_peered":"2024-02-13T14:45:30.027371+0000","last_clean":"2024-02-13T14:45:30.027371+0000","last_became_active":"2024-02-13T14:43:40.642957+0000","last_became_peered":"2024-02-13T14:43:40.642957+0000","last_unstale":"2024-02-13T14:45:30.027371+0000","last_undegraded":"2024-02-13T14:45:30.027371+0000","last_fullsized":"2024-02-13T14:45:30.027371+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:01:28.182991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"67'11","reported_seq":77,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607624+0000","last_change":"2024-02-13T14:43:38.596118+0000","last_active":"2024-02-13T14:46:19.607624+0000","last_peered":"2024-02-13T14:46:19.607624+0000","last_clean":"2024-02-13T14:46:19.607624+0000","last_became_active":"2024-02-13T14:43:38.595307+0000","last_became_peered":"2024-02-13T14:43:38.595307+0000","last_unstale":"2024-02-13T14:46:19.607624+0000","last_undegraded":"2024-02-13T14:46:19.607624+0000","last_fullsized":"2024-02-13T14:46:19.607624+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:53:37.144393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027673+0000","last_change":"2024-02-13T14:43:34.394241+0000","last_active":"2024-02-13T14:45:30.027673+0000","last_peered":"2024-02-13T14:45:30.027673+0000","last_clean":"2024-02-13T14:45:30.027673+0000","last_became_active":"2024-02-13T14:43:34.393719+0000","last_became_peered":"2024-02-13T14:43:34.393719+0000","last_unstale":"2024-02-13T14:45:30.027673+0000","last_undegraded":"2024-02-13T14:45:30.027673+0000","last_fullsized":"2024-02-13T14:45:30.027673+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:15:07.640738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"67'9","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.030811+0000","last_change":"2024-02-13T14:43:36.422922+0000","last_active":"2024-02-13T14:45:30.030811+0000","last_peered":"2024-02-13T14:45:30.030811+0000","last_clean":"2024-02-13T14:45:30.030811+0000","last_became_active":"2024-02-13T14:43:36.421433+0000","last_became_peered":"2024-02-13T14:43:36.421433+0000","last_unstale":"2024-02-13T14:45:30.030811+0000","last_undegraded":"2024-02-13T14:45:30.030811+0000","last_fullsized":"2024-02-13T14:45:30.030811+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:18:28.370832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099280+0000","last_change":"2024-02-13T14:43:40.657443+0000","last_active":"2024-02-13T14:45:30.099280+0000","last_peered":"2024-02-13T14:45:30.099280+0000","last_clean":"2024-02-13T14:45:30.099280+0000","last_became_active":"2024-02-13T14:43:40.656693+0000","last_became_peered":"2024-02-13T14:43:40.656693+0000","last_unstale":"2024-02-13T14:45:30.099280+0000","last_undegraded":"2024-02-13T14:45:30.099280+0000","last_fullsized":"2024-02-13T14:45:30.099280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:45:05.717403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027879+0000","last_change":"2024-02-13T14:43:38.604942+0000","last_active":"2024-02-13T14:45:30.027879+0000","last_peered":"2024-02-13T14:45:30.027879+0000","last_clean":"2024-02-13T14:45:30.027879+0000","last_became_active":"2024-02-13T14:43:38.603956+0000","last_became_peered":"2024-02-13T14:43:38.603956+0000","last_unstale":"2024-02-13T14:45:30.027879+0000","last_undegraded":"2024-02-13T14:45:30.027879+0000","last_fullsized":"2024-02-13T14:45:30.027879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:51:07.805352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098824+0000","last_change":"2024-02-13T14:43:34.417160+0000","last_active":"2024-02-13T14:45:30.098824+0000","last_peered":"2024-02-13T14:45:30.098824+0000","last_clean":"2024-02-13T14:45:30.098824+0000","last_became_active":"2024-02-13T14:43:34.416286+0000","last_became_peered":"2024-02-13T14:43:34.416286+0000","last_unstale":"2024-02-13T14:45:30.098824+0000","last_undegraded":"2024-02-13T14:45:30.098824+0000","last_fullsized":"2024-02-13T14:45:30.098824+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:02:30.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"67'19","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098984+0000","last_change":"2024-02-13T14:43:36.413331+0000","last_active":"2024-02-13T14:45:30.098984+0000","last_peered":"2024-02-13T14:45:30.098984+0000","last_clean":"2024-02-13T14:45:30.098984+0000","last_became_active":"2024-02-13T14:43:36.412906+0000","last_became_peered":"2024-02-13T14:43:36.412906+0000","last_unstale":"2024-02-13T14:45:30.098984+0000","last_undegraded":"2024-02-13T14:45:30.098984+0000","last_fullsized":"2024-02-13T14:45:30.098984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:23:59.982113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097182+0000","last_change":"2024-02-13T14:43:40.652265+0000","last_active":"2024-02-13T14:45:30.097182+0000","last_peered":"2024-02-13T14:45:30.097182+0000","last_clean":"2024-02-13T14:45:30.097182+0000","last_became_active":"2024-02-13T14:43:40.651613+0000","last_became_peered":"2024-02-13T14:43:40.651613+0000","last_unstale":"2024-02-13T14:45:30.097182+0000","last_undegraded":"2024-02-13T14:45:30.097182+0000","last_fullsized":"2024-02-13T14:45:30.097182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:43:03.401464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098409+0000","last_change":"2024-02-13T14:43:38.598071+0000","last_active":"2024-02-13T14:45:30.098409+0000","last_peered":"2024-02-13T14:45:30.098409+0000","last_clean":"2024-02-13T14:45:30.098409+0000","last_became_active":"2024-02-13T14:43:38.597230+0000","last_became_peered":"2024-02-13T14:43:38.597230+0000","last_unstale":"2024-02-13T14:45:30.098409+0000","last_undegraded":"2024-02-13T14:45:30.098409+0000","last_fullsized":"2024-02-13T14:45:30.098409+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:59:13.795132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098638+0000","last_change":"2024-02-13T14:43:34.402965+0000","last_active":"2024-02-13T14:45:30.098638+0000","last_peered":"2024-02-13T14:45:30.098638+0000","last_clean":"2024-02-13T14:45:30.098638+0000","last_became_active":"2024-02-13T14:43:34.402609+0000","last_became_peered":"2024-02-13T14:43:34.402609+0000","last_unstale":"2024-02-13T14:45:30.098638+0000","last_undegraded":"2024-02-13T14:45:30.098638+0000","last_fullsized":"2024-02-13T14:45:30.098638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:01:54.460648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101138+0000","last_change":"2024-02-13T14:43:36.401504+0000","last_active":"2024-02-13T14:45:30.101138+0000","last_peered":"2024-02-13T14:45:30.101138+0000","last_clean":"2024-02-13T14:45:30.101138+0000","last_became_active":"2024-02-13T14:43:36.401064+0000","last_became_peered":"2024-02-13T14:43:36.401064+0000","last_unstale":"2024-02-13T14:45:30.101138+0000","last_undegraded":"2024-02-13T14:45:30.101138+0000","last_fullsized":"2024-02-13T14:45:30.101138+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:45:49.985353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033322+0000","last_change":"2024-02-13T14:43:40.664616+0000","last_active":"2024-02-13T14:45:30.033322+0000","last_peered":"2024-02-13T14:45:30.033322+0000","last_clean":"2024-02-13T14:45:30.033322+0000","last_became_active":"2024-02-13T14:43:40.658030+0000","last_became_peered":"2024-02-13T14:43:40.658030+0000","last_unstale":"2024-02-13T14:45:30.033322+0000","last_undegraded":"2024-02-13T14:45:30.033322+0000","last_fullsized":"2024-02-13T14:45:30.033322+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:17:52.430796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098180+0000","last_change":"2024-02-13T14:43:38.612225+0000","last_active":"2024-02-13T14:45:30.098180+0000","last_peered":"2024-02-13T14:45:30.098180+0000","last_clean":"2024-02-13T14:45:30.098180+0000","last_became_active":"2024-02-13T14:43:38.611082+0000","last_became_peered":"2024-02-13T14:43:38.611082+0000","last_unstale":"2024-02-13T14:45:30.098180+0000","last_undegraded":"2024-02-13T14:45:30.098180+0000","last_fullsized":"2024-02-13T14:45:30.098180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:43:36.988884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027369+0000","last_change":"2024-02-13T14:43:34.388154+0000","last_active":"2024-02-13T14:45:30.027369+0000","last_peered":"2024-02-13T14:45:30.027369+0000","last_clean":"2024-02-13T14:45:30.027369+0000","last_became_active":"2024-02-13T14:43:34.387618+0000","last_became_peered":"2024-02-13T14:43:34.387618+0000","last_unstale":"2024-02-13T14:45:30.027369+0000","last_undegraded":"2024-02-13T14:45:30.027369+0000","last_fullsized":"2024-02-13T14:45:30.027369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:45:36.222733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.103504+0000","last_change":"2024-02-13T14:43:36.408075+0000","last_active":"2024-02-13T14:45:30.103504+0000","last_peered":"2024-02-13T14:45:30.103504+0000","last_clean":"2024-02-13T14:45:30.103504+0000","last_became_active":"2024-02-13T14:43:36.407672+0000","last_became_peered":"2024-02-13T14:43:36.407672+0000","last_unstale":"2024-02-13T14:45:30.103504+0000","last_undegraded":"2024-02-13T14:45:30.103504+0000","last_fullsized":"2024-02-13T14:45:30.103504+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:39:04.527041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099932+0000","last_change":"2024-02-13T14:43:41.070752+0000","last_active":"2024-02-13T14:45:30.099932+0000","last_peered":"2024-02-13T14:45:30.099932+0000","last_clean":"2024-02-13T14:45:30.099932+0000","last_became_active":"2024-02-13T14:43:41.069839+0000","last_became_peered":"2024-02-13T14:43:41.069839+0000","last_unstale":"2024-02-13T14:45:30.099932+0000","last_undegraded":"2024-02-13T14:45:30.099932+0000","last_fullsized":"2024-02-13T14:45:30.099932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:42:39.267645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099335+0000","last_change":"2024-02-13T14:43:34.393691+0000","last_active":"2024-02-13T14:45:30.099335+0000","last_peered":"2024-02-13T14:45:30.099335+0000","last_clean":"2024-02-13T14:45:30.099335+0000","last_became_active":"2024-02-13T14:43:34.393189+0000","last_became_peered":"2024-02-13T14:43:34.393189+0000","last_unstale":"2024-02-13T14:45:30.099335+0000","last_undegraded":"2024-02-13T14:45:30.099335+0000","last_fullsized":"2024-02-13T14:45:30.099335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:45:46.425519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.102879+0000","last_change":"2024-02-13T14:43:36.408829+0000","last_active":"2024-02-13T14:45:30.102879+0000","last_peered":"2024-02-13T14:45:30.102879+0000","last_clean":"2024-02-13T14:45:30.102879+0000","last_became_active":"2024-02-13T14:43:36.408423+0000","last_became_peered":"2024-02-13T14:43:36.408423+0000","last_unstale":"2024-02-13T14:45:30.102879+0000","last_undegraded":"2024-02-13T14:45:30.102879+0000","last_fullsized":"2024-02-13T14:45:30.102879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:38:01.530968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"67'11","reported_seq":76,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:19.607669+0000","last_change":"2024-02-13T14:43:38.605449+0000","last_active":"2024-02-13T14:46:19.607669+0000","last_peered":"2024-02-13T14:46:19.607669+0000","last_clean":"2024-02-13T14:46:19.607669+0000","last_became_active":"2024-02-13T14:43:38.604624+0000","last_became_peered":"2024-02-13T14:43:38.604624+0000","last_unstale":"2024-02-13T14:46:19.607669+0000","last_undegraded":"2024-02-13T14:46:19.607669+0000","last_fullsized":"2024-02-13T14:46:19.607669+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:52:11.783572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":150,"num_read_kb":145,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234028,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28356,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716796,"statfs":{"total":95995035648,"available":95965999104,"internally_reserved":0,"allocated":1363968,"data_stored":886754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.90400000000000003,"15min":0.92600000000000005},"min":{"1min":0.54700000000000004,"5min":0.376,"15min":0.376},"max":{"1min":1.3160000000000001,"5min":1.427,"15min":1.427},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93000000000000005,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.181}]},{"osd":1,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.92000000000000004,"15min":0.91800000000000004},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3819999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.0660000000000001},{"interface":"front","average":{"1min":1.014,"5min":1.048,"15min":1.089},"min":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3200000000000001,"5min":1.468,"15min":1.468},"last":0.82899999999999996}]},{"osd":2,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.014},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.236,"5min":1.331,"15min":1.331},"last":1.004},{"interface":"front","average":{"1min":1,"5min":1.05,"15min":1.0780000000000001},"min":{"1min":0.67600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3480000000000001,"5min":1.605,"15min":1.605},"last":0.77200000000000002}]},{"osd":3,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.034,"15min":1.046},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.048,"5min":1.1060000000000001,"15min":1.141},"min":{"1min":0.60599999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.367,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":0.97599999999999998}]},{"osd":4,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96099999999999997,"15min":0.98199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3759999999999999,"5min":1.873,"15min":1.873},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.97699999999999998,"15min":0.98299999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2949999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":1.123}]},{"osd":5,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0900000000000001,"15min":1.1180000000000001},"min":{"1min":0.50700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4039999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.1240000000000001,"15min":1.173},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.46,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.3049999999999999}]},{"osd":6,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1439999999999999,"15min":1.173},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.395,"5min":1.986,"15min":1.986},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1819999999999999,"15min":1.222},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.347}]}]},{"osd":6,"up_from":46,"seq":197568495669,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712668,"statfs":{"total":95995035648,"available":95961772032,"internally_reserved":0,"allocated":1331200,"data_stored":884572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89100000000000001,"15min":0.89000000000000001},"min":{"1min":0.52900000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.2849999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.006,"5min":0.94199999999999995,"15min":0.92400000000000004},"min":{"1min":0.63,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.95299999999999996}]},{"osd":1,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97199999999999998,"15min":0.98299999999999998},"min":{"1min":0.60399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3740000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.96599999999999997,"15min":0.95899999999999996},"min":{"1min":0.58399999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.0449999999999999}]},{"osd":2,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.67100000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3120000000000001,"5min":1.508,"15min":1.508},"last":0.872},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.012,"15min":1.0289999999999999},"min":{"1min":0.73599999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.321,"5min":1.452,"15min":1.452},"last":1.1240000000000001}]},{"osd":3,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98499999999999999,"15min":0.97399999999999998},"min":{"1min":0.79700000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.071,"5min":1.052,"15min":1.042},"min":{"1min":0.81100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4339999999999999,"5min":1.609,"15min":1.609},"last":0.75}]},{"osd":4,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.89300000000000002,"15min":0.84699999999999998},"min":{"1min":0.63500000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.95499999999999996,"15min":0.91000000000000003},"min":{"1min":0.63400000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5720000000000001,"5min":1.649,"15min":1.649},"last":0.71199999999999997}]},{"osd":5,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.034,"15min":0.997},"min":{"1min":0.77600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.5109999999999999,"5min":1.794,"15min":1.794},"last":1.02},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0449999999999999,"15min":1.0049999999999999},"min":{"1min":0.69099999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3720000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":1.157}]},{"osd":7,"last update":"Tue Feb 13 14:46:01 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1459999999999999,"15min":1.171},"min":{"1min":0.54400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6699999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.1459999999999999,"15min":1.1739999999999999},"min":{"1min":0.48399999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5369999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.99399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713244,"statfs":{"total":95995035648,"available":95962361856,"internally_reserved":0,"allocated":745472,"data_stored":294124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:46:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.58599999999999997},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.251},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83699999999999997,"15min":0.63400000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.26400000000000001},"max":{"1min":1.3680000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.95499999999999996}]},{"osd":2,"last update":"Tue Feb 13 14:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79800000000000004,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90700000000000003,"15min":0.748},"min":{"1min":0.57199999999999995,"5min":0.36599999999999999,"15min":0.26100000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.0900000000000001}]},{"osd":3,"last update":"Tue Feb 13 14:45:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0149999999999999,"15min":0.91200000000000003},"min":{"1min":0.67000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.786,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.89400000000000002,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.78300000000000003}]},{"osd":4,"last update":"Tue Feb 13 14:45:27 2024","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.018,"15min":0.96999999999999997},"min":{"1min":0.77000000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.085,"15min":1.0209999999999999},"min":{"1min":0.81299999999999994,"5min":0.747,"15min":0.747},"max":{"1min":1.5940000000000001,"5min":1.915,"15min":1.915},"last":1.1739999999999999}]},{"osd":5,"last update":"Tue Feb 13 14:46:23 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.115,"15min":1.0629999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5049999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.246,"15min":1.1599999999999999},"min":{"1min":0.83999999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6870000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.417}]},{"osd":6,"last update":"Tue Feb 13 14:46:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.111,"15min":1.105},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.409,"5min":1.702,"15min":1.702},"last":0.995},{"interface":"front","average":{"1min":1.278,"5min":1.288,"15min":1.292},"min":{"1min":0.85599999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5780000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2290000000000001}]},{"osd":7,"last update":"Tue Feb 13 14:46:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.268,"15min":1.2769999999999999},"min":{"1min":0.89800000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6479999999999999,"5min":1.746,"15min":1.746},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.1799999999999999,"15min":1.1839999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.458,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.0549999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738483,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32492,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712660,"statfs":{"total":95995035648,"available":95961763840,"internally_reserved":0,"allocated":1343488,"data_stored":885214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 13 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.59699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.75800000000000001,"15min":0.60799999999999998},"min":{"1min":0.307,"5min":0.30099999999999999,"15min":0.28100000000000003},"max":{"1min":0.98399999999999999,"5min":1.319,"15min":1.319},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Feb 13 14:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77600000000000002,"15min":0.66800000000000004},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.84999999999999998,"15min":0.73499999999999999},"min":{"1min":0.39700000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":1.2769999999999999}]},{"osd":3,"last update":"Tue Feb 13 14:45:32 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":0.94999999999999996,"15min":0.84899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.0369999999999999,"15min":0.94699999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":1.361}]},{"osd":4,"last update":"Tue Feb 13 14:45:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":0.97999999999999998,"15min":0.97599999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.1399999999999999,"5min":1.762,"15min":1.762},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0589999999999999,"15min":1.0449999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.5880000000000001,"5min":2.339,"15min":2.339},"last":1.0309999999999999}]},{"osd":5,"last update":"Tue Feb 13 14:46:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1439999999999999,"15min":1.1180000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6000000000000001,"5min":1.869,"15min":1.869},"last":1.079},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.133,"15min":1.091},"min":{"1min":0.69899999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.98399999999999999}]},{"osd":6,"last update":"Tue Feb 13 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.159,"15min":1.1639999999999999},"min":{"1min":0.57999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.22,"15min":1.2589999999999999},"min":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5289999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.179}]},{"osd":7,"last update":"Tue Feb 13 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2270000000000001,"15min":1.2569999999999999},"min":{"1min":0.56999999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3,"15min":1.3180000000000001},"min":{"1min":0.74099999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.2350000000000001}]}]},{"osd":2,"up_from":18,"seq":77309411423,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717416,"statfs":{"total":95995035648,"available":95966633984,"internally_reserved":0,"allocated":733184,"data_stored":294252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:45:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1419999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":0.71399999999999997},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3919999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.80200000000000005}]},{"osd":1,"last update":"Tue Feb 13 14:45:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80700000000000005,"15min":0.68100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.399,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.95999999999999996},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.86899999999999999,"15min":0.73999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.38900000000000001},"max":{"1min":1.302,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.0960000000000001}]},{"osd":3,"last update":"Tue Feb 13 14:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97199999999999998,"15min":0.876},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.88900000000000001,"15min":0.83099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2470000000000001,"5min":1.335,"15min":1.335},"last":0.89800000000000002}]},{"osd":4,"last update":"Tue Feb 13 14:45:33 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0109999999999999,"15min":0.98099999999999998},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.655,"5min":1.655,"15min":1.655},"last":1.204},{"interface":"front","average":{"1min":1.127,"5min":1.1040000000000001,"15min":1.0740000000000001},"min":{"1min":0.64500000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.4350000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.2569999999999999}]},{"osd":5,"last update":"Tue Feb 13 14:46:15 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.147},"min":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3680000000000001,"5min":1.952,"15min":1.952},"last":1.415},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0629999999999999,"15min":1.0289999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.379,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":1.056}]},{"osd":6,"last update":"Tue Feb 13 14:46:10 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.222,"15min":1.228},"min":{"1min":0.73599999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.452,"5min":1.76,"15min":1.76},"last":1.474},{"interface":"front","average":{"1min":1.071,"5min":1.1299999999999999,"15min":1.135},"min":{"1min":0.74299999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.244,"5min":1.669,"15min":1.669},"last":1.1619999999999999}]},{"osd":7,"last update":"Tue Feb 13 14:45:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1950000000000001,"15min":1.198},"min":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5149999999999999,"5min":1.778,"15min":1.778},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.357,"15min":1.381},"min":{"1min":0.71599999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.71,"5min":1.919,"15min":1.919},"last":1.526}]}]},{"osd":3,"up_from":25,"seq":107374182486,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717416,"statfs":{"total":95995035648,"available":95966633984,"internally_reserved":0,"allocated":733184,"data_stored":294193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:45:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.70299999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.77800000000000002,"15min":0.74399999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0660000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.044}]},{"osd":1,"last update":"Tue Feb 13 14:45:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.81000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.871,"15min":0.80900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.92800000000000005}]},{"osd":2,"last update":"Tue Feb 13 14:45:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.95999999999999996,"15min":0.90800000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.98799999999999999}]},{"osd":4,"last update":"Tue Feb 13 14:45:28 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1299999999999999,"15min":1.0669999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.641,"5min":1.641,"15min":1.641},"last":1.101},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0409999999999999,"15min":0.97499999999999998},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":1.321}]},{"osd":5,"last update":"Tue Feb 13 14:46:23 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.089,"15min":1.0469999999999999},"min":{"1min":0.66700000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.49,"5min":1.556,"15min":1.556},"last":1.49},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.258,"15min":1.1879999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.2210000000000001}]},{"osd":6,"last update":"Tue Feb 13 14:46:11 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.268,"15min":1.294},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.1180000000000001,"15min":1.1379999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5389999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.143}]},{"osd":7,"last update":"Tue Feb 13 14:46:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.597,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.367,"15min":1.3979999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.5449999999999999}]}]},{"osd":4,"up_from":30,"seq":128849018954,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31936,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713216,"statfs":{"total":95995035648,"available":95962333184,"internally_reserved":0,"allocated":774144,"data_stored":295612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.89500000000000002,"15min":0.86499999999999999},"min":{"1min":0.55000000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.077},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.92500000000000004,"15min":0.90100000000000002},"min":{"1min":0.627,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.284,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Feb 13 14:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.88500000000000001,"15min":0.872},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.93400000000000005,"15min":0.90200000000000002},"min":{"1min":0.68999999999999995,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4670000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.82399999999999995}]},{"osd":2,"last update":"Tue Feb 13 14:45:25 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.95199999999999996,"15min":0.91200000000000003},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.385,"5min":1.46,"15min":1.46},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.028,"5min":0.93100000000000005,"15min":0.91100000000000003},"min":{"1min":0.73399999999999999,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":0.85899999999999999}]},{"osd":3,"last update":"Tue Feb 13 14:45:25 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.0489999999999999,"15min":1.0109999999999999},"min":{"1min":0.73299999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.01,"15min":0.95999999999999996},"min":{"1min":0.78400000000000003,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.4139999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.151}]},{"osd":5,"last update":"Tue Feb 13 14:46:13 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.95699999999999996,"15min":0.83699999999999997},"min":{"1min":0.52000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7549999999999999,"5min":1.829,"15min":1.829},"last":1.2789999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.0109999999999999,"15min":0.86299999999999999},"min":{"1min":0.76400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.1879999999999999}]},{"osd":6,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.96299999999999997,"15min":0.871},"min":{"1min":0.68700000000000006,"5min":0.317,"15min":0.317},"max":{"1min":1.6319999999999999,"5min":1.879,"15min":1.879},"last":1},{"interface":"front","average":{"1min":1.048,"5min":0.93100000000000005,"15min":0.84699999999999998},"min":{"1min":0.46300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Feb 13 14:45:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1000000000000001,"15min":1.079},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1659999999999999,"15min":1.194},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5129999999999999,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.95899999999999996}]}]},{"osd":5,"up_from":38,"seq":163208757312,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713252,"statfs":{"total":95995035648,"available":95962370048,"internally_reserved":0,"allocated":737280,"data_stored":295035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.117,"5min":1.393,"15min":1.393},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.91600000000000004,"15min":0.92900000000000005},"min":{"1min":0.59199999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.72,"15min":1.72},"last":0.94799999999999995}]},{"osd":1,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.92500000000000004},"min":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.544,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.2549999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.98499999999999999,"15min":0.91700000000000004},"min":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3340000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94799999999999995,"15min":0.93000000000000005},"min":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.999,"15min":0.94499999999999995},"min":{"1min":0.58399999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.417,"5min":1.637,"15min":1.637},"last":1.018}]},{"osd":3,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.98299999999999998,"15min":0.98099999999999998},"min":{"1min":0.55300000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.2190000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.58199999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.282,"5min":1.296,"15min":1.296},"last":1.127}]},{"osd":4,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.85799999999999998,"15min":0.80000000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82799999999999996,"15min":0.76000000000000001},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.179,"5min":1.387,"15min":1.387},"last":1.0580000000000001}]},{"osd":6,"last update":"Tue Feb 13 14:46:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85999999999999999,"15min":0.83599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.349,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.2030000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.0009999999999999,"15min":0.95699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.385,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.365}]},{"osd":7,"last update":"Tue Feb 13 14:45:57 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.145,"15min":1.1659999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4910000000000001,"5min":1.522,"15min":1.522},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.036,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.45,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.2290000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-13T14:46:28.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph pg dump --format=json 2024-02-13T14:46:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:29 smithi111 bash[23388]: audit 2024-02-13T14:46:27.781521+0000 mgr.y (mgr.14613) 107 : audit 0 from='client.14781 v1:172.21.15.62:0/2653582307' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T14:46:29.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:29 smithi062 bash[21479]: audit 2024-02-13T14:46:27.781521+0000 mgr.y (mgr.14613) 107 : audit 0 from='client.14781 v1:172.21.15.62:0/2653582307' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T14:46:29.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:29 smithi062 bash[28859]: audit 2024-02-13T14:46:27.781521+0000 mgr.y (mgr.14613) 107 : audit 0 from='client.14781 v1:172.21.15.62:0/2653582307' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T14:46:30.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:46:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:46:30.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:30 smithi111 bash[23388]: cluster 2024-02-13T14:46:28.696820+0000 mgr.y (mgr.14613) 108 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:30.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:30 smithi111 bash[23388]: audit 2024-02-13T14:46:29.352128+0000 mon.b (mon.1) 86 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:30.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:30 smithi062 bash[21479]: cluster 2024-02-13T14:46:28.696820+0000 mgr.y (mgr.14613) 108 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:30.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:30 smithi062 bash[21479]: audit 2024-02-13T14:46:29.352128+0000 mon.b (mon.1) 86 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:30.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:30 smithi062 bash[28859]: cluster 2024-02-13T14:46:28.696820+0000 mgr.y (mgr.14613) 108 : cluster 0 pgmap v65: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:30.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:30 smithi062 bash[28859]: audit 2024-02-13T14:46:29.352128+0000 mon.b (mon.1) 86 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:31.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:31 smithi062 bash[21479]: audit 2024-02-13T14:46:30.000282+0000 mgr.y (mgr.14613) 109 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:31.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:31 smithi062 bash[28859]: audit 2024-02-13T14:46:30.000282+0000 mgr.y (mgr.14613) 109 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:31.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:31 smithi111 bash[23388]: audit 2024-02-13T14:46:30.000282+0000 mgr.y (mgr.14613) 109 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:32.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:32 smithi062 bash[21479]: cluster 2024-02-13T14:46:30.698239+0000 mgr.y (mgr.14613) 110 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:32.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:32 smithi062 bash[28859]: cluster 2024-02-13T14:46:30.698239+0000 mgr.y (mgr.14613) 110 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:32.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:32 smithi111 bash[23388]: cluster 2024-02-13T14:46:30.698239+0000 mgr.y (mgr.14613) 110 : cluster 0 pgmap v66: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:33.360 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:46:34.373 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:34 smithi062 bash[21479]: cluster 2024-02-13T14:46:32.698942+0000 mgr.y (mgr.14613) 111 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:34.374 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:34 smithi062 bash[28859]: cluster 2024-02-13T14:46:32.698942+0000 mgr.y (mgr.14613) 111 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:34 smithi111 bash[23388]: cluster 2024-02-13T14:46:32.698942+0000 mgr.y (mgr.14613) 111 : cluster 0 pgmap v67: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:36.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.231+0000 7f638ec44700 1 -- 172.21.15.62:0/3072796 >> v1:172.21.15.62:6790/0 conn(0x7f6388102c10 legacy=0x7f6388102ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.231+0000 7f638ec44700 1 -- 172.21.15.62:0/3072796 shutdown_connections 2024-02-13T14:46:36.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.231+0000 7f638ec44700 1 -- 172.21.15.62:0/3072796 >> 172.21.15.62:0/3072796 conn(0x7f63880fc480 msgr2=0x7f63880fe8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:36.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.231+0000 7f638ec44700 1 -- 172.21.15.62:0/3072796 shutdown_connections 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.231+0000 7f638ec44700 1 -- 172.21.15.62:0/3072796 wait complete. 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638ec44700 1 Processor -- start 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638ec44700 1 -- start start 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638ec44700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f63881a68e0 con 0x7f6388102c10 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638ec44700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f63881a7ac0 con 0x7f638810aa20 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638ec44700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f63881a8cc0 con 0x7f638810e530 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638c9e0700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6388102c10 0x7f638810a100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:46852/0 (socket says 172.21.15.62:46852) 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638c9e0700 1 -- 172.21.15.62:0/549786505 learned_addr learned my addr 172.21.15.62:0/549786505 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130173693 0 0) 0x7f63881a68e0 con 0x7f6388102c10 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63700031f0 con 0x7f6388102c10 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1982484255 0 0) 0x7f63881a8cc0 con 0x7f638810e530 2024-02-13T14:46:36.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63881a68e0 con 0x7f638810e530 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2794210325 0 0) 0x7f63700031f0 con 0x7f6388102c10 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f63881a8cc0 con 0x7f6388102c10 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f6378004540 con 0x7f6388102c10 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3427409039 0 0) 0x7f63881a68e0 con 0x7f638810e530 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f63700031f0 con 0x7f638810e530 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f6380001b70 con 0x7f638810e530 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873412885 0 0) 0x7f63881a7ac0 con 0x7f638810aa20 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63881a68e0 con 0x7f638810aa20 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1813922565 0 0) 0x7f63881a8cc0 con 0x7f6388102c10 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 >> v1:172.21.15.62:6790/0 conn(0x7f638810e530 legacy=0x7f63881a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 >> v1:172.21.15.111:6789/0 conn(0x7f638810aa20 legacy=0x7f63881a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63881a9ec0 con 0x7f6388102c10 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63881a8e50 con 0x7f6388102c10 2024-02-13T14:46:36.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f63881a92d0 con 0x7f6388102c10 2024-02-13T14:46:36.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f6378003ba0 con 0x7f6388102c10 2024-02-13T14:46:36.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638806a840 con 0x7f6388102c10 2024-02-13T14:46:36.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f6378005030 con 0x7f6388102c10 2024-02-13T14:46:36.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f6378005250 con 0x7f6388102c10 2024-02-13T14:46:36.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.235+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f63780893e0 con 0x7f6388102c10 2024-02-13T14:46:36.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.243+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f6378057280 con 0x7f6388102c10 2024-02-13T14:46:36.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:36 smithi062 bash[21479]: cluster 2024-02-13T14:46:34.700353+0000 mgr.y (mgr.14613) 112 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:36.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:36 smithi062 bash[28859]: cluster 2024-02-13T14:46:34.700353+0000 mgr.y (mgr.14613) 112 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:36.310 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:46:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:46:36.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.447+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 --> v1:172.21.15.62:6800/3802446050 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f638804f9a0 con 0x7f637006eec0 2024-02-13T14:46:36.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.487+0000 7f6385ffb700 1 -- 172.21.15.62:0/549786505 <== mgr.14613 v1:172.21.15.62:6800/3802446050 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+381886 (unknown 2965378022 0 2354140969) 0x7f638804f9a0 con 0x7f637006eec0 2024-02-13T14:46:36.491 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:46:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.491+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 >> v1:172.21.15.62:6800/3802446050 conn(0x7f637006eec0 legacy=0x7f6370071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.491+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 >> v1:172.21.15.62:6789/0 conn(0x7f6388102c10 legacy=0x7f638810a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.491+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 shutdown_connections 2024-02-13T14:46:36.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.491+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 >> 172.21.15.62:0/549786505 conn(0x7f63880fc480 msgr2=0x7f63880fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.491+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 shutdown_connections 2024-02-13T14:46:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:36.491+0000 7f638ec44700 1 -- 172.21.15.62:0/549786505 wait complete. 2024-02-13T14:46:36.495 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-02-13T14:46:36.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:36 smithi111 bash[23388]: cluster 2024-02-13T14:46:34.700353+0000 mgr.y (mgr.14613) 112 : cluster 0 pgmap v68: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:37.266 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-02-13T14:46:34.699186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596316,"num_objects":198,"num_object_clones":0,"num_object_copies":594,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":1110,"num_read_kb":956,"num_write":615,"num_write_kb":2461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":626,"ondisk_log_size":626,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":244548,"kb_used_data":7580,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":749716668,"statfs":{"total":767960285184,"available":767709868032,"internally_reserved":0,"allocated":7761920,"data_stored":4129756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005375"},"pg_stats":[{"pgid":"6.1b","version":"67'1","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025551+0000","last_change":"2024-02-13T14:43:41.077576+0000","last_active":"2024-02-13T14:45:30.025551+0000","last_peered":"2024-02-13T14:45:30.025551+0000","last_clean":"2024-02-13T14:45:30.025551+0000","last_became_active":"2024-02-13T14:43:41.075640+0000","last_became_peered":"2024-02-13T14:43:41.075640+0000","last_unstale":"2024-02-13T14:45:30.025551+0000","last_undegraded":"2024-02-13T14:45:30.025551+0000","last_fullsized":"2024-02-13T14:45:30.025551+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:19:15.831296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025133+0000","last_change":"2024-02-13T14:43:38.585426+0000","last_active":"2024-02-13T14:45:30.025133+0000","last_peered":"2024-02-13T14:45:30.025133+0000","last_clean":"2024-02-13T14:45:30.025133+0000","last_became_active":"2024-02-13T14:43:38.584997+0000","last_became_peered":"2024-02-13T14:43:38.584997+0000","last_unstale":"2024-02-13T14:45:30.025133+0000","last_undegraded":"2024-02-13T14:45:30.025133+0000","last_fullsized":"2024-02-13T14:45:30.025133+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:11:39.641463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035489+0000","last_change":"2024-02-13T14:43:34.397455+0000","last_active":"2024-02-13T14:45:30.035489+0000","last_peered":"2024-02-13T14:45:30.035489+0000","last_clean":"2024-02-13T14:45:30.035489+0000","last_became_active":"2024-02-13T14:43:34.397092+0000","last_became_peered":"2024-02-13T14:43:34.397092+0000","last_unstale":"2024-02-13T14:45:30.035489+0000","last_undegraded":"2024-02-13T14:45:30.035489+0000","last_fullsized":"2024-02-13T14:45:30.035489+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:48:47.259278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"67'10","reported_seq":50,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031095+0000","last_change":"2024-02-13T14:43:36.548135+0000","last_active":"2024-02-13T14:45:30.031095+0000","last_peered":"2024-02-13T14:45:30.031095+0000","last_clean":"2024-02-13T14:45:30.031095+0000","last_became_active":"2024-02-13T14:43:36.547737+0000","last_became_peered":"2024-02-13T14:43:36.547737+0000","last_unstale":"2024-02-13T14:45:30.031095+0000","last_undegraded":"2024-02-13T14:45:30.031095+0000","last_fullsized":"2024-02-13T14:45:30.031095+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:04:20.538260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,2],"acting":[3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025447+0000","last_change":"2024-02-13T14:43:40.639107+0000","last_active":"2024-02-13T14:45:30.025447+0000","last_peered":"2024-02-13T14:45:30.025447+0000","last_clean":"2024-02-13T14:45:30.025447+0000","last_became_active":"2024-02-13T14:43:40.636514+0000","last_became_peered":"2024-02-13T14:43:40.636514+0000","last_unstale":"2024-02-13T14:45:30.025447+0000","last_undegraded":"2024-02-13T14:45:30.025447+0000","last_fullsized":"2024-02-13T14:45:30.025447+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:35:18.185885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026418+0000","last_change":"2024-02-13T14:43:38.601065+0000","last_active":"2024-02-13T14:45:30.026418+0000","last_peered":"2024-02-13T14:45:30.026418+0000","last_clean":"2024-02-13T14:45:30.026418+0000","last_became_active":"2024-02-13T14:43:38.600530+0000","last_became_peered":"2024-02-13T14:43:38.600530+0000","last_unstale":"2024-02-13T14:45:30.026418+0000","last_undegraded":"2024-02-13T14:45:30.026418+0000","last_fullsized":"2024-02-13T14:45:30.026418+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:53:58.732553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031670+0000","last_change":"2024-02-13T14:43:34.402344+0000","last_active":"2024-02-13T14:45:30.031670+0000","last_peered":"2024-02-13T14:45:30.031670+0000","last_clean":"2024-02-13T14:45:30.031670+0000","last_became_active":"2024-02-13T14:43:34.401846+0000","last_became_peered":"2024-02-13T14:43:34.401846+0000","last_unstale":"2024-02-13T14:45:30.031670+0000","last_undegraded":"2024-02-13T14:45:30.031670+0000","last_fullsized":"2024-02-13T14:45:30.031670+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:49:31.325733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"67'11","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035406+0000","last_change":"2024-02-13T14:43:36.548122+0000","last_active":"2024-02-13T14:45:30.035406+0000","last_peered":"2024-02-13T14:45:30.035406+0000","last_clean":"2024-02-13T14:45:30.035406+0000","last_became_active":"2024-02-13T14:43:36.547716+0000","last_became_peered":"2024-02-13T14:43:36.547716+0000","last_unstale":"2024-02-13T14:45:30.035406+0000","last_undegraded":"2024-02-13T14:45:30.035406+0000","last_fullsized":"2024-02-13T14:45:30.035406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:08:54.967282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2],"acting":[0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101128+0000","last_change":"2024-02-13T14:43:40.660449+0000","last_active":"2024-02-13T14:45:30.101128+0000","last_peered":"2024-02-13T14:45:30.101128+0000","last_clean":"2024-02-13T14:45:30.101128+0000","last_became_active":"2024-02-13T14:43:40.659543+0000","last_became_peered":"2024-02-13T14:43:40.659543+0000","last_unstale":"2024-02-13T14:45:30.101128+0000","last_undegraded":"2024-02-13T14:45:30.101128+0000","last_fullsized":"2024-02-13T14:45:30.101128+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:17:22.125224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098174+0000","last_change":"2024-02-13T14:43:38.598047+0000","last_active":"2024-02-13T14:45:30.098174+0000","last_peered":"2024-02-13T14:45:30.098174+0000","last_clean":"2024-02-13T14:45:30.098174+0000","last_became_active":"2024-02-13T14:43:38.596306+0000","last_became_peered":"2024-02-13T14:43:38.596306+0000","last_unstale":"2024-02-13T14:45:30.098174+0000","last_undegraded":"2024-02-13T14:45:30.098174+0000","last_fullsized":"2024-02-13T14:45:30.098174+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:13:26.845570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"60'1","reported_seq":47,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100930+0000","last_change":"2024-02-13T14:43:34.409085+0000","last_active":"2024-02-13T14:45:30.100930+0000","last_peered":"2024-02-13T14:45:30.100930+0000","last_clean":"2024-02-13T14:45:30.100930+0000","last_became_active":"2024-02-13T14:43:34.408077+0000","last_became_peered":"2024-02-13T14:43:34.408077+0000","last_unstale":"2024-02-13T14:45:30.100930+0000","last_undegraded":"2024-02-13T14:45:30.100930+0000","last_fullsized":"2024-02-13T14:45:30.100930+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:32:57.867700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104089+0000","last_change":"2024-02-13T14:43:36.414326+0000","last_active":"2024-02-13T14:45:30.104089+0000","last_peered":"2024-02-13T14:45:30.104089+0000","last_clean":"2024-02-13T14:45:30.104089+0000","last_became_active":"2024-02-13T14:43:36.413940+0000","last_became_peered":"2024-02-13T14:43:36.413940+0000","last_unstale":"2024-02-13T14:45:30.104089+0000","last_undegraded":"2024-02-13T14:45:30.104089+0000","last_fullsized":"2024-02-13T14:45:30.104089+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:00:14.848648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033370+0000","last_change":"2024-02-13T14:43:40.654415+0000","last_active":"2024-02-13T14:45:30.033370+0000","last_peered":"2024-02-13T14:45:30.033370+0000","last_clean":"2024-02-13T14:45:30.033370+0000","last_became_active":"2024-02-13T14:43:40.653117+0000","last_became_peered":"2024-02-13T14:43:40.653117+0000","last_unstale":"2024-02-13T14:45:30.033370+0000","last_undegraded":"2024-02-13T14:45:30.033370+0000","last_fullsized":"2024-02-13T14:45:30.033370+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:52:11.182928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.102338+0000","last_change":"2024-02-13T14:43:38.610948+0000","last_active":"2024-02-13T14:45:30.102338+0000","last_peered":"2024-02-13T14:45:30.102338+0000","last_clean":"2024-02-13T14:45:30.102338+0000","last_became_active":"2024-02-13T14:43:38.610145+0000","last_became_peered":"2024-02-13T14:43:38.610145+0000","last_unstale":"2024-02-13T14:45:30.102338+0000","last_undegraded":"2024-02-13T14:45:30.102338+0000","last_fullsized":"2024-02-13T14:45:30.102338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:45:15.767650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100499+0000","last_change":"2024-02-13T14:43:34.405952+0000","last_active":"2024-02-13T14:45:30.100499+0000","last_peered":"2024-02-13T14:45:30.100499+0000","last_clean":"2024-02-13T14:45:30.100499+0000","last_became_active":"2024-02-13T14:43:34.405079+0000","last_became_peered":"2024-02-13T14:43:34.405079+0000","last_unstale":"2024-02-13T14:45:30.100499+0000","last_undegraded":"2024-02-13T14:45:30.100499+0000","last_fullsized":"2024-02-13T14:45:30.100499+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:14:16.859324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.103509+0000","last_change":"2024-02-13T14:43:36.407371+0000","last_active":"2024-02-13T14:45:30.103509+0000","last_peered":"2024-02-13T14:45:30.103509+0000","last_clean":"2024-02-13T14:45:30.103509+0000","last_became_active":"2024-02-13T14:43:36.406930+0000","last_became_peered":"2024-02-13T14:43:36.406930+0000","last_unstale":"2024-02-13T14:45:30.103509+0000","last_undegraded":"2024-02-13T14:45:30.103509+0000","last_fullsized":"2024-02-13T14:45:30.103509+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:00:46.211437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.032521+0000","last_change":"2024-02-13T14:43:41.071540+0000","last_active":"2024-02-13T14:45:30.032521+0000","last_peered":"2024-02-13T14:45:30.032521+0000","last_clean":"2024-02-13T14:45:30.032521+0000","last_became_active":"2024-02-13T14:43:41.070169+0000","last_became_peered":"2024-02-13T14:43:41.070169+0000","last_unstale":"2024-02-13T14:45:30.032521+0000","last_undegraded":"2024-02-13T14:45:30.032521+0000","last_fullsized":"2024-02-13T14:45:30.032521+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:22:14.394810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026547+0000","last_change":"2024-02-13T14:43:38.610170+0000","last_active":"2024-02-13T14:45:30.026547+0000","last_peered":"2024-02-13T14:45:30.026547+0000","last_clean":"2024-02-13T14:45:30.026547+0000","last_became_active":"2024-02-13T14:43:38.609739+0000","last_became_peered":"2024-02-13T14:43:38.609739+0000","last_unstale":"2024-02-13T14:45:30.026547+0000","last_undegraded":"2024-02-13T14:45:30.026547+0000","last_fullsized":"2024-02-13T14:45:30.026547+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:04:51.304582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104469+0000","last_change":"2024-02-13T14:45:30.103672+0000","last_active":"2024-02-13T14:45:30.104469+0000","last_peered":"2024-02-13T14:45:30.104469+0000","last_clean":"2024-02-13T14:45:30.104469+0000","last_became_active":"2024-02-13T14:45:30.102564+0000","last_became_peered":"2024-02-13T14:45:30.102564+0000","last_unstale":"2024-02-13T14:45:30.104469+0000","last_undegraded":"2024-02-13T14:45:30.104469+0000","last_fullsized":"2024-02-13T14:45:30.104469+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:26:21.462462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026534+0000","last_change":"2024-02-13T14:43:36.547956+0000","last_active":"2024-02-13T14:45:30.026534+0000","last_peered":"2024-02-13T14:45:30.026534+0000","last_clean":"2024-02-13T14:45:30.026534+0000","last_became_active":"2024-02-13T14:43:36.547533+0000","last_became_peered":"2024-02-13T14:43:36.547533+0000","last_unstale":"2024-02-13T14:45:30.026534+0000","last_undegraded":"2024-02-13T14:45:30.026534+0000","last_fullsized":"2024-02-13T14:45:30.026534+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:16:00.036174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027529+0000","last_change":"2024-02-13T14:43:41.071345+0000","last_active":"2024-02-13T14:45:30.027529+0000","last_peered":"2024-02-13T14:45:30.027529+0000","last_clean":"2024-02-13T14:45:30.027529+0000","last_became_active":"2024-02-13T14:43:41.070508+0000","last_became_peered":"2024-02-13T14:43:41.070508+0000","last_unstale":"2024-02-13T14:45:30.027529+0000","last_undegraded":"2024-02-13T14:45:30.027529+0000","last_fullsized":"2024-02-13T14:45:30.027529+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:35:27.630663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027786+0000","last_change":"2024-02-13T14:43:38.604772+0000","last_active":"2024-02-13T14:45:30.027786+0000","last_peered":"2024-02-13T14:45:30.027786+0000","last_clean":"2024-02-13T14:45:30.027786+0000","last_became_active":"2024-02-13T14:43:38.604230+0000","last_became_peered":"2024-02-13T14:43:38.604230+0000","last_unstale":"2024-02-13T14:45:30.027786+0000","last_undegraded":"2024-02-13T14:45:30.027786+0000","last_fullsized":"2024-02-13T14:45:30.027786+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:19:40.846301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099329+0000","last_change":"2024-02-13T14:43:34.416593+0000","last_active":"2024-02-13T14:45:30.099329+0000","last_peered":"2024-02-13T14:45:30.099329+0000","last_clean":"2024-02-13T14:45:30.099329+0000","last_became_active":"2024-02-13T14:43:34.415883+0000","last_became_peered":"2024-02-13T14:43:34.415883+0000","last_unstale":"2024-02-13T14:45:30.099329+0000","last_undegraded":"2024-02-13T14:45:30.099329+0000","last_fullsized":"2024-02-13T14:45:30.099329+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:12:21.980486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"67'5","reported_seq":46,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035670+0000","last_change":"2024-02-13T14:43:36.420806+0000","last_active":"2024-02-13T14:45:30.035670+0000","last_peered":"2024-02-13T14:45:30.035670+0000","last_clean":"2024-02-13T14:45:30.035670+0000","last_became_active":"2024-02-13T14:43:36.416670+0000","last_became_peered":"2024-02-13T14:43:36.416670+0000","last_unstale":"2024-02-13T14:45:30.035670+0000","last_undegraded":"2024-02-13T14:45:30.035670+0000","last_fullsized":"2024-02-13T14:45:30.035670+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:08:31.828307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7],"acting":[0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.028054+0000","last_change":"2024-02-13T14:43:40.644411+0000","last_active":"2024-02-13T14:45:30.028054+0000","last_peered":"2024-02-13T14:45:30.028054+0000","last_clean":"2024-02-13T14:45:30.028054+0000","last_became_active":"2024-02-13T14:43:40.643570+0000","last_became_peered":"2024-02-13T14:43:40.643570+0000","last_unstale":"2024-02-13T14:45:30.028054+0000","last_undegraded":"2024-02-13T14:45:30.028054+0000","last_fullsized":"2024-02-13T14:45:30.028054+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:41:19.571448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035263+0000","last_change":"2024-02-13T14:43:38.585484+0000","last_active":"2024-02-13T14:45:30.035263+0000","last_peered":"2024-02-13T14:45:30.035263+0000","last_clean":"2024-02-13T14:45:30.035263+0000","last_became_active":"2024-02-13T14:43:38.584143+0000","last_became_peered":"2024-02-13T14:43:38.584143+0000","last_unstale":"2024-02-13T14:45:30.035263+0000","last_undegraded":"2024-02-13T14:45:30.035263+0000","last_fullsized":"2024-02-13T14:45:30.035263+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:39:30.445955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"60'1","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025989+0000","last_change":"2024-02-13T14:43:34.412618+0000","last_active":"2024-02-13T14:45:30.025989+0000","last_peered":"2024-02-13T14:45:30.025989+0000","last_clean":"2024-02-13T14:45:30.025989+0000","last_became_active":"2024-02-13T14:43:34.412308+0000","last_became_peered":"2024-02-13T14:43:34.412308+0000","last_unstale":"2024-02-13T14:45:30.025989+0000","last_undegraded":"2024-02-13T14:45:30.025989+0000","last_fullsized":"2024-02-13T14:45:30.025989+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:59:28.336275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"67'9","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.029379+0000","last_change":"2024-02-13T14:43:36.418590+0000","last_active":"2024-02-13T14:45:30.029379+0000","last_peered":"2024-02-13T14:45:30.029379+0000","last_clean":"2024-02-13T14:45:30.029379+0000","last_became_active":"2024-02-13T14:43:36.414905+0000","last_became_peered":"2024-02-13T14:43:36.414905+0000","last_unstale":"2024-02-13T14:45:30.029379+0000","last_undegraded":"2024-02-13T14:45:30.029379+0000","last_fullsized":"2024-02-13T14:45:30.029379+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:00:53.021647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1c","version":"67'1","reported_seq":29,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101922+0000","last_change":"2024-02-13T14:43:40.651423+0000","last_active":"2024-02-13T14:45:30.101922+0000","last_peered":"2024-02-13T14:45:30.101922+0000","last_clean":"2024-02-13T14:45:30.101922+0000","last_became_active":"2024-02-13T14:43:40.650649+0000","last_became_peered":"2024-02-13T14:43:40.650649+0000","last_unstale":"2024-02-13T14:45:30.101922+0000","last_undegraded":"2024-02-13T14:45:30.101922+0000","last_fullsized":"2024-02-13T14:45:30.101922+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:13:56.120241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":369,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"67'11","reported_seq":85,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.615827+0000","last_change":"2024-02-13T14:43:38.594934+0000","last_active":"2024-02-13T14:46:29.615827+0000","last_peered":"2024-02-13T14:46:29.615827+0000","last_clean":"2024-02-13T14:46:29.615827+0000","last_became_active":"2024-02-13T14:43:38.594407+0000","last_became_peered":"2024-02-13T14:43:38.594407+0000","last_unstale":"2024-02-13T14:46:29.615827+0000","last_undegraded":"2024-02-13T14:46:29.615827+0000","last_fullsized":"2024-02-13T14:46:29.615827+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:00:57.577752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"60'1","reported_seq":48,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100303+0000","last_change":"2024-02-13T14:43:34.409165+0000","last_active":"2024-02-13T14:45:30.100303+0000","last_peered":"2024-02-13T14:45:30.100303+0000","last_clean":"2024-02-13T14:45:30.100303+0000","last_became_active":"2024-02-13T14:43:34.408187+0000","last_became_peered":"2024-02-13T14:43:34.408187+0000","last_unstale":"2024-02-13T14:45:30.100303+0000","last_undegraded":"2024-02-13T14:45:30.100303+0000","last_fullsized":"2024-02-13T14:45:30.100303+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:11:50.089140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":874,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"67'15","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025985+0000","last_change":"2024-02-13T14:43:36.411974+0000","last_active":"2024-02-13T14:45:30.025985+0000","last_peered":"2024-02-13T14:45:30.025985+0000","last_clean":"2024-02-13T14:45:30.025985+0000","last_became_active":"2024-02-13T14:43:36.411078+0000","last_became_peered":"2024-02-13T14:43:36.411078+0000","last_unstale":"2024-02-13T14:45:30.025985+0000","last_undegraded":"2024-02-13T14:45:30.025985+0000","last_fullsized":"2024-02-13T14:45:30.025985+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:58:28.871172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031518+0000","last_change":"2024-02-13T14:43:41.077014+0000","last_active":"2024-02-13T14:45:30.031518+0000","last_peered":"2024-02-13T14:45:30.031518+0000","last_clean":"2024-02-13T14:45:30.031518+0000","last_became_active":"2024-02-13T14:43:41.075559+0000","last_became_peered":"2024-02-13T14:43:41.075559+0000","last_unstale":"2024-02-13T14:45:30.031518+0000","last_undegraded":"2024-02-13T14:45:30.031518+0000","last_fullsized":"2024-02-13T14:45:30.031518+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:59:07.743774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097975+0000","last_change":"2024-02-13T14:43:38.606016+0000","last_active":"2024-02-13T14:45:30.097975+0000","last_peered":"2024-02-13T14:45:30.097975+0000","last_clean":"2024-02-13T14:45:30.097975+0000","last_became_active":"2024-02-13T14:43:38.605511+0000","last_became_peered":"2024-02-13T14:43:38.605511+0000","last_unstale":"2024-02-13T14:45:30.097975+0000","last_undegraded":"2024-02-13T14:45:30.097975+0000","last_fullsized":"2024-02-13T14:45:30.097975+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:08:05.814881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101628+0000","last_change":"2024-02-13T14:43:34.423921+0000","last_active":"2024-02-13T14:45:30.101628+0000","last_peered":"2024-02-13T14:45:30.101628+0000","last_clean":"2024-02-13T14:45:30.101628+0000","last_became_active":"2024-02-13T14:43:34.423178+0000","last_became_peered":"2024-02-13T14:43:34.423178+0000","last_unstale":"2024-02-13T14:45:30.101628+0000","last_undegraded":"2024-02-13T14:45:30.101628+0000","last_fullsized":"2024-02-13T14:45:30.101628+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:29:56.629846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.103298+0000","last_change":"2024-02-13T14:43:36.414138+0000","last_active":"2024-02-13T14:45:30.103298+0000","last_peered":"2024-02-13T14:45:30.103298+0000","last_clean":"2024-02-13T14:45:30.103298+0000","last_became_active":"2024-02-13T14:43:36.413048+0000","last_became_peered":"2024-02-13T14:43:36.413048+0000","last_unstale":"2024-02-13T14:45:30.103298+0000","last_undegraded":"2024-02-13T14:45:30.103298+0000","last_fullsized":"2024-02-13T14:45:30.103298+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:10:46.093288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097716+0000","last_change":"2024-02-13T14:43:40.649345+0000","last_active":"2024-02-13T14:45:30.097716+0000","last_peered":"2024-02-13T14:45:30.097716+0000","last_clean":"2024-02-13T14:45:30.097716+0000","last_became_active":"2024-02-13T14:43:40.648303+0000","last_became_peered":"2024-02-13T14:43:40.648303+0000","last_unstale":"2024-02-13T14:45:30.097716+0000","last_undegraded":"2024-02-13T14:45:30.097716+0000","last_fullsized":"2024-02-13T14:45:30.097716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:41:39.558579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098979+0000","last_change":"2024-02-13T14:43:38.590758+0000","last_active":"2024-02-13T14:45:30.098979+0000","last_peered":"2024-02-13T14:45:30.098979+0000","last_clean":"2024-02-13T14:45:30.098979+0000","last_became_active":"2024-02-13T14:43:38.589655+0000","last_became_peered":"2024-02-13T14:43:38.589655+0000","last_unstale":"2024-02-13T14:45:30.098979+0000","last_undegraded":"2024-02-13T14:45:30.098979+0000","last_fullsized":"2024-02-13T14:45:30.098979+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:26:04.863247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104173+0000","last_change":"2024-02-13T14:43:34.396569+0000","last_active":"2024-02-13T14:45:30.104173+0000","last_peered":"2024-02-13T14:45:30.104173+0000","last_clean":"2024-02-13T14:45:30.104173+0000","last_became_active":"2024-02-13T14:43:34.394454+0000","last_became_peered":"2024-02-13T14:43:34.394454+0000","last_unstale":"2024-02-13T14:45:30.104173+0000","last_undegraded":"2024-02-13T14:45:30.104173+0000","last_fullsized":"2024-02-13T14:45:30.104173+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:11:14.981297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"67'6","reported_seq":45,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035232+0000","last_change":"2024-02-13T14:43:36.427172+0000","last_active":"2024-02-13T14:45:30.035232+0000","last_peered":"2024-02-13T14:45:30.035232+0000","last_clean":"2024-02-13T14:45:30.035232+0000","last_became_active":"2024-02-13T14:43:36.426157+0000","last_became_peered":"2024-02-13T14:43:36.426157+0000","last_unstale":"2024-02-13T14:45:30.035232+0000","last_undegraded":"2024-02-13T14:45:30.035232+0000","last_fullsized":"2024-02-13T14:45:30.035232+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:11:26.475496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025718+0000","last_change":"2024-02-13T14:43:40.654721+0000","last_active":"2024-02-13T14:45:30.025718+0000","last_peered":"2024-02-13T14:45:30.025718+0000","last_clean":"2024-02-13T14:45:30.025718+0000","last_became_active":"2024-02-13T14:43:40.653912+0000","last_became_peered":"2024-02-13T14:43:40.653912+0000","last_unstale":"2024-02-13T14:45:30.025718+0000","last_undegraded":"2024-02-13T14:45:30.025718+0000","last_fullsized":"2024-02-13T14:45:30.025718+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:43:47.477628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027426+0000","last_change":"2024-02-13T14:43:38.609232+0000","last_active":"2024-02-13T14:45:30.027426+0000","last_peered":"2024-02-13T14:45:30.027426+0000","last_clean":"2024-02-13T14:45:30.027426+0000","last_became_active":"2024-02-13T14:43:38.608315+0000","last_became_peered":"2024-02-13T14:43:38.608315+0000","last_unstale":"2024-02-13T14:45:30.027426+0000","last_undegraded":"2024-02-13T14:45:30.027426+0000","last_fullsized":"2024-02-13T14:45:30.027426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:57:38.062519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026918+0000","last_change":"2024-02-13T14:43:34.398663+0000","last_active":"2024-02-13T14:45:30.026918+0000","last_peered":"2024-02-13T14:45:30.026918+0000","last_clean":"2024-02-13T14:45:30.026918+0000","last_became_active":"2024-02-13T14:43:34.398287+0000","last_became_peered":"2024-02-13T14:43:34.398287+0000","last_unstale":"2024-02-13T14:45:30.026918+0000","last_undegraded":"2024-02-13T14:45:30.026918+0000","last_fullsized":"2024-02-13T14:45:30.026918+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:30:30.050584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026085+0000","last_change":"2024-02-13T14:43:36.408314+0000","last_active":"2024-02-13T14:45:30.026085+0000","last_peered":"2024-02-13T14:45:30.026085+0000","last_clean":"2024-02-13T14:45:30.026085+0000","last_became_active":"2024-02-13T14:43:36.407891+0000","last_became_peered":"2024-02-13T14:43:36.407891+0000","last_unstale":"2024-02-13T14:45:30.026085+0000","last_undegraded":"2024-02-13T14:45:30.026085+0000","last_fullsized":"2024-02-13T14:45:30.026085+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:20:51.354944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033092+0000","last_change":"2024-02-13T14:43:40.664206+0000","last_active":"2024-02-13T14:45:30.033092+0000","last_peered":"2024-02-13T14:45:30.033092+0000","last_clean":"2024-02-13T14:45:30.033092+0000","last_became_active":"2024-02-13T14:43:40.654663+0000","last_became_peered":"2024-02-13T14:43:40.654663+0000","last_unstale":"2024-02-13T14:45:30.033092+0000","last_undegraded":"2024-02-13T14:45:30.033092+0000","last_fullsized":"2024-02-13T14:45:30.033092+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:59:26.438166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031079+0000","last_change":"2024-02-13T14:43:38.604703+0000","last_active":"2024-02-13T14:45:30.031079+0000","last_peered":"2024-02-13T14:45:30.031079+0000","last_clean":"2024-02-13T14:45:30.031079+0000","last_became_active":"2024-02-13T14:43:38.603902+0000","last_became_peered":"2024-02-13T14:43:38.603902+0000","last_unstale":"2024-02-13T14:45:30.031079+0000","last_undegraded":"2024-02-13T14:45:30.031079+0000","last_fullsized":"2024-02-13T14:45:30.031079+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:33:41.346058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100828+0000","last_change":"2024-02-13T14:43:34.421243+0000","last_active":"2024-02-13T14:45:30.100828+0000","last_peered":"2024-02-13T14:45:30.100828+0000","last_clean":"2024-02-13T14:45:30.100828+0000","last_became_active":"2024-02-13T14:43:34.420558+0000","last_became_peered":"2024-02-13T14:43:34.420558+0000","last_unstale":"2024-02-13T14:45:30.100828+0000","last_undegraded":"2024-02-13T14:45:30.100828+0000","last_fullsized":"2024-02-13T14:45:30.100828+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:55:12.994592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"67'9","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101201+0000","last_change":"2024-02-13T14:43:36.408106+0000","last_active":"2024-02-13T14:45:30.101201+0000","last_peered":"2024-02-13T14:45:30.101201+0000","last_clean":"2024-02-13T14:45:30.101201+0000","last_became_active":"2024-02-13T14:43:36.407838+0000","last_became_peered":"2024-02-13T14:43:36.407838+0000","last_unstale":"2024-02-13T14:45:30.101201+0000","last_undegraded":"2024-02-13T14:45:30.101201+0000","last_fullsized":"2024-02-13T14:45:30.101201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:46:29.140052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027423+0000","last_change":"2024-02-13T14:43:40.645153+0000","last_active":"2024-02-13T14:45:30.027423+0000","last_peered":"2024-02-13T14:45:30.027423+0000","last_clean":"2024-02-13T14:45:30.027423+0000","last_became_active":"2024-02-13T14:43:40.644206+0000","last_became_peered":"2024-02-13T14:43:40.644206+0000","last_unstale":"2024-02-13T14:45:30.027423+0000","last_undegraded":"2024-02-13T14:45:30.027423+0000","last_fullsized":"2024-02-13T14:45:30.027423+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:29:56.638474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.615855+0000","last_change":"2024-02-13T14:43:38.604997+0000","last_active":"2024-02-13T14:46:29.615855+0000","last_peered":"2024-02-13T14:46:29.615855+0000","last_clean":"2024-02-13T14:46:29.615855+0000","last_became_active":"2024-02-13T14:43:38.604048+0000","last_became_peered":"2024-02-13T14:43:38.604048+0000","last_unstale":"2024-02-13T14:46:29.615855+0000","last_undegraded":"2024-02-13T14:46:29.615855+0000","last_fullsized":"2024-02-13T14:46:29.615855+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:51:09.297727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035834+0000","last_change":"2024-02-13T14:43:34.395935+0000","last_active":"2024-02-13T14:45:30.035834+0000","last_peered":"2024-02-13T14:45:30.035834+0000","last_clean":"2024-02-13T14:45:30.035834+0000","last_became_active":"2024-02-13T14:43:34.394891+0000","last_became_peered":"2024-02-13T14:43:34.394891+0000","last_unstale":"2024-02-13T14:45:30.035834+0000","last_undegraded":"2024-02-13T14:45:30.035834+0000","last_fullsized":"2024-02-13T14:45:30.035834+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:54:20.234779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"67'9","reported_seq":52,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.034526+0000","last_change":"2024-02-13T14:43:36.425566+0000","last_active":"2024-02-13T14:45:30.034526+0000","last_peered":"2024-02-13T14:45:30.034526+0000","last_clean":"2024-02-13T14:45:30.034526+0000","last_became_active":"2024-02-13T14:43:36.424693+0000","last_became_peered":"2024-02-13T14:43:36.424693+0000","last_unstale":"2024-02-13T14:45:30.034526+0000","last_undegraded":"2024-02-13T14:45:30.034526+0000","last_fullsized":"2024-02-13T14:45:30.034526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:11:09.257409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.034931+0000","last_change":"2024-02-13T14:43:40.655616+0000","last_active":"2024-02-13T14:45:30.034931+0000","last_peered":"2024-02-13T14:45:30.034931+0000","last_clean":"2024-02-13T14:45:30.034931+0000","last_became_active":"2024-02-13T14:43:40.654559+0000","last_became_peered":"2024-02-13T14:43:40.654559+0000","last_unstale":"2024-02-13T14:45:30.034931+0000","last_undegraded":"2024-02-13T14:45:30.034931+0000","last_fullsized":"2024-02-13T14:45:30.034931+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:34:04.826689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"67'11","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.616091+0000","last_change":"2024-02-13T14:43:38.613232+0000","last_active":"2024-02-13T14:46:29.616091+0000","last_peered":"2024-02-13T14:46:29.616091+0000","last_clean":"2024-02-13T14:46:29.616091+0000","last_became_active":"2024-02-13T14:43:38.612636+0000","last_became_peered":"2024-02-13T14:43:38.612636+0000","last_unstale":"2024-02-13T14:46:29.616091+0000","last_undegraded":"2024-02-13T14:46:29.616091+0000","last_fullsized":"2024-02-13T14:46:29.616091+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:36:57.002295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100187+0000","last_change":"2024-02-13T14:43:34.411694+0000","last_active":"2024-02-13T14:45:30.100187+0000","last_peered":"2024-02-13T14:45:30.100187+0000","last_clean":"2024-02-13T14:45:30.100187+0000","last_became_active":"2024-02-13T14:43:34.410711+0000","last_became_peered":"2024-02-13T14:43:34.410711+0000","last_unstale":"2024-02-13T14:45:30.100187+0000","last_undegraded":"2024-02-13T14:45:30.100187+0000","last_fullsized":"2024-02-13T14:45:30.100187+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:35:37.039562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"67'11","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101897+0000","last_change":"2024-02-13T14:43:36.550281+0000","last_active":"2024-02-13T14:45:30.101897+0000","last_peered":"2024-02-13T14:45:30.101897+0000","last_clean":"2024-02-13T14:45:30.101897+0000","last_became_active":"2024-02-13T14:43:36.549769+0000","last_became_peered":"2024-02-13T14:43:36.549769+0000","last_unstale":"2024-02-13T14:45:30.101897+0000","last_undegraded":"2024-02-13T14:45:30.101897+0000","last_fullsized":"2024-02-13T14:45:30.101897+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:42:36.018067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100646+0000","last_change":"2024-02-13T14:43:41.073322+0000","last_active":"2024-02-13T14:45:30.100646+0000","last_peered":"2024-02-13T14:45:30.100646+0000","last_clean":"2024-02-13T14:45:30.100646+0000","last_became_active":"2024-02-13T14:43:41.072424+0000","last_became_peered":"2024-02-13T14:43:41.072424+0000","last_unstale":"2024-02-13T14:45:30.100646+0000","last_undegraded":"2024-02-13T14:45:30.100646+0000","last_fullsized":"2024-02-13T14:45:30.100646+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:58:53.528233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104452+0000","last_change":"2024-02-13T14:43:38.606673+0000","last_active":"2024-02-13T14:45:30.104452+0000","last_peered":"2024-02-13T14:45:30.104452+0000","last_clean":"2024-02-13T14:45:30.104452+0000","last_became_active":"2024-02-13T14:43:38.605756+0000","last_became_peered":"2024-02-13T14:43:38.605756+0000","last_unstale":"2024-02-13T14:45:30.104452+0000","last_undegraded":"2024-02-13T14:45:30.104452+0000","last_fullsized":"2024-02-13T14:45:30.104452+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:28:46.776873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099349+0000","last_change":"2024-02-13T14:43:34.412693+0000","last_active":"2024-02-13T14:45:30.099349+0000","last_peered":"2024-02-13T14:45:30.099349+0000","last_clean":"2024-02-13T14:45:30.099349+0000","last_became_active":"2024-02-13T14:43:34.410736+0000","last_became_peered":"2024-02-13T14:43:34.410736+0000","last_unstale":"2024-02-13T14:45:30.099349+0000","last_undegraded":"2024-02-13T14:45:30.099349+0000","last_fullsized":"2024-02-13T14:45:30.099349+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:27:02.711192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"67'4","reported_seq":42,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099138+0000","last_change":"2024-02-13T14:43:36.413948+0000","last_active":"2024-02-13T14:45:30.099138+0000","last_peered":"2024-02-13T14:45:30.099138+0000","last_clean":"2024-02-13T14:45:30.099138+0000","last_became_active":"2024-02-13T14:43:36.413615+0000","last_became_peered":"2024-02-13T14:43:36.413615+0000","last_unstale":"2024-02-13T14:45:30.099138+0000","last_undegraded":"2024-02-13T14:45:30.099138+0000","last_fullsized":"2024-02-13T14:45:30.099138+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:51:20.009395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098961+0000","last_change":"2024-02-13T14:43:40.651699+0000","last_active":"2024-02-13T14:45:30.098961+0000","last_peered":"2024-02-13T14:45:30.098961+0000","last_clean":"2024-02-13T14:45:30.098961+0000","last_became_active":"2024-02-13T14:43:40.648932+0000","last_became_peered":"2024-02-13T14:43:40.648932+0000","last_unstale":"2024-02-13T14:45:30.098961+0000","last_undegraded":"2024-02-13T14:45:30.098961+0000","last_fullsized":"2024-02-13T14:45:30.098961+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:35:29.596675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.032774+0000","last_change":"2024-02-13T14:43:38.605336+0000","last_active":"2024-02-13T14:45:30.032774+0000","last_peered":"2024-02-13T14:45:30.032774+0000","last_clean":"2024-02-13T14:45:30.032774+0000","last_became_active":"2024-02-13T14:43:38.604782+0000","last_became_peered":"2024-02-13T14:43:38.604782+0000","last_unstale":"2024-02-13T14:45:30.032774+0000","last_undegraded":"2024-02-13T14:45:30.032774+0000","last_fullsized":"2024-02-13T14:45:30.032774+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:33:01.139138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097823+0000","last_change":"2024-02-13T14:43:34.390068+0000","last_active":"2024-02-13T14:45:30.097823+0000","last_peered":"2024-02-13T14:45:30.097823+0000","last_clean":"2024-02-13T14:45:30.097823+0000","last_became_active":"2024-02-13T14:43:34.389268+0000","last_became_peered":"2024-02-13T14:43:34.389268+0000","last_unstale":"2024-02-13T14:45:30.097823+0000","last_undegraded":"2024-02-13T14:45:30.097823+0000","last_fullsized":"2024-02-13T14:45:30.097823+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:07:23.678354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"67'11","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097797+0000","last_change":"2024-02-13T14:43:36.407382+0000","last_active":"2024-02-13T14:45:30.097797+0000","last_peered":"2024-02-13T14:45:30.097797+0000","last_clean":"2024-02-13T14:45:30.097797+0000","last_became_active":"2024-02-13T14:43:36.406992+0000","last_became_peered":"2024-02-13T14:43:36.406992+0000","last_unstale":"2024-02-13T14:45:30.097797+0000","last_undegraded":"2024-02-13T14:45:30.097797+0000","last_fullsized":"2024-02-13T14:45:30.097797+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:06:52.980265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031359+0000","last_change":"2024-02-13T14:43:40.657649+0000","last_active":"2024-02-13T14:45:30.031359+0000","last_peered":"2024-02-13T14:45:30.031359+0000","last_clean":"2024-02-13T14:45:30.031359+0000","last_became_active":"2024-02-13T14:43:40.656546+0000","last_became_peered":"2024-02-13T14:43:40.656546+0000","last_unstale":"2024-02-13T14:45:30.031359+0000","last_undegraded":"2024-02-13T14:45:30.031359+0000","last_fullsized":"2024-02-13T14:45:30.031359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:27:59.696610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"60'2","reported_seq":56,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026708+0000","last_change":"2024-02-13T14:43:34.396569+0000","last_active":"2024-02-13T14:45:30.026708+0000","last_peered":"2024-02-13T14:45:30.026708+0000","last_clean":"2024-02-13T14:45:30.026708+0000","last_became_active":"2024-02-13T14:43:34.395778+0000","last_became_peered":"2024-02-13T14:43:34.395778+0000","last_unstale":"2024-02-13T14:45:30.026708+0000","last_undegraded":"2024-02-13T14:45:30.026708+0000","last_fullsized":"2024-02-13T14:45:30.026708+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:45:48.160852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"67'11","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101554+0000","last_change":"2024-02-13T14:43:36.408462+0000","last_active":"2024-02-13T14:45:30.101554+0000","last_peered":"2024-02-13T14:45:30.101554+0000","last_clean":"2024-02-13T14:45:30.101554+0000","last_became_active":"2024-02-13T14:43:36.408080+0000","last_became_peered":"2024-02-13T14:43:36.408080+0000","last_unstale":"2024-02-13T14:45:30.101554+0000","last_undegraded":"2024-02-13T14:45:30.101554+0000","last_fullsized":"2024-02-13T14:45:30.101554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:53:38.807867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097760+0000","last_change":"2024-02-13T14:43:38.604548+0000","last_active":"2024-02-13T14:45:30.097760+0000","last_peered":"2024-02-13T14:45:30.097760+0000","last_clean":"2024-02-13T14:45:30.097760+0000","last_became_active":"2024-02-13T14:43:38.603700+0000","last_became_peered":"2024-02-13T14:43:38.603700+0000","last_unstale":"2024-02-13T14:45:30.097760+0000","last_undegraded":"2024-02-13T14:45:30.097760+0000","last_fullsized":"2024-02-13T14:45:30.097760+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:38:40.371320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033272+0000","last_change":"2024-02-13T14:43:40.664806+0000","last_active":"2024-02-13T14:45:30.033272+0000","last_peered":"2024-02-13T14:45:30.033272+0000","last_clean":"2024-02-13T14:45:30.033272+0000","last_became_active":"2024-02-13T14:43:40.656591+0000","last_became_peered":"2024-02-13T14:43:40.656591+0000","last_unstale":"2024-02-13T14:45:30.033272+0000","last_undegraded":"2024-02-13T14:45:30.033272+0000","last_fullsized":"2024-02-13T14:45:30.033272+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:28:50.932219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027687+0000","last_change":"2024-02-13T14:43:34.394680+0000","last_active":"2024-02-13T14:45:30.027687+0000","last_peered":"2024-02-13T14:45:30.027687+0000","last_clean":"2024-02-13T14:45:30.027687+0000","last_became_active":"2024-02-13T14:43:34.393886+0000","last_became_peered":"2024-02-13T14:43:34.393886+0000","last_unstale":"2024-02-13T14:45:30.027687+0000","last_undegraded":"2024-02-13T14:45:30.027687+0000","last_fullsized":"2024-02-13T14:45:30.027687+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:39:29.821411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"67'16","reported_seq":95,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.616179+0000","last_change":"2024-02-13T14:43:36.547863+0000","last_active":"2024-02-13T14:46:29.616179+0000","last_peered":"2024-02-13T14:46:29.616179+0000","last_clean":"2024-02-13T14:46:29.616179+0000","last_became_active":"2024-02-13T14:43:36.547476+0000","last_became_peered":"2024-02-13T14:43:36.547476+0000","last_unstale":"2024-02-13T14:46:29.616179+0000","last_undegraded":"2024-02-13T14:46:29.616179+0000","last_fullsized":"2024-02-13T14:46:29.616179+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:20:06.215661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":25,"num_read_kb":15,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"70'2","reported_seq":43,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027165+0000","last_change":"2024-02-13T14:43:46.668483+0000","last_active":"2024-02-13T14:45:30.027165+0000","last_peered":"2024-02-13T14:45:30.027165+0000","last_clean":"2024-02-13T14:45:30.027165+0000","last_became_active":"2024-02-13T14:43:37.581652+0000","last_became_peered":"2024-02-13T14:43:37.581652+0000","last_unstale":"2024-02-13T14:45:30.027165+0000","last_undegraded":"2024-02-13T14:45:30.027165+0000","last_fullsized":"2024-02-13T14:45:30.027165+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_clean_scrub_stamp":"2024-02-13T14:43:36.381263+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:57:31.733417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041123319999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"67'11","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.615756+0000","last_change":"2024-02-13T14:43:38.592776+0000","last_active":"2024-02-13T14:46:29.615756+0000","last_peered":"2024-02-13T14:46:29.615756+0000","last_clean":"2024-02-13T14:46:29.615756+0000","last_became_active":"2024-02-13T14:43:38.592175+0000","last_became_peered":"2024-02-13T14:43:38.592175+0000","last_unstale":"2024-02-13T14:46:29.615756+0000","last_undegraded":"2024-02-13T14:46:29.615756+0000","last_fullsized":"2024-02-13T14:46:29.615756+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:19:43.508963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.031404+0000","last_change":"2024-02-13T14:43:40.641330+0000","last_active":"2024-02-13T14:45:30.031404+0000","last_peered":"2024-02-13T14:45:30.031404+0000","last_clean":"2024-02-13T14:45:30.031404+0000","last_became_active":"2024-02-13T14:43:40.640185+0000","last_became_peered":"2024-02-13T14:43:40.640185+0000","last_unstale":"2024-02-13T14:45:30.031404+0000","last_undegraded":"2024-02-13T14:45:30.031404+0000","last_fullsized":"2024-02-13T14:45:30.031404+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:52:08.724355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100436+0000","last_change":"2024-02-13T14:43:34.421845+0000","last_active":"2024-02-13T14:45:30.100436+0000","last_peered":"2024-02-13T14:45:30.100436+0000","last_clean":"2024-02-13T14:45:30.100436+0000","last_became_active":"2024-02-13T14:43:34.421011+0000","last_became_peered":"2024-02-13T14:43:34.421011+0000","last_unstale":"2024-02-13T14:45:30.100436+0000","last_undegraded":"2024-02-13T14:45:30.100436+0000","last_fullsized":"2024-02-13T14:45:30.100436+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:51:52.760390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"67'19","reported_seq":72,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026744+0000","last_change":"2024-02-13T14:43:36.421879+0000","last_active":"2024-02-13T14:45:30.026744+0000","last_peered":"2024-02-13T14:45:30.026744+0000","last_clean":"2024-02-13T14:45:30.026744+0000","last_became_active":"2024-02-13T14:43:36.421567+0000","last_became_peered":"2024-02-13T14:43:36.421567+0000","last_unstale":"2024-02-13T14:45:30.026744+0000","last_undegraded":"2024-02-13T14:45:30.026744+0000","last_fullsized":"2024-02-13T14:45:30.026744+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:10:20.385410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035544+0000","last_change":"2024-02-13T14:43:38.578518+0000","last_active":"2024-02-13T14:45:30.035544+0000","last_peered":"2024-02-13T14:45:30.035544+0000","last_clean":"2024-02-13T14:45:30.035544+0000","last_became_active":"2024-02-13T14:43:38.577579+0000","last_became_peered":"2024-02-13T14:43:38.577579+0000","last_unstale":"2024-02-13T14:45:30.035544+0000","last_undegraded":"2024-02-13T14:45:30.035544+0000","last_fullsized":"2024-02-13T14:45:30.035544+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:16:51.058286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100524+0000","last_change":"2024-02-13T14:43:41.074165+0000","last_active":"2024-02-13T14:45:30.100524+0000","last_peered":"2024-02-13T14:45:30.100524+0000","last_clean":"2024-02-13T14:45:30.100524+0000","last_became_active":"2024-02-13T14:43:41.073113+0000","last_became_peered":"2024-02-13T14:43:41.073113+0000","last_unstale":"2024-02-13T14:45:30.100524+0000","last_undegraded":"2024-02-13T14:45:30.100524+0000","last_fullsized":"2024-02-13T14:45:30.100524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:35:18.795875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"67'18","reported_seq":68,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025745+0000","last_change":"2024-02-13T14:43:36.548185+0000","last_active":"2024-02-13T14:45:30.025745+0000","last_peered":"2024-02-13T14:45:30.025745+0000","last_clean":"2024-02-13T14:45:30.025745+0000","last_became_active":"2024-02-13T14:43:36.547862+0000","last_became_peered":"2024-02-13T14:43:36.547862+0000","last_unstale":"2024-02-13T14:45:30.025745+0000","last_undegraded":"2024-02-13T14:45:30.025745+0000","last_fullsized":"2024-02-13T14:45:30.025745+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:16:37.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098038+0000","last_change":"2024-02-13T14:43:34.392258+0000","last_active":"2024-02-13T14:45:30.098038+0000","last_peered":"2024-02-13T14:45:30.098038+0000","last_clean":"2024-02-13T14:45:30.098038+0000","last_became_active":"2024-02-13T14:43:34.391877+0000","last_became_peered":"2024-02-13T14:43:34.391877+0000","last_unstale":"2024-02-13T14:45:30.098038+0000","last_undegraded":"2024-02-13T14:45:30.098038+0000","last_fullsized":"2024-02-13T14:45:30.098038+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:11:43.876933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098806+0000","last_change":"2024-02-13T14:43:38.600288+0000","last_active":"2024-02-13T14:45:30.098806+0000","last_peered":"2024-02-13T14:45:30.098806+0000","last_clean":"2024-02-13T14:45:30.098806+0000","last_became_active":"2024-02-13T14:43:38.599299+0000","last_became_peered":"2024-02-13T14:43:38.599299+0000","last_unstale":"2024-02-13T14:45:30.098806+0000","last_undegraded":"2024-02-13T14:45:30.098806+0000","last_fullsized":"2024-02-13T14:45:30.098806+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:57:12.807763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104395+0000","last_change":"2024-02-13T14:43:40.659717+0000","last_active":"2024-02-13T14:45:30.104395+0000","last_peered":"2024-02-13T14:45:30.104395+0000","last_clean":"2024-02-13T14:45:30.104395+0000","last_became_active":"2024-02-13T14:43:40.658899+0000","last_became_peered":"2024-02-13T14:43:40.658899+0000","last_unstale":"2024-02-13T14:45:30.104395+0000","last_undegraded":"2024-02-13T14:45:30.104395+0000","last_fullsized":"2024-02-13T14:45:30.104395+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:38:33.801424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"67'10","reported_seq":50,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027795+0000","last_change":"2024-02-13T14:43:36.406123+0000","last_active":"2024-02-13T14:45:30.027795+0000","last_peered":"2024-02-13T14:45:30.027795+0000","last_clean":"2024-02-13T14:45:30.027795+0000","last_became_active":"2024-02-13T14:43:36.404405+0000","last_became_peered":"2024-02-13T14:43:36.404405+0000","last_unstale":"2024-02-13T14:45:30.027795+0000","last_undegraded":"2024-02-13T14:45:30.027795+0000","last_fullsized":"2024-02-13T14:45:30.027795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:18:57.260874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.102062+0000","last_change":"2024-02-13T14:43:34.398613+0000","last_active":"2024-02-13T14:45:30.102062+0000","last_peered":"2024-02-13T14:45:30.102062+0000","last_clean":"2024-02-13T14:45:30.102062+0000","last_became_active":"2024-02-13T14:43:34.396302+0000","last_became_peered":"2024-02-13T14:43:34.396302+0000","last_unstale":"2024-02-13T14:45:30.102062+0000","last_undegraded":"2024-02-13T14:45:30.102062+0000","last_fullsized":"2024-02-13T14:45:30.102062+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:39:27.898608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'128","reported_seq":282,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097359+0000","last_change":"2024-02-13T14:42:55.184522+0000","last_active":"2024-02-13T14:45:30.097359+0000","last_peered":"2024-02-13T14:45:30.097359+0000","last_clean":"2024-02-13T14:45:30.097359+0000","last_became_active":"2024-02-13T14:42:55.183484+0000","last_became_peered":"2024-02-13T14:42:55.183484+0000","last_unstale":"2024-02-13T14:45:30.097359+0000","last_undegraded":"2024-02-13T14:45:30.097359+0000","last_fullsized":"2024-02-13T14:45:30.097359+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:38:35.991267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:38:35.991267+0000","last_clean_scrub_stamp":"2024-02-13T14:38:35.991267+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:02:03.166622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101357+0000","last_change":"2024-02-13T14:43:38.604455+0000","last_active":"2024-02-13T14:45:30.101357+0000","last_peered":"2024-02-13T14:45:30.101357+0000","last_clean":"2024-02-13T14:45:30.101357+0000","last_became_active":"2024-02-13T14:43:38.599873+0000","last_became_peered":"2024-02-13T14:43:38.599873+0000","last_unstale":"2024-02-13T14:45:30.101357+0000","last_undegraded":"2024-02-13T14:45:30.101357+0000","last_fullsized":"2024-02-13T14:45:30.101357+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:17:21.648043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.026839+0000","last_change":"2024-02-13T14:43:40.661480+0000","last_active":"2024-02-13T14:45:30.026839+0000","last_peered":"2024-02-13T14:45:30.026839+0000","last_clean":"2024-02-13T14:45:30.026839+0000","last_became_active":"2024-02-13T14:43:40.660782+0000","last_became_peered":"2024-02-13T14:43:40.660782+0000","last_unstale":"2024-02-13T14:45:30.026839+0000","last_undegraded":"2024-02-13T14:45:30.026839+0000","last_fullsized":"2024-02-13T14:45:30.026839+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:53:58.613662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"67'14","reported_seq":57,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033910+0000","last_change":"2024-02-13T14:43:36.426090+0000","last_active":"2024-02-13T14:45:30.033910+0000","last_peered":"2024-02-13T14:45:30.033910+0000","last_clean":"2024-02-13T14:45:30.033910+0000","last_became_active":"2024-02-13T14:43:36.424878+0000","last_became_peered":"2024-02-13T14:43:36.424878+0000","last_unstale":"2024-02-13T14:45:30.033910+0000","last_undegraded":"2024-02-13T14:45:30.033910+0000","last_fullsized":"2024-02-13T14:45:30.033910+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:26:23.105032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097399+0000","last_change":"2024-02-13T14:43:34.403512+0000","last_active":"2024-02-13T14:45:30.097399+0000","last_peered":"2024-02-13T14:45:30.097399+0000","last_clean":"2024-02-13T14:45:30.097399+0000","last_became_active":"2024-02-13T14:43:34.402014+0000","last_became_peered":"2024-02-13T14:43:34.402014+0000","last_unstale":"2024-02-13T14:45:30.097399+0000","last_undegraded":"2024-02-13T14:45:30.097399+0000","last_fullsized":"2024-02-13T14:45:30.097399+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:37:45.500784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104081+0000","last_change":"2024-02-13T14:43:38.604096+0000","last_active":"2024-02-13T14:45:30.104081+0000","last_peered":"2024-02-13T14:45:30.104081+0000","last_clean":"2024-02-13T14:45:30.104081+0000","last_became_active":"2024-02-13T14:43:38.603337+0000","last_became_peered":"2024-02-13T14:43:38.603337+0000","last_unstale":"2024-02-13T14:45:30.104081+0000","last_undegraded":"2024-02-13T14:45:30.104081+0000","last_fullsized":"2024-02-13T14:45:30.104081+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:18:15.924642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025454+0000","last_change":"2024-02-13T14:43:41.071103+0000","last_active":"2024-02-13T14:45:30.025454+0000","last_peered":"2024-02-13T14:45:30.025454+0000","last_clean":"2024-02-13T14:45:30.025454+0000","last_became_active":"2024-02-13T14:43:41.069657+0000","last_became_peered":"2024-02-13T14:43:41.069657+0000","last_unstale":"2024-02-13T14:45:30.025454+0000","last_undegraded":"2024-02-13T14:45:30.025454+0000","last_fullsized":"2024-02-13T14:45:30.025454+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:23:57.812208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.100839+0000","last_change":"2024-02-13T14:43:34.407497+0000","last_active":"2024-02-13T14:45:30.100839+0000","last_peered":"2024-02-13T14:45:30.100839+0000","last_clean":"2024-02-13T14:45:30.100839+0000","last_became_active":"2024-02-13T14:43:34.406594+0000","last_became_peered":"2024-02-13T14:43:34.406594+0000","last_unstale":"2024-02-13T14:45:30.100839+0000","last_undegraded":"2024-02-13T14:45:30.100839+0000","last_fullsized":"2024-02-13T14:45:30.100839+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:48:56.771416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"67'30","reported_seq":123,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.615703+0000","last_change":"2024-02-13T14:43:36.548166+0000","last_active":"2024-02-13T14:46:29.615703+0000","last_peered":"2024-02-13T14:46:29.615703+0000","last_clean":"2024-02-13T14:46:29.615703+0000","last_became_active":"2024-02-13T14:43:36.547814+0000","last_became_peered":"2024-02-13T14:43:36.547814+0000","last_unstale":"2024-02-13T14:46:29.615703+0000","last_undegraded":"2024-02-13T14:46:29.615703+0000","last_fullsized":"2024-02-13T14:46:29.615703+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:37:22.327007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099582+0000","last_change":"2024-02-13T14:43:38.601053+0000","last_active":"2024-02-13T14:45:30.099582+0000","last_peered":"2024-02-13T14:45:30.099582+0000","last_clean":"2024-02-13T14:45:30.099582+0000","last_became_active":"2024-02-13T14:43:38.600149+0000","last_became_peered":"2024-02-13T14:43:38.600149+0000","last_unstale":"2024-02-13T14:45:30.099582+0000","last_undegraded":"2024-02-13T14:45:30.099582+0000","last_fullsized":"2024-02-13T14:45:30.099582+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T18:57:41.161430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025506+0000","last_change":"2024-02-13T14:43:40.644975+0000","last_active":"2024-02-13T14:45:30.025506+0000","last_peered":"2024-02-13T14:45:30.025506+0000","last_clean":"2024-02-13T14:45:30.025506+0000","last_became_active":"2024-02-13T14:43:40.644123+0000","last_became_peered":"2024-02-13T14:43:40.644123+0000","last_unstale":"2024-02-13T14:45:30.025506+0000","last_undegraded":"2024-02-13T14:45:30.025506+0000","last_fullsized":"2024-02-13T14:45:30.025506+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:27:41.842411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"60'1","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.029089+0000","last_change":"2024-02-13T14:43:34.403854+0000","last_active":"2024-02-13T14:45:30.029089+0000","last_peered":"2024-02-13T14:45:30.029089+0000","last_clean":"2024-02-13T14:45:30.029089+0000","last_became_active":"2024-02-13T14:43:34.403502+0000","last_became_peered":"2024-02-13T14:43:34.403502+0000","last_unstale":"2024-02-13T14:45:30.029089+0000","last_undegraded":"2024-02-13T14:45:30.029089+0000","last_fullsized":"2024-02-13T14:45:30.029089+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:43:44.971087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"67'13","reported_seq":62,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033051+0000","last_change":"2024-02-13T14:43:36.425810+0000","last_active":"2024-02-13T14:45:30.033051+0000","last_peered":"2024-02-13T14:45:30.033051+0000","last_clean":"2024-02-13T14:45:30.033051+0000","last_became_active":"2024-02-13T14:43:36.424613+0000","last_became_peered":"2024-02-13T14:43:36.424613+0000","last_unstale":"2024-02-13T14:45:30.033051+0000","last_undegraded":"2024-02-13T14:45:30.033051+0000","last_fullsized":"2024-02-13T14:45:30.033051+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:38:33.422831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"71'5","reported_seq":202,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:33.191338+0000","last_change":"2024-02-13T14:43:47.052444+0000","last_active":"2024-02-13T14:46:33.191338+0000","last_peered":"2024-02-13T14:46:33.191338+0000","last_clean":"2024-02-13T14:46:33.191338+0000","last_became_active":"2024-02-13T14:43:37.585093+0000","last_became_peered":"2024-02-13T14:43:37.585093+0000","last_unstale":"2024-02-13T14:46:33.191338+0000","last_undegraded":"2024-02-13T14:46:33.191338+0000","last_fullsized":"2024-02-13T14:46:33.191338+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_clean_scrub_stamp":"2024-02-13T14:43:36.381263+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:34:26.420455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002500979,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025384+0000","last_change":"2024-02-13T14:43:38.610656+0000","last_active":"2024-02-13T14:45:30.025384+0000","last_peered":"2024-02-13T14:45:30.025384+0000","last_clean":"2024-02-13T14:45:30.025384+0000","last_became_active":"2024-02-13T14:43:38.609882+0000","last_became_peered":"2024-02-13T14:43:38.609882+0000","last_unstale":"2024-02-13T14:45:30.025384+0000","last_undegraded":"2024-02-13T14:45:30.025384+0000","last_fullsized":"2024-02-13T14:45:30.025384+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:57:43.502668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097901+0000","last_change":"2024-02-13T14:43:41.075605+0000","last_active":"2024-02-13T14:45:30.097901+0000","last_peered":"2024-02-13T14:45:30.097901+0000","last_clean":"2024-02-13T14:45:30.097901+0000","last_became_active":"2024-02-13T14:43:41.074764+0000","last_became_peered":"2024-02-13T14:43:41.074764+0000","last_unstale":"2024-02-13T14:45:30.097901+0000","last_undegraded":"2024-02-13T14:45:30.097901+0000","last_fullsized":"2024-02-13T14:45:30.097901+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:16:11.427147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101456+0000","last_change":"2024-02-13T14:43:34.414179+0000","last_active":"2024-02-13T14:45:30.101456+0000","last_peered":"2024-02-13T14:45:30.101456+0000","last_clean":"2024-02-13T14:45:30.101456+0000","last_became_active":"2024-02-13T14:43:34.413109+0000","last_became_peered":"2024-02-13T14:43:34.413109+0000","last_unstale":"2024-02-13T14:45:30.101456+0000","last_undegraded":"2024-02-13T14:45:30.101456+0000","last_fullsized":"2024-02-13T14:45:30.101456+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:33:59.460484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"67'12","reported_seq":54,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.035482+0000","last_change":"2024-02-13T14:43:36.421569+0000","last_active":"2024-02-13T14:45:30.035482+0000","last_peered":"2024-02-13T14:45:30.035482+0000","last_clean":"2024-02-13T14:45:30.035482+0000","last_became_active":"2024-02-13T14:43:36.419949+0000","last_became_peered":"2024-02-13T14:43:36.419949+0000","last_unstale":"2024-02-13T14:45:30.035482+0000","last_undegraded":"2024-02-13T14:45:30.035482+0000","last_fullsized":"2024-02-13T14:45:30.035482+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T02:16:06.601230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":41,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025732+0000","last_change":"2024-02-13T14:43:46.676861+0000","last_active":"2024-02-13T14:45:30.025732+0000","last_peered":"2024-02-13T14:45:30.025732+0000","last_clean":"2024-02-13T14:45:30.025732+0000","last_became_active":"2024-02-13T14:43:37.586167+0000","last_became_peered":"2024-02-13T14:43:37.586167+0000","last_unstale":"2024-02-13T14:45:30.025732+0000","last_undegraded":"2024-02-13T14:45:30.025732+0000","last_fullsized":"2024-02-13T14:45:30.025732+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:36.381263+0000","last_clean_scrub_stamp":"2024-02-13T14:43:36.381263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T19:13:22.397017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013756389999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.615739+0000","last_change":"2024-02-13T14:43:38.607992+0000","last_active":"2024-02-13T14:46:29.615739+0000","last_peered":"2024-02-13T14:46:29.615739+0000","last_clean":"2024-02-13T14:46:29.615739+0000","last_became_active":"2024-02-13T14:43:38.607202+0000","last_became_peered":"2024-02-13T14:43:38.607202+0000","last_unstale":"2024-02-13T14:46:29.615739+0000","last_undegraded":"2024-02-13T14:46:29.615739+0000","last_fullsized":"2024-02-13T14:46:29.615739+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:54:34.580156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.030845+0000","last_change":"2024-02-13T14:43:41.071027+0000","last_active":"2024-02-13T14:45:30.030845+0000","last_peered":"2024-02-13T14:45:30.030845+0000","last_clean":"2024-02-13T14:45:30.030845+0000","last_became_active":"2024-02-13T14:43:41.070122+0000","last_became_peered":"2024-02-13T14:43:41.070122+0000","last_unstale":"2024-02-13T14:45:30.030845+0000","last_undegraded":"2024-02-13T14:45:30.030845+0000","last_fullsized":"2024-02-13T14:45:30.030845+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T15:42:40.177804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.104252+0000","last_change":"2024-02-13T14:43:38.593228+0000","last_active":"2024-02-13T14:45:30.104252+0000","last_peered":"2024-02-13T14:45:30.104252+0000","last_clean":"2024-02-13T14:45:30.104252+0000","last_became_active":"2024-02-13T14:43:38.592691+0000","last_became_peered":"2024-02-13T14:43:38.592691+0000","last_unstale":"2024-02-13T14:45:30.104252+0000","last_undegraded":"2024-02-13T14:45:30.104252+0000","last_fullsized":"2024-02-13T14:45:30.104252+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:42:03.631755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097665+0000","last_change":"2024-02-13T14:43:34.402874+0000","last_active":"2024-02-13T14:45:30.097665+0000","last_peered":"2024-02-13T14:45:30.097665+0000","last_clean":"2024-02-13T14:45:30.097665+0000","last_became_active":"2024-02-13T14:43:34.400940+0000","last_became_peered":"2024-02-13T14:43:34.400940+0000","last_unstale":"2024-02-13T14:45:30.097665+0000","last_undegraded":"2024-02-13T14:45:30.097665+0000","last_fullsized":"2024-02-13T14:45:30.097665+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:53:46.812675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"67'12","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025427+0000","last_change":"2024-02-13T14:43:36.550772+0000","last_active":"2024-02-13T14:45:30.025427+0000","last_peered":"2024-02-13T14:45:30.025427+0000","last_clean":"2024-02-13T14:45:30.025427+0000","last_became_active":"2024-02-13T14:43:36.549740+0000","last_became_peered":"2024-02-13T14:43:36.549740+0000","last_unstale":"2024-02-13T14:45:30.025427+0000","last_undegraded":"2024-02-13T14:45:30.025427+0000","last_fullsized":"2024-02-13T14:45:30.025427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T17:15:11.976606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.102038+0000","last_change":"2024-02-13T14:43:40.665579+0000","last_active":"2024-02-13T14:45:30.102038+0000","last_peered":"2024-02-13T14:45:30.102038+0000","last_clean":"2024-02-13T14:45:30.102038+0000","last_became_active":"2024-02-13T14:43:40.665009+0000","last_became_peered":"2024-02-13T14:43:40.665009+0000","last_unstale":"2024-02-13T14:45:30.102038+0000","last_undegraded":"2024-02-13T14:45:30.102038+0000","last_fullsized":"2024-02-13T14:45:30.102038+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:04:30.263937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"67'11","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.615827+0000","last_change":"2024-02-13T14:43:38.586567+0000","last_active":"2024-02-13T14:46:29.615827+0000","last_peered":"2024-02-13T14:46:29.615827+0000","last_clean":"2024-02-13T14:46:29.615827+0000","last_became_active":"2024-02-13T14:43:38.586101+0000","last_became_peered":"2024-02-13T14:43:38.586101+0000","last_unstale":"2024-02-13T14:46:29.615827+0000","last_undegraded":"2024-02-13T14:46:29.615827+0000","last_fullsized":"2024-02-13T14:46:29.615827+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:55:40.141731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.025716+0000","last_change":"2024-02-13T14:43:34.394560+0000","last_active":"2024-02-13T14:45:30.025716+0000","last_peered":"2024-02-13T14:45:30.025716+0000","last_clean":"2024-02-13T14:45:30.025716+0000","last_became_active":"2024-02-13T14:43:34.393449+0000","last_became_peered":"2024-02-13T14:43:34.393449+0000","last_unstale":"2024-02-13T14:45:30.025716+0000","last_undegraded":"2024-02-13T14:45:30.025716+0000","last_fullsized":"2024-02-13T14:45:30.025716+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T23:31:54.994823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"67'15","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.029082+0000","last_change":"2024-02-13T14:43:36.411693+0000","last_active":"2024-02-13T14:45:30.029082+0000","last_peered":"2024-02-13T14:45:30.029082+0000","last_clean":"2024-02-13T14:45:30.029082+0000","last_became_active":"2024-02-13T14:43:36.408550+0000","last_became_peered":"2024-02-13T14:43:36.408550+0000","last_unstale":"2024-02-13T14:45:30.029082+0000","last_undegraded":"2024-02-13T14:45:30.029082+0000","last_fullsized":"2024-02-13T14:45:30.029082+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:01:07.801006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027371+0000","last_change":"2024-02-13T14:43:40.645020+0000","last_active":"2024-02-13T14:45:30.027371+0000","last_peered":"2024-02-13T14:45:30.027371+0000","last_clean":"2024-02-13T14:45:30.027371+0000","last_became_active":"2024-02-13T14:43:40.642957+0000","last_became_peered":"2024-02-13T14:43:40.642957+0000","last_unstale":"2024-02-13T14:45:30.027371+0000","last_undegraded":"2024-02-13T14:45:30.027371+0000","last_fullsized":"2024-02-13T14:45:30.027371+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:01:28.182991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"67'11","reported_seq":79,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.615541+0000","last_change":"2024-02-13T14:43:38.596118+0000","last_active":"2024-02-13T14:46:29.615541+0000","last_peered":"2024-02-13T14:46:29.615541+0000","last_clean":"2024-02-13T14:46:29.615541+0000","last_became_active":"2024-02-13T14:43:38.595307+0000","last_became_peered":"2024-02-13T14:43:38.595307+0000","last_unstale":"2024-02-13T14:46:29.615541+0000","last_undegraded":"2024-02-13T14:46:29.615541+0000","last_fullsized":"2024-02-13T14:46:29.615541+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:53:37.144393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027673+0000","last_change":"2024-02-13T14:43:34.394241+0000","last_active":"2024-02-13T14:45:30.027673+0000","last_peered":"2024-02-13T14:45:30.027673+0000","last_clean":"2024-02-13T14:45:30.027673+0000","last_became_active":"2024-02-13T14:43:34.393719+0000","last_became_peered":"2024-02-13T14:43:34.393719+0000","last_unstale":"2024-02-13T14:45:30.027673+0000","last_undegraded":"2024-02-13T14:45:30.027673+0000","last_fullsized":"2024-02-13T14:45:30.027673+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:15:07.640738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"67'9","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.030811+0000","last_change":"2024-02-13T14:43:36.422922+0000","last_active":"2024-02-13T14:45:30.030811+0000","last_peered":"2024-02-13T14:45:30.030811+0000","last_clean":"2024-02-13T14:45:30.030811+0000","last_became_active":"2024-02-13T14:43:36.421433+0000","last_became_peered":"2024-02-13T14:43:36.421433+0000","last_unstale":"2024-02-13T14:45:30.030811+0000","last_undegraded":"2024-02-13T14:45:30.030811+0000","last_fullsized":"2024-02-13T14:45:30.030811+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:18:28.370832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099280+0000","last_change":"2024-02-13T14:43:40.657443+0000","last_active":"2024-02-13T14:45:30.099280+0000","last_peered":"2024-02-13T14:45:30.099280+0000","last_clean":"2024-02-13T14:45:30.099280+0000","last_became_active":"2024-02-13T14:43:40.656693+0000","last_became_peered":"2024-02-13T14:43:40.656693+0000","last_unstale":"2024-02-13T14:45:30.099280+0000","last_undegraded":"2024-02-13T14:45:30.099280+0000","last_fullsized":"2024-02-13T14:45:30.099280+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:45:05.717403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027879+0000","last_change":"2024-02-13T14:43:38.604942+0000","last_active":"2024-02-13T14:45:30.027879+0000","last_peered":"2024-02-13T14:45:30.027879+0000","last_clean":"2024-02-13T14:45:30.027879+0000","last_became_active":"2024-02-13T14:43:38.603956+0000","last_became_peered":"2024-02-13T14:43:38.603956+0000","last_unstale":"2024-02-13T14:45:30.027879+0000","last_undegraded":"2024-02-13T14:45:30.027879+0000","last_fullsized":"2024-02-13T14:45:30.027879+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:51:07.805352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":39,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098824+0000","last_change":"2024-02-13T14:43:34.417160+0000","last_active":"2024-02-13T14:45:30.098824+0000","last_peered":"2024-02-13T14:45:30.098824+0000","last_clean":"2024-02-13T14:45:30.098824+0000","last_became_active":"2024-02-13T14:43:34.416286+0000","last_became_peered":"2024-02-13T14:43:34.416286+0000","last_unstale":"2024-02-13T14:45:30.098824+0000","last_undegraded":"2024-02-13T14:45:30.098824+0000","last_fullsized":"2024-02-13T14:45:30.098824+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T21:02:30.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"67'19","reported_seq":67,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098984+0000","last_change":"2024-02-13T14:43:36.413331+0000","last_active":"2024-02-13T14:45:30.098984+0000","last_peered":"2024-02-13T14:45:30.098984+0000","last_clean":"2024-02-13T14:45:30.098984+0000","last_became_active":"2024-02-13T14:43:36.412906+0000","last_became_peered":"2024-02-13T14:43:36.412906+0000","last_unstale":"2024-02-13T14:45:30.098984+0000","last_undegraded":"2024-02-13T14:45:30.098984+0000","last_fullsized":"2024-02-13T14:45:30.098984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T22:23:59.982113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":27,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.097182+0000","last_change":"2024-02-13T14:43:40.652265+0000","last_active":"2024-02-13T14:45:30.097182+0000","last_peered":"2024-02-13T14:45:30.097182+0000","last_clean":"2024-02-13T14:45:30.097182+0000","last_became_active":"2024-02-13T14:43:40.651613+0000","last_became_peered":"2024-02-13T14:43:40.651613+0000","last_unstale":"2024-02-13T14:45:30.097182+0000","last_undegraded":"2024-02-13T14:45:30.097182+0000","last_fullsized":"2024-02-13T14:45:30.097182+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:43:03.401464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098409+0000","last_change":"2024-02-13T14:43:38.598071+0000","last_active":"2024-02-13T14:45:30.098409+0000","last_peered":"2024-02-13T14:45:30.098409+0000","last_clean":"2024-02-13T14:45:30.098409+0000","last_became_active":"2024-02-13T14:43:38.597230+0000","last_became_peered":"2024-02-13T14:43:38.597230+0000","last_unstale":"2024-02-13T14:45:30.098409+0000","last_undegraded":"2024-02-13T14:45:30.098409+0000","last_fullsized":"2024-02-13T14:45:30.098409+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T14:59:13.795132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098638+0000","last_change":"2024-02-13T14:43:34.402965+0000","last_active":"2024-02-13T14:45:30.098638+0000","last_peered":"2024-02-13T14:45:30.098638+0000","last_clean":"2024-02-13T14:45:30.098638+0000","last_became_active":"2024-02-13T14:43:34.402609+0000","last_became_peered":"2024-02-13T14:43:34.402609+0000","last_unstale":"2024-02-13T14:45:30.098638+0000","last_undegraded":"2024-02-13T14:45:30.098638+0000","last_fullsized":"2024-02-13T14:45:30.098638+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T20:01:54.460648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"67'17","reported_seq":63,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.101138+0000","last_change":"2024-02-13T14:43:36.401504+0000","last_active":"2024-02-13T14:45:30.101138+0000","last_peered":"2024-02-13T14:45:30.101138+0000","last_clean":"2024-02-13T14:45:30.101138+0000","last_became_active":"2024-02-13T14:43:36.401064+0000","last_became_peered":"2024-02-13T14:43:36.401064+0000","last_unstale":"2024-02-13T14:45:30.101138+0000","last_undegraded":"2024-02-13T14:45:30.101138+0000","last_fullsized":"2024-02-13T14:45:30.101138+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:45:49.985353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.033322+0000","last_change":"2024-02-13T14:43:40.664616+0000","last_active":"2024-02-13T14:45:30.033322+0000","last_peered":"2024-02-13T14:45:30.033322+0000","last_clean":"2024-02-13T14:45:30.033322+0000","last_became_active":"2024-02-13T14:43:40.658030+0000","last_became_peered":"2024-02-13T14:43:40.658030+0000","last_unstale":"2024-02-13T14:45:30.033322+0000","last_undegraded":"2024-02-13T14:45:30.033322+0000","last_fullsized":"2024-02-13T14:45:30.033322+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:17:52.430796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":32,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.098180+0000","last_change":"2024-02-13T14:43:38.612225+0000","last_active":"2024-02-13T14:45:30.098180+0000","last_peered":"2024-02-13T14:45:30.098180+0000","last_clean":"2024-02-13T14:45:30.098180+0000","last_became_active":"2024-02-13T14:43:38.611082+0000","last_became_peered":"2024-02-13T14:43:38.611082+0000","last_unstale":"2024-02-13T14:45:30.098180+0000","last_undegraded":"2024-02-13T14:45:30.098180+0000","last_fullsized":"2024-02-13T14:45:30.098180+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:43:36.988884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.027369+0000","last_change":"2024-02-13T14:43:34.388154+0000","last_active":"2024-02-13T14:45:30.027369+0000","last_peered":"2024-02-13T14:45:30.027369+0000","last_clean":"2024-02-13T14:45:30.027369+0000","last_became_active":"2024-02-13T14:43:34.387618+0000","last_became_peered":"2024-02-13T14:43:34.387618+0000","last_unstale":"2024-02-13T14:45:30.027369+0000","last_undegraded":"2024-02-13T14:45:30.027369+0000","last_fullsized":"2024-02-13T14:45:30.027369+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:45:36.222733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"67'10","reported_seq":51,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.103504+0000","last_change":"2024-02-13T14:43:36.408075+0000","last_active":"2024-02-13T14:45:30.103504+0000","last_peered":"2024-02-13T14:45:30.103504+0000","last_clean":"2024-02-13T14:45:30.103504+0000","last_became_active":"2024-02-13T14:43:36.407672+0000","last_became_peered":"2024-02-13T14:43:36.407672+0000","last_unstale":"2024-02-13T14:45:30.103504+0000","last_undegraded":"2024-02-13T14:45:30.103504+0000","last_fullsized":"2024-02-13T14:45:30.103504+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:39:04.527041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":28,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099932+0000","last_change":"2024-02-13T14:43:41.070752+0000","last_active":"2024-02-13T14:45:30.099932+0000","last_peered":"2024-02-13T14:45:30.099932+0000","last_clean":"2024-02-13T14:45:30.099932+0000","last_became_active":"2024-02-13T14:43:41.069839+0000","last_became_peered":"2024-02-13T14:43:41.069839+0000","last_unstale":"2024-02-13T14:45:30.099932+0000","last_undegraded":"2024-02-13T14:45:30.099932+0000","last_fullsized":"2024-02-13T14:45:30.099932+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:39.593868+0000","last_clean_scrub_stamp":"2024-02-13T14:43:39.593868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T00:42:39.267645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":40,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.099335+0000","last_change":"2024-02-13T14:43:34.393691+0000","last_active":"2024-02-13T14:45:30.099335+0000","last_peered":"2024-02-13T14:45:30.099335+0000","last_clean":"2024-02-13T14:45:30.099335+0000","last_became_active":"2024-02-13T14:43:34.393189+0000","last_became_peered":"2024-02-13T14:43:34.393189+0000","last_unstale":"2024-02-13T14:45:30.099335+0000","last_undegraded":"2024-02-13T14:45:30.099335+0000","last_fullsized":"2024-02-13T14:45:30.099335+0000","mapping_epoch":59,"log_start":"0'0","ondisk_log_start":"0'0","created":59,"last_epoch_clean":60,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:33.364808+0000","last_clean_scrub_stamp":"2024-02-13T14:43:33.364808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:45:46.425519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"67'15","reported_seq":60,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:45:30.102879+0000","last_change":"2024-02-13T14:43:36.408829+0000","last_active":"2024-02-13T14:45:30.102879+0000","last_peered":"2024-02-13T14:45:30.102879+0000","last_clean":"2024-02-13T14:45:30.102879+0000","last_became_active":"2024-02-13T14:43:36.408423+0000","last_became_peered":"2024-02-13T14:43:36.408423+0000","last_unstale":"2024-02-13T14:45:30.102879+0000","last_undegraded":"2024-02-13T14:45:30.102879+0000","last_fullsized":"2024-02-13T14:45:30.102879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:35.371587+0000","last_clean_scrub_stamp":"2024-02-13T14:43:35.371587+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-14T16:38:01.530968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"67'11","reported_seq":78,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-02-13T14:46:29.615835+0000","last_change":"2024-02-13T14:43:38.605449+0000","last_active":"2024-02-13T14:46:29.615835+0000","last_peered":"2024-02-13T14:46:29.615835+0000","last_clean":"2024-02-13T14:46:29.615835+0000","last_became_active":"2024-02-13T14:43:38.604624+0000","last_became_peered":"2024-02-13T14:43:38.604624+0000","last_unstale":"2024-02-13T14:46:29.615835+0000","last_undegraded":"2024-02-13T14:46:29.615835+0000","last_fullsized":"2024-02-13T14:46:29.615835+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-13T14:43:37.554545+0000","last_clean_scrub_stamp":"2024-02-13T14:43:37.554545+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-02-15T01:52:11.783572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":382,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":3,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":160,"num_read_kb":155,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":9,"acting":9,"num_store_stats":7},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":534,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":701,"num_read_kb":458,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":11106,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":395,"ondisk_log_size":395,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1771104,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1456,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":54,"seq":231928234030,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28356,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716796,"statfs":{"total":95995035648,"available":95965999104,"internally_reserved":0,"allocated":1363968,"data_stored":886754,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.90400000000000003,"15min":0.92600000000000005},"min":{"1min":0.54700000000000004,"5min":0.376,"15min":0.376},"max":{"1min":1.3160000000000001,"5min":1.427,"15min":1.427},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93000000000000005,"15min":0.94799999999999995},"min":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":1.1339999999999999}]},{"osd":1,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.95799999999999996,"5min":0.92000000000000004,"15min":0.91800000000000004},"min":{"1min":0.627,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.3819999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":1.343},{"interface":"front","average":{"1min":1.014,"5min":1.048,"15min":1.089},"min":{"1min":0.59499999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.3200000000000001,"5min":1.468,"15min":1.468},"last":0.86699999999999999}]},{"osd":2,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":0.99399999999999999,"15min":1.014},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.236,"5min":1.331,"15min":1.331},"last":1.165},{"interface":"front","average":{"1min":1,"5min":1.05,"15min":1.0780000000000001},"min":{"1min":0.67600000000000005,"5min":0.621,"15min":0.621},"max":{"1min":1.3480000000000001,"5min":1.605,"15min":1.605},"last":1.004}]},{"osd":3,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.034,"15min":1.046},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.048,"5min":1.1060000000000001,"15min":1.141},"min":{"1min":0.60599999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.367,"5min":1.5549999999999999,"15min":1.5549999999999999},"last":1.2370000000000001}]},{"osd":4,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.96099999999999997,"15min":0.98199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.3759999999999999,"5min":1.873,"15min":1.873},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.94399999999999995,"5min":0.97699999999999998,"15min":0.98299999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2949999999999999,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.80300000000000005}]},{"osd":5,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0900000000000001,"15min":1.1180000000000001},"min":{"1min":0.50700000000000001,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.4039999999999999,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.1240000000000001,"15min":1.173},"min":{"1min":0.52600000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.46,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":1.2909999999999999}]},{"osd":6,"last update":"Tue Feb 13 14:45:55 2024","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.1439999999999999,"15min":1.173},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.395,"5min":1.986,"15min":1.986},"last":1.204},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1819999999999999,"15min":1.222},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.097}]}]},{"osd":6,"up_from":46,"seq":197568495671,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32484,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712668,"statfs":{"total":95995035648,"available":95961772032,"internally_reserved":0,"allocated":1331200,"data_stored":884572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.89100000000000001,"15min":0.89000000000000001},"min":{"1min":0.52900000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.2849999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.2529999999999999},{"interface":"front","average":{"1min":1.006,"5min":0.94199999999999995,"15min":0.92400000000000004},"min":{"1min":0.63,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.95199999999999996}]},{"osd":1,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97199999999999998,"15min":0.98299999999999998},"min":{"1min":0.60399999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.3740000000000001,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.0389999999999999,"5min":0.96599999999999997,"15min":0.95899999999999996},"min":{"1min":0.58399999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":1.3440000000000001}]},{"osd":2,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97999999999999998,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.67100000000000004,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.3120000000000001,"5min":1.508,"15min":1.508},"last":1.157},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.012,"15min":1.0289999999999999},"min":{"1min":0.73599999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.321,"5min":1.452,"15min":1.452},"last":1.0129999999999999}]},{"osd":3,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.98499999999999999,"15min":0.97399999999999998},"min":{"1min":0.79700000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.052,"15min":1.042},"min":{"1min":0.81100000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4339999999999999,"5min":1.609,"15min":1.609},"last":0.91700000000000004}]},{"osd":4,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":0.99099999999999999,"5min":0.89300000000000002,"15min":0.84699999999999998},"min":{"1min":0.63500000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.67700000000000005},{"interface":"front","average":{"1min":1.0860000000000001,"5min":0.95499999999999996,"15min":0.91000000000000003},"min":{"1min":0.63400000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.5720000000000001,"5min":1.649,"15min":1.649},"last":1.107}]},{"osd":5,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.034,"15min":0.997},"min":{"1min":0.77600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.5109999999999999,"5min":1.794,"15min":1.794},"last":1.3},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.0449999999999999,"15min":1.0049999999999999},"min":{"1min":0.69099999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.3720000000000001,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.72899999999999998}]},{"osd":7,"last update":"Tue Feb 13 14:46:01 2024","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.1459999999999999,"15min":1.171},"min":{"1min":0.54400000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.6699999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.133,"5min":1.1459999999999999,"15min":1.1739999999999999},"min":{"1min":0.48399999999999999,"5min":0.442,"15min":0.442},"max":{"1min":1.5369999999999999,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.224}]}]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31908,"kb_used_data":728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713244,"statfs":{"total":95995035648,"available":95962361856,"internally_reserved":0,"allocated":745472,"data_stored":294124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:46:00 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71899999999999997,"15min":0.58599999999999997},"min":{"1min":0.371,"5min":0.32100000000000001,"15min":0.251},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.83699999999999997,"15min":0.63400000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.26400000000000001},"max":{"1min":1.3680000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Tue Feb 13 14:45:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.79800000000000004,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.41499999999999998,"15min":0.39700000000000002},"max":{"1min":1.0149999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.622},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90700000000000003,"15min":0.748},"min":{"1min":0.57199999999999995,"5min":0.36599999999999999,"15min":0.26100000000000001},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.80100000000000005}]},{"osd":3,"last update":"Tue Feb 13 14:45:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0149999999999999,"15min":0.91200000000000003},"min":{"1min":0.67000000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.786,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.89400000000000002,"15min":0.84499999999999997},"min":{"1min":0.51400000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.96899999999999997}]},{"osd":4,"last update":"Tue Feb 13 14:46:28 2024","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.026,"15min":0.97199999999999998},"min":{"1min":0.69599999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.3759999999999999,"5min":1.55,"15min":1.55},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1120000000000001,"15min":1.03},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.4019999999999999,"5min":1.915,"15min":1.915},"last":1.335}]},{"osd":5,"last update":"Tue Feb 13 14:46:23 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.115,"15min":1.0629999999999999},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5049999999999999,"5min":1.8859999999999999,"15min":1.8859999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.246,"15min":1.1599999999999999},"min":{"1min":0.83999999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"max":{"1min":1.6870000000000001,"5min":2.0209999999999999,"15min":2.0209999999999999},"last":1.1160000000000001}]},{"osd":6,"last update":"Tue Feb 13 14:46:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.111,"15min":1.105},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.409,"5min":1.702,"15min":1.702},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.288,"15min":1.292},"min":{"1min":0.85599999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.5780000000000001,"5min":2.0760000000000001,"15min":2.0760000000000001},"last":1.2330000000000001}]},{"osd":7,"last update":"Tue Feb 13 14:46:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.268,"15min":1.2769999999999999},"min":{"1min":0.89800000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":1.6479999999999999,"5min":1.746,"15min":1.746},"last":1.2030000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.1799999999999999,"15min":1.1839999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.458,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.1779999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738485,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32492,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712660,"statfs":{"total":95995035648,"available":95961763840,"internally_reserved":0,"allocated":1343488,"data_stored":885214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 13 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.72799999999999998,"15min":0.59699999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":3.6659999999999999,"5min":3.6659999999999999,"15min":3.6659999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.75800000000000001,"15min":0.60799999999999998},"min":{"1min":0.307,"5min":0.30099999999999999,"15min":0.28100000000000003},"max":{"1min":0.98399999999999999,"5min":1.319,"15min":1.319},"last":1.0329999999999999}]},{"osd":2,"last update":"Tue Feb 13 14:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.77600000000000002,"15min":0.66800000000000004},"min":{"1min":0.34100000000000003,"5min":0.309,"15min":0.26200000000000001},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.84999999999999998,"15min":0.73499999999999999},"min":{"1min":0.39700000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.417,"5min":1.417,"15min":1.417},"last":0.82099999999999995}]},{"osd":3,"last update":"Tue Feb 13 14:45:32 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":0.94999999999999996,"15min":0.84899999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":4.2759999999999998,"5min":4.2759999999999998,"15min":4.2759999999999998},"last":1.276},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.0369999999999999,"15min":0.94699999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.754}]},{"osd":4,"last update":"Tue Feb 13 14:46:29 2024","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98199999999999998,"15min":0.97599999999999998},"min":{"1min":0.57499999999999996,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.806,"5min":2.806,"15min":2.806},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.0629999999999999,"15min":1.046},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":3.0430000000000001,"5min":3.0430000000000001,"15min":3.0430000000000001},"last":1.351}]},{"osd":5,"last update":"Tue Feb 13 14:46:24 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.1439999999999999,"15min":1.1180000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6000000000000001,"5min":1.869,"15min":1.869},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.133,"15min":1.091},"min":{"1min":0.69899999999999995,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":1.1299999999999999}]},{"osd":6,"last update":"Tue Feb 13 14:46:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.159,"15min":1.1639999999999999},"min":{"1min":0.57999999999999996,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.8610000000000002,"5min":2.8610000000000002,"15min":2.8610000000000002},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.22,"15min":1.2589999999999999},"min":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.5289999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.2030000000000001}]},{"osd":7,"last update":"Tue Feb 13 14:46:03 2024","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.2270000000000001,"15min":1.2569999999999999},"min":{"1min":0.56999999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.3,"15min":1.3180000000000001},"min":{"1min":0.74099999999999999,"5min":0.629,"15min":0.629},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.405}]}]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717416,"statfs":{"total":95995035648,"available":95966633984,"internally_reserved":0,"allocated":733184,"data_stored":294252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:45:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.75700000000000001,"15min":0.63400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.1419999999999999,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":0.71399999999999997},"min":{"1min":0.34300000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.3919999999999999,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.77500000000000002}]},{"osd":1,"last update":"Tue Feb 13 14:45:51 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80700000000000005,"15min":0.68100000000000005},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.399,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":0.629},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.86899999999999999,"15min":0.73999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.38900000000000001},"max":{"1min":1.302,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.67400000000000004}]},{"osd":3,"last update":"Tue Feb 13 14:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.97199999999999998,"15min":0.876},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.88900000000000001,"15min":0.83099999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2470000000000001,"5min":1.335,"15min":1.335},"last":0.60899999999999999}]},{"osd":4,"last update":"Tue Feb 13 14:46:34 2024","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":0.98399999999999999},"min":{"1min":0.67500000000000004,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.444,"5min":1.655,"15min":1.655},"last":0.92300000000000004},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.1120000000000001,"15min":1.077},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.3799999999999999,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.90700000000000003}]},{"osd":5,"last update":"Tue Feb 13 14:46:15 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.139,"15min":1.147},"min":{"1min":0.64600000000000002,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.3680000000000001,"5min":1.952,"15min":1.952},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0629999999999999,"15min":1.0289999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.379,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Tue Feb 13 14:46:10 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.222,"15min":1.228},"min":{"1min":0.73599999999999999,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.452,"5min":1.76,"15min":1.76},"last":0.86299999999999999},{"interface":"front","average":{"1min":1.071,"5min":1.1299999999999999,"15min":1.135},"min":{"1min":0.74299999999999999,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.244,"5min":1.669,"15min":1.669},"last":0.81699999999999995}]},{"osd":7,"last update":"Tue Feb 13 14:45:57 2024","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.1950000000000001,"15min":1.198},"min":{"1min":0.64800000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.5149999999999999,"5min":1.778,"15min":1.778},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.256,"5min":1.357,"15min":1.381},"min":{"1min":0.71599999999999997,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.71,"5min":1.919,"15min":1.919},"last":1.1060000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182488,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27736,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717416,"statfs":{"total":95995035648,"available":95966633984,"internally_reserved":0,"allocated":733184,"data_stored":294193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:45:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.70299999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.495},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.77800000000000002,"15min":0.74399999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0660000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.016}]},{"osd":1,"last update":"Tue Feb 13 14:45:40 2024","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":0.83399999999999996,"15min":0.81000000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.871,"15min":0.80900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Feb 13 14:45:40 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.95999999999999996,"15min":0.90800000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.83499999999999996,"15min":0.83299999999999996},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.83199999999999996}]},{"osd":4,"last update":"Tue Feb 13 14:46:28 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1599999999999999,"15min":1.077},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.734,"5min":1.734,"15min":1.734},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0700000000000001,"15min":0.98499999999999999},"min":{"1min":0.71499999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.4379999999999999,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.98899999999999999}]},{"osd":5,"last update":"Tue Feb 13 14:46:23 2024","interfaces":[{"interface":"back","average":{"1min":1.163,"5min":1.089,"15min":1.0469999999999999},"min":{"1min":0.66700000000000004,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.49,"5min":1.556,"15min":1.556},"last":1.53},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.258,"15min":1.1879999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.149}]},{"osd":6,"last update":"Tue Feb 13 14:46:11 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.268,"15min":1.294},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.119,"5min":1.1180000000000001,"15min":1.1379999999999999},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.5389999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.6930000000000001}]},{"osd":7,"last update":"Tue Feb 13 14:46:00 2024","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.2130000000000001,"15min":1.224},"min":{"1min":0.65800000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.597,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.367,"15min":1.3979999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.2709999999999999}]}]},{"osd":4,"up_from":30,"seq":128849018956,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31936,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713216,"statfs":{"total":95995035648,"available":95962333184,"internally_reserved":0,"allocated":774144,"data_stored":295612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.90200000000000002,"15min":0.86699999999999999},"min":{"1min":0.63100000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.077,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.163},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.92600000000000005,"15min":0.90100000000000002},"min":{"1min":0.629,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2589999999999999,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.90400000000000003}]},{"osd":1,"last update":"Tue Feb 13 14:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.88700000000000001,"15min":0.873},"min":{"1min":0.53900000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":1.1160000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.94299999999999995,"15min":0.90500000000000003},"min":{"1min":0.58799999999999997,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.206,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":0.85699999999999998}]},{"osd":2,"last update":"Tue Feb 13 14:46:26 2024","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.95899999999999996,"15min":0.91500000000000004},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.127,"5min":1.46,"15min":1.46},"last":0.996},{"interface":"front","average":{"1min":1.0129999999999999,"5min":0.95399999999999996,"15min":0.91900000000000004},"min":{"1min":0.71199999999999997,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.3440000000000001,"5min":1.452,"15min":1.452},"last":1.208}]},{"osd":3,"last update":"Tue Feb 13 14:46:26 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.0780000000000001,"15min":1.02},"min":{"1min":0.70399999999999996,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3959999999999999,"5min":1.724,"15min":1.724},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":1.0189999999999999,"15min":0.96299999999999997},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.232,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.254}]},{"osd":5,"last update":"Tue Feb 13 14:46:13 2024","interfaces":[{"interface":"back","average":{"1min":1.03,"5min":0.95699999999999996,"15min":0.83699999999999997},"min":{"1min":0.52000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.7549999999999999,"5min":1.829,"15min":1.829},"last":1.032},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.0109999999999999,"15min":0.86299999999999999},"min":{"1min":0.76400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.726,"5min":1.726,"15min":1.726},"last":1.0629999999999999}]},{"osd":6,"last update":"Tue Feb 13 14:46:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.96299999999999997,"15min":0.871},"min":{"1min":0.68700000000000006,"5min":0.317,"15min":0.317},"max":{"1min":1.6319999999999999,"5min":1.879,"15min":1.879},"last":0.73299999999999998},{"interface":"front","average":{"1min":1.048,"5min":0.93100000000000005,"15min":0.84699999999999998},"min":{"1min":0.46300000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.51,"5min":1.51,"15min":1.51},"last":0.94299999999999995}]},{"osd":7,"last update":"Tue Feb 13 14:45:54 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.1000000000000001,"15min":1.079},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1659999999999999,"15min":1.194},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.5129999999999999,"5min":2.0950000000000002,"15min":2.0950000000000002},"last":0.77800000000000002}]}]},{"osd":5,"up_from":38,"seq":163208757314,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":31900,"kb_used_data":720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713252,"statfs":{"total":95995035648,"available":95962370048,"internally_reserved":0,"allocated":737280,"data_stored":295035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.89400000000000002,"15min":0.82099999999999995},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.117,"5min":1.393,"15min":1.393},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.91600000000000004,"15min":0.92900000000000005},"min":{"1min":0.59199999999999997,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.1839999999999999,"5min":1.72,"15min":1.72},"last":1.1699999999999999}]},{"osd":1,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":0.94699999999999995,"15min":0.92500000000000004},"min":{"1min":0.53900000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.544,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.98499999999999999,"15min":0.91700000000000004},"min":{"1min":0.57199999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.3340000000000001,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":1.2}]},{"osd":2,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94799999999999995,"15min":0.93000000000000005},"min":{"1min":0.63300000000000001,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.583,"5min":1.583,"15min":1.583},"last":1.228},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.999,"15min":0.94499999999999995},"min":{"1min":0.58399999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.417,"5min":1.637,"15min":1.637},"last":0.93799999999999994}]},{"osd":3,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":0.96299999999999997,"5min":0.98299999999999998,"15min":0.98099999999999998},"min":{"1min":0.55300000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.2190000000000001,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.94499999999999995},"min":{"1min":0.58199999999999996,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.282,"5min":1.296,"15min":1.296},"last":0.88800000000000001}]},{"osd":4,"last update":"Tue Feb 13 14:46:14 2024","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.85799999999999998,"15min":0.80000000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82799999999999996,"15min":0.76000000000000001},"min":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.179,"5min":1.387,"15min":1.387},"last":1.2529999999999999}]},{"osd":6,"last update":"Tue Feb 13 14:46:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.85999999999999999,"15min":0.83599999999999997},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.349,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.0009999999999999,"15min":0.95699999999999996},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.385,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":1.286}]},{"osd":7,"last update":"Tue Feb 13 14:45:57 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.145,"15min":1.1659999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.4910000000000001,"5min":1.522,"15min":1.522},"last":1},{"interface":"front","average":{"1min":1.036,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.45,"5min":1.5309999999999999,"15min":1.5309999999999999},"last":1.1339999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":1980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":13,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-13T14:46:37.272 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-13T14:46:37.272 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-13T14:46:37.272 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-13T14:46:37.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e1b79d5a4193a484176863ab96c0ca28c00e1662 shell --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 -- ceph health --format=json 2024-02-13T14:46:38.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:38 smithi062 bash[21479]: audit 2024-02-13T14:46:36.453688+0000 mgr.y (mgr.14613) 113 : audit 0 from='client.14787 v1:172.21.15.62:0/549786505' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T14:46:38.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:38 smithi062 bash[21479]: cluster 2024-02-13T14:46:36.700804+0000 mgr.y (mgr.14613) 114 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:38.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:38 smithi062 bash[28859]: audit 2024-02-13T14:46:36.453688+0000 mgr.y (mgr.14613) 113 : audit 0 from='client.14787 v1:172.21.15.62:0/549786505' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T14:46:38.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:38 smithi062 bash[28859]: cluster 2024-02-13T14:46:36.700804+0000 mgr.y (mgr.14613) 114 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:38.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:38 smithi111 bash[23388]: audit 2024-02-13T14:46:36.453688+0000 mgr.y (mgr.14613) 113 : audit 0 from='client.14787 v1:172.21.15.62:0/549786505' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-13T14:46:38.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:38 smithi111 bash[23388]: cluster 2024-02-13T14:46:36.700804+0000 mgr.y (mgr.14613) 114 : cluster 0 pgmap v69: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:40.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:46:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:46:40.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:40 smithi111 bash[23388]: cluster 2024-02-13T14:46:38.701480+0000 mgr.y (mgr.14613) 115 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:40.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:40 smithi062 bash[21479]: cluster 2024-02-13T14:46:38.701480+0000 mgr.y (mgr.14613) 115 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:40.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:40 smithi062 bash[28859]: cluster 2024-02-13T14:46:38.701480+0000 mgr.y (mgr.14613) 115 : cluster 0 pgmap v70: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:41.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:41 smithi062 bash[28859]: audit 2024-02-13T14:46:40.011783+0000 mgr.y (mgr.14613) 116 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:41.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:41 smithi062 bash[21479]: audit 2024-02-13T14:46:40.011783+0000 mgr.y (mgr.14613) 116 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:41.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:41 smithi111 bash[23388]: audit 2024-02-13T14:46:40.011783+0000 mgr.y (mgr.14613) 116 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:42.067 INFO:teuthology.orchestra.run.smithi062.stderr:Inferring config /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/mon.a/config 2024-02-13T14:46:42.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:42 smithi062 bash[28859]: cluster 2024-02-13T14:46:40.702973+0000 mgr.y (mgr.14613) 117 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:42.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:42 smithi062 bash[21479]: cluster 2024-02-13T14:46:40.702973+0000 mgr.y (mgr.14613) 117 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:42 smithi111 bash[23388]: cluster 2024-02-13T14:46:40.702973+0000 mgr.y (mgr.14613) 117 : cluster 0 pgmap v71: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:44.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:44 smithi062 bash[21479]: cluster 2024-02-13T14:46:42.703635+0000 mgr.y (mgr.14613) 118 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:44.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:44 smithi062 bash[28859]: cluster 2024-02-13T14:46:42.703635+0000 mgr.y (mgr.14613) 118 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:44.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:44 smithi111 bash[23388]: cluster 2024-02-13T14:46:42.703635+0000 mgr.y (mgr.14613) 118 : cluster 0 pgmap v72: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:44.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.995+0000 7f17568de700 1 -- 172.21.15.62:0/3619288051 >> v1:172.21.15.62:6789/0 conn(0x7f17501106e0 legacy=0x7f1750112b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:44.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.995+0000 7f17568de700 1 -- 172.21.15.62:0/3619288051 shutdown_connections 2024-02-13T14:46:44.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.995+0000 7f17568de700 1 -- 172.21.15.62:0/3619288051 >> 172.21.15.62:0/3619288051 conn(0x7f17500ff760 msgr2=0x7f1750101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:44.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.995+0000 7f17568de700 1 -- 172.21.15.62:0/3619288051 shutdown_connections 2024-02-13T14:46:44.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.995+0000 7f17568de700 1 -- 172.21.15.62:0/3619288051 wait complete. 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17568de700 1 Processor -- start 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17568de700 1 -- start start 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17568de700 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f17501a8bd0 con 0x7f17501106e0 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17568de700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f17501a9d70 con 0x7f1750103eb0 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17568de700 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f17501aaf70 con 0x7f175010cb40 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f1754e7b700 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f17501106e0 0x7f17501a7260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60370/0 (socket says 172.21.15.62:60370) 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f1754e7b700 1 -- 172.21.15.62:0/1724007811 learned_addr learned my addr 172.21.15.62:0/1724007811 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17477fe700 1 --1- 172.21.15.62:0/1724007811 >> v1:172.21.15.62:6790/0 conn(0x7f175010cb40 0x7f17501a3a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:35256/0 (socket says 172.21.15.62:35256) 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3489745961 0 0) 0x7f17501a8bd0 con 0x7f17501106e0 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c0031f0 con 0x7f17501106e0 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010031352 0 0) 0x7f17501aaf70 con 0x7f175010cb40 2024-02-13T14:46:45.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17501a8bd0 con 0x7f175010cb40 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290664672 0 0) 0x7f17501a9d70 con 0x7f1750103eb0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17501aaf70 con 0x7f1750103eb0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3030734331 0 0) 0x7f173c0031f0 con 0x7f17501106e0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f17501a9d70 con 0x7f17501106e0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1258166096 0 0) 0x7f17501a8bd0 con 0x7f175010cb40 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f173c0031f0 con 0x7f175010cb40 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f1748004870 con 0x7f17501106e0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f1738001850 con 0x7f175010cb40 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2579660449 0 0) 0x7f17501a9d70 con 0x7f17501106e0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 >> v1:172.21.15.62:6790/0 conn(0x7f175010cb40 legacy=0x7f17501a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 >> v1:172.21.15.111:6789/0 conn(0x7f1750103eb0 legacy=0x7f1750109130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17501ac170 con 0x7f17501106e0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17501ab160 con 0x7f17501106e0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f1748001da0 con 0x7f17501106e0 2024-02-13T14:46:45.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f1748005330 con 0x7f17501106e0 2024-02-13T14:46:45.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f17501ab5e0 con 0x7f17501106e0 2024-02-13T14:46:45.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1750105390 con 0x7f17501106e0 2024-02-13T14:46:45.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:44.999+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f1748005570 con 0x7f17501106e0 2024-02-13T14:46:45.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.003+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(74..74 src has 1..74) v4 ==== 6201+0+0 (unknown 527420524 0 0) 0x7f17480896c0 con 0x7f17501106e0 2024-02-13T14:46:45.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.007+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f1748056740 con 0x7f17501106e0 2024-02-13T14:46:45.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.271+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1750107710 con 0x7f17501106e0 2024-02-13T14:46:45.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.271+0000 7f174dffb700 1 -- 172.21.15.62:0/1724007811 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f1748054ab0 con 0x7f17501106e0 2024-02-13T14:46:45.273 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-02-13T14:46:45.273 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-13T14:46:45.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.275+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 >> v1:172.21.15.62:6800/3802446050 conn(0x7f173c06eef0 legacy=0x7f173c0713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:45.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.275+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 >> v1:172.21.15.62:6789/0 conn(0x7f17501106e0 legacy=0x7f17501a7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T14:46:45.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.275+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 shutdown_connections 2024-02-13T14:46:45.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.275+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 >> 172.21.15.62:0/1724007811 conn(0x7f17500ff760 msgr2=0x7f1750113350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T14:46:45.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.275+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 shutdown_connections 2024-02-13T14:46:45.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-02-13T14:46:45.275+0000 7f17568de700 1 -- 172.21.15.62:0/1724007811 wait complete. 2024-02-13T14:46:45.489 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:45 smithi062 bash[21479]: audit 2024-02-13T14:46:44.384665+0000 mon.b (mon.1) 87 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:45.489 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:45 smithi062 bash[28859]: audit 2024-02-13T14:46:44.384665+0000 mon.b (mon.1) 87 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:45.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:45 smithi111 bash[23388]: audit 2024-02-13T14:46:44.384665+0000 mon.b (mon.1) 87 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:46:45.980 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-13T14:46:45.980 INFO:tasks.cephadm:Setup complete, yielding 2024-02-13T14:46:45.981 INFO:teuthology.run_tasks:Running task workunit... 2024-02-13T14:46:45.994 INFO:tasks.workunit:Pulling workunits from ref e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:46:45.995 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-13T14:46:45.995 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-13T14:46:46.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T14:46:46.001 INFO:teuthology.orchestra.run.smithi062.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-02-13T14:46:46.002 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-02-13T14:46:46.048 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-02-13T14:46:46.048 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-02-13T14:46:46.096 INFO:tasks.workunit:timeout=3h 2024-02-13T14:46:46.096 INFO:tasks.workunit:cleanup=True 2024-02-13T14:46:46.097 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout e1b79d5a4193a484176863ab96c0ca28c00e1662 2024-02-13T14:46:46.150 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-13T14:46:46.309 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:46:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:46:46.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:46 smithi062 bash[28859]: cluster 2024-02-13T14:46:44.705056+0000 mgr.y (mgr.14613) 119 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:46.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:46 smithi062 bash[28859]: audit 2024-02-13T14:46:45.276494+0000 mon.a (mon.0) 846 : audit 0 from='client.? v1:172.21.15.62:0/1724007811' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-13T14:46:46.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:46 smithi062 bash[21479]: cluster 2024-02-13T14:46:44.705056+0000 mgr.y (mgr.14613) 119 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:46.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:46 smithi062 bash[21479]: audit 2024-02-13T14:46:45.276494+0000 mon.a (mon.0) 846 : audit 0 from='client.? v1:172.21.15.62:0/1724007811' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-13T14:46:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:46 smithi111 bash[23388]: cluster 2024-02-13T14:46:44.705056+0000 mgr.y (mgr.14613) 119 : cluster 0 pgmap v73: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:46 smithi111 bash[23388]: audit 2024-02-13T14:46:45.276494+0000 mon.a (mon.0) 846 : audit 0 from='client.? v1:172.21.15.62:0/1724007811' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-13T14:46:48.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:48 smithi062 bash[28859]: cluster 2024-02-13T14:46:46.705729+0000 mgr.y (mgr.14613) 120 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:48.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:48 smithi062 bash[21479]: cluster 2024-02-13T14:46:46.705729+0000 mgr.y (mgr.14613) 120 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:48.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:48 smithi111 bash[23388]: cluster 2024-02-13T14:46:46.705729+0000 mgr.y (mgr.14613) 120 : cluster 0 pgmap v74: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:50.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:46:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:46:50.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:50 smithi111 bash[23388]: cluster 2024-02-13T14:46:48.706365+0000 mgr.y (mgr.14613) 121 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:50.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:50 smithi062 bash[28859]: cluster 2024-02-13T14:46:48.706365+0000 mgr.y (mgr.14613) 121 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:50.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:50 smithi062 bash[21479]: cluster 2024-02-13T14:46:48.706365+0000 mgr.y (mgr.14613) 121 : cluster 0 pgmap v75: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:51.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:51 smithi062 bash[28859]: audit 2024-02-13T14:46:50.022762+0000 mgr.y (mgr.14613) 122 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:51.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:51 smithi062 bash[21479]: audit 2024-02-13T14:46:50.022762+0000 mgr.y (mgr.14613) 122 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:51.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:51 smithi111 bash[23388]: audit 2024-02-13T14:46:50.022762+0000 mgr.y (mgr.14613) 122 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:46:52.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:52 smithi062 bash[21479]: cluster 2024-02-13T14:46:50.707824+0000 mgr.y (mgr.14613) 123 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:52.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:52 smithi062 bash[28859]: cluster 2024-02-13T14:46:50.707824+0000 mgr.y (mgr.14613) 123 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:52.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:52 smithi111 bash[23388]: cluster 2024-02-13T14:46:50.707824+0000 mgr.y (mgr.14613) 123 : cluster 0 pgmap v76: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:54.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:54 smithi062 bash[28859]: cluster 2024-02-13T14:46:52.708512+0000 mgr.y (mgr.14613) 124 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:54.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:54 smithi062 bash[21479]: cluster 2024-02-13T14:46:52.708512+0000 mgr.y (mgr.14613) 124 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:54 smithi111 bash[23388]: cluster 2024-02-13T14:46:52.708512+0000 mgr.y (mgr.14613) 124 : cluster 0 pgmap v77: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:56.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:56 smithi062 bash[21479]: cluster 2024-02-13T14:46:54.709910+0000 mgr.y (mgr.14613) 125 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:56.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:46:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:46:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:46:56.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:56 smithi062 bash[28859]: cluster 2024-02-13T14:46:54.709910+0000 mgr.y (mgr.14613) 125 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:56.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:56 smithi111 bash[23388]: cluster 2024-02-13T14:46:54.709910+0000 mgr.y (mgr.14613) 125 : cluster 0 pgmap v78: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:46:58.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:46:58 smithi062 bash[28859]: cluster 2024-02-13T14:46:56.710666+0000 mgr.y (mgr.14613) 126 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:46:58 smithi062 bash[21479]: cluster 2024-02-13T14:46:56.710666+0000 mgr.y (mgr.14613) 126 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:46:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:46:58 smithi111 bash[23388]: cluster 2024-02-13T14:46:56.710666+0000 mgr.y (mgr.14613) 126 : cluster 0 pgmap v79: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:00.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:00 smithi111 bash[23388]: cluster 2024-02-13T14:46:58.711379+0000 mgr.y (mgr.14613) 127 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:00.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:00 smithi111 bash[23388]: audit 2024-02-13T14:46:59.416492+0000 mon.b (mon.1) 88 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:00.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:47:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:47:00.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:00 smithi062 bash[28859]: cluster 2024-02-13T14:46:58.711379+0000 mgr.y (mgr.14613) 127 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:00.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:00 smithi062 bash[28859]: audit 2024-02-13T14:46:59.416492+0000 mon.b (mon.1) 88 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:00.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:00 smithi062 bash[21479]: cluster 2024-02-13T14:46:58.711379+0000 mgr.y (mgr.14613) 127 : cluster 0 pgmap v80: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:00.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:00 smithi062 bash[21479]: audit 2024-02-13T14:46:59.416492+0000 mon.b (mon.1) 88 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:01.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:01 smithi062 bash[21479]: audit 2024-02-13T14:47:00.034140+0000 mgr.y (mgr.14613) 128 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:01.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:01 smithi062 bash[28859]: audit 2024-02-13T14:47:00.034140+0000 mgr.y (mgr.14613) 128 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:01 smithi111 bash[23388]: audit 2024-02-13T14:47:00.034140+0000 mgr.y (mgr.14613) 128 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:02.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:02 smithi062 bash[21479]: cluster 2024-02-13T14:47:00.713388+0000 mgr.y (mgr.14613) 129 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:02.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:02 smithi062 bash[28859]: cluster 2024-02-13T14:47:00.713388+0000 mgr.y (mgr.14613) 129 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:02.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:02 smithi111 bash[23388]: cluster 2024-02-13T14:47:00.713388+0000 mgr.y (mgr.14613) 129 : cluster 0 pgmap v81: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:04.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:04 smithi062 bash[21479]: cluster 2024-02-13T14:47:02.714106+0000 mgr.y (mgr.14613) 130 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:04.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:04 smithi062 bash[28859]: cluster 2024-02-13T14:47:02.714106+0000 mgr.y (mgr.14613) 130 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:04.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:04 smithi111 bash[23388]: cluster 2024-02-13T14:47:02.714106+0000 mgr.y (mgr.14613) 130 : cluster 0 pgmap v82: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:06.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:47:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:47:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:47:06.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:06 smithi062 bash[28859]: cluster 2024-02-13T14:47:04.715544+0000 mgr.y (mgr.14613) 131 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:06 smithi062 bash[21479]: cluster 2024-02-13T14:47:04.715544+0000 mgr.y (mgr.14613) 131 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:06.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:06 smithi111 bash[23388]: cluster 2024-02-13T14:47:04.715544+0000 mgr.y (mgr.14613) 131 : cluster 0 pgmap v83: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:08.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:08 smithi062 bash[21479]: cluster 2024-02-13T14:47:06.716354+0000 mgr.y (mgr.14613) 132 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:08 smithi062 bash[28859]: cluster 2024-02-13T14:47:06.716354+0000 mgr.y (mgr.14613) 132 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:08 smithi111 bash[23388]: cluster 2024-02-13T14:47:06.716354+0000 mgr.y (mgr.14613) 132 : cluster 0 pgmap v84: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:10.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:10 smithi111 bash[23388]: cluster 2024-02-13T14:47:08.717186+0000 mgr.y (mgr.14613) 133 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:10.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:47:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:47:10.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:10 smithi062 bash[21479]: cluster 2024-02-13T14:47:08.717186+0000 mgr.y (mgr.14613) 133 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:10.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:10 smithi062 bash[28859]: cluster 2024-02-13T14:47:08.717186+0000 mgr.y (mgr.14613) 133 : cluster 0 pgmap v85: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:11.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:11 smithi062 bash[21479]: audit 2024-02-13T14:47:10.038630+0000 mgr.y (mgr.14613) 134 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:11.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:11 smithi062 bash[28859]: audit 2024-02-13T14:47:10.038630+0000 mgr.y (mgr.14613) 134 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:11.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:11 smithi111 bash[23388]: audit 2024-02-13T14:47:10.038630+0000 mgr.y (mgr.14613) 134 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:12.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:12 smithi062 bash[28859]: cluster 2024-02-13T14:47:10.718814+0000 mgr.y (mgr.14613) 135 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:12.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:12 smithi062 bash[21479]: cluster 2024-02-13T14:47:10.718814+0000 mgr.y (mgr.14613) 135 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:12.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:12 smithi111 bash[23388]: cluster 2024-02-13T14:47:10.718814+0000 mgr.y (mgr.14613) 135 : cluster 0 pgmap v86: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:14.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:14 smithi062 bash[21479]: cluster 2024-02-13T14:47:12.719477+0000 mgr.y (mgr.14613) 136 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:14.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:14 smithi062 bash[28859]: cluster 2024-02-13T14:47:12.719477+0000 mgr.y (mgr.14613) 136 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:14.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:14 smithi111 bash[23388]: cluster 2024-02-13T14:47:12.719477+0000 mgr.y (mgr.14613) 136 : cluster 0 pgmap v87: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:15.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:15 smithi062 bash[21479]: audit 2024-02-13T14:47:14.447937+0000 mon.b (mon.1) 89 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:15.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:15 smithi062 bash[28859]: audit 2024-02-13T14:47:14.447937+0000 mon.b (mon.1) 89 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:15.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:15 smithi111 bash[23388]: audit 2024-02-13T14:47:14.447937+0000 mon.b (mon.1) 89 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:16.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:47:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:47:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:47:16.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:16 smithi062 bash[28859]: cluster 2024-02-13T14:47:14.720878+0000 mgr.y (mgr.14613) 137 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:16 smithi062 bash[21479]: cluster 2024-02-13T14:47:14.720878+0000 mgr.y (mgr.14613) 137 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:16.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:16 smithi111 bash[23388]: cluster 2024-02-13T14:47:14.720878+0000 mgr.y (mgr.14613) 137 : cluster 0 pgmap v88: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:18.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:18 smithi062 bash[21479]: cluster 2024-02-13T14:47:16.721564+0000 mgr.y (mgr.14613) 138 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:18.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:18 smithi062 bash[28859]: cluster 2024-02-13T14:47:16.721564+0000 mgr.y (mgr.14613) 138 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:18.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:18 smithi111 bash[23388]: cluster 2024-02-13T14:47:16.721564+0000 mgr.y (mgr.14613) 138 : cluster 0 pgmap v89: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:20.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:20 smithi111 bash[23388]: cluster 2024-02-13T14:47:18.722340+0000 mgr.y (mgr.14613) 139 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:20.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:47:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:47:20.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:20 smithi062 bash[28859]: cluster 2024-02-13T14:47:18.722340+0000 mgr.y (mgr.14613) 139 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:20.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:20 smithi062 bash[21479]: cluster 2024-02-13T14:47:18.722340+0000 mgr.y (mgr.14613) 139 : cluster 0 pgmap v90: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:21.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:21 smithi062 bash[21479]: audit 2024-02-13T14:47:20.049811+0000 mgr.y (mgr.14613) 140 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:21.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:21 smithi062 bash[28859]: audit 2024-02-13T14:47:20.049811+0000 mgr.y (mgr.14613) 140 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:21.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:21 smithi111 bash[23388]: audit 2024-02-13T14:47:20.049811+0000 mgr.y (mgr.14613) 140 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:22.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:22 smithi062 bash[21479]: cluster 2024-02-13T14:47:20.723744+0000 mgr.y (mgr.14613) 141 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:22.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:22 smithi062 bash[21479]: audit 2024-02-13T14:47:21.759841+0000 mon.b (mon.1) 90 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:47:22.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:22 smithi062 bash[28859]: cluster 2024-02-13T14:47:20.723744+0000 mgr.y (mgr.14613) 141 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:22.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:22 smithi062 bash[28859]: audit 2024-02-13T14:47:21.759841+0000 mon.b (mon.1) 90 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:47:22.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:22 smithi111 bash[23388]: cluster 2024-02-13T14:47:20.723744+0000 mgr.y (mgr.14613) 141 : cluster 0 pgmap v91: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:22.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:22 smithi111 bash[23388]: audit 2024-02-13T14:47:21.759841+0000 mon.b (mon.1) 90 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:47:23.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:23 smithi062 bash[28859]: audit 2024-02-13T14:47:22.487866+0000 mon.b (mon.1) 91 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:47:23.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:23 smithi062 bash[28859]: audit 2024-02-13T14:47:22.489725+0000 mon.b (mon.1) 92 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:47:23.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:23 smithi062 bash[28859]: audit 2024-02-13T14:47:22.502504+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:47:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:23 smithi062 bash[21479]: audit 2024-02-13T14:47:22.487866+0000 mon.b (mon.1) 91 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:47:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:23 smithi062 bash[21479]: audit 2024-02-13T14:47:22.489725+0000 mon.b (mon.1) 92 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:47:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:23 smithi062 bash[21479]: audit 2024-02-13T14:47:22.502504+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:47:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:23 smithi111 bash[23388]: audit 2024-02-13T14:47:22.487866+0000 mon.b (mon.1) 91 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:47:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:23 smithi111 bash[23388]: audit 2024-02-13T14:47:22.489725+0000 mon.b (mon.1) 92 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:47:23.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:23 smithi111 bash[23388]: audit 2024-02-13T14:47:22.502504+0000 mon.a (mon.0) 847 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:47:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:24 smithi062 bash[28859]: cluster 2024-02-13T14:47:22.724392+0000 mgr.y (mgr.14613) 142 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:24.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:24 smithi062 bash[21479]: cluster 2024-02-13T14:47:22.724392+0000 mgr.y (mgr.14613) 142 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:24.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:24 smithi111 bash[23388]: cluster 2024-02-13T14:47:22.724392+0000 mgr.y (mgr.14613) 142 : cluster 0 pgmap v92: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:26.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:26 smithi062 bash[28859]: cluster 2024-02-13T14:47:24.725915+0000 mgr.y (mgr.14613) 143 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:26.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:26 smithi062 bash[21479]: cluster 2024-02-13T14:47:24.725915+0000 mgr.y (mgr.14613) 143 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:26.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:47:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:47:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:47:26.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:26 smithi111 bash[23388]: cluster 2024-02-13T14:47:24.725915+0000 mgr.y (mgr.14613) 143 : cluster 0 pgmap v93: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:28.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:28 smithi062 bash[21479]: cluster 2024-02-13T14:47:26.726668+0000 mgr.y (mgr.14613) 144 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:28.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:28 smithi062 bash[28859]: cluster 2024-02-13T14:47:26.726668+0000 mgr.y (mgr.14613) 144 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:28 smithi111 bash[23388]: cluster 2024-02-13T14:47:26.726668+0000 mgr.y (mgr.14613) 144 : cluster 0 pgmap v94: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:30.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:47:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:47:30.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:30 smithi111 bash[23388]: cluster 2024-02-13T14:47:28.727342+0000 mgr.y (mgr.14613) 145 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:30.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:30 smithi111 bash[23388]: audit 2024-02-13T14:47:29.477265+0000 mon.b (mon.1) 93 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:30.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:30 smithi062 bash[28859]: cluster 2024-02-13T14:47:28.727342+0000 mgr.y (mgr.14613) 145 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:30.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:30 smithi062 bash[28859]: audit 2024-02-13T14:47:29.477265+0000 mon.b (mon.1) 93 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:30.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:30 smithi062 bash[21479]: cluster 2024-02-13T14:47:28.727342+0000 mgr.y (mgr.14613) 145 : cluster 0 pgmap v95: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:30.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:30 smithi062 bash[21479]: audit 2024-02-13T14:47:29.477265+0000 mon.b (mon.1) 93 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:31.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:31 smithi062 bash[28859]: audit 2024-02-13T14:47:30.060901+0000 mgr.y (mgr.14613) 146 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:31.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:31 smithi062 bash[21479]: audit 2024-02-13T14:47:30.060901+0000 mgr.y (mgr.14613) 146 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:31.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:31 smithi111 bash[23388]: audit 2024-02-13T14:47:30.060901+0000 mgr.y (mgr.14613) 146 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:32.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:32 smithi062 bash[28859]: cluster 2024-02-13T14:47:30.728203+0000 mgr.y (mgr.14613) 147 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:32.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:32 smithi062 bash[21479]: cluster 2024-02-13T14:47:30.728203+0000 mgr.y (mgr.14613) 147 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:32.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:32 smithi111 bash[23388]: cluster 2024-02-13T14:47:30.728203+0000 mgr.y (mgr.14613) 147 : cluster 0 pgmap v96: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:34 smithi062 bash[28859]: cluster 2024-02-13T14:47:32.728572+0000 mgr.y (mgr.14613) 148 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:34.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:34 smithi062 bash[21479]: cluster 2024-02-13T14:47:32.728572+0000 mgr.y (mgr.14613) 148 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:34 smithi111 bash[23388]: cluster 2024-02-13T14:47:32.728572+0000 mgr.y (mgr.14613) 148 : cluster 0 pgmap v97: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:35.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:35 smithi062 bash[28859]: cluster 2024-02-13T14:47:34.729353+0000 mgr.y (mgr.14613) 149 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:35.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:35 smithi062 bash[21479]: cluster 2024-02-13T14:47:34.729353+0000 mgr.y (mgr.14613) 149 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:35.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:35 smithi111 bash[23388]: cluster 2024-02-13T14:47:34.729353+0000 mgr.y (mgr.14613) 149 : cluster 0 pgmap v98: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:36.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:47:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:47:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:47:38.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:37 smithi062 bash[28859]: cluster 2024-02-13T14:47:36.729756+0000 mgr.y (mgr.14613) 150 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:38.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:37 smithi062 bash[21479]: cluster 2024-02-13T14:47:36.729756+0000 mgr.y (mgr.14613) 150 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:37 smithi111 bash[23388]: cluster 2024-02-13T14:47:36.729756+0000 mgr.y (mgr.14613) 150 : cluster 0 pgmap v99: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:47:40.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:39 smithi062 bash[21479]: cluster 2024-02-13T14:47:38.730169+0000 mgr.y (mgr.14613) 151 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:40.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:39 smithi062 bash[28859]: cluster 2024-02-13T14:47:38.730169+0000 mgr.y (mgr.14613) 151 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:40.059 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:39 smithi111 bash[23388]: cluster 2024-02-13T14:47:38.730169+0000 mgr.y (mgr.14613) 151 : cluster 0 pgmap v100: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:40.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:47:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:47:41.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:40 smithi062 bash[21479]: audit 2024-02-13T14:47:40.062246+0000 mgr.y (mgr.14613) 152 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:41.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:40 smithi062 bash[28859]: audit 2024-02-13T14:47:40.062246+0000 mgr.y (mgr.14613) 152 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:40 smithi111 bash[23388]: audit 2024-02-13T14:47:40.062246+0000 mgr.y (mgr.14613) 152 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:42.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:41 smithi062 bash[21479]: cluster 2024-02-13T14:47:40.730959+0000 mgr.y (mgr.14613) 153 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:42.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:41 smithi062 bash[28859]: cluster 2024-02-13T14:47:40.730959+0000 mgr.y (mgr.14613) 153 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:42.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:41 smithi111 bash[23388]: cluster 2024-02-13T14:47:40.730959+0000 mgr.y (mgr.14613) 153 : cluster 0 pgmap v101: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:44.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:43 smithi062 bash[21479]: cluster 2024-02-13T14:47:42.731379+0000 mgr.y (mgr.14613) 154 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:44.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:43 smithi062 bash[28859]: cluster 2024-02-13T14:47:42.731379+0000 mgr.y (mgr.14613) 154 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:44.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:43 smithi111 bash[23388]: cluster 2024-02-13T14:47:42.731379+0000 mgr.y (mgr.14613) 154 : cluster 0 pgmap v102: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:45.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:44 smithi062 bash[28859]: audit 2024-02-13T14:47:44.489818+0000 mon.b (mon.1) 94 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:45.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:44 smithi062 bash[21479]: audit 2024-02-13T14:47:44.489818+0000 mon.b (mon.1) 94 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:45.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:44 smithi111 bash[23388]: audit 2024-02-13T14:47:44.489818+0000 mon.b (mon.1) 94 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:47:46.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:45 smithi062 bash[28859]: cluster 2024-02-13T14:47:44.732176+0000 mgr.y (mgr.14613) 155 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:46.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:45 smithi062 bash[21479]: cluster 2024-02-13T14:47:44.732176+0000 mgr.y (mgr.14613) 155 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:46.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:45 smithi111 bash[23388]: cluster 2024-02-13T14:47:44.732176+0000 mgr.y (mgr.14613) 155 : cluster 0 pgmap v103: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:46.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:47:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:47:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:47:48.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:47 smithi111 bash[23388]: cluster 2024-02-13T14:47:46.732584+0000 mgr.y (mgr.14613) 156 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:48.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:47 smithi062 bash[21479]: cluster 2024-02-13T14:47:46.732584+0000 mgr.y (mgr.14613) 156 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:48.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:47 smithi062 bash[28859]: cluster 2024-02-13T14:47:46.732584+0000 mgr.y (mgr.14613) 156 : cluster 0 pgmap v104: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:50.069 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:49 smithi111 bash[23388]: cluster 2024-02-13T14:47:48.732999+0000 mgr.y (mgr.14613) 157 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:50.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:49 smithi062 bash[28859]: cluster 2024-02-13T14:47:48.732999+0000 mgr.y (mgr.14613) 157 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:50.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:49 smithi062 bash[21479]: cluster 2024-02-13T14:47:48.732999+0000 mgr.y (mgr.14613) 157 : cluster 0 pgmap v105: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:50.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:47:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:47:51.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:50 smithi111 bash[23388]: audit 2024-02-13T14:47:50.071512+0000 mgr.y (mgr.14613) 158 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:51.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:50 smithi062 bash[28859]: audit 2024-02-13T14:47:50.071512+0000 mgr.y (mgr.14613) 158 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:51.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:50 smithi062 bash[21479]: audit 2024-02-13T14:47:50.071512+0000 mgr.y (mgr.14613) 158 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:47:52.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:51 smithi111 bash[23388]: cluster 2024-02-13T14:47:50.733792+0000 mgr.y (mgr.14613) 159 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:52.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:51 smithi062 bash[21479]: cluster 2024-02-13T14:47:50.733792+0000 mgr.y (mgr.14613) 159 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:52.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:51 smithi062 bash[28859]: cluster 2024-02-13T14:47:50.733792+0000 mgr.y (mgr.14613) 159 : cluster 0 pgmap v106: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:54.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:53 smithi111 bash[23388]: cluster 2024-02-13T14:47:52.734209+0000 mgr.y (mgr.14613) 160 : cluster 0 pgmap v107: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:54.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:53 smithi062 bash[21479]: cluster 2024-02-13T14:47:52.734209+0000 mgr.y (mgr.14613) 160 : cluster 0 pgmap v107: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:54.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:53 smithi062 bash[28859]: cluster 2024-02-13T14:47:52.734209+0000 mgr.y (mgr.14613) 160 : cluster 0 pgmap v107: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:55 smithi111 bash[23388]: cluster 2024-02-13T14:47:54.735563+0000 mgr.y (mgr.14613) 161 : cluster 0 pgmap v108: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:56.224 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:55 smithi062 bash[28859]: cluster 2024-02-13T14:47:54.735563+0000 mgr.y (mgr.14613) 161 : cluster 0 pgmap v108: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:56.224 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:55 smithi062 bash[21479]: cluster 2024-02-13T14:47:54.735563+0000 mgr.y (mgr.14613) 161 : cluster 0 pgmap v108: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:47:56.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:47:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:47:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:47:56.849 INFO:tasks.workunit.client.0.smithi062.stderr:Updating files: 94% (11609/12222) Updating files: 95% (11611/12222) Updating files: 96% (11734/12222) Updating files: 97% (11856/12222) Updating files: 98% (11978/12222) Updating files: 99% (12100/12222) Updating files: 100% (12222/12222) Updating files: 100% (12222/12222), done. 2024-02-13T14:47:57.479 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to 'e1b79d5a4193a484176863ab96c0ca28c00e1662'. 2024-02-13T14:47:57.479 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-13T14:47:57.479 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-13T14:47:57.479 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-13T14:47:57.479 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-02-13T14:47:57.479 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-02-13T14:47:57.480 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at e1b79d5a419 Merge branch 'jjm-cephadm-smb-svc-spec' of https://github.com/phlogistonjohn/ceph into wip-phlogistonjohn-testing-2024-02-12-1654 2024-02-13T14:47:57.482 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-13T14:47:57.536 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-13T14:47:57.539 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-13T14:47:57.539 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-13T14:47:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:47:57 smithi111 bash[23388]: cluster 2024-02-13T14:47:56.736196+0000 mgr.y (mgr.14613) 162 : cluster 0 pgmap v109: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:58.301 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-13T14:47:58.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:47:57 smithi062 bash[21479]: cluster 2024-02-13T14:47:56.736196+0000 mgr.y (mgr.14613) 162 : cluster 0 pgmap v109: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:58.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:47:57 smithi062 bash[28859]: cluster 2024-02-13T14:47:56.736196+0000 mgr.y (mgr.14613) 162 : cluster 0 pgmap v109: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:47:58.384 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-13T14:47:58.452 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-13T14:47:58.455 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-13T14:47:58.455 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-13T14:47:58.501 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-13T14:47:58.504 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-02-13T14:47:58.504 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-13T14:47:58.556 INFO:tasks.workunit:Running workunits matching rados/test.sh on client.0... 2024-02-13T14:47:58.557 INFO:tasks.workunit:Running workunit rados/test.sh... 2024-02-13T14:47:58.557 DEBUG:teuthology.orchestra.run.smithi062:workunit test rados/test.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e1b79d5a4193a484176863ab96c0ca28c00e1662 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh 2024-02-13T14:47:58.614 INFO:tasks.workunit.client.0.smithi062.stderr:+ parallel=1 2024-02-13T14:47:58.614 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' '' = --serial ']' 2024-02-13T14:47:58.614 INFO:tasks.workunit.client.0.smithi062.stderr:+ crimson=0 2024-02-13T14:47:58.614 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' '' = --crimson ']' 2024-02-13T14:47:58.614 INFO:tasks.workunit.client.0.smithi062.stderr:+ color= 2024-02-13T14:47:58.615 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -t 1 ']' 2024-02-13T14:47:58.615 INFO:tasks.workunit.client.0.smithi062.stderr:+ trap cleanup EXIT ERR HUP INT QUIT 2024-02-13T14:47:58.615 INFO:tasks.workunit.client.0.smithi062.stderr:+ GTEST_OUTPUT=xml:/home/ubuntu/cephtest/archive/gtest_xml_report 2024-02-13T14:47:58.615 INFO:tasks.workunit.client.0.smithi062.stderr:+ declare -A pids 2024-02-13T14:47:58.615 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.615 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.616 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_aio 2024-02-13T14:47:58.616 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_aio' 2024-02-13T14:47:58.616 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_aio 2024-02-13T14:47:58.616 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.618 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_aio 2024-02-13T14:47:58.618 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64499 2024-02-13T14:47:58.618 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_aio on pid 64499' 2024-02-13T14:47:58.619 INFO:tasks.workunit.client.0.smithi062.stdout:test api_aio on pid 64499 2024-02-13T14:47:58.620 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64499 2024-02-13T14:47:58.620 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.620 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.620 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2>&1 | tee ceph_test_rados_api_aio.log | sed "s/^/ api_aio: /"' 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_aio_pp 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_aio_pp' 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_aio_pp 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_aio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio.xml 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_aio.log 2024-02-13T14:47:58.621 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_aio: /' 2024-02-13T14:47:58.622 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_aio_pp 2024-02-13T14:47:58.622 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64507 2024-02-13T14:47:58.622 INFO:tasks.workunit.client.0.smithi062.stdout:test api_aio_pp on pid 64507 2024-02-13T14:47:58.623 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_aio_pp on pid 64507' 2024-02-13T14:47:58.624 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64507 2024-02-13T14:47:58.624 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.624 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2>&1 | tee ceph_test_rados_api_aio_pp.log | sed "s/^/ api_aio_pp: /"' 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_io 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_io' 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_io 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_aio_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_aio_pp.xml 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_aio_pp.log 2024-02-13T14:47:58.625 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_aio_pp: /' 2024-02-13T14:47:58.626 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_io 2024-02-13T14:47:58.626 INFO:tasks.workunit.client.0.smithi062.stdout:test api_io on pid 64515 2024-02-13T14:47:58.627 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64515 2024-02-13T14:47:58.627 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_io on pid 64515' 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64515 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2>&1 | tee ceph_test_rados_api_io.log | sed "s/^/ api_io: /"' 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_io_pp 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_io_pp' 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_io_pp 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_io --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io.xml 2024-02-13T14:47:58.628 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_io.log 2024-02-13T14:47:58.629 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_io: /' 2024-02-13T14:47:58.629 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_io_pp 2024-02-13T14:47:58.629 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64523 2024-02-13T14:47:58.629 INFO:tasks.workunit.client.0.smithi062.stdout:test api_io_pp on pid 64523 2024-02-13T14:47:58.630 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_io_pp on pid 64523' 2024-02-13T14:47:58.630 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64523 2024-02-13T14:47:58.630 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.630 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2>&1 | tee ceph_test_rados_api_io_pp.log | sed "s/^/ api_io_pp: /"' 2024-02-13T14:47:58.630 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.630 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_asio 2024-02-13T14:47:58.630 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_asio' 2024-02-13T14:47:58.631 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.631 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.631 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.631 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.632 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_asio 2024-02-13T14:47:58.632 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.632 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_io_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_io_pp.xml 2024-02-13T14:47:58.632 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_io_pp.log 2024-02-13T14:47:58.632 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_io_pp: /' 2024-02-13T14:47:58.633 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_asio 2024-02-13T14:47:58.633 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64531 2024-02-13T14:47:58.633 INFO:tasks.workunit.client.0.smithi062.stdout:test api_asio on pid 64531 2024-02-13T14:47:58.634 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_asio on pid 64531' 2024-02-13T14:47:58.634 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64531 2024-02-13T14:47:58.634 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2>&1 | tee ceph_test_rados_api_asio.log | sed "s/^/ api_asio: /"' 2024-02-13T14:47:58.634 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.634 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.634 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_list 2024-02-13T14:47:58.634 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_list' 2024-02-13T14:47:58.635 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.636 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_list 2024-02-13T14:47:58.636 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.636 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.636 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_asio --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_asio.xml 2024-02-13T14:47:58.636 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_asio: /' 2024-02-13T14:47:58.636 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_asio.log 2024-02-13T14:47:58.638 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_list 2024-02-13T14:47:58.638 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64539 2024-02-13T14:47:58.638 INFO:tasks.workunit.client.0.smithi062.stdout:test api_list on pid 64539 2024-02-13T14:47:58.639 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_list on pid 64539' 2024-02-13T14:47:58.639 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64539 2024-02-13T14:47:58.639 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2>&1 | tee ceph_test_rados_api_list.log | sed "s/^/ api_list: /"' 2024-02-13T14:47:58.639 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.639 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.639 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_lock 2024-02-13T14:47:58.639 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_lock' 2024-02-13T14:47:58.640 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_lock 2024-02-13T14:47:58.640 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.640 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.640 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.640 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.640 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_list --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_list.xml 2024-02-13T14:47:58.640 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_list.log 2024-02-13T14:47:58.640 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_list: /' 2024-02-13T14:47:58.641 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.644 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_lock 2024-02-13T14:47:58.644 INFO:tasks.workunit.client.0.smithi062.stdout:test api_lock on pid 64547 2024-02-13T14:47:58.644 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64547 2024-02-13T14:47:58.645 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_lock on pid 64547' 2024-02-13T14:47:58.645 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64547 2024-02-13T14:47:58.645 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2>&1 | tee ceph_test_rados_api_lock.log | sed "s/^/ api_lock: /"' 2024-02-13T14:47:58.645 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.645 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.646 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.646 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.646 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.646 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.646 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_lock --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock.xml 2024-02-13T14:47:58.646 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_lock.log 2024-02-13T14:47:58.647 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_lock_pp 2024-02-13T14:47:58.647 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_lock_pp' 2024-02-13T14:47:58.647 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_lock: /' 2024-02-13T14:47:58.649 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_lock_pp 2024-02-13T14:47:58.649 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.652 INFO:tasks.workunit.client.0.smithi062.stdout:test api_lock_pp on pid 64555 2024-02-13T14:47:58.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_lock_pp 2024-02-13T14:47:58.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64555 2024-02-13T14:47:58.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_lock_pp on pid 64555' 2024-02-13T14:47:58.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64555 2024-02-13T14:47:58.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.653 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2>&1 | tee ceph_test_rados_api_lock_pp.log | sed "s/^/ api_lock_pp: /"' 2024-02-13T14:47:58.654 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.654 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.654 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.654 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.655 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_lock_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_lock_pp.xml 2024-02-13T14:47:58.661 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_misc 2024-02-13T14:47:58.661 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_misc' 2024-02-13T14:47:58.661 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_lock_pp: /' 2024-02-13T14:47:58.662 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_lock_pp.log 2024-02-13T14:47:58.664 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_misc 2024-02-13T14:47:58.667 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.676 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_misc 2024-02-13T14:47:58.677 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64602 2024-02-13T14:47:58.677 INFO:tasks.workunit.client.0.smithi062.stdout:test api_misc on pid 64602 2024-02-13T14:47:58.678 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_misc on pid 64602' 2024-02-13T14:47:58.678 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64602 2024-02-13T14:47:58.678 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.678 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2>&1 | tee ceph_test_rados_api_misc.log | sed "s/^/ api_misc: /"' 2024-02-13T14:47:58.678 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.678 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_misc_pp 2024-02-13T14:47:58.679 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_misc_pp' 2024-02-13T14:47:58.679 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_misc_pp 2024-02-13T14:47:58.679 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.679 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.679 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.679 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.679 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_misc.log 2024-02-13T14:47:58.679 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.681 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_misc: /' 2024-02-13T14:47:58.681 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_misc --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc.xml 2024-02-13T14:47:58.682 INFO:tasks.workunit.client.0.smithi062.stdout:test api_misc_pp on pid 64636 2024-02-13T14:47:58.682 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_misc_pp 2024-02-13T14:47:58.682 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64636 2024-02-13T14:47:58.682 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_misc_pp on pid 64636' 2024-02-13T14:47:58.682 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64636 2024-02-13T14:47:58.682 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.682 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.685 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2>&1 | tee ceph_test_rados_api_misc_pp.log | sed "s/^/ api_misc_pp: /"' 2024-02-13T14:47:58.686 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.686 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.687 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.687 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.691 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_tier_pp 2024-02-13T14:47:58.691 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_tier_pp' 2024-02-13T14:47:58.691 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_misc_pp.log 2024-02-13T14:47:58.693 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.693 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_misc_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_misc_pp.xml 2024-02-13T14:47:58.693 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_misc_pp: /' 2024-02-13T14:47:58.697 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_tier_pp 2024-02-13T14:47:58.699 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_tier_pp 2024-02-13T14:47:58.700 INFO:tasks.workunit.client.0.smithi062.stdout:test api_tier_pp on pid 64688 2024-02-13T14:47:58.700 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64688 2024-02-13T14:47:58.700 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_tier_pp on pid 64688' 2024-02-13T14:47:58.700 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64688 2024-02-13T14:47:58.700 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2>&1 | tee ceph_test_rados_api_tier_pp.log | sed "s/^/ api_tier_pp: /"' 2024-02-13T14:47:58.700 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.700 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.701 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_pool 2024-02-13T14:47:58.701 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_pool' 2024-02-13T14:47:58.701 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.701 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.701 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.701 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.702 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_tier_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_tier_pp.xml 2024-02-13T14:47:58.702 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_tier_pp: /' 2024-02-13T14:47:58.702 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_pool 2024-02-13T14:47:58.704 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.710 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_tier_pp.log 2024-02-13T14:47:58.712 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_pool 2024-02-13T14:47:58.712 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64713 2024-02-13T14:47:58.712 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_pool on pid 64713' 2024-02-13T14:47:58.713 INFO:tasks.workunit.client.0.smithi062.stdout:test api_pool on pid 64713 2024-02-13T14:47:58.713 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64713 2024-02-13T14:47:58.713 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2>&1 | tee ceph_test_rados_api_pool.log | sed "s/^/ api_pool: /"' 2024-02-13T14:47:58.713 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.713 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.713 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_snapshots 2024-02-13T14:47:58.713 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_snapshots' 2024-02-13T14:47:58.714 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.714 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.714 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.715 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.715 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_pool --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_pool.xml 2024-02-13T14:47:58.715 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_pool.log 2024-02-13T14:47:58.715 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_pool: /' 2024-02-13T14:47:58.720 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_snapshots 2024-02-13T14:47:58.720 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.722 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_snapshots 2024-02-13T14:47:58.723 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64726 2024-02-13T14:47:58.723 INFO:tasks.workunit.client.0.smithi062.stdout:test api_snapshots on pid 64726 2024-02-13T14:47:58.723 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_snapshots on pid 64726' 2024-02-13T14:47:58.723 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64726 2024-02-13T14:47:58.723 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2>&1 | tee ceph_test_rados_api_snapshots.log | sed "s/^/ api_snapshots: /"' 2024-02-13T14:47:58.724 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.724 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.724 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_snapshots_pp 2024-02-13T14:47:58.724 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_snapshots_pp' 2024-02-13T14:47:58.725 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.725 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.725 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_snapshots_pp 2024-02-13T14:47:58.725 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.725 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.725 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_snapshots --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots.xml 2024-02-13T14:47:58.725 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_snapshots.log 2024-02-13T14:47:58.725 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_snapshots: /' 2024-02-13T14:47:58.726 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.728 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_snapshots_pp 2024-02-13T14:47:58.728 INFO:tasks.workunit.client.0.smithi062.stdout:test api_snapshots_pp on pid 64734 2024-02-13T14:47:58.729 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64734 2024-02-13T14:47:58.729 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_snapshots_pp on pid 64734' 2024-02-13T14:47:58.729 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2>&1 | tee ceph_test_rados_api_snapshots_pp.log | sed "s/^/ api_snapshots_pp: /"' 2024-02-13T14:47:58.729 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64734 2024-02-13T14:47:58.729 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.729 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.730 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.730 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.730 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.730 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.730 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_snapshots_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_snapshots_pp.xml 2024-02-13T14:47:58.730 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_snapshots_pp.log 2024-02-13T14:47:58.731 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_snapshots_pp: /' 2024-02-13T14:47:58.732 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_stat 2024-02-13T14:47:58.732 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_stat' 2024-02-13T14:47:58.739 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.742 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_stat 2024-02-13T14:47:58.743 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_stat 2024-02-13T14:47:58.744 INFO:tasks.workunit.client.0.smithi062.stdout:test api_stat on pid 64758 2024-02-13T14:47:58.744 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64758 2024-02-13T14:47:58.744 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_stat on pid 64758' 2024-02-13T14:47:58.744 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2>&1 | tee ceph_test_rados_api_stat.log | sed "s/^/ api_stat: /"' 2024-02-13T14:47:58.744 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64758 2024-02-13T14:47:58.744 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.745 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.746 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.747 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.747 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.747 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.747 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_stat --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat.xml 2024-02-13T14:47:58.748 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_stat_pp 2024-02-13T14:47:58.749 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_stat_pp' 2024-02-13T14:47:58.751 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_stat: /' 2024-02-13T14:47:58.753 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_stat.log 2024-02-13T14:47:58.753 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_stat_pp 2024-02-13T14:47:58.754 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.759 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_stat_pp 2024-02-13T14:47:58.759 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64793 2024-02-13T14:47:58.759 INFO:tasks.workunit.client.0.smithi062.stdout:test api_stat_pp on pid 64793 2024-02-13T14:47:58.760 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_stat_pp on pid 64793' 2024-02-13T14:47:58.760 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64793 2024-02-13T14:47:58.760 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.760 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.761 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2>&1 | tee ceph_test_rados_api_stat_pp.log | sed "s/^/ api_stat_pp: /"' 2024-02-13T14:47:58.761 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_watch_notify 2024-02-13T14:47:58.761 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_watch_notify' 2024-02-13T14:47:58.761 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.761 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.761 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.761 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.761 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_stat_pp.log 2024-02-13T14:47:58.762 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_stat_pp: /' 2024-02-13T14:47:58.764 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_watch_notify 2024-02-13T14:47:58.764 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_stat_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_stat_pp.xml 2024-02-13T14:47:58.766 INFO:tasks.workunit.client.0.smithi062.stdout:test api_watch_notify on pid 64816 2024-02-13T14:47:58.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_watch_notify 2024-02-13T14:47:58.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64816 2024-02-13T14:47:58.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_watch_notify on pid 64816' 2024-02-13T14:47:58.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64816 2024-02-13T14:47:58.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.767 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2>&1 | tee ceph_test_rados_api_watch_notify.log | sed "s/^/ api_watch_notify: /"' 2024-02-13T14:47:58.767 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_watch_notify_pp 2024-02-13T14:47:58.768 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_watch_notify_pp' 2024-02-13T14:47:58.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_watch_notify --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify.xml 2024-02-13T14:47:58.771 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_watch_notify.log 2024-02-13T14:47:58.771 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_watch_notify: /' 2024-02-13T14:47:58.773 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_watch_notify_pp 2024-02-13T14:47:58.773 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.776 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_watch_notify_pp 2024-02-13T14:47:58.776 INFO:tasks.workunit.client.0.smithi062.stdout:test api_watch_notify_pp on pid 64843 2024-02-13T14:47:58.776 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64843 2024-02-13T14:47:58.777 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_watch_notify_pp on pid 64843' 2024-02-13T14:47:58.777 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64843 2024-02-13T14:47:58.777 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.777 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.778 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2>&1 | tee ceph_test_rados_api_watch_notify_pp.log | sed "s/^/ api_watch_notify_pp: /"' 2024-02-13T14:47:58.780 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.780 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.780 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.780 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.781 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_watch_notify_pp: /' 2024-02-13T14:47:58.781 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_watch_notify_pp.log 2024-02-13T14:47:58.783 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_cmd 2024-02-13T14:47:58.784 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_cmd' 2024-02-13T14:47:58.784 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_cmd 2024-02-13T14:47:58.787 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.787 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_watch_notify_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_watch_notify_pp.xml 2024-02-13T14:47:58.791 INFO:tasks.workunit.client.0.smithi062.stdout:test api_cmd on pid 64881 2024-02-13T14:47:58.791 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_cmd 2024-02-13T14:47:58.791 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64881 2024-02-13T14:47:58.791 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_cmd on pid 64881' 2024-02-13T14:47:58.791 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64881 2024-02-13T14:47:58.791 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.791 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.791 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2>&1 | tee ceph_test_rados_api_cmd.log | sed "s/^/ api_cmd: /"' 2024-02-13T14:47:58.792 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.792 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.792 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.792 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.793 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_cmd --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd.xml 2024-02-13T14:47:58.793 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_cmd: /' 2024-02-13T14:47:58.794 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_cmd_pp 2024-02-13T14:47:58.795 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_cmd_pp' 2024-02-13T14:47:58.795 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_cmd_pp 2024-02-13T14:47:58.796 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_cmd.log 2024-02-13T14:47:58.798 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.801 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_cmd_pp 2024-02-13T14:47:58.801 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64897 2024-02-13T14:47:58.802 INFO:tasks.workunit.client.0.smithi062.stdout:test api_cmd_pp on pid 64897 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_cmd_pp on pid 64897' 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64897 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2>&1 | tee ceph_test_rados_api_cmd_pp.log | sed "s/^/ api_cmd_pp: /"' 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_service 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_service' 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_service 2024-02-13T14:47:58.803 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.804 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.804 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.804 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.804 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.804 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_cmd_pp: /' 2024-02-13T14:47:58.805 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_cmd_pp.log 2024-02-13T14:47:58.805 INFO:tasks.workunit.client.0.smithi062.stdout:test api_service on pid 64912 2024-02-13T14:47:58.806 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_service 2024-02-13T14:47:58.806 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64912 2024-02-13T14:47:58.806 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_service on pid 64912' 2024-02-13T14:47:58.806 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64912 2024-02-13T14:47:58.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2>&1 | tee ceph_test_rados_api_service.log | sed "s/^/ api_service: /"' 2024-02-13T14:47:58.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_service_pp 2024-02-13T14:47:58.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_service_pp' 2024-02-13T14:47:58.807 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_service_pp 2024-02-13T14:47:58.807 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_cmd_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cmd_pp.xml 2024-02-13T14:47:58.808 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.808 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.809 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.809 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.809 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.809 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_service.log 2024-02-13T14:47:58.809 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_service: /' 2024-02-13T14:47:58.809 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_service --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service.xml 2024-02-13T14:47:58.812 INFO:tasks.workunit.client.0.smithi062.stdout:test api_service_pp on pid 64935 2024-02-13T14:47:58.812 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_service_pp 2024-02-13T14:47:58.812 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64935 2024-02-13T14:47:58.813 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_service_pp on pid 64935' 2024-02-13T14:47:58.813 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64935 2024-02-13T14:47:58.813 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.813 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2>&1 | tee ceph_test_rados_api_service_pp.log | sed "s/^/ api_service_pp: /"' 2024-02-13T14:47:58.813 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.814 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.814 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.814 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.814 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.814 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_service_pp --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_service_pp.xml 2024-02-13T14:47:58.815 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_service_pp.log 2024-02-13T14:47:58.816 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_c_write_operations 2024-02-13T14:47:58.816 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_c_write_operations' 2024-02-13T14:47:58.816 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_service_pp: /' 2024-02-13T14:47:58.816 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_c_write_operations 2024-02-13T14:47:58.829 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.830 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_c_write_operations 2024-02-13T14:47:58.831 INFO:tasks.workunit.client.0.smithi062.stdout:test api_c_write_operations on pid 64951 2024-02-13T14:47:58.831 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64951 2024-02-13T14:47:58.831 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_c_write_operations on pid 64951' 2024-02-13T14:47:58.832 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64951 2024-02-13T14:47:58.832 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2>&1 | tee ceph_test_rados_api_c_write_operations.log | sed "s/^/ api_c_write_operations: /"' 2024-02-13T14:47:58.832 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.832 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.832 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_c_read_operations 2024-02-13T14:47:58.832 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_c_read_operations' 2024-02-13T14:47:58.833 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.833 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.833 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.833 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.833 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.833 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_c_write_operations.log 2024-02-13T14:47:58.833 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_c_write_operations: /' 2024-02-13T14:47:58.834 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_c_write_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_write_operations.xml 2024-02-13T14:47:58.834 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_c_read_operations 2024-02-13T14:47:58.836 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_c_read_operations 2024-02-13T14:47:58.836 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2>&1 | tee ceph_test_rados_api_c_read_operations.log | sed "s/^/ api_c_read_operations: /"' 2024-02-13T14:47:58.836 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64972 2024-02-13T14:47:58.836 INFO:tasks.workunit.client.0.smithi062.stdout:test api_c_read_operations on pid 64972 2024-02-13T14:47:58.837 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_c_read_operations on pid 64972' 2024-02-13T14:47:58.837 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=64972 2024-02-13T14:47:58.837 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.837 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.838 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.839 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.839 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.839 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s api_cls_remote_reads 2024-02-13T14:47:58.839 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' api_cls_remote_reads' 2024-02-13T14:47:58.844 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.845 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_c_read_operations --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_c_read_operations.xml 2024-02-13T14:47:58.845 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_c_read_operations: /' 2024-02-13T14:47:58.846 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_c_read_operations.log 2024-02-13T14:47:58.852 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.854 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo api_cls_remote_reads 2024-02-13T14:47:58.856 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=api_cls_remote_reads 2024-02-13T14:47:58.856 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65014 2024-02-13T14:47:58.856 INFO:tasks.workunit.client.0.smithi062.stdout:test api_cls_remote_reads on pid 65014 2024-02-13T14:47:58.857 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test api_cls_remote_reads on pid 65014' 2024-02-13T14:47:58.857 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65014 2024-02-13T14:47:58.857 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.857 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.857 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2>&1 | tee ceph_test_rados_api_cls_remote_reads.log | sed "s/^/ api_cls_remote_reads: /"' 2024-02-13T14:47:58.857 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s list_parallel 2024-02-13T14:47:58.857 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' list_parallel' 2024-02-13T14:47:58.858 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo list_parallel 2024-02-13T14:47:58.858 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.858 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.859 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.859 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.859 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.859 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_api_cls_remote_reads.log 2024-02-13T14:47:58.861 INFO:tasks.workunit.client.0.smithi062.stdout:test list_parallel on pid 65024 2024-02-13T14:47:58.861 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=list_parallel 2024-02-13T14:47:58.861 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65024 2024-02-13T14:47:58.862 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test list_parallel on pid 65024' 2024-02-13T14:47:58.862 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65024 2024-02-13T14:47:58.862 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.862 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.862 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2>&1 | tee ceph_test_rados_list_parallel.log | sed "s/^/ list_parallel: /"' 2024-02-13T14:47:58.862 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_api_cls_remote_reads --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-api_cls_remote_reads.xml 2024-02-13T14:47:58.862 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.863 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.863 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.863 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.866 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s open_pools_parallel 2024-02-13T14:47:58.867 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' open_pools_parallel' 2024-02-13T14:47:58.867 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo open_pools_parallel 2024-02-13T14:47:58.868 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.870 INFO:tasks.workunit.client.0.smithi062.stdout:test open_pools_parallel on pid 65033 2024-02-13T14:47:58.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=open_pools_parallel 2024-02-13T14:47:58.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65033 2024-02-13T14:47:58.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test open_pools_parallel on pid 65033' 2024-02-13T14:47:58.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65033 2024-02-13T14:47:58.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in api_aio api_aio_pp api_io api_io_pp api_asio api_list api_lock api_lock_pp api_misc api_misc_pp api_tier_pp api_pool api_snapshots api_snapshots_pp api_stat api_stat_pp api_watch_notify api_watch_notify_pp api_cmd api_cmd_pp api_service api_service_pp api_c_write_operations api_c_read_operations api_cls_remote_reads list_parallel open_pools_parallel delete_pools_parallel 2024-02-13T14:47:58.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ api_cls_remote_reads: /' 2024-02-13T14:47:58.871 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_list_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-list_parallel.xml 2024-02-13T14:47:58.872 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s delete_pools_parallel 2024-02-13T14:47:58.872 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' delete_pools_parallel' 2024-02-13T14:47:58.872 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2>&1 | tee ceph_test_rados_open_pools_parallel.log | sed "s/^/ open_pools_parallel: /"' 2024-02-13T14:47:58.873 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ list_parallel: /' 2024-02-13T14:47:58.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.875 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ open_pools_parallel: /' 2024-02-13T14:47:58.876 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_open_pools_parallel.log 2024-02-13T14:47:58.878 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_list_parallel.log 2024-02-13T14:47:58.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_open_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-open_pools_parallel.xml 2024-02-13T14:47:58.892 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.897 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo delete_pools_parallel 2024-02-13T14:47:58.899 INFO:tasks.workunit.client.0.smithi062.stdout:test delete_pools_parallel on pid 65096 2024-02-13T14:47:58.899 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=delete_pools_parallel 2024-02-13T14:47:58.899 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65096 2024-02-13T14:47:58.899 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test delete_pools_parallel on pid 65096' 2024-02-13T14:47:58.899 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65096 2024-02-13T14:47:58.899 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:58.899 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.903 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2>&1 | tee ceph_test_rados_delete_pools_parallel.log | sed "s/^/ delete_pools_parallel: /"' 2024-02-13T14:47:58.903 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s cls 2024-02-13T14:47:58.905 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' cls' 2024-02-13T14:47:58.906 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.906 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.906 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.906 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.910 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_rados_delete_pools_parallel --gtest_output=xml:/home/ubuntu/cephtest/archive/gtest_xml_report-delete_pools_parallel.xml 2024-02-13T14:47:58.912 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_rados_delete_pools_parallel.log 2024-02-13T14:47:58.913 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ delete_pools_parallel: /' 2024-02-13T14:47:58.913 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo cls 2024-02-13T14:47:58.914 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.923 INFO:tasks.workunit.client.0.smithi062.stdout:test cls on pid 65164 2024-02-13T14:47:58.923 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=cls 2024-02-13T14:47:58.924 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65164 2024-02-13T14:47:58.924 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test cls on pid 65164' 2024-02-13T14:47:58.924 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65164 2024-02-13T14:47:58.924 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:58.924 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.926 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s cmd 2024-02-13T14:47:58.927 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' cmd' 2024-02-13T14:47:58.927 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo cmd 2024-02-13T14:47:58.931 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.934 INFO:tasks.workunit.client.0.smithi062.stdout:test cmd on pid 65193 2024-02-13T14:47:58.934 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=cmd 2024-02-13T14:47:58.934 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65193 2024-02-13T14:47:58.934 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test cmd on pid 65193' 2024-02-13T14:47:58.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65193 2024-02-13T14:47:58.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:58.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cmd 2>&1 | tee ceph_test_neorados_cmd.log | sed "s/^/ cmd: /"' 2024-02-13T14:47:58.935 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s handler_error 2024-02-13T14:47:58.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_cls 2>&1 | tee ceph_test_neorados_cls.log | sed "s/^/ cls: /"' 2024-02-13T14:47:58.935 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' handler_error' 2024-02-13T14:47:58.936 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.936 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.936 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.936 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.936 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.937 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_cmd.log 2024-02-13T14:47:58.937 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ cmd: /' 2024-02-13T14:47:58.937 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_cmd 2024-02-13T14:47:58.937 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo handler_error 2024-02-13T14:47:58.940 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.940 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.941 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.941 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.944 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_cls.log 2024-02-13T14:47:58.946 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_cls 2024-02-13T14:47:58.946 INFO:tasks.workunit.client.0.smithi062.stdout:test handler_error on pid 65235 2024-02-13T14:47:58.947 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=handler_error 2024-02-13T14:47:58.947 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65235 2024-02-13T14:47:58.947 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test handler_error on pid 65235' 2024-02-13T14:47:58.947 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65235 2024-02-13T14:47:58.947 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:58.947 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.951 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s io 2024-02-13T14:47:58.951 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ cls: /' 2024-02-13T14:47:58.954 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_handler_error 2>&1 | tee ceph_test_neorados_handler_error.log | sed "s/^/ handler_error: /"' 2024-02-13T14:47:58.954 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' io' 2024-02-13T14:47:58.955 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.955 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.955 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.956 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.956 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.958 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_handler_error 2024-02-13T14:47:58.958 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo io 2024-02-13T14:47:58.959 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=io 2024-02-13T14:47:58.962 INFO:tasks.workunit.client.0.smithi062.stdout:test io on pid 65262 2024-02-13T14:47:58.963 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65262 2024-02-13T14:47:58.963 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test io on pid 65262' 2024-02-13T14:47:58.963 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65262 2024-02-13T14:47:58.963 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:58.963 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.963 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_handler_error.log 2024-02-13T14:47:58.963 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ handler_error: /' 2024-02-13T14:47:58.964 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s ec_io 2024-02-13T14:47:58.964 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' ec_io' 2024-02-13T14:47:58.966 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_io 2>&1 | tee ceph_test_neorados_io.log | sed "s/^/ io: /"' 2024-02-13T14:47:58.968 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.968 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.968 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.968 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.968 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_io.log 2024-02-13T14:47:58.969 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ io: /' 2024-02-13T14:47:58.970 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.971 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo ec_io 2024-02-13T14:47:58.973 INFO:tasks.workunit.client.0.smithi062.stdout:test ec_io on pid 65298 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=ec_io 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_io 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65298 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test ec_io on pid 65298' 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65298 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_io 2>&1 | tee ceph_test_neorados_ec_io.log | sed "s/^/ ec_io: /"' 2024-02-13T14:47:58.974 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s list 2024-02-13T14:47:58.975 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' list' 2024-02-13T14:47:58.975 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.975 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.975 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.975 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.976 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_ec_io.log 2024-02-13T14:47:58.976 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_ec_io 2024-02-13T14:47:58.976 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ ec_io: /' 2024-02-13T14:47:58.976 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo list 2024-02-13T14:47:58.978 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:58.991 INFO:tasks.workunit.client.0.smithi062.stdout:test list on pid 65352 2024-02-13T14:47:58.991 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=list 2024-02-13T14:47:58.991 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65352 2024-02-13T14:47:58.991 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test list on pid 65352' 2024-02-13T14:47:58.992 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65352 2024-02-13T14:47:58.992 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:58.992 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:58.992 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_list 2>&1 | tee ceph_test_neorados_list.log | sed "s/^/ list: /"' 2024-02-13T14:47:58.994 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:58.994 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.994 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:58.994 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:58.995 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_list 2024-02-13T14:47:58.995 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_list.log 2024-02-13T14:47:58.995 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ list: /' 2024-02-13T14:47:58.998 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s ec_list 2024-02-13T14:47:58.999 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' ec_list' 2024-02-13T14:47:59.000 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo ec_list 2024-02-13T14:47:59.003 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:59.005 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=ec_list 2024-02-13T14:47:59.006 INFO:tasks.workunit.client.0.smithi062.stdout:test ec_list on pid 65391 2024-02-13T14:47:59.006 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65391 2024-02-13T14:47:59.007 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test ec_list on pid 65391' 2024-02-13T14:47:59.007 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65391 2024-02-13T14:47:59.007 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:59.007 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:59.007 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_ec_list 2>&1 | tee ceph_test_neorados_ec_list.log | sed "s/^/ ec_list: /"' 2024-02-13T14:47:59.007 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s misc 2024-02-13T14:47:59.007 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' misc' 2024-02-13T14:47:59.008 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo misc 2024-02-13T14:47:59.008 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:59.008 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:59.008 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.008 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:59.008 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.008 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_ec_list 2024-02-13T14:47:59.009 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_ec_list.log 2024-02-13T14:47:59.009 INFO:tasks.workunit.client.0.smithi062.stdout:test misc on pid 65402 2024-02-13T14:47:59.010 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=misc 2024-02-13T14:47:59.010 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65402 2024-02-13T14:47:59.010 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test misc on pid 65402' 2024-02-13T14:47:59.010 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65402 2024-02-13T14:47:59.010 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:59.010 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:59.010 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_misc 2>&1 | tee ceph_test_neorados_misc.log | sed "s/^/ misc: /"' 2024-02-13T14:47:59.010 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s pool 2024-02-13T14:47:59.011 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' pool' 2024-02-13T14:47:59.011 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo pool 2024-02-13T14:47:59.012 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ ec_list: /' 2024-02-13T14:47:59.012 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:59.012 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.012 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:59.012 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.012 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_misc 2024-02-13T14:47:59.012 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_misc.log 2024-02-13T14:47:59.012 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ misc: /' 2024-02-13T14:47:59.013 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:59.015 INFO:tasks.workunit.client.0.smithi062.stdout:test pool on pid 65410 2024-02-13T14:47:59.016 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=pool 2024-02-13T14:47:59.016 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65410 2024-02-13T14:47:59.016 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test pool on pid 65410' 2024-02-13T14:47:59.016 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65410 2024-02-13T14:47:59.016 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:59.016 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:59.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_pool 2>&1 | tee ceph_test_neorados_pool.log | sed "s/^/ pool: /"' 2024-02-13T14:47:59.017 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s read_operations 2024-02-13T14:47:59.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' read_operations' 2024-02-13T14:47:59.017 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo read_operations 2024-02-13T14:47:59.017 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:59.017 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:59.018 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.018 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:59.018 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.018 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=read_operations 2024-02-13T14:47:59.019 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_pool.log 2024-02-13T14:47:59.019 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ pool: /' 2024-02-13T14:47:59.019 INFO:tasks.workunit.client.0.smithi062.stdout:test read_operations on pid 65424 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65424 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test read_operations on pid 65424' 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65424 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_pool 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s snapshots 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_read_operations 2>&1 | tee ceph_test_neorados_read_operations.log | sed "s/^/ read_operations: /"' 2024-02-13T14:47:59.020 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' snapshots' 2024-02-13T14:47:59.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo snapshots 2024-02-13T14:47:59.021 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:59.023 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:59.023 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.023 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:59.023 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.023 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_read_operations 2024-02-13T14:47:59.023 INFO:tasks.workunit.client.0.smithi062.stdout:test snapshots on pid 65434 2024-02-13T14:47:59.023 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=snapshots 2024-02-13T14:47:59.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65434 2024-02-13T14:47:59.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test snapshots on pid 65434' 2024-02-13T14:47:59.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65434 2024-02-13T14:47:59.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:59.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:59.024 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_snapshots 2>&1 | tee ceph_test_neorados_snapshots.log | sed "s/^/ snapshots: /"' 2024-02-13T14:47:59.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:59.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:59.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_snapshots 2024-02-13T14:47:59.025 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_snapshots.log 2024-02-13T14:47:59.026 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_read_operations.log 2024-02-13T14:47:59.030 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ snapshots: /' 2024-02-13T14:47:59.032 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s watch_notify 2024-02-13T14:47:59.032 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' watch_notify' 2024-02-13T14:47:59.033 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ read_operations: /' 2024-02-13T14:47:59.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo watch_notify 2024-02-13T14:47:59.033 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:59.036 INFO:tasks.workunit.client.0.smithi062.stdout:test watch_notify on pid 65453 2024-02-13T14:47:59.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=watch_notify 2024-02-13T14:47:59.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65453 2024-02-13T14:47:59.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test watch_notify on pid 65453' 2024-02-13T14:47:59.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65453 2024-02-13T14:47:59.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ for f in cls cmd handler_error io ec_io list ec_list misc pool read_operations snapshots watch_notify write_operations 2024-02-13T14:47:59.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:59.037 INFO:tasks.workunit.client.0.smithi062.stderr:++ printf %25s write_operations 2024-02-13T14:47:59.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ r=' write_operations' 2024-02-13T14:47:59.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_watch_notify 2>&1 | tee ceph_test_neorados_watch_notify.log | sed "s/^/ watch_notify: /"' 2024-02-13T14:47:59.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:59.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:59.038 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.038 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_watch_notify 2024-02-13T14:47:59.038 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ watch_notify: /' 2024-02-13T14:47:59.038 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_watch_notify.log 2024-02-13T14:47:59.044 INFO:tasks.workunit.client.0.smithi062.stderr:++ awk '{print $1}' 2024-02-13T14:47:59.046 INFO:tasks.workunit.client.0.smithi062.stderr:++ echo write_operations 2024-02-13T14:47:59.049 INFO:tasks.workunit.client.0.smithi062.stdout:test write_operations on pid 65486 2024-02-13T14:47:59.049 INFO:tasks.workunit.client.0.smithi062.stderr:+ ff=write_operations 2024-02-13T14:47:59.049 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65486 2024-02-13T14:47:59.049 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo 'test write_operations on pid 65486' 2024-02-13T14:47:59.049 INFO:tasks.workunit.client.0.smithi062.stderr:+ pids[$f]=65486 2024-02-13T14:47:59.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ ret=0 2024-02-13T14:47:59.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' 1 -eq 1 ']' 2024-02-13T14:47:59.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T14:47:59.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64688 2024-02-13T14:47:59.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64688 2024-02-13T14:47:59.050 INFO:tasks.workunit.client.0.smithi062.stderr:+ bash -o pipefail -exc 'ceph_test_neorados_write_operations 2>&1 | tee ceph_test_neorados_write_operations.log | sed "s/^/ write_operations: /"' 2024-02-13T14:47:59.051 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z '' ']' 2024-02-13T14:47:59.051 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.051 INFO:tasks.workunit.client.0.smithi062.stderr:+ case $- in 2024-02-13T14:47:59.051 INFO:tasks.workunit.client.0.smithi062.stderr:+ return 2024-02-13T14:47:59.051 INFO:tasks.workunit.client.0.smithi062.stderr:+ tee ceph_test_neorados_write_operations.log 2024-02-13T14:47:59.051 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph_test_neorados_write_operations 2024-02-13T14:47:59.060 INFO:tasks.workunit.client.0.smithi062.stderr:+ sed 's/^/ write_operations: /' 2024-02-13T14:48:00.342 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:48:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:48:05.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:04 smithi062 bash[21479]: audit 2024-02-13T14:47:58.851457+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:05.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:04 smithi062 bash[21479]: audit 2024-02-13T14:47:58.860315+0000 mon.c (mon.2) 30 : audit 0 from='client.? v1:172.21.15.62:0/1994656902' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-13T14:48:05.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:04 smithi062 bash[21479]: audit 2024-02-13T14:47:59.017217+0000 mon.c (mon.2) 31 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:05.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:04 smithi062 bash[21479]: audit 2024-02-13T14:47:59.059208+0000 mon.b (mon.1) 96 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:05.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:04 smithi062 bash[28859]: audit 2024-02-13T14:47:58.851457+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:05.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:04 smithi062 bash[28859]: audit 2024-02-13T14:47:58.860315+0000 mon.c (mon.2) 30 : audit 0 from='client.? v1:172.21.15.62:0/1994656902' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-13T14:48:05.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:04 smithi062 bash[28859]: audit 2024-02-13T14:47:59.017217+0000 mon.c (mon.2) 31 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:05.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:04 smithi062 bash[28859]: audit 2024-02-13T14:47:59.059208+0000 mon.b (mon.1) 96 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:04 smithi111 bash[23388]: audit 2024-02-13T14:47:58.851457+0000 mon.b (mon.1) 95 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:04 smithi111 bash[23388]: audit 2024-02-13T14:47:58.860315+0000 mon.c (mon.2) 30 : audit 0 from='client.? v1:172.21.15.62:0/1994656902' entity='client.admin' cmd=[{"prefix":"quorum_status"}]: dispatch 2024-02-13T14:48:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:04 smithi111 bash[23388]: audit 2024-02-13T14:47:59.017217+0000 mon.c (mon.2) 31 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:04 smithi111 bash[23388]: audit 2024-02-13T14:47:59.059208+0000 mon.b (mon.1) 96 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:06.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:48:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:48:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [==========] Running 4 tests from 1 test suite. 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [----------] Global test environment set-up. 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [----------] 4 tests from LibRadosService 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ RUN ] LibRadosService.RegisterEarly 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ OK ] LibRadosService.RegisterEarly (5067 ms) 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ RUN ] LibRadosService.RegisterLate 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ OK ] LibRadosService.RegisterLate (23 ms) 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ RUN ] LibRadosService.StatusFormat 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: cluster: 2024-02-13T14:48:10.272 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: id: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: health: HEALTH_OK 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: services: 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: data: 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pools: 6 pools, 132 pgs 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: objects: 198 objects, 582 KiB 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pgs: 132 active+clean 2024-02-13T14:48:10.273 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: io: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: cluster: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: id: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: health: HEALTH_OK 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: services: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: data: 2024-02-13T14:48:10.274 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pools: 6 pools, 132 pgs 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: objects: 198 objects, 582 KiB 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pgs: 132 active+clean 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: io: 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: cluster: 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: id: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: health: HEALTH_OK 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: services: 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mgr: y(active, since 3m), standbys: x 2024-02-13T14:48:10.275 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: data: 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pools: 6 pools, 132 pgs 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: objects: 198 objects, 582 KiB 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pgs: 132 active+clean 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: io: 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.276 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: cluster: 2024-02-13T14:48:10.277 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: id: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T14:48:10.277 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: health: HEALTH_WARN 2024-02-13T14:48:10.277 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2 pool(s) do not have an application enabled 2024-02-13T14:48:10.277 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:10.277 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: services: 2024-02-13T14:48:10.277 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mon: 3 daemons, quorum a,b,c (age 12m) 2024-02-13T14:48:10.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: mgr: api_asio: [==========] Running 12 tests from 1 test suite. 2024-02-13T14:48:10.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [----------] Global test environment set-up. 2024-02-13T14:48:10.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [----------] 12 tests from AsioRados 2024-02-13T14:48:10.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadCallback 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadCallback (0 ms) 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadFuture 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadFuture (1 ms) 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadYield 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadYield (0 ms) 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteCallback 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteCallback (2 ms) 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteFuture 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteFuture (1 ms) 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteYield 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteYield (1 ms) 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationCallback 2024-02-13T14:48:10.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationCallback (1 ms) 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationFuture 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationFuture (0 ms) 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncReadOperationYield 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncReadOperationYield (1 ms) 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationCallback 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationCallback (1 ms) 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationFuture 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationFuture (1 ms) 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ RUN ] AsioRados.AsyncWriteOperationYield 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ OK ] AsioRados.AsyncWriteOperationYield (1 ms) 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [----------] 12 tests from AsioRados (10 ms total) 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [----------] Global test environment tear-down 2024-02-13T14:48:10.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [==========] 12 tests from 1 test suite ran. (11688 ms total) 2024-02-13T14:48:10.367 INFO:tasks.workunit.client.0.smithi062.stdout: api_asio: [ PASSED ] 12 tests. 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: cluster 2024-02-13T14:47:58.736878+0000 mgr.y (mgr.14613) 163 : cluster 0 pgmap v110: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:47:59.507699+0000 mon.b (mon.1) 97 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:47:59.619658+0000 mon.a (mon.0) 848 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:47:59.633875+0000 mon.b (mon.1) 98 : audit 1 from='client.? v1:172.21.15.62:0/1501128385' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:48:00.082633+0000 mgr.y (mgr.14613) 164 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: cluster 2024-02-13T14:48:00.738699+0000 mgr.y (mgr.14613) 165 : cluster 0 pgmap v112: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:48:01.854367+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: cluster 2024-02-13T14:48:02.739428+0000 mgr.y (mgr.14613) 166 : cluster 0 pgmap v113: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:48:04.148208+0000 mon.c (mon.2) 32 : audit 0 from='client.? v1:172.21.15.62:0/1061062416' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:10.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: cluster 2024-02-13T14:48:04.899620+0000 mon.a (mon.0) 849 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:48:04.912768+0000 mon.a (mon.0) 850 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:48:04.922841+0000 mon.a (mon.0) 851 : audit 1 from='client.24718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:48:04.923618+0000 mon.a (mon.0) 852 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[21479]: audit 2024-02-13T14:48:04.924004+0000 mon.a (mon.0) 853 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: cluster 2024-02-13T14:47:58.736878+0000 mgr.y (mgr.14613) 163 : cluster 0 pgmap v110: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:47:59.507699+0000 mon.b (mon.1) 97 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:47:59.619658+0000 mon.a (mon.0) 848 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:47:59.633875+0000 mon.b (mon.1) 98 : audit 1 from='client.? v1:172.21.15.62:0/1501128385' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:48:00.082633+0000 mgr.y (mgr.14613) 164 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: cluster 2024-02-13T14:48:00.738699+0000 mgr.y (mgr.14613) 165 : cluster 0 pgmap v112: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:10.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:48:01.854367+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: cluster 2024-02-13T14:48:02.739428+0000 mgr.y (mgr.14613) 166 : cluster 0 pgmap v113: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:48:04.148208+0000 mon.c (mon.2) 32 : audit 0 from='client.? v1:172.21.15.62:0/1061062416' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: cluster 2024-02-13T14:48:04.899620+0000 mon.a (mon.0) 849 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-02-13T14:48:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:48:04.912768+0000 mon.a (mon.0) 850 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:48:04.922841+0000 mon.a (mon.0) 851 : audit 1 from='client.24718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:48:04.923618+0000 mon.a (mon.0) 852 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:10 smithi062 bash[28859]: audit 2024-02-13T14:48:04.924004+0000 mon.a (mon.0) 853 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:10.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:48:10.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: cluster 2024-02-13T14:47:58.736878+0000 mgr.y (mgr.14613) 163 : cluster 0 pgmap v110: 132 pgs: 132 active+clean; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-02-13T14:48:10.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:47:59.507699+0000 mon.b (mon.1) 97 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:10.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:47:59.619658+0000 mon.a (mon.0) 848 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:10.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:47:59.633875+0000 mon.b (mon.1) 98 : audit 1 from='client.? v1:172.21.15.62:0/1501128385' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:10.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:48:00.082633+0000 mgr.y (mgr.14613) 164 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: cluster 2024-02-13T14:48:00.738699+0000 mgr.y (mgr.14613) 165 : cluster 0 pgmap v112: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:48:01.854367+0000 mon.b (mon.1) 99 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: cluster 2024-02-13T14:48:02.739428+0000 mgr.y (mgr.14613) 166 : cluster 0 pgmap v113: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:48:04.148208+0000 mon.c (mon.2) 32 : audit 0 from='client.? v1:172.21.15.62:0/1061062416' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: cluster 2024-02-13T14:48:04.899620+0000 mon.a (mon.0) 849 : cluster 0 osdmap e75: 8 total, 8 up, 8 in 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:48:04.912768+0000 mon.a (mon.0) 850 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:48:04.922841+0000 mon.a (mon.0) 851 : audit 1 from='client.24718 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:48:04.923618+0000 mon.a (mon.0) 852 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:10 smithi111 bash[23388]: audit 2024-02-13T14:48:04.924004+0000 mon.a (mon.0) 853 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.946775+0000 mon.c (mon.2) 33 : audit 1 from='client.? v1:172.21.15.62:0/1303884808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.948212+0000 mon.c (mon.2) 34 : audit 1 from='client.? v1:172.21.15.62:0/4022622967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.948802+0000 mon.c (mon.2) 35 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.950199+0000 mon.c (mon.2) 36 : audit 1 from='client.? v1:172.21.15.62:0/3187935484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.951588+0000 mon.c (mon.2) 37 : audit 1 from='client.? v1:172.21.15.62:0/1623799410' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.952240+0000 mon.c (mon.2) 38 : audit 1 from='client.? v1:172.21.15.62:0/1863370363' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.952723+0000 mon.c (mon.2) 39 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.960557+0000 mon.b (mon.1) 100 : audit 1 from='client.? v1:172.21.15.62:0/11614307' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.961389+0000 mon.b (mon.1) 101 : audit 1 from='client.? v1:172.21.15.62:0/754748377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:04.962289+0000 mon.b (mon.1) 102 : audit 1 from='client.? v1:172.21.15.62:0/2429481879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:06.185044+0000 mon.c (mon.2) 40 : audit 0 from='client.? v1:172.21.15.62:0/2012025967' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:08.223327+0000 mon.c (mon.2) 41 : audit 0 from='client.? v1:172.21.15.62:0/1965064832' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: cluster 2024-02-13T14:48:10.208048+0000 mon.a (mon.0) 854 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: cluster 2024-02-13T14:48:10.216414+0000 mon.a (mon.0) 855 : cluster 3 Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:10.220913+0000 mon.a (mon.0) 856 : audit 1 from='client.24850 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:10.232511+0000 mon.a (mon.0) 857 : audit 1 from='client.? v1:172.21.15.62:0/1310548487' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi062-64512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:10.234210+0000 mon.a (mon.0) 858 : audit 1 from='client.24847 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:10.235088+0000 mon.a (mon.0) 859 : audit 1 from='client.24695 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[21479]: audit 2024-02-13T14:48:10.236037+0000 mon.a (mon.0) 860 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.946775+0000 mon.c (mon.2) 33 : audit 1 from='client.? v1:172.21.15.62:0/1303884808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.948212+0000 mon.c (mon.2) 34 : audit 1 from='client.? v1:172.21.15.62:0/4022622967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.948802+0000 mon.c (mon.2) 35 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.950199+0000 mon.c (mon.2) 36 : audit 1 from='client.? v1:172.21.15.62:0/3187935484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.951588+0000 mon.c (mon.2) 37 : audit 1 from='client.? v1:172.21.15.62:0/1623799410' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.952240+0000 mon.c (mon.2) 38 : audit 1 from='client.? v1:172.21.15.62:0/1863370363' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.952723+0000 mon.c (mon.2) 39 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.960557+0000 mon.b (mon.1) 100 : audit 1 from='client.? v1:172.21.15.62:0/11614307' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.961389+0000 mon.b (mon.1) 101 : audit 1 from='client.? v1:172.21.15.62:0/754748377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:04.962289+0000 mon.b (mon.1) 102 : audit 1 from='client.? v1:172.21.15.62:0/2429481879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:06.185044+0000 mon.c (mon.2) 40 : audit 0 from='client.? v1:172.21.15.62:0/2012025967' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:08.223327+0000 mon.c (mon.2) 41 : audit 0 from='client.? v1:172.21.15.62:0/1965064832' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: cluster 2024-02-13T14:48:10.208048+0000 mon.a (mon.0) 854 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: cluster 2024-02-13T14:48:10.216414+0000 mon.a (mon.0) 855 : cluster 3 Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:10.220913+0000 mon.a (mon.0) 856 : audit 1 from='client.24850 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:10.232511+0000 mon.a (mon.0) 857 : audit 1 from='client.? v1:172.21.15.62:0/1310548487' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi062-64512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:10.234210+0000 mon.a (mon.0) 858 : audit 1 from='client.24847 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:10.235088+0000 mon.a (mon.0) 859 : audit 1 from='client.24695 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:14 smithi062 bash[28859]: audit 2024-02-13T14:48:10.236037+0000 mon.a (mon.0) 860 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.946775+0000 mon.c (mon.2) 33 : audit 1 from='client.? v1:172.21.15.62:0/1303884808' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.948212+0000 mon.c (mon.2) 34 : audit 1 from='client.? v1:172.21.15.62:0/4022622967' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.948802+0000 mon.c (mon.2) 35 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.950199+0000 mon.c (mon.2) 36 : audit 1 from='client.? v1:172.21.15.62:0/3187935484' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.951588+0000 mon.c (mon.2) 37 : audit 1 from='client.? v1:172.21.15.62:0/1623799410' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.952240+0000 mon.c (mon.2) 38 : audit 1 from='client.? v1:172.21.15.62:0/1863370363' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.952723+0000 mon.c (mon.2) 39 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.960557+0000 mon.b (mon.1) 100 : audit 1 from='client.? v1:172.21.15.62:0/11614307' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.961389+0000 mon.b (mon.1) 101 : audit 1 from='client.? v1:172.21.15.62:0/754748377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:04.962289+0000 mon.b (mon.1) 102 : audit 1 from='client.? v1:172.21.15.62:0/2429481879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:06.185044+0000 mon.c (mon.2) 40 : audit 0 from='client.? v1:172.21.15.62:0/2012025967' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:08.223327+0000 mon.c (mon.2) 41 : audit 0 from='client.? v1:172.21.15.62:0/1965064832' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: cluster 2024-02-13T14:48:10.208048+0000 mon.a (mon.0) 854 : cluster 0 osdmap e76: 8 total, 8 up, 8 in 2024-02-13T14:48:15.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: cluster 2024-02-13T14:48:10.216414+0000 mon.a (mon.0) 855 : cluster 3 Health check failed: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:10.220913+0000 mon.a (mon.0) 856 : audit 1 from='client.24850 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:10.232511+0000 mon.a (mon.0) 857 : audit 1 from='client.? v1:172.21.15.62:0/1310548487' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi062-64512-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:10.234210+0000 mon.a (mon.0) 858 : audit 1 from='client.24847 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:10.235088+0000 mon.a (mon.0) 859 : audit 1 from='client.24695 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:14 smithi111 bash[23388]: audit 2024-02-13T14:48:10.236037+0000 mon.a (mon.0) 860 : audit 1 from='client.24739 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: cluster 2024-02-13T14:48:04.741341+0000 mgr.y (mgr.14613) 167 : cluster 0 pgmap v114: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: cluster 2024-02-13T14:48:06.742191+0000 mgr.y (mgr.14613) 168 : cluster 0 pgmap v116: 580 pgs: 55 creating+peering, 132 active+clean, 393 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: cluster 2024-02-13T14:48:08.743468+0000 mgr.y (mgr.14613) 169 : cluster 0 pgmap v117: 580 pgs: 55 creating+peering, 132 active+clean, 393 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T14:48:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.093900+0000 mgr.y (mgr.14613) 170 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.236815+0000 mon.a (mon.0) 861 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.236911+0000 mon.a (mon.0) 862 : audit 1 from='client.24718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.256664+0000 mon.c (mon.2) 42 : audit 1 from='client.? v1:172.21.15.62:0/1985710894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.257221+0000 mon.c (mon.2) 43 : audit 1 from='client.? v1:172.21.15.62:0/2184640716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.257692+0000 mon.c (mon.2) 44 : audit 1 from='client.? v1:172.21.15.62:0/3531481609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.258341+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.258721+0000 mon.c (mon.2) 45 : audit 1 from='client.? v1:172.21.15.62:0/3287312863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.258989+0000 mon.c (mon.2) 46 : audit 1 from='client.? v1:172.21.15.62:0/2490475216' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.259789+0000 mon.c (mon.2) 47 : audit 1 from='client.? v1:172.21.15.62:0/1978954362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: cluster 2024-02-13T14:48:04.741341+0000 mgr.y (mgr.14613) 167 : cluster 0 pgmap v114: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: cluster 2024-02-13T14:48:06.742191+0000 mgr.y (mgr.14613) 168 : cluster 0 pgmap v116: 580 pgs: 55 creating+peering, 132 active+clean, 393 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: cluster 2024-02-13T14:48:08.743468+0000 mgr.y (mgr.14613) 169 : cluster 0 pgmap v117: 580 pgs: 55 creating+peering, 132 active+clean, 393 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.093900+0000 mgr.y (mgr.14613) 170 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.236815+0000 mon.a (mon.0) 861 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.236911+0000 mon.a (mon.0) 862 : audit 1 from='client.24718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.256664+0000 mon.c (mon.2) 42 : audit 1 from='client.? v1:172.21.15.62:0/1985710894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.257221+0000 mon.c (mon.2) 43 : audit 1 from='client.? v1:172.21.15.62:0/2184640716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.257692+0000 mon.c (mon.2) 44 : audit 1 from='client.? v1:172.21.15.62:0/3531481609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.258341+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.258721+0000 mon.c (mon.2) 45 : audit 1 from='client.? v1:172.21.15.62:0/3287312863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.258989+0000 mon.c (mon.2) 46 : audit 1 from='client.? v1:172.21.15.62:0/2490475216' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.259789+0000 mon.c (mon.2) 47 : audit 1 from='client.? v1:172.21.15.62:0/1978954362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.260367+0000 mon.c (mon.2) 48 : audit 1 from='client.? v1:172.21.15.62:0/2608480029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:10.272232+0000 mon.c (mon.2) 49 : audit 0 from='client.? v1:172.21.15.62:0/3503054680' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: cluster 2024-02-13T14:48:10.745046+0000 mgr.y (mgr.14613) 171 : cluster 0 pgmap v119: 964 pgs: 358 creating+peering, 132 active+clean, 474 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: cluster 2024-02-13T14:48:12.746587+0000 mgr.y (mgr.14613) 172 : cluster 0 pgmap v120: 964 pgs: 358 creating+peering, 132 active+clean, 474 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:12.922051+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: cluster 2024-02-13T14:48:14.693392+0000 mon.a (mon.0) 863 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.702074+0000 mon.a (mon.0) 864 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.712388+0000 mon.a (mon.0) 865 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.712975+0000 mon.a (mon.0) 866 : audit 1 from='client.24701 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.713474+0000 mon.a (mon.0) 867 : audit 1 from='client.24740 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.713991+0000 mon.a (mon.0) 868 : audit 1 from='client.24737 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.714620+0000 mon.a (mon.0) 869 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.714844+0000 mon.a (mon.0) 870 : audit 1 from='client.24850 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.714897+0000 mon.a (mon.0) 871 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.714965+0000 mon.a (mon.0) 872 : audit 1 from='client.? v1:172.21.15.62:0/1310548487' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi062-64512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.260367+0000 mon.c (mon.2) 48 : audit 1 from='client.? v1:172.21.15.62:0/2608480029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:10.272232+0000 mon.c (mon.2) 49 : audit 0 from='client.? v1:172.21.15.62:0/3503054680' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: cluster 2024-02-13T14:48:10.745046+0000 mgr.y (mgr.14613) 171 : cluster 0 pgmap v119: 964 pgs: 358 creating+peering, 132 active+clean, 474 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:16.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: cluster 2024-02-13T14:48:12.746587+0000 mgr.y (mgr.14613) 172 : cluster 0 pgmap v120: 964 pgs: 358 creating+peering, 132 active+clean, 474 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:12.922051+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: cluster 2024-02-13T14:48:14.693392+0000 mon.a (mon.0) 863 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.702074+0000 mon.a (mon.0) 864 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.712388+0000 mon.a (mon.0) 865 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.712975+0000 mon.a (mon.0) 866 : audit 1 from='client.24701 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.713474+0000 mon.a (mon.0) 867 : audit 1 from='client.24740 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.713991+0000 mon.a (mon.0) 868 : audit 1 from='client.24737 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.714620+0000 mon.a (mon.0) 869 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.714844+0000 mon.a (mon.0) 870 : audit 1 from='client.24850 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.714897+0000 mon.a (mon.0) 871 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:16.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.714965+0000 mon.a (mon.0) 872 : audit 1 from='client.? v1:172.21.15.62:0/1310548487' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi062-64512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.715053+0000 mon.a (mon.0) 873 : audit 1 from='client.24847 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.715149+0000 mon.a (mon.0) 874 : audit 1 from='client.24695 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.715203+0000 mon.a (mon.0) 875 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: cluster 2024-02-13T14:48:14.719393+0000 mon.a (mon.0) 876 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.727849+0000 mon.c (mon.2) 50 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.730557+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.62:0/1073773229' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.747452+0000 mon.a (mon.0) 877 : audit 1 from='client.24749 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: cluster 2024-02-13T14:48:14.747859+0000 mgr.y (mgr.14613) 173 : cluster 0 pgmap v122: 1284 pgs: 718 creating+peering, 148 active+clean, 418 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 895 B/s wr, 2 op/s 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.757466+0000 mon.a (mon.0) 878 : audit 1 from='client.24755 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.757997+0000 mon.a (mon.0) 879 : audit 1 from='client.24752 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.758380+0000 mon.a (mon.0) 880 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:16.066 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.758880+0000 mon.a (mon.0) 881 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.759372+0000 mon.a (mon.0) 882 : audit 1 from='client.24767 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.759869+0000 mon.a (mon.0) 883 : audit 1 from='client.24785 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.762720+0000 mon.a (mon.0) 884 : audit 1 from='client.24791 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:14.763527+0000 mon.a (mon.0) 885 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:15.208840+0000 mon.a (mon.0) 886 : audit 1 from='client.24857 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:15.219680+0000 mon.a (mon.0) 887 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:15.230008+0000 mon.a (mon.0) 888 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[21479]: audit 2024-02-13T14:48:15.235648+0000 mon.b (mon.1) 105 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:16.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.715053+0000 mon.a (mon.0) 873 : audit 1 from='client.24847 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.715149+0000 mon.a (mon.0) 874 : audit 1 from='client.24695 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.715203+0000 mon.a (mon.0) 875 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: cluster 2024-02-13T14:48:14.719393+0000 mon.a (mon.0) 876 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.727849+0000 mon.c (mon.2) 50 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.730557+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.62:0/1073773229' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.747452+0000 mon.a (mon.0) 877 : audit 1 from='client.24749 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: cluster 2024-02-13T14:48:14.747859+0000 mgr.y (mgr.14613) 173 : cluster 0 pgmap v122: 1284 pgs: 718 creating+peering, 148 active+clean, 418 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 895 B/s wr, 2 op/s 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.757466+0000 mon.a (mon.0) 878 : audit 1 from='client.24755 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.757997+0000 mon.a (mon.0) 879 : audit 1 from='client.24752 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.758380+0000 mon.a (mon.0) 880 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.758880+0000 mon.a (mon.0) 881 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.759372+0000 mon.a (mon.0) 882 : audit 1 from='client.24767 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.759869+0000 mon.a (mon.0) 883 : audit 1 from='client.24785 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.068 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.762720+0000 mon.a (mon.0) 884 : audit 1 from='client.24791 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.069 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:14.763527+0000 mon.a (mon.0) 885 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:16.069 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:15.208840+0000 mon.a (mon.0) 886 : audit 1 from='client.24857 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.069 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:15.219680+0000 mon.a (mon.0) 887 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:16.069 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:15.230008+0000 mon.a (mon.0) 888 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:16.069 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:15 smithi062 bash[28859]: audit 2024-02-13T14:48:15.235648+0000 mon.b (mon.1) 105 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: cluster 2024-02-13T14:48:04.741341+0000 mgr.y (mgr.14613) 167 : cluster 0 pgmap v114: 196 pgs: 55 creating+peering, 132 active+clean, 9 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:48:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: cluster 2024-02-13T14:48:06.742191+0000 mgr.y (mgr.14613) 168 : cluster 0 pgmap v116: 580 pgs: 55 creating+peering, 132 active+clean, 393 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: cluster 2024-02-13T14:48:08.743468+0000 mgr.y (mgr.14613) 169 : cluster 0 pgmap v117: 580 pgs: 55 creating+peering, 132 active+clean, 393 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T14:48:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.093900+0000 mgr.y (mgr.14613) 170 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.236815+0000 mon.a (mon.0) 861 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectssmithi062-65398-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.236911+0000 mon.a (mon.0) 862 : audit 1 from='client.24718 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBig_smithi062-64504-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.256664+0000 mon.c (mon.2) 42 : audit 1 from='client.? v1:172.21.15.62:0/1985710894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.257221+0000 mon.c (mon.2) 43 : audit 1 from='client.? v1:172.21.15.62:0/2184640716' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.257692+0000 mon.c (mon.2) 44 : audit 1 from='client.? v1:172.21.15.62:0/3531481609' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.258341+0000 mon.b (mon.1) 103 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.258721+0000 mon.c (mon.2) 45 : audit 1 from='client.? v1:172.21.15.62:0/3287312863' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.258989+0000 mon.c (mon.2) 46 : audit 1 from='client.? v1:172.21.15.62:0/2490475216' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.259789+0000 mon.c (mon.2) 47 : audit 1 from='client.? v1:172.21.15.62:0/1978954362' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.260367+0000 mon.c (mon.2) 48 : audit 1 from='client.? v1:172.21.15.62:0/2608480029' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:10.272232+0000 mon.c (mon.2) 49 : audit 0 from='client.? v1:172.21.15.62:0/3503054680' entity='client.admin' cmd=[{"prefix":"status"}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: cluster 2024-02-13T14:48:10.745046+0000 mgr.y (mgr.14613) 171 : cluster 0 pgmap v119: 964 pgs: 358 creating+peering, 132 active+clean, 474 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: cluster 2024-02-13T14:48:12.746587+0000 mgr.y (mgr.14613) 172 : cluster 0 pgmap v120: 964 pgs: 358 creating+peering, 132 active+clean, 474 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:12.922051+0000 mon.b (mon.1) 104 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: cluster 2024-02-13T14:48:14.693392+0000 mon.a (mon.0) 863 : cluster 0 osdmap e77: 8 total, 8 up, 8 in 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.702074+0000 mon.a (mon.0) 864 : audit 1 from='client.24707 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.712388+0000 mon.a (mon.0) 865 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.712975+0000 mon.a (mon.0) 866 : audit 1 from='client.24701 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.713474+0000 mon.a (mon.0) 867 : audit 1 from='client.24740 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.713991+0000 mon.a (mon.0) 868 : audit 1 from='client.24737 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.714620+0000 mon.a (mon.0) 869 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.714844+0000 mon.a (mon.0) 870 : audit 1 from='client.24850 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-65020-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.714897+0000 mon.a (mon.0) 871 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritesmithi062-65304-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.714965+0000 mon.a (mon.0) 872 : audit 1 from='client.? v1:172.21.15.62:0/1310548487' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "TooBigPP_smithi062-64512-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.715053+0000 mon.a (mon.0) 873 : audit 1 from='client.24847 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64909-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.715149+0000 mon.a (mon.0) 874 : audit 1 from='client.24695 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIoPP_smithi062-64528-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.715203+0000 mon.a (mon.0) 875 : audit 1 from='client.24739 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLockPP_smithi062-64557-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: cluster 2024-02-13T14:48:14.719393+0000 mon.a (mon.0) 876 : cluster 0 osdmap e78: 8 total, 8 up, 8 in 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.727849+0000 mon.c (mon.2) 50 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.730557+0000 mon.c (mon.2) 51 : audit 1 from='client.? v1:172.21.15.62:0/1073773229' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.747452+0000 mon.a (mon.0) 877 : audit 1 from='client.24749 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: cluster 2024-02-13T14:48:14.747859+0000 mgr.y (mgr.14613) 173 : cluster 0 pgmap v122: 1284 pgs: 718 creating+peering, 148 active+clean, 418 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 895 B/s wr, 2 op/s 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.757466+0000 mon.a (mon.0) 878 : audit 1 from='client.24755 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.757997+0000 mon.a (mon.0) 879 : audit 1 from='client.24752 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.758380+0000 mon.a (mon.0) 880 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.758880+0000 mon.a (mon.0) 881 : audit 1 from='client.24761 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.759372+0000 mon.a (mon.0) 882 : audit 1 from='client.24767 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.759869+0000 mon.a (mon.0) 883 : audit 1 from='client.24785 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.762720+0000 mon.a (mon.0) 884 : audit 1 from='client.24791 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:14.763527+0000 mon.a (mon.0) 885 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:16.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:15.208840+0000 mon.a (mon.0) 886 : audit 1 from='client.24857 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:16.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:15.219680+0000 mon.a (mon.0) 887 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:16.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:15.230008+0000 mon.a (mon.0) 888 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:16.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:15 smithi111 bash[23388]: audit 2024-02-13T14:48:15.235648+0000 mon.b (mon.1) 105 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [==========] Running 11 tests from 3 test suites. 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] Global test environment set-up. 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 7 tests from LibRadosList 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjects 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjects (400 ms) 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjectsZeroInName 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjectsZeroInName (104 ms) 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjectsNS 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo1,foo2,foo3 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo1 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo2 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo3 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo1,foo4,foo5 2024-02-13T14:48:16.541 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo4 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo5 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo1 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo6,foo7 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo7 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo6 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo4 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo5 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns2:foo7 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns2:foo6 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo1 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo1 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo2 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo3 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjectsNS (119 ms) 2024-02-13T14:48:16.542 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjectsStart 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 1 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 10 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 13 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 7 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 14 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 0 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 15 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 11 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 5 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 8 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 6 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 3 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 4 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 12 0 2024-02-13T14:48:16.543 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 9 0 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2 0 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjectsStart (80 ms) 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.ListObjectsCursor 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: x cursor=MIN 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=1 cursor=14:02547ec2:::1:head 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=10 cursor=14:52ea6a34:::10:head 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=13 cursor=14:566253c9:::13:head 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=7 cursor=14:5c6b0b28:::7:head 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=14 cursor=14:62a1935d:::14:head 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=0 cursor=14:6cac518f:::0:head 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=15 cursor=14:863748b0:::15:head 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=11 cursor=14:89d3ae78:::11:head 2024-02-13T14:48:16.544 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=5 cursor=14:b29083e3:::5:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=8 cursor=14:bd63b0f1:::8:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=6 cursor=14:c4fdafeb:::6:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=3 cursor=14:cfc208b3:::3:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=4 cursor=14:d83876eb:::4:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=12 cursor=14:de5d7c5f:::12:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=9 cursor=14:e960b815:::9:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > oid=2 cursor=14:f905c69b:::2:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: FIRST> seek to MIN oid=1 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=1 cursor=14:02547ec2:::1:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:02547ec2:::1:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:02547ec2:::1:head -> 1 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=10 cursor=14:52ea6a34:::10:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:52ea6a34:::10:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:52ea6a34:::10:head -> 10 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=13 cursor=14:566253c9:::13:head 2024-02-13T14:48:16.545 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:566253c9:::13:head 2024-02-13T14:48:16.546 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:566253c9:::13:head -> 13 2024-02-13T14:48:16.546 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=7 cursor=14:5c6b0b28:::7:head 2024-02-13T14:48:16.546 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:5c6b0b28:::7:head 2024-02-13T14:48:16.546 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:5c6b0b28:::7:head -> 7 2024-02-13T14:48:16.558 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:48:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:48:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=14 cursor=14:62a1935d:::14:head 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:62a1935d:::14:head 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:62a1935d:::14:head -> 14 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=0 cursor=14:6cac518f:::0:head 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:6cac518f:::0:head 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:6cac518f:::0:head -> 0 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=15 cursor=14:863748b0:::15:head 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:863748b0:::15:head 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:863748b0:::15:head -> 15 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=11 cursor=14:89d3ae78:::11:head 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:89d3ae78:::11:head 2024-02-13T14:48:16.603 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:89d3ae78:::11:head -> 11 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=5 cursor=14:b29083e3:::5:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:b29083e3:::5:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:b29083e3:::5:head -> 5 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=8 cursor=14:bd63b0f1:::8:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:bd63b0f1:::8:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:bd63b0f1:::8:head -> 8 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=6 cursor=14:c4fdafeb:::6:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:c4fdafeb:::6:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:c4fdafeb:::6:head -> 6 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=3 cursor=14:cfc208b3:::3:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:cfc208b3:::3:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:cfc208b3:::3:head -> 3 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=4 cursor=14:d83876eb:::4:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:d83876eb:::4:head 2024-02-13T14:48:16.604 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:d83876eb:::4:head -> 4 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=12 cursor=14:de5d7c5f:::12:head 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:de5d7c5f:::12:head 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:de5d7c5f:::12:head -> 12 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=9 cursor=14:e960b815:::9:head 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:e960b815:::9:head 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:e960b815:::9:head -> 9 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : oid=2 cursor=14:f905c69b:::2:head 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:f905c69b:::2:head 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:f905c69b:::2:head -> 2 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:de5d7c5f:::12:head 2024-02-13T14:48:16.605 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:de5d7c5f:::12:head expected=14:de5d7c5f:::12:head 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:de5d7c5f:::12:head -> 12 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=12 expected=12 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:d83876eb:::4:head 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:d83876eb:::4:head expected=14:d83876eb:::4:head 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:d83876eb:::4:head -> 4 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=4 expected=4 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:cfc208b3:::3:head 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:cfc208b3:::3:head expected=14:cfc208b3:::3:head 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:cfc208b3:::3:head -> 3 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=3 expected=3 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:89d3ae78:::11:head 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:89d3ae78:::11:head expected=14:89d3ae78:::11:head 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:89d3ae78:::11:head -> 11 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=11 expected=11 2024-02-13T14:48:16.606 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:f905c69b:::2:head 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:f905c69b:::2:head expected=14:f905c69b:::2:head 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:f905c69b:::2:head -> 2 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=2 expected=2 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:e960b815:::9:head 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:e960b815:::9:head expected=14:e960b815:::9:head 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:e960b815:::9:head -> 9 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=9 expected=9 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:863748b0:::15:head 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:863748b0:::15:head expected=14:863748b0:::15:head 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:863748b0:::15:head -> 15 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=15 expected=15 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:6cac518f:::0:head 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:6cac518f:::0:head expected=14:6cac518f:::0:head 2024-02-13T14:48:16.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:6cac518f:::0:head -> 0 2024-02-13T14:48:16.851 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : list_parallel: process_1_[65060]: starting. 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[65060]: creating pool ceph_test_rados_list_parallel.smithi062-65026 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[65060]: created object 0... 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[65060]: created object 25... 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[65060]: created object 49... 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[65060]: finishing. 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_1_[65060]: shutting down. 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[65061]: starting. 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[65061]: listing objects. 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[65061]: listed object 0... 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[65061]: listed object 25... 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[65061]: saw 50 objects 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_2_[65061]: shutting down. 2024-02-13T14:48:16.852 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[66106]: starting. 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[66106]: creating pool ceph_test_rados_list_parallel.smithi062-65026 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[66106]: created object 0... 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[66106]: created object 25... 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[66106]: created object 49... 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[66106]: finishing. 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_3_[66106]: shutting down. 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[66107]: starting. 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[66107]: listing objects. 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[66107]: listed object 0... 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[66107]: listed object 25... 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[66107]: saw 42 objects 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_4_[66107]: shutting down. 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.853 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[66108]: starting. 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[66108]: removed 25 objects... 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[66108]: removed half of the objects 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[66108]: removed 50 objects... 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[66108]: removed 50 objects 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_5_[66108]: shutting down. 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[66154]: starting. 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[66154]: creating pool ceph_test_rados_list_parallel.smithi062-65026 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[66154]: created object 0... 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[66154]: created object 25... 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[66154]: created object 49... 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[66154]: finishing. 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_6_[66154]: shutting down. 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.854 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[66155]: starting. 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[66155]: listing objects. 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[66155]: listed object 0... 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[66155]: listed object 25... 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[66155]: listed object 50... 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[66155]: saw 55 objects 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_7_[66155]: shutting down. 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[66156]: starting. 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[66156]: added 25 objects... 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[66156]: added half of the objects 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[66156]: added 50 objects... 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[66156]: added 50 objects 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_8_[66156]: shutting down. 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:16.855 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:16 smithi111 bash[23388]: cluster 2024-02-13T14:48:15.729788+0000 mon.a (mon.0) 889 : cluster 3 Health check update: 30 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:17.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:16 smithi111 bash[23388]: audit 2024-02-13T14:48:15.733155+0000 mon.a (mon.0) 890 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[66202]: starting. 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[66202]: creating pool ceph_test_rados_list_parallel.smithi062-65026 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[66202]: created object 0... 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[66202]: created object 25... 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[66202]: created object 49... 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[66202]: finishing. 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_9_[66202]: shutting down. 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.103 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[66203]: starting. 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[66203]: listing objects. 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[66203]: listed object 0... 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[66203]: listed object 25... 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[66203]: listed object 50... 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[66203]: listed object 75... 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[66203]: saw 97 objects 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_10_[66203]: shutting down. 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[66206]: starting. 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[66206]: removed 25 objects... 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[66206]: removed half of the objects 2024-02-13T14:48:17.104 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[66206]: removed 50 objects... 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[66206]: removed 50 objects 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_13_[66206]: shutting down. 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[66204]: starting. 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[66204]: added 25 objects... 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[66204]: added half of the objects 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[66204]: added 50 objects... 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[66204]: added 50 objects 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_11_[66204]: shutting down. 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[66205]: starting. 2024-02-13T14:48:17.105 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[66205]: added 25 objects... 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[66205]: added half of the objects 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[66205]: added 50 objects... 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[66205]: added 50 objects 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_12_[66205]: shutting down. 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[66325]: starting. 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[66325]: creating pool ceph_test_rados_list_parallel.smithi062-65026 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[66325]: created object 0... 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[66325]: created object 25... 2024-02-13T14:48:17.106 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[66325]: created object 49... 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[66325]: finishing. 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_14_[66325]: shutting down. 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: starting. 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: listing objects. 2024-02-13T14:48:17.107 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: listed object 0... 2024-02-13T14:48:17.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:16 smithi062 bash[21479]: cluster 2024-02-13T14:48:15.729788+0000 mon.a (mon.0) 889 : cluster 3 Health check update: 30 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:17.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:16 smithi062 bash[21479]: audit 2024-02-13T14:48:15.733155+0000 mon.a (mon.0) 890 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:17.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:16 smithi062 bash[28859]: cluster 2024-02-13T14:48:15.729788+0000 mon.a (mon.0) 889 : cluster 3 Health check update: 30 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:17.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:16 smithi062 bash[28859]: audit 2024-02-13T14:48:15.733155+0000 mon.a (mon.0) 890 : audit 1 from='client.24707 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosLock_smithi062-64549-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.733336+0000 mon.a (mon.0) 891 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.733616+0000 mon.a (mon.0) 892 : audit 1 from='client.24701 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.733750+0000 mon.a (mon.0) 893 : audit 1 from='client.24740 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.733867+0000 mon.a (mon.0) 894 : audit 1 from='client.24737 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.733990+0000 mon.a (mon.0) 895 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.734101+0000 mon.a (mon.0) 896 : audit 1 from='client.24749 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.734209+0000 mon.a (mon.0) 897 : audit 1 from='client.24755 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.734416+0000 mon.a (mon.0) 898 : audit 1 from='client.24752 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.734735+0000 mon.a (mon.0) 899 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.734976+0000 mon.a (mon.0) 900 : audit 1 from='client.24767 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.735202+0000 mon.a (mon.0) 901 : audit 1 from='client.24785 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.735420+0000 mon.a (mon.0) 902 : audit 1 from='client.24791 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.735641+0000 mon.a (mon.0) 903 : audit 1 from='client.24857 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.735899+0000 mon.a (mon.0) 904 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:15.745178+0000 mon.b (mon.1) 106 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:16.733325+0000 mon.c (mon.2) 52 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: cluster 2024-02-13T14:48:16.786478+0000 mon.a (mon.0) 905 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:16.801170+0000 mon.a (mon.0) 906 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:16.826376+0000 mon.a (mon.0) 907 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:18.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:16.829193+0000 mon.a (mon.0) 908 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:18.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: cluster 2024-02-13T14:48:16.847354+0000 mon.a (mon.0) 909 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-02-13T14:48:18.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:17 smithi111 bash[23388]: audit 2024-02-13T14:48:17.734882+0000 mon.c (mon.2) 53 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:18.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.733336+0000 mon.a (mon.0) 891 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.733616+0000 mon.a (mon.0) 892 : audit 1 from='client.24701 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.733750+0000 mon.a (mon.0) 893 : audit 1 from='client.24740 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.733867+0000 mon.a (mon.0) 894 : audit 1 from='client.24737 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.733990+0000 mon.a (mon.0) 895 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.734101+0000 mon.a (mon.0) 896 : audit 1 from='client.24749 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.734209+0000 mon.a (mon.0) 897 : audit 1 from='client.24755 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.734416+0000 mon.a (mon.0) 898 : audit 1 from='client.24752 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.734735+0000 mon.a (mon.0) 899 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.734976+0000 mon.a (mon.0) 900 : audit 1 from='client.24767 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.735202+0000 mon.a (mon.0) 901 : audit 1 from='client.24785 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.735420+0000 mon.a (mon.0) 902 : audit 1 from='client.24791 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.735641+0000 mon.a (mon.0) 903 : audit 1 from='client.24857 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.733336+0000 mon.a (mon.0) 891 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.733616+0000 mon.a (mon.0) 892 : audit 1 from='client.24701 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.733750+0000 mon.a (mon.0) 893 : audit 1 from='client.24740 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.733867+0000 mon.a (mon.0) 894 : audit 1 from='client.24737 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.733990+0000 mon.a (mon.0) 895 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.734101+0000 mon.a (mon.0) 896 : audit 1 from='client.24749 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.734209+0000 mon.a (mon.0) 897 : audit 1 from='client.24755 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.734416+0000 mon.a (mon.0) 898 : audit 1 from='client.24752 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.734735+0000 mon.a (mon.0) 899 : audit 1 from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.734976+0000 mon.a (mon.0) 900 : audit 1 from='client.24767 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.735202+0000 mon.a (mon.0) 901 : audit 1 from='client.24785 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.735420+0000 mon.a (mon.0) 902 : audit 1 from='client.24791 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.735641+0000 mon.a (mon.0) 903 : audit 1 from='client.24857 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.735899+0000 mon.a (mon.0) 904 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:15.745178+0000 mon.b (mon.1) 106 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:16.733325+0000 mon.c (mon.2) 52 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: cluster 2024-02-13T14:48:16.786478+0000 mon.a (mon.0) 905 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-02-13T14:48:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:16.801170+0000 mon.a (mon.0) 906 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:16.826376+0000 mon.a (mon.0) 907 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:16.829193+0000 mon.a (mon.0) 908 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: cluster 2024-02-13T14:48:16.847354+0000 mon.a (mon.0) 909 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[21479]: audit 2024-02-13T14:48:17.734882+0000 mon.c (mon.2) 53 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.735899+0000 mon.a (mon.0) 904 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:15.745178+0000 mon.b (mon.1) 106 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:16.733325+0000 mon.c (mon.2) 52 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: cluster 2024-02-13T14:48:16.786478+0000 mon.a (mon.0) 905 : cluster 0 osdmap e79: 8 total, 8 up, 8 in 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:16.801170+0000 mon.a (mon.0) 906 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:16.826376+0000 mon.a (mon.0) 907 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:16.829193+0000 mon.a (mon.0) 908 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: cluster 2024-02-13T14:48:16.847354+0000 mon.a (mon.0) 909 : cluster 0 osdmap e80: 8 total, 8 up, 8 in 2024-02-13T14:48:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:17 smithi062 bash[28859]: audit 2024-02-13T14:48:17.734882+0000 mon.c (mon.2) 53 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:18.317 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: listed object 2 api_c_read_operations: Running main() from gmock_main.cc 2024-02-13T14:48:18.317 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [==========] Running 17 tests from 1 test suite. 2024-02-13T14:48:18.317 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [----------] Global test environment set-up. 2024-02-13T14:48:18.317 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest 2024-02-13T14:48:18.317 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.NewDelete 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.NewDelete (0 ms) 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.SetOpFlags 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.SetOpFlags (360 ms) 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertExists 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertExists (8 ms) 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.AssertVersion 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.AssertVersion (12 ms) 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpXattr 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpXattr (79 ms) 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Read 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Read (12 ms) 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Checksum 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Checksum (14 ms) 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.RWOrderedRead 2024-02-13T14:48:18.318 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.RWOrderedRead (7 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ShortRead 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ShortRead (7 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Exec 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Exec (8 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.ExecUserBuf 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.ExecUserBuf (5 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat (6 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Stat2 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Stat2 (11 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.Omap 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.Omap (23 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.OmapNuls 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.OmapNuls (20 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.GetXattrs 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.GetXattrs (14 ms) 2024-02-13T14:48:18.319 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ RUN ] CReadOpsTest.CmpExt 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ OK ] CReadOpsTest.CmpExt (7 ms) 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [----------] 17 tests from CReadOpsTest (593 ms total) 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [----------] Global test environment tear-down 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [==========] 17 tests from 1 test suite ran. (19453 ms total) 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_read_operations: [ PASSED ] 17 tests. 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout:5... 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: listed object 50... 2024-02-13T14:48:18.320 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: listed object 75... 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: listed object 100... 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: listed object 125... 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: saw 150 objects 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_15_[66326]: shutting down. 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[66327]: starting. 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[66327]: added 25 objects... 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[66327]: added half of the objects 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[66327]: added 50 objects... 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[66327]: added 50 objects 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: process_16_[66327]: shutting down. 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.321 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.322 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.322 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******************************* 2024-02-13T14:48:18.322 INFO:tasks.workunit.client.0.smithi062.stdout: list_parallel: ******* SUCCESS ********** 2024-02-13T14:48:18.380 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: Running main() from gmock_main.cc 2024-02-13T14:48:18.380 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [==========] Running 4 tests from 1 test suite. 2024-02-13T14:48:18.380 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [----------] Global test environment set-up. 2024-02-13T14:48:18.380 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [----------] 4 tests from LibRadosCmd 2024-02-13T14:48:18.380 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ RUN ] LibRadosCmd.MonDescribe 2024-02-13T14:48:18.380 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ OK ] LibRadosCmd.MonDescribe (45 ms) 2024-02-13T14:48:18.380 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ RUN ] LibRadosCmd.OSDCmd 2024-02-13T14:48:18.380 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ OK ] LibRadosCmd.OSDCmd (79 ms) 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ RUN ] LibRadosCmd.PGCmd 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ OK ] LibRadosCmd.PGCmd (19376 ms) 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ RUN ] LibRadosCmd.WatchLog 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.733336+0000 mon.a [INF] from='client.24716 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosList_smithi062-64544-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.733616+0000 mon.a [INF] from='client.24701 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosIo_smithi062-64520-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.733750+0000 mon.a [INF] from='client.24740 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.733867+0000 mon.a [INF] from='client.24737 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosTierPP_smithi062-64695-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.733990+0000 mon.a [INF] from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.734101+0000 mon.a [INF] from='client.24749 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshots_smithi062-64731-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.734209+0000 mon.a [INF] from='client.24755 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStat_smithi062-64770-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.734416+0000 mon.a [INF] from='client.24752 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsPP_smithi062-64736-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.734735+0000 mon.a [INF] from='client.24761 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotify_smithi062-64828-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.381 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.734976+0000 mon.a [INF] from='client.24767 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosStatPP_smithi062-64799-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.382 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.735202+0000 mon.a [INF] from='client.24785 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:18.382 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.735420+0000 mon.a [INF] from='client.24791 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "CReadOpsTest_smithi062-64998-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:19.323 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.735641+0000 mon.a [INF] from='client.24857 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64886-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.735899+0000 mon.a [INF] from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:15.745178+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:16.801170+0000 mon.a [INF] from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:16.826376+0000 mon.a [INF] from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectssmithi062-65398-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:16.829193+0000 mon.a [INF] from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritesmithi062-65304-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.318706+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.326762+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.343481+0000 mon.a [INF] from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.344064+0000 mon.a [INF] from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.359178+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.375699+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:19.324 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.378990+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T14:48:19.325 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.384749+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:19.325 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.385414+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:19.353 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.825491+0000 mon.a [INF] from='client.25247 ' handler_error: Running main() from gmock_main.cc 2024-02-13T14:48:19.353 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [==========] Running 1 test from 1 test suite. 2024-02-13T14:48:19.353 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [----------] Global test environment set-up. 2024-02-13T14:48:19.353 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [----------] 1 test from neocls_handler_error 2024-02-13T14:48:19.354 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [ RUN ] neocls_handler_error.test_handler_error 2024-02-13T14:48:19.354 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [ OK ] neocls_handler_error.test_handler_error (20379 ms) 2024-02-13T14:48:19.354 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [----------] 1 test from neocls_handler_error (20379 ms total) 2024-02-13T14:48:19.354 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: 2024-02-13T14:48:19.354 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [----------] Global test environment tear-down 2024-02-13T14:48:19.354 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [==========] 1 test from 1 test suite ran. (20379 ms total) 2024-02-13T14:48:19.354 INFO:tasks.workunit.client.0.smithi062.stdout: handler_error: [ PASSED ] 1 test. 2024-02-13T14:48:19.355 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [==========] Running 1 test from 1 test suite. 2024-02-13T14:48:19.355 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [----------] Global test environment set-up. 2024-02-13T14:48:19.355 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads 2024-02-13T14:48:19.356 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [ RUN ] ClsTestRemoteReads.TestGather 2024-02-13T14:48:19.356 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [ OK ] ClsTestRemoteReads.TestGather (20436 ms) 2024-02-13T14:48:19.356 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [----------] 1 test from ClsTestRemoteReads (20436 ms total) 2024-02-13T14:48:19.356 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: 2024-02-13T14:48:19.356 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [----------] Global test environment tear-down 2024-02-13T14:48:19.356 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [==========] 1 test from 1 test suite ran. (20436 ms total) 2024-02-13T14:48:19.356 INFO:tasks.workunit.client.0.smithi062.stdout: api_cls_remote_reads: [ PASSED ] 1 test. 2024-02-13T14:48:19.358 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: Running main() from gmock_main.cc 2024-02-13T14:48:19.358 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [==========] Running 3 tests from 1 test suite. 2024-02-13T14:48:19.358 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [----------] Global test environment set-up. 2024-02-13T14:48:19.358 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd 2024-02-13T14:48:19.358 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.MonDescribePP 2024-02-13T14:48:19.358 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ OK ] LibRadosCmd.MonDescribePP (49 ms) 2024-02-13T14:48:19.358 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.OSDCmdPP 2024-02-13T14:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ OK ] LibRadosCmd.OSDCmdPP (43 ms) 2024-02-13T14:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ RUN ] LibRadosCmd.PGCmdPP 2024-02-13T14:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ OK ] LibRadosCmd.PGCmdPP (20440 ms) 2024-02-13T14:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [----------] 3 tests from LibRadosCmd (20532 ms total) 2024-02-13T14:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: 2024-02-13T14:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [----------] Global test environment tear-down 2024-02-13T14:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [==========] 3 tests from 1 test suite ran. (20532 ms total) 2024-02-13T14:48:19.359 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd_pp: [ PASSED ] 3 tests. 2024-02-13T14:48:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.318706+0000 mon.c (mon.2) 54 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: cluster 2024-02-13T14:48:18.321362+0000 mon.a (mon.0) 910 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-02-13T14:48:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.326762+0000 mon.c (mon.2) 55 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.343481+0000 mon.a (mon.0) 911 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.344064+0000 mon.a (mon.0) 912 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.359178+0000 mon.b (mon.1) 107 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.375699+0000 mon.b (mon.1) 108 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.378990+0000 mon.b (mon.1) 109 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.384749+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.385414+0000 mon.c (mon.2) 56 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.736527+0000 mon.c (mon.2) 57 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:19 smithi111 bash[23388]: audit 2024-02-13T14:48:18.825491+0000 mon.a (mon.0) 913 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:19.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.318706+0000 mon.c (mon.2) 54 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:19.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: cluster 2024-02-13T14:48:18.321362+0000 mon.a (mon.0) 910 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-02-13T14:48:19.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.326762+0000 mon.c (mon.2) 55 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:19.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.343481+0000 mon.a (mon.0) 911 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:19.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.344064+0000 mon.a (mon.0) 912 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:19.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.359178+0000 mon.b (mon.1) 107 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:19.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.375699+0000 mon.b (mon.1) 108 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:19.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.378990+0000 mon.b (mon.1) 109 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T14:48:19.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.384749+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:19.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.385414+0000 mon.c (mon.2) 56 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.736527+0000 mon.c (mon.2) 57 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[21479]: audit 2024-02-13T14:48:18.825491+0000 mon.a (mon.0) 913 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.318706+0000 mon.c (mon.2) 54 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: cluster 2024-02-13T14:48:18.321362+0000 mon.a (mon.0) 910 : cluster 0 osdmap e81: 8 total, 8 up, 8 in 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.326762+0000 mon.c (mon.2) 55 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.343481+0000 mon.a (mon.0) 911 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.344064+0000 mon.a (mon.0) 912 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.359178+0000 mon.b (mon.1) 107 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.375699+0000 mon.b (mon.1) 108 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.378990+0000 mon.b (mon.1) 109 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.384749+0000 mon.b (mon.1) 110 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.385414+0000 mon.c (mon.2) 56 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.736527+0000 mon.c (mon.2) 57 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:19 smithi062 bash[28859]: audit 2024-02-13T14:48:18.825491+0000 mon.a (mon.0) 913 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:20.592 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:48:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:48:22.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: cluster 2024-02-13T14:48:16.748630+0000 mgr.y (mgr.14613) 174 : cluster 0 pgmap v124: 1156 pgs: 639 creating+peering, 140 active+clean, 377 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-13T14:48:22.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: cluster 2024-02-13T14:48:18.379676+0000 client.admin (client.25252) 0 : cluster 1 onexx 2024-02-13T14:48:22.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: cluster 2024-02-13T14:48:18.749988+0000 mgr.y (mgr.14613) 175 : cluster 0 pgmap v127: 844 pgs: 393 creating+peering, 140 active+clean, 311 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:22.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: audit 2024-02-13T14:48:18.826410+0000 mon.c (mon.2) 58 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:22.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: audit 2024-02-13T14:48:19.310084+0000 mon.a (mon.0) 914 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:22.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: audit 2024-02-13T14:48:19.318759+0000 mon.a (mon.0) 915 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:22.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: audit 2024-02-13T14:48:19.319005+0000 mon.a (mon.0) 916 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: audit 2024-02-13T14:48:19.319159+0000 mon.a (mon.0) 917 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: audit 2024-02-13T14:48:19.319351+0000 mon.a (mon.0) 918 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[28859]: audit 2024-02-13T14:48:19.338400+0000 mon.a (mon.0) 919 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: cluster 2024-02-13T14:48:16.748630+0000 mgr.y (mgr.14613) 174 : cluster 0 pgmap v124: 1156 pgs: 639 creating+peering, 140 active+clean, 377 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: cluster 2024-02-13T14:48:18.379676+0000 client.admin (client.25252) 0 : cluster 1 onexx 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: cluster 2024-02-13T14:48:18.749988+0000 mgr.y (mgr.14613) 175 : cluster 0 pgmap v127: 844 pgs: 393 creating+peering, 140 active+clean, 311 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: audit 2024-02-13T14:48:18.826410+0000 mon.c (mon.2) 58 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: audit 2024-02-13T14:48:19.310084+0000 mon.a (mon.0) 914 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:22.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: audit 2024-02-13T14:48:19.318759+0000 mon.a (mon.0) 915 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:22.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: audit 2024-02-13T14:48:19.319005+0000 mon.a (mon.0) 916 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:22.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: audit 2024-02-13T14:48:19.319159+0000 mon.a (mon.0) 917 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T14:48:22.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: audit 2024-02-13T14:48:19.319351+0000 mon.a (mon.0) 918 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:22.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:22 smithi062 bash[21479]: audit 2024-02-13T14:48:19.338400+0000 mon.a (mon.0) 919 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:22.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: cluster 2024-02-13T14:48:16.748630+0000 mgr.y (mgr.14613) 174 : cluster 0 pgmap v124: 1156 pgs: 639 creating+peering, 140 active+clean, 377 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.1 KiB/s wr, 2 op/s 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: cluster 2024-02-13T14:48:18.379676+0000 client.admin (client.25252) 0 : cluster 1 onexx 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: cluster 2024-02-13T14:48:18.749988+0000 mgr.y (mgr.14613) 175 : cluster 0 pgmap v127: 844 pgs: 393 creating+peering, 140 active+clean, 311 unknown; 582 KiB data, 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: audit 2024-02-13T14:48:18.826410+0000 mon.c (mon.2) 58 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: audit 2024-02-13T14:48:19.310084+0000 mon.a (mon.0) 914 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: audit 2024-02-13T14:48:19.318759+0000 mon.a (mon.0) 915 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: audit 2024-02-13T14:48:19.319005+0000 mon.a (mon.0) 916 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: audit 2024-02-13T14:48:19.319159+0000 mon.a (mon.0) 917 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: audit 2024-02-13T14:48:19.319351+0000 mon.a (mon.0) 918 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:22.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:22 smithi111 bash[23388]: audit 2024-02-13T14:48:19.338400+0000 mon.a (mon.0) 919 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:24.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.338690+0000 mon.a (mon.0) 920 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:24.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.338827+0000 mon.a (mon.0) 921 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:24.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.344528+0000 mon.c (mon.2) 59 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:24.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.354970+0000 mon.b (mon.1) 111 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.408736+0000 mon.c (mon.2) 60 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:24.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.409467+0000 mon.c (mon.2) 61 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.414498+0000 mon.c (mon.2) 62 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.415459+0000 mon.c (mon.2) 63 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.417294+0000 mon.c (mon.2) 64 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.419007+0000 mon.c (mon.2) 65 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.421906+0000 mon.c (mon.2) 66 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.423206+0000 mon.c (mon.2) 67 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.425255+0000 mon.c (mon.2) 68 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.427691+0000 mon.c (mon.2) 69 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.431701+0000 mon.c (mon.2) 70 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: cluster 2024-02-13T14:48:19.634619+0000 osd.2 (osd.2) 3 : cluster 0 16.1 deep-scrub starts 2024-02-13T14:48:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: cluster 2024-02-13T14:48:19.638241+0000 osd.2 (osd.2) 4 : cluster 0 16.1 deep-scrub ok 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.338690+0000 mon.a (mon.0) 920 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.338827+0000 mon.a (mon.0) 921 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.344528+0000 mon.c (mon.2) 59 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.354970+0000 mon.b (mon.1) 111 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.408736+0000 mon.c (mon.2) 60 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.409467+0000 mon.c (mon.2) 61 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.414498+0000 mon.c (mon.2) 62 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.415459+0000 mon.c (mon.2) 63 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.417294+0000 mon.c (mon.2) 64 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.419007+0000 mon.c (mon.2) 65 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.421906+0000 mon.c (mon.2) 66 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.423206+0000 mon.c (mon.2) 67 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.425255+0000 mon.c (mon.2) 68 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.427691+0000 mon.c (mon.2) 69 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.431701+0000 mon.c (mon.2) 70 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: cluster 2024-02-13T14:48:19.634619+0000 osd.2 (osd.2) 3 : cluster 0 16.1 deep-scrub starts 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: cluster 2024-02-13T14:48:19.638241+0000 osd.2 (osd.2) 4 : cluster 0 16.1 deep-scrub ok 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:19.738093+0000 mon.c (mon.2) 71 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:20.269770+0000 mon.c (mon.2) 72 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:20.723853+0000 mon.b (mon.1) 112 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:20.739673+0000 mon.c (mon.2) 73 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:21.633695+0000 mon.b (mon.1) 113 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:21.740808+0000 mon.c (mon.2) 74 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.082542+0000 mon.b (mon.1) 114 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: cluster 2024-02-13T14:48:22.532822+0000 mon.a (mon.0) 922 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: cluster 2024-02-13T14:48:22.533698+0000 mon.a (mon.0) 923 : cluster 3 Health check update: 13 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.547977+0000 mon.a (mon.0) 924 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.555617+0000 mon.a (mon.0) 925 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.561738+0000 mon.a (mon.0) 926 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.573084+0000 mon.b (mon.1) 115 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.574102+0000 mon.b (mon.1) 116 : audit 1 from='client.? v1:172.21.15.62:0/677921883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.575400+0000 mon.b (mon.1) 117 : audit 1 from='client.? v1:172.21.15.62:0/3149955604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.579675+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.62:0/1922753874' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:19.738093+0000 mon.c (mon.2) 71 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:20.269770+0000 mon.c (mon.2) 72 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:24.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:20.723853+0000 mon.b (mon.1) 112 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:20.739673+0000 mon.c (mon.2) 73 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:21.633695+0000 mon.b (mon.1) 113 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:21.740808+0000 mon.c (mon.2) 74 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.082542+0000 mon.b (mon.1) 114 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: cluster 2024-02-13T14:48:22.532822+0000 mon.a (mon.0) 922 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: cluster 2024-02-13T14:48:22.533698+0000 mon.a (mon.0) 923 : cluster 3 Health check update: 13 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.547977+0000 mon.a (mon.0) 924 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.555617+0000 mon.a (mon.0) 925 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.561738+0000 mon.a (mon.0) 926 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.573084+0000 mon.b (mon.1) 115 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.574102+0000 mon.b (mon.1) 116 : audit 1 from='client.? v1:172.21.15.62:0/677921883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.575400+0000 mon.b (mon.1) 117 : audit 1 from='client.? v1:172.21.15.62:0/3149955604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.579675+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.62:0/1922753874' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.580418+0000 mon.b (mon.1) 119 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.647892+0000 mon.c (mon.2) 75 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:22.742272+0000 mon.c (mon.2) 76 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: cluster 2024-02-13T14:48:23.014967+0000 mon.a (mon.0) 927 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:23.340007+0000 mon.b (mon.1) 120 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:23.341676+0000 mon.b (mon.1) 121 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:23.443425+0000 mon.a (mon.0) 928 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:23.444356+0000 mon.c (mon.2) 77 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[28859]: audit 2024-02-13T14:48:23.743406+0000 mon.c (mon.2) 78 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.580418+0000 mon.b (mon.1) 119 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:48:24.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.647892+0000 mon.c (mon.2) 75 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:24.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:22.742272+0000 mon.c (mon.2) 76 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: cluster 2024-02-13T14:48:23.014967+0000 mon.a (mon.0) 927 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-02-13T14:48:24.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:23.340007+0000 mon.b (mon.1) 120 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:48:24.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:23.341676+0000 mon.b (mon.1) 121 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:48:24.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:23.443425+0000 mon.a (mon.0) 928 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:23.444356+0000 mon.c (mon.2) 77 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.817 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:24 smithi062 bash[21479]: audit 2024-02-13T14:48:23.743406+0000 mon.c (mon.2) 78 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.338690+0000 mon.a (mon.0) 920 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.338827+0000 mon.a (mon.0) 921 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.344528+0000 mon.c (mon.2) 59 : audit 1 from='client.? v1:172.21.15.62:0/919405047' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.354970+0000 mon.b (mon.1) 111 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.408736+0000 mon.c (mon.2) 60 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.409467+0000 mon.c (mon.2) 61 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.414498+0000 mon.c (mon.2) 62 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.415459+0000 mon.c (mon.2) 63 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.417294+0000 mon.c (mon.2) 64 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.419007+0000 mon.c (mon.2) 65 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.421906+0000 mon.c (mon.2) 66 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.423206+0000 mon.c (mon.2) 67 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.425255+0000 mon.c (mon.2) 68 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.427691+0000 mon.c (mon.2) 69 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.431701+0000 mon.c (mon.2) 70 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: cluster 2024-02-13T14:48:19.634619+0000 osd.2 (osd.2) 3 : cluster 0 16.1 deep-scrub starts 2024-02-13T14:48:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: cluster 2024-02-13T14:48:19.638241+0000 osd.2 (osd.2) 4 : cluster 0 16.1 deep-scrub ok 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:19.738093+0000 mon.c (mon.2) 71 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:20.269770+0000 mon.c (mon.2) 72 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:20.723853+0000 mon.b (mon.1) 112 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:20.739673+0000 mon.c (mon.2) 73 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:21.633695+0000 mon.b (mon.1) 113 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:21.740808+0000 mon.c (mon.2) 74 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.082542+0000 mon.b (mon.1) 114 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: cluster 2024-02-13T14:48:22.532822+0000 mon.a (mon.0) 922 : cluster 0 osdmap e82: 8 total, 8 up, 8 in 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: cluster 2024-02-13T14:48:22.533698+0000 mon.a (mon.0) 923 : cluster 3 Health check update: 13 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.547977+0000 mon.a (mon.0) 924 : audit 1 from='client.24893 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.555617+0000 mon.a (mon.0) 925 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.561738+0000 mon.a (mon.0) 926 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["onexx"]}]': finished 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.573084+0000 mon.b (mon.1) 115 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.574102+0000 mon.b (mon.1) 116 : audit 1 from='client.? v1:172.21.15.62:0/677921883' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.575400+0000 mon.b (mon.1) 117 : audit 1 from='client.? v1:172.21.15.62:0/3149955604' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.579675+0000 mon.b (mon.1) 118 : audit 1 from='client.? v1:172.21.15.62:0/1922753874' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.580418+0000 mon.b (mon.1) 119 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.647892+0000 mon.c (mon.2) 75 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:22.742272+0000 mon.c (mon.2) 76 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: cluster 2024-02-13T14:48:23.014967+0000 mon.a (mon.0) 927 : cluster 0 osdmap e83: 8 total, 8 up, 8 in 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:23.340007+0000 mon.b (mon.1) 120 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:23.341676+0000 mon.b (mon.1) 121 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:23.443425+0000 mon.a (mon.0) 928 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:23.444356+0000 mon.c (mon.2) 77 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:24.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:24 smithi111 bash[23388]: audit 2024-02-13T14:48:23.743406+0000 mon.c (mon.2) 78 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:26.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.408962+0000 mgr.y (mgr.14613) 176 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:26.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.409684+0000 mgr.y (mgr.14613) 177 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:26.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.414749+0000 mgr.y (mgr.14613) 178 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:26.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.415655+0000 mgr.y (mgr.14613) 179 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:26.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.417525+0000 mgr.y (mgr.14613) 180 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.419261+0000 mgr.y (mgr.14613) 181 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.422207+0000 mgr.y (mgr.14613) 182 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.423422+0000 mgr.y (mgr.14613) 183 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.425611+0000 mgr.y (mgr.14613) 184 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:19.428061+0000 mgr.y (mgr.14613) 185 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:19.633726+0000 osd.4 (osd.4) 3 : cluster 0 16.2 deep-scrub starts 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:19.638213+0000 osd.4 (osd.4) 4 : cluster 0 16.2 deep-scrub ok 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:19.722483+0000 osd.6 (osd.6) 3 : cluster 0 16.6 deep-scrub starts 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:19.780645+0000 osd.6 (osd.6) 4 : cluster 0 16.6 deep-scrub ok 2024-02-13T14:48:26.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.014212+0000 osd.5 (osd.5) 3 : cluster 0 16.3 deep-scrub starts 2024-02-13T14:48:26.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.017833+0000 osd.5 (osd.5) 4 : cluster 0 16.3 deep-scrub ok 2024-02-13T14:48:26.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.018530+0000 osd.3 (osd.3) 3 : cluster 0 16.4 deep-scrub starts 2024-02-13T14:48:26.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.020514+0000 osd.3 (osd.3) 4 : cluster 0 16.4 deep-scrub ok 2024-02-13T14:48:26.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.097872+0000 osd.1 (osd.1) 3 : cluster 0 16.9 deep-scrub starts 2024-02-13T14:48:26.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:20.102613+0000 mgr.y (mgr.14613) 186 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:26.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.150766+0000 osd.1 (osd.1) 4 : cluster 0 16.9 deep-scrub ok 2024-02-13T14:48:26.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.235106+0000 osd.0 (osd.0) 3 : cluster 0 16.0 deep-scrub starts 2024-02-13T14:48:26.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.239237+0000 osd.0 (osd.0) 4 : cluster 0 16.0 deep-scrub ok 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.408962+0000 mgr.y (mgr.14613) 176 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.409684+0000 mgr.y (mgr.14613) 177 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.414749+0000 mgr.y (mgr.14613) 178 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.415655+0000 mgr.y (mgr.14613) 179 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.417525+0000 mgr.y (mgr.14613) 180 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.419261+0000 mgr.y (mgr.14613) 181 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.422207+0000 mgr.y (mgr.14613) 182 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.423422+0000 mgr.y (mgr.14613) 183 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.425611+0000 mgr.y (mgr.14613) 184 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:26.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:19.428061+0000 mgr.y (mgr.14613) 185 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:19.633726+0000 osd.4 (osd.4) 3 : cluster 0 16.2 deep-scrub starts 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:19.638213+0000 osd.4 (osd.4) 4 : cluster 0 16.2 deep-scrub ok 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:19.722483+0000 osd.6 (osd.6) 3 : cluster 0 16.6 deep-scrub starts 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:19.780645+0000 osd.6 (osd.6) 4 : cluster 0 16.6 deep-scrub ok 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.014212+0000 osd.5 (osd.5) 3 : cluster 0 16.3 deep-scrub starts 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.017833+0000 osd.5 (osd.5) 4 : cluster 0 16.3 deep-scrub ok 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.018530+0000 osd.3 (osd.3) 3 : cluster 0 16.4 deep-scrub starts 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.020514+0000 osd.3 (osd.3) 4 : cluster 0 16.4 deep-scrub ok 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.097872+0000 osd.1 (osd.1) 3 : cluster 0 16.9 deep-scrub starts 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:20.102613+0000 mgr.y (mgr.14613) 186 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.150766+0000 osd.1 (osd.1) 4 : cluster 0 16.9 deep-scrub ok 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.235106+0000 osd.0 (osd.0) 3 : cluster 0 16.0 deep-scrub starts 2024-02-13T14:48:26.229 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.239237+0000 osd.0 (osd.0) 4 : cluster 0 16.0 deep-scrub ok 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:20.752567+0000 mgr.y (mgr.14613) 187 : cluster 0 pgmap v129: 692 pgs: 75 creating+peering, 599 active+clean, 18 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 9.6 MiB/s rd, 30 MiB/s wr, 441 op/s 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:21.029023+0000 osd.3 (osd.3) 5 : cluster 0 16.7 deep-scrub starts 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:21.033025+0000 osd.3 (osd.3) 6 : cluster 0 16.7 deep-scrub ok 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:21.265730+0000 osd.0 (osd.0) 5 : cluster 0 16.8 deep-scrub starts 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:21.268193+0000 osd.0 (osd.0) 6 : cluster 0 16.8 deep-scrub ok 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:22.260261+0000 osd.0 (osd.0) 7 : cluster 0 16.5 deep-scrub starts 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:22.312353+0000 osd.0 (osd.0) 8 : cluster 0 16.5 deep-scrub ok 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:22.573360+0000 client.admin (client.25252) 0 : cluster 1 twoxx 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:22.753639+0000 mgr.y (mgr.14613) 188 : cluster 0 pgmap v131: 852 pgs: 75 creating+peering, 535 active+clean, 242 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 8.1 MiB/s rd, 25 MiB/s wr, 367 op/s 2024-02-13T14:48:26.230 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:23.345323+0000 mgr.y (mgr.14613) 189 : cluster 0 pgmap v132: 852 pgs: 75 creating+peering, 535 active+clean, 242 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 8.7 MiB/s rd, 27 MiB/s wr, 396 op/s 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.870144+0000 mon.a (mon.0) 929 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.872066+0000 mon.a (mon.0) 930 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.872236+0000 mon.a (mon.0) 931 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.872379+0000 mon.a (mon.0) 932 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.872519+0000 mon.a (mon.0) 933 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.872828+0000 mon.a (mon.0) 934 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.873076+0000 mon.a (mon.0) 935 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.889441+0000 mon.b (mon.1) 122 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.231 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:20.752567+0000 mgr.y (mgr.14613) 187 : cluster 0 pgmap v129: 692 pgs: 75 creating+peering, 599 active+clean, 18 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 9.6 MiB/s rd, 30 MiB/s wr, 441 op/s 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:21.029023+0000 osd.3 (osd.3) 5 : cluster 0 16.7 deep-scrub starts 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:21.033025+0000 osd.3 (osd.3) 6 : cluster 0 16.7 deep-scrub ok 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:21.265730+0000 osd.0 (osd.0) 5 : cluster 0 16.8 deep-scrub starts 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:21.268193+0000 osd.0 (osd.0) 6 : cluster 0 16.8 deep-scrub ok 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:22.260261+0000 osd.0 (osd.0) 7 : cluster 0 16.5 deep-scrub starts 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:22.312353+0000 osd.0 (osd.0) 8 : cluster 0 16.5 deep-scrub ok 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:22.573360+0000 client.admin (client.25252) 0 : cluster 1 twoxx 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:22.753639+0000 mgr.y (mgr.14613) 188 : cluster 0 pgmap v131: 852 pgs: 75 creating+peering, 535 active+clean, 242 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 8.1 MiB/s rd, 25 MiB/s wr, 367 op/s 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:23.345323+0000 mgr.y (mgr.14613) 189 : cluster 0 pgmap v132: 852 pgs: 75 creating+peering, 535 active+clean, 242 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 8.7 MiB/s rd, 27 MiB/s wr, 396 op/s 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.870144+0000 mon.a (mon.0) 929 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.232 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.872066+0000 mon.a (mon.0) 930 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.233 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.872236+0000 mon.a (mon.0) 931 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:26.233 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.872379+0000 mon.a (mon.0) 932 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.233 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.872519+0000 mon.a (mon.0) 933 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T14:48:26.233 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.872828+0000 mon.a (mon.0) 934 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:26.233 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.873076+0000 mon.a (mon.0) 935 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.233 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.889441+0000 mon.b (mon.1) 122 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.233 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.893760+0000 mon.b (mon.1) 123 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.233 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.899037+0000 mon.c (mon.2) 79 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:23.936791+0000 mon.c (mon.2) 80 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:24.358462+0000 mon.a (mon.0) 936 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.360465+0000 mon.b (mon.1) 124 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.373228+0000 mon.a (mon.0) 937 : audit 1 from='client.25099 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.379719+0000 mon.a (mon.0) 938 : audit 1 from='client.25261 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.381852+0000 mon.a (mon.0) 939 : audit 1 from='client.25258 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.384814+0000 mon.a (mon.0) 940 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.386133+0000 mon.a (mon.0) 941 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.234 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.386253+0000 mon.c (mon.2) 81 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.386949+0000 mon.c (mon.2) 82 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.387365+0000 mon.a (mon.0) 942 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.389114+0000 mon.a (mon.0) 943 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.393882+0000 mon.a (mon.0) 944 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.394546+0000 mon.c (mon.2) 83 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.394585+0000 mon.a (mon.0) 945 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.395649+0000 mon.a (mon.0) 946 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.745036+0000 mon.c (mon.2) 84 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.863232+0000 mon.a (mon.0) 947 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.864193+0000 mon.a (mon.0) 948 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.865750+0000 mon.a (mon.0) 949 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.880843+0000 mon.a (mon.0) 950 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.235 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.881297+0000 mon.a (mon.0) 951 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.881491+0000 mon.a (mon.0) 952 : audit 1 from='client.25099 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.881657+0000 mon.a (mon.0) 953 : audit 1 from='client.25261 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.881825+0000 mon.a (mon.0) 954 : audit 1 from='client.25258 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.882025+0000 mon.a (mon.0) 955 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.236 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.882205+0000 mon.a (mon.0) 956 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.893760+0000 mon.b (mon.1) 123 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.236 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.899037+0000 mon.c (mon.2) 79 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:23.936791+0000 mon.c (mon.2) 80 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:24.358462+0000 mon.a (mon.0) 936 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.360465+0000 mon.b (mon.1) 124 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.373228+0000 mon.a (mon.0) 937 : audit 1 from='client.25099 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.379719+0000 mon.a (mon.0) 938 : audit 1 from='client.25261 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.381852+0000 mon.a (mon.0) 939 : audit 1 from='client.25258 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.384814+0000 mon.a (mon.0) 940 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.386133+0000 mon.a (mon.0) 941 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.386253+0000 mon.c (mon.2) 81 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.386949+0000 mon.c (mon.2) 82 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.387365+0000 mon.a (mon.0) 942 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.389114+0000 mon.a (mon.0) 943 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.237 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.393882+0000 mon.a (mon.0) 944 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.882406+0000 mon.a (mon.0) 957 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.882721+0000 mon.a (mon.0) 958 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.882985+0000 mon.a (mon.0) 959 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.883191+0000 mon.a (mon.0) 960 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.892108+0000 mon.b (mon.1) 125 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.892566+0000 mon.b (mon.1) 126 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.892761+0000 mon.c (mon.2) 85 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.893073+0000 mon.c (mon.2) 86 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.238 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.893243+0000 mon.c (mon.2) 87 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.893416+0000 mon.c (mon.2) 88 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: cluster 2024-02-13T14:48:24.899560+0000 mon.a (mon.0) 961 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.904519+0000 mon.a (mon.0) 962 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.394546+0000 mon.c (mon.2) 83 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.394585+0000 mon.a (mon.0) 945 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.395649+0000 mon.a (mon.0) 946 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.745036+0000 mon.c (mon.2) 84 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.863232+0000 mon.a (mon.0) 947 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:26.239 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.864193+0000 mon.a (mon.0) 948 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.865750+0000 mon.a (mon.0) 949 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.880843+0000 mon.a (mon.0) 950 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.881297+0000 mon.a (mon.0) 951 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.881491+0000 mon.a (mon.0) 952 : audit 1 from='client.25099 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.881657+0000 mon.a (mon.0) 953 : audit 1 from='client.25261 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.881825+0000 mon.a (mon.0) 954 : audit 1 from='client.25258 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.882025+0000 mon.a (mon.0) 955 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.882205+0000 mon.a (mon.0) 956 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.240 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.904558+0000 mon.b (mon.1) 127 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.905539+0000 mon.b (mon.1) 128 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.914710+0000 mon.a (mon.0) 963 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.915372+0000 mon.a (mon.0) 964 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.915814+0000 mon.a (mon.0) 965 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.916214+0000 mon.a (mon.0) 966 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.916726+0000 mon.a (mon.0) 967 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.919738+0000 mon.a (mon.0) 968 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.920195+0000 mon.a (mon.0) 969 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.923415+0000 mon.c (mon.2) 89 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T14:48:26.241 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[28859]: audit 2024-02-13T14:48:24.923980+0000 mon.a (mon.0) 970 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T14:48:26.242 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.882406+0000 mon.a (mon.0) 957 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.242 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.882721+0000 mon.a (mon.0) 958 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.242 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.882985+0000 mon.a (mon.0) 959 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.242 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.883191+0000 mon.a (mon.0) 960 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.242 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.892108+0000 mon.b (mon.1) 125 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.242 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.892566+0000 mon.b (mon.1) 126 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.242 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.892761+0000 mon.c (mon.2) 85 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.893073+0000 mon.c (mon.2) 86 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.893243+0000 mon.c (mon.2) 87 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.893416+0000 mon.c (mon.2) 88 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: cluster 2024-02-13T14:48:24.899560+0000 mon.a (mon.0) 961 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.904519+0000 mon.a (mon.0) 962 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.904558+0000 mon.b (mon.1) 127 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.905539+0000 mon.b (mon.1) 128 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.914710+0000 mon.a (mon.0) 963 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.915372+0000 mon.a (mon.0) 964 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.915814+0000 mon.a (mon.0) 965 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.243 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.916214+0000 mon.a (mon.0) 966 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:26.244 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.916726+0000 mon.a (mon.0) 967 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.244 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.919738+0000 mon.a (mon.0) 968 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.244 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.920195+0000 mon.a (mon.0) 969 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:26.244 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.923415+0000 mon.c (mon.2) 89 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T14:48:26.244 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:25 smithi062 bash[21479]: audit 2024-02-13T14:48:24.923980+0000 mon.a (mon.0) 970 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T14:48:26.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.408962+0000 mgr.y (mgr.14613) 176 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:26.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.409684+0000 mgr.y (mgr.14613) 177 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:26.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.414749+0000 mgr.y (mgr.14613) 178 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:26.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.415655+0000 mgr.y (mgr.14613) 179 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.417525+0000 mgr.y (mgr.14613) 180 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.419261+0000 mgr.y (mgr.14613) 181 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.422207+0000 mgr.y (mgr.14613) 182 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.423422+0000 mgr.y (mgr.14613) 183 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.425611+0000 mgr.y (mgr.14613) 184 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:19.428061+0000 mgr.y (mgr.14613) 185 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:19.633726+0000 osd.4 (osd.4) 3 : cluster 0 16.2 deep-scrub starts 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:19.638213+0000 osd.4 (osd.4) 4 : cluster 0 16.2 deep-scrub ok 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:19.722483+0000 osd.6 (osd.6) 3 : cluster 0 16.6 deep-scrub starts 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:19.780645+0000 osd.6 (osd.6) 4 : cluster 0 16.6 deep-scrub ok 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.014212+0000 osd.5 (osd.5) 3 : cluster 0 16.3 deep-scrub starts 2024-02-13T14:48:26.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.017833+0000 osd.5 (osd.5) 4 : cluster 0 16.3 deep-scrub ok 2024-02-13T14:48:26.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.018530+0000 osd.3 (osd.3) 3 : cluster 0 16.4 deep-scrub starts 2024-02-13T14:48:26.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.020514+0000 osd.3 (osd.3) 4 : cluster 0 16.4 deep-scrub ok 2024-02-13T14:48:26.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.097872+0000 osd.1 (osd.1) 3 : cluster 0 16.9 deep-scrub starts 2024-02-13T14:48:26.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:20.102613+0000 mgr.y (mgr.14613) 186 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:26.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.150766+0000 osd.1 (osd.1) 4 : cluster 0 16.9 deep-scrub ok 2024-02-13T14:48:26.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.235106+0000 osd.0 (osd.0) 3 : cluster 0 16.0 deep-scrub starts 2024-02-13T14:48:26.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.239237+0000 osd.0 (osd.0) 4 : cluster 0 16.0 deep-scrub ok 2024-02-13T14:48:26.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:20.752567+0000 mgr.y (mgr.14613) 187 : cluster 0 pgmap v129: 692 pgs: 75 creating+peering, 599 active+clean, 18 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 9.6 MiB/s rd, 30 MiB/s wr, 441 op/s 2024-02-13T14:48:26.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:21.029023+0000 osd.3 (osd.3) 5 : cluster 0 16.7 deep-scrub starts 2024-02-13T14:48:26.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:21.033025+0000 osd.3 (osd.3) 6 : cluster 0 16.7 deep-scrub ok 2024-02-13T14:48:26.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:21.265730+0000 osd.0 (osd.0) 5 : cluster 0 16.8 deep-scrub starts 2024-02-13T14:48:26.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:21.268193+0000 osd.0 (osd.0) 6 : cluster 0 16.8 deep-scrub ok 2024-02-13T14:48:26.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:22.260261+0000 osd.0 (osd.0) 7 : cluster 0 16.5 deep-scrub starts 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:22.312353+0000 osd.0 (osd.0) 8 : cluster 0 16.5 deep-scrub ok 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:22.573360+0000 client.admin (client.25252) 0 : cluster 1 twoxx 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:22.753639+0000 mgr.y (mgr.14613) 188 : cluster 0 pgmap v131: 852 pgs: 75 creating+peering, 535 active+clean, 242 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 8.1 MiB/s rd, 25 MiB/s wr, 367 op/s 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:23.345323+0000 mgr.y (mgr.14613) 189 : cluster 0 pgmap v132: 852 pgs: 75 creating+peering, 535 active+clean, 242 unknown; 145 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 8.7 MiB/s rd, 27 MiB/s wr, 396 op/s 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.870144+0000 mon.a (mon.0) 929 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.872066+0000 mon.a (mon.0) 930 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.872236+0000 mon.a (mon.0) 931 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.872379+0000 mon.a (mon.0) 932 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.872519+0000 mon.a (mon.0) 933 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.872828+0000 mon.a (mon.0) 934 : audit 1 from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.873076+0000 mon.a (mon.0) 935 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.889441+0000 mon.b (mon.1) 122 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.893760+0000 mon.b (mon.1) 123 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.899037+0000 mon.c (mon.2) 79 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:23.936791+0000 mon.c (mon.2) 80 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:24.358462+0000 mon.a (mon.0) 936 : cluster 0 osdmap e84: 8 total, 8 up, 8 in 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.360465+0000 mon.b (mon.1) 124 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.373228+0000 mon.a (mon.0) 937 : audit 1 from='client.25099 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.379719+0000 mon.a (mon.0) 938 : audit 1 from='client.25261 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.381852+0000 mon.a (mon.0) 939 : audit 1 from='client.25258 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.384814+0000 mon.a (mon.0) 940 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.386133+0000 mon.a (mon.0) 941 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.386253+0000 mon.c (mon.2) 81 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.386949+0000 mon.c (mon.2) 82 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.387365+0000 mon.a (mon.0) 942 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.389114+0000 mon.a (mon.0) 943 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.393882+0000 mon.a (mon.0) 944 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.394546+0000 mon.c (mon.2) 83 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.394585+0000 mon.a (mon.0) 945 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.347 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.395649+0000 mon.a (mon.0) 946 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.745036+0000 mon.c (mon.2) 84 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.863232+0000 mon.a (mon.0) 947 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.864193+0000 mon.a (mon.0) 948 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.865750+0000 mon.a (mon.0) 949 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.880843+0000 mon.a (mon.0) 950 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.881297+0000 mon.a (mon.0) 951 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.881491+0000 mon.a (mon.0) 952 : audit 1 from='client.25099 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.881657+0000 mon.a (mon.0) 953 : audit 1 from='client.25261 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.881825+0000 mon.a (mon.0) 954 : audit 1 from='client.25258 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.882025+0000 mon.a (mon.0) 955 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.882205+0000 mon.a (mon.0) 956 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.882406+0000 mon.a (mon.0) 957 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.882721+0000 mon.a (mon.0) 958 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.348 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.882985+0000 mon.a (mon.0) 959 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.883191+0000 mon.a (mon.0) 960 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.892108+0000 mon.b (mon.1) 125 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.892566+0000 mon.b (mon.1) 126 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.892761+0000 mon.c (mon.2) 85 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.893073+0000 mon.c (mon.2) 86 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.893243+0000 mon.c (mon.2) 87 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.893416+0000 mon.c (mon.2) 88 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: cluster 2024-02-13T14:48:24.899560+0000 mon.a (mon.0) 961 : cluster 0 osdmap e85: 8 total, 8 up, 8 in 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.904519+0000 mon.a (mon.0) 962 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.904558+0000 mon.b (mon.1) 127 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.905539+0000 mon.b (mon.1) 128 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.914710+0000 mon.a (mon.0) 963 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.915372+0000 mon.a (mon.0) 964 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.915814+0000 mon.a (mon.0) 965 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.916214+0000 mon.a (mon.0) 966 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:26.349 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.916726+0000 mon.a (mon.0) 967 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:26.350 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.919738+0000 mon.a (mon.0) 968 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:26.350 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.920195+0000 mon.a (mon.0) 969 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:26.350 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.923415+0000 mon.c (mon.2) 89 : audit 1 from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T14:48:26.350 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:25 smithi111 bash[23388]: audit 2024-02-13T14:48:24.923980+0000 mon.a (mon.0) 970 : audit 1 from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T14:48:26.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:48:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:48:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:48:27.903 INFO:tasks.workunit.client.0.smithi062.stdout: entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.379676+0000 client.admin [INF] onexx 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:18.826410+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:19.310084+0000 mon.a [INF] from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:19.318759+0000 mon.a [INF] from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:19.319005+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:19.319159+0000 mon.a [INF] from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["onexx"]}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:19.319351+0000 mon.a [INF] from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:19.338400+0000 mon.a [INF] from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyECPP_smithi062-64853-1", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:22.573360+0000 client.admin [INF] twoxx 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.870144+0000 mon.a [INF] from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.872066+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.872236+0000 mon.a [INF] from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:27.904 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.872379+0000 mon.a [INF] from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.872519+0000 mon.a [INF] from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["twoxx"]}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.872828+0000 mon.a [INF] from='client.24893 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritesmithi062-65304-1"}]': finished 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.873076+0000 mon.a [INF] from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.889441+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.893760+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.899037+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:23.936791+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.360465+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.373228+0000 mon.a [INF] from='client.25099 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.379719+0000 mon.a [INF] from='client.25261 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.381852+0000 mon.a [INF] from='client.25258 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.384814+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.386133+0000 mon.a [INF] from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.386253+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.386949+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.905 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.387365+0000 mon.a [INF] from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.389114+0000 mon.a [INF] from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.393882+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.394546+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.394585+0000 mon.a [INF] from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.395649+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.863232+0000 mon.a [INF] from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.864193+0000 mon.a [INF] from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.865750+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.880843+0000 mon.a [INF] from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.881297+0000 mon.a [INF] from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatEC_smithi062-64770-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.881491+0000 mon.a [INF] from='client.25099 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWrite_smithi062-64504-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.881657+0000 mon.a [INF] from='client.25261 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:27.906 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.881825+0000 mon.a [INF] from='client.25258 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-2","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.882025+0000 mon.a [INF] from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolQuotaPP_smithi062-64512-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.882205+0000 mon.a [INF] from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReadOpsmithi062-65304-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.882406+0000 mon.a [INF] from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockEC_smithi062-64549-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.882721+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.882985+0000 mon.a [INF] from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.883191+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosIoEC_smithi062-64520-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.892108+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.892566+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.892761+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.893073+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.893243+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.893416+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.904519+0000 mon.a [INF] from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.904558+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.905539+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:27.907 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.914710+0000 mon.a [INF] from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:27.908 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.915372+0000 mon.a [INF] from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:27.908 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.915814+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:29.077 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.916214+0000 mon.a [INF] from='client.25301 ' entity='c api_service_pp: [==========] Running 4 tests from 1 test suite. 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [----------] Global test environment set-up. 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterEarly 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterEarly (5074 ms) 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ RUN ] LibRadosServicePP.RegisterLate 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ OK ] LibRadosServicePP.RegisterLate (49 ms) 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Status 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ OK ] LibRadosServicePP.Status (20034 ms) 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ RUN ] LibRadosServicePP.Close 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: attempt 0 of 20 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ OK ] LibRadosServicePP.Close (5075 ms) 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [----------] 4 tests from LibRadosServicePP (30232 ms total) 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [----------] Global test environment tear-down 2024-02-13T14:48:29.078 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [==========] 4 tests from 1 test suite ran. (30232 ms total) 2024-02-13T14:48:29.079 INFO:tasks.workunit.client.0.smithi062.stdout: api_service_pp: [ PASSED ] 4 tests. 2024-02-13T14:48:29.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:29 smithi062 bash[21479]: cluster 2024-02-13T14:48:25.434262+0000 mon.a (mon.0) 971 : cluster 3 Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T14:48:29.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:29 smithi062 bash[21479]: audit 2024-02-13T14:48:25.746726+0000 mon.c (mon.2) 90 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:29.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:29 smithi062 bash[21479]: audit 2024-02-13T14:48:25.891384+0000 mon.a (mon.0) 972 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-13T14:48:29.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:29 smithi062 bash[28859]: cluster 2024-02-13T14:48:25.434262+0000 mon.a (mon.0) 971 : cluster 3 Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T14:48:29.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:29 smithi062 bash[28859]: audit 2024-02-13T14:48:25.746726+0000 mon.c (mon.2) 90 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:29.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:29 smithi062 bash[28859]: audit 2024-02-13T14:48:25.891384+0000 mon.a (mon.0) 972 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-13T14:48:29.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:29 smithi111 bash[23388]: cluster 2024-02-13T14:48:25.434262+0000 mon.a (mon.0) 971 : cluster 3 Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T14:48:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:29 smithi111 bash[23388]: audit 2024-02-13T14:48:25.746726+0000 mon.c (mon.2) 90 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:29 smithi111 bash[23388]: audit 2024-02-13T14:48:25.891384+0000 mon.a (mon.0) 972 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout:y(active, since 3m), standbys: x 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: osd: 8 osds: 8 up (since 5m), 8 in (since 5m) 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: foo: 16 portals active (1 hosts, 3 zones) 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: laundry: 1 daemon active (1 hosts) 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: rgw: 1 daemon active (1 hosts, 1 zones) 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: data: 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pools: 8 pools, 196 pgs 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: objects: 198 objects, 582 KiB 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: usage: 239 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: pgs: 4.592% pgs unknown 2024-02-13T14:48:30.360 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 28.061% pgs not active 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 132 active+clean 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 55 creating+peering 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 9 unknown 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: io: 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: client: 1023 B/s rd, 0 op/s rd, 0 op/s wr 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ OK ] LibRadosService.StatusFormat (6361 ms) 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ RUN ] LibRadosService.Status 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ OK ] LibRadosService.Status (20044 ms) 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [----------] 4 tests from LibRadosService (31495 ms total) 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: 2024-02-13T14:48:30.361 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [----------] Global test environment tear-down 2024-02-13T14:48:30.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [==========] 4 tests from 1 test suite ran. (31495 ms total) 2024-02-13T14:48:30.362 INFO:tasks.workunit.client.0.smithi062.stdout: api_service: [ PASSED ] 4 tests. 2024-02-13T14:48:30.362 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout:lient.admin' cmd=[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.916726+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.919738+0000 mon.a [INF] from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.920195+0000 mon.a [INF] from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.923415+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/92931879' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:24.923980+0000 mon.a [INF] from='client.25178 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]: dispatch 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.434262+0000 mon.a [WRN] Health check failed: 2 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.891384+0000 mon.a [INF] from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["twoxx"]}]': finished 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.912970+0000 mon.a [INF] from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.913053+0000 mon.a [INF] from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:30.363 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.913111+0000 mon.a [INF] from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:30.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.913155+0000 mon.a [INF] from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-13T14:48:30.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.924130+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:30.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.924922+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:30.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.926717+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:30.364 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:25.927480+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:30.387 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: go delete_pools_parallel: process_1_[65202]: starting. 2024-02-13T14:48:30.387 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[65202]: creating pool ceph_test_rados_delete_pools_parallel.smithi062-65119 2024-02-13T14:48:30.387 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[65202]: created object 0... 2024-02-13T14:48:30.387 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[65202]: created object 25... 2024-02-13T14:48:30.387 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[65202]: created object 49... 2024-02-13T14:48:30.387 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[65202]: finishing. 2024-02-13T14:48:30.387 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_1_[65202]: shutting down. 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_2_[65203]: starting. 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_2_[65203]: deleting pool ceph_test_rados_delete_pools_parallel.smithi062-65119 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_2_[65203]: shutting down. 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[66561]: starting. 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[66561]: creating pool ceph_test_rados_delete_pools_parallel.smithi062-65119 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[66561]: created object 0... 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[66561]: created object 25... 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[66561]: created object 49... 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[66561]: finishing. 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_3_[66561]: shutting down. 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[66563]: starting. 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[66563]: listing objects. 2024-02-13T14:48:30.388 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[66563]: listed object 0... 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[66563]: listed object 25... 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[66563]: saw 50 objects 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_5_[66563]: shutting down. 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_4_[66562]: starting. 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_4_[66562]: deleting pool ceph_test_rados_delete_pools_parallel.smithi062-65119 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: process_4_[66562]: shutting down. 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******************************* 2024-02-13T14:48:30.389 INFO:tasks.workunit.client.0.smithi062.stdout: delete_pools_parallel: ******* SUCCESS ********** 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[65073]: starting. 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[65073]: creating pool ceph_test_rados_open_pools_parallel.smithi062-65042 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[65073]: created object 0... 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[65073]: created object 25... 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[65073]: created object 49... 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[65073]: finishing. 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_1_[65073]: shutting down. 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_2_[65076]: starting. 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_2_[65076]: rados_pool_create. 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_2_[65076]: rados_ioctx_create. 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_2_[65076]: shutting down. 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******************************* 2024-02-13T14:48:30.390 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[66393]: starting. 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[66393]: creating pool ceph_test_rados_open_pools_parallel.smithi062-65042 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[66393]: created object 0... 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[66393]: created object 25... 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[66393]: created object 49... 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[66393]: finishing. 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_3_[66393]: shutting down. 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******************************* 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_4_[66394]: starting. 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_4_[66394]: rados_pool_create. 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_4_[66394]: rados_ioctx_create. 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: process_4_[66394]: shutting down. 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******************************* 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******************************* 2024-02-13T14:48:30.391 INFO:tasks.workunit.client.0.smithi062.stdout: open_pools_parallel: ******* SUCCESS ********** 2024-02-13T14:48:30.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:25.912970+0000 mon.a (mon.0) 973 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:30.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:25.913053+0000 mon.a (mon.0) 974 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:25.913111+0000 mon.a (mon.0) 975 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:25.913155+0000 mon.a (mon.0) 976 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:25.924130+0000 mon.b (mon.1) 129 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:25.924922+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:25.926717+0000 mon.b (mon.1) 131 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:25.927480+0000 mon.b (mon.1) 132 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:26.748326+0000 mon.c (mon.2) 91 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:27.750091+0000 mon.c (mon.2) 92 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:27.906547+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:28.751822+0000 mon.c (mon.2) 93 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: cluster 2024-02-13T14:48:28.999738+0000 mon.a (mon.0) 977 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: cluster 2024-02-13T14:48:29.004326+0000 mon.a (mon.0) 978 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:30.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.031622+0000 mon.a (mon.0) 979 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:25.912970+0000 mon.a (mon.0) 973 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:25.913053+0000 mon.a (mon.0) 974 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:25.913111+0000 mon.a (mon.0) 975 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:25.913155+0000 mon.a (mon.0) 976 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:25.924130+0000 mon.b (mon.1) 129 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:25.924922+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:25.926717+0000 mon.b (mon.1) 131 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:25.927480+0000 mon.b (mon.1) 132 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:26.748326+0000 mon.c (mon.2) 91 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:27.750091+0000 mon.c (mon.2) 92 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:27.906547+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:28.751822+0000 mon.c (mon.2) 93 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: cluster 2024-02-13T14:48:28.999738+0000 mon.a (mon.0) 977 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: cluster 2024-02-13T14:48:29.004326+0000 mon.a (mon.0) 978 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.031622+0000 mon.a (mon.0) 979 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.031928+0000 mon.a (mon.0) 980 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.032159+0000 mon.a (mon.0) 981 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.032356+0000 mon.a (mon.0) 982 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.032549+0000 mon.a (mon.0) 983 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.032712+0000 mon.a (mon.0) 984 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.053808+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.058928+0000 mon.c (mon.2) 95 : audit 0 from='client.? v1:172.21.15.62:0/390354747' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: cluster 2024-02-13T14:48:29.496096+0000 mon.a (mon.0) 985 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[28859]: audit 2024-02-13T14:48:29.753622+0000 mon.c (mon.2) 96 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.031928+0000 mon.a (mon.0) 980 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.032159+0000 mon.a (mon.0) 981 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.032356+0000 mon.a (mon.0) 982 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.032549+0000 mon.a (mon.0) 983 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.032712+0000 mon.a (mon.0) 984 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.053808+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.058928+0000 mon.c (mon.2) 95 : audit 0 from='client.? v1:172.21.15.62:0/390354747' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: cluster 2024-02-13T14:48:29.496096+0000 mon.a (mon.0) 985 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-02-13T14:48:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:30 smithi062 bash[21479]: audit 2024-02-13T14:48:29.753622+0000 mon.c (mon.2) 96 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:25.912970+0000 mon.a (mon.0) 973 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:25.913053+0000 mon.a (mon.0) 974 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-4-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:25.913111+0000 mon.a (mon.0) 975 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:25.913155+0000 mon.a (mon.0) 976 : audit 1 from='client.25178 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "PoolQuotaPP_smithi062-64512-3", "field": "max_bytes", "val": "4096"}]': finished 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:25.924130+0000 mon.b (mon.1) 129 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:25.924922+0000 mon.b (mon.1) 130 : audit 1 from='client.? v1:172.21.15.62:0/1393057005' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:25.926717+0000 mon.b (mon.1) 131 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:25.927480+0000 mon.b (mon.1) 132 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:26.748326+0000 mon.c (mon.2) 91 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:27.750091+0000 mon.c (mon.2) 92 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:27.906547+0000 mon.b (mon.1) 133 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:28.751822+0000 mon.c (mon.2) 93 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: cluster 2024-02-13T14:48:28.999738+0000 mon.a (mon.0) 977 : cluster 0 osdmap e86: 8 total, 8 up, 8 in 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: cluster 2024-02-13T14:48:29.004326+0000 mon.a (mon.0) 978 : cluster 3 Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.031622+0000 mon.a (mon.0) 979 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.031928+0000 mon.a (mon.0) 980 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.032159+0000 mon.a (mon.0) 981 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.032356+0000 mon.a (mon.0) 982 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.032549+0000 mon.a (mon.0) 983 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.032712+0000 mon.a (mon.0) 984 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.053808+0000 mon.c (mon.2) 94 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.058928+0000 mon.c (mon.2) 95 : audit 0 from='client.? v1:172.21.15.62:0/390354747' entity='client.admin' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T14:48:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: cluster 2024-02-13T14:48:29.496096+0000 mon.a (mon.0) 985 : cluster 0 osdmap e87: 8 total, 8 up, 8 in 2024-02-13T14:48:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:30 smithi111 bash[23388]: audit 2024-02-13T14:48:29.753622+0000 mon.c (mon.2) 96 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:31.365 INFO:tasks.workunit.client.0.smithi062.stdout:t: 2024-02-13T14:48:27.906547+0000 mon.b [INF] from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T14:48:31.365 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:29.004326+0000 mon.a [WRN] Health check update: 17 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:29.031622+0000 mon.a [INF] from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatEC_smithi062-64770-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:29.031928+0000 mon.a [INF] from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoECPP_smithi062-64528-22", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:29.032159+0000 mon.a [INF] from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockEC_smithi062-64549-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:29.032356+0000 mon.a [INF] from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosIoEC_smithi062-64520-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:29.032549+0000 mon.a [INF] from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReadOpsmithi062-65304-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:29.032712+0000 mon.a [INF] from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosLockECPP_smithi062-64557-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:29.053808+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:27.906796+0000 client.admin [INF] threexx 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.370738+0000 mon.a [INF] from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.385917+0000 mon.c [INF] from='client.? v1:172.21.15.62:0/1134774163' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.391133+0000 mon.a [INF] from='client.25322 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.401221+0000 mon.a [INF] from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:31.366 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.401633+0000 mon.a [INF] from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:31.411 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.401934+000 cls: Running main() from gmock_main.cc 2024-02-13T14:48:31.411 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [==========] Running 2 tests from 1 test suite. 2024-02-13T14:48:31.411 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [----------] Global test environment set-up. 2024-02-13T14:48:31.411 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [----------] 2 tests from NeoRadosCls 2024-02-13T14:48:31.411 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ RUN ] NeoRadosCls.DNE 2024-02-13T14:48:31.412 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ OK ] NeoRadosCls.DNE (19355 ms) 2024-02-13T14:48:31.412 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ RUN ] NeoRadosCls.RemoteReads 2024-02-13T14:48:31.412 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ OK ] NeoRadosCls.RemoteReads (13079 ms) 2024-02-13T14:48:31.412 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [----------] 2 tests from NeoRadosCls (32434 ms total) 2024-02-13T14:48:31.412 INFO:tasks.workunit.client.0.smithi062.stdout: cls: 2024-02-13T14:48:31.412 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [----------] Global test environment tear-down 2024-02-13T14:48:31.412 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [==========] 2 tests from 1 test suite ran. (32434 ms total) 2024-02-13T14:48:31.412 INFO:tasks.workunit.client.0.smithi062.stdout: cls: [ PASSED ] 2 tests. 2024-02-13T14:48:31.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: Running main() from gmock_main.cc 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [==========] Running 37 tests from 2 test suites. 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] Global test environment set-up. 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: seed 64528 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TooBigPP 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.TooBigPP (0 ms) 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SimpleWritePP 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.SimpleWritePP (1384 ms) 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadOpPP 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadOpPP (10 ms) 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.SparseReadOpPP 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.SparseReadOpPP (10 ms) 2024-02-13T14:48:31.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP (27 ms) 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RoundTripPP2 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.RoundTripPP2 (3 ms) 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.Checksum 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.Checksum (4 ms) 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.ReadIntoBufferlist 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.ReadIntoBufferlist (10 ms) 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.OverlappingWriteRoundTripPP 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.OverlappingWriteRoundTripPP (4 ms) 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP (7 ms) 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.WriteFullRoundTripPP2 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.WriteFullRoundTripPP2 (3 ms) 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.AppendRoundTripPP 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.AppendRoundTripPP (5 ms) 2024-02-13T14:48:31.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.TruncTestPP 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.TruncTestPP (5 ms) 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RemoveTestPP 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.RemoveTestPP (13 ms) 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrsRoundTripPP 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrsRoundTripPP (5 ms) 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.RmXattrPP 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.RmXattrPP (19 ms) 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.XattrListPP (5 ms) 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtPP 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtPP (4 ms) 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtDNEPP 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtDNEPP (4 ms) 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoPP.CmpExtMismatchPP 2024-02-13T14:48:31.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoPP.CmpExtMismatchPP (9 ms) 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] 20 tests from LibRadosIoPP (1531 ms total) 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SimpleWritePP 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SimpleWritePP (2537 ms) 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.ReadOpPP 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.ReadOpPP (19 ms) 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.SparseReadOpPP 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.SparseReadOpPP (3 ms) 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP (2 ms) 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RoundTripPP2 2024-02-13T14:48:31.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RoundTripPP2 (5 ms) 2024-02-13T14:48:31.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: cluster 2024-02-13T14:48:25.346687+0000 mgr.y (mgr.14613) 190 : cluster 0 pgmap v135: 876 pgs: 248 creating+peering, 564 active+clean, 64 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:31.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: cluster 2024-02-13T14:48:27.348077+0000 mgr.y (mgr.14613) 191 : cluster 0 pgmap v137: 868 pgs: 218 creating+peering, 554 active+clean, 96 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: cluster 2024-02-13T14:48:27.906796+0000 client.admin (client.25252) 0 : cluster 1 threexx 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:29.061201+0000 mgr.y (mgr.14613) 192 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: cluster 2024-02-13T14:48:29.349619+0000 mgr.y (mgr.14613) 193 : cluster 0 pgmap v139: 948 pgs: 218 creating+peering, 554 active+clean, 176 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.111957+0000 mgr.y (mgr.14613) 194 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.370738+0000 mon.a (mon.0) 986 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: cluster 2024-02-13T14:48:30.382742+0000 mon.a (mon.0) 987 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.385917+0000 mon.c (mon.2) 97 : audit 1 from='client.? v1:172.21.15.62:0/1134774163' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.391133+0000 mon.a (mon.0) 988 : audit 1 from='client.25322 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.401221+0000 mon.a (mon.0) 989 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.401633+0000 mon.a (mon.0) 990 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.401934+0000 mon.a (mon.0) 991 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.402164+0000 mon.a (mon.0) 992 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.409259+0000 mon.a (mon.0) 993 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.443055+0000 mon.a (mon.0) 994 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:31.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.447676+0000 mon.a (mon.0) 995 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.448635+0000 mon.b (mon.1) 134 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.755334+0000 mon.c (mon.2) 98 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.916310+0000 mon.a (mon.0) 996 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[21479]: audit 2024-02-13T14:48:30.917279+0000 mon.a (mon.0) 997 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: cluster 2024-02-13T14:48:25.346687+0000 mgr.y (mgr.14613) 190 : cluster 0 pgmap v135: 876 pgs: 248 creating+peering, 564 active+clean, 64 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: cluster 2024-02-13T14:48:27.348077+0000 mgr.y (mgr.14613) 191 : cluster 0 pgmap v137: 868 pgs: 218 creating+peering, 554 active+clean, 96 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: cluster 2024-02-13T14:48:27.906796+0000 client.admin (client.25252) 0 : cluster 1 threexx 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:29.061201+0000 mgr.y (mgr.14613) 192 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: cluster 2024-02-13T14:48:29.349619+0000 mgr.y (mgr.14613) 193 : cluster 0 pgmap v139: 948 pgs: 218 creating+peering, 554 active+clean, 176 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:48:31.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.111957+0000 mgr.y (mgr.14613) 194 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.370738+0000 mon.a (mon.0) 986 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: cluster 2024-02-13T14:48:30.382742+0000 mon.a (mon.0) 987 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.385917+0000 mon.c (mon.2) 97 : audit 1 from='client.? v1:172.21.15.62:0/1134774163' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.391133+0000 mon.a (mon.0) 988 : audit 1 from='client.25322 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.401221+0000 mon.a (mon.0) 989 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.401633+0000 mon.a (mon.0) 990 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.401934+0000 mon.a (mon.0) 991 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.402164+0000 mon.a (mon.0) 992 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.409259+0000 mon.a (mon.0) 993 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.443055+0000 mon.a (mon.0) 994 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.447676+0000 mon.a (mon.0) 995 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.448635+0000 mon.b (mon.1) 134 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.755334+0000 mon.c (mon.2) 98 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.916310+0000 mon.a (mon.0) 996 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:31 smithi062 bash[28859]: audit 2024-02-13T14:48:30.917279+0000 mon.a (mon.0) 997 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:31.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: cluster 2024-02-13T14:48:25.346687+0000 mgr.y (mgr.14613) 190 : cluster 0 pgmap v135: 876 pgs: 248 creating+peering, 564 active+clean, 64 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:48:31.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: cluster 2024-02-13T14:48:27.348077+0000 mgr.y (mgr.14613) 191 : cluster 0 pgmap v137: 868 pgs: 218 creating+peering, 554 active+clean, 96 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:48:31.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: cluster 2024-02-13T14:48:27.906796+0000 client.admin (client.25252) 0 : cluster 1 threexx 2024-02-13T14:48:31.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:29.061201+0000 mgr.y (mgr.14613) 192 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "service dump"}]: dispatch 2024-02-13T14:48:31.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: cluster 2024-02-13T14:48:29.349619+0000 mgr.y (mgr.14613) 193 : cluster 0 pgmap v139: 948 pgs: 218 creating+peering, 554 active+clean, 176 unknown; 145 MiB data, 719 MiB used, 715 GiB / 715 GiB avail; 935 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:48:31.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.111957+0000 mgr.y (mgr.14613) 194 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.370738+0000 mon.a (mon.0) 986 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: cluster 2024-02-13T14:48:30.382742+0000 mon.a (mon.0) 987 : cluster 0 osdmap e88: 8 total, 8 up, 8 in 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.385917+0000 mon.c (mon.2) 97 : audit 1 from='client.? v1:172.21.15.62:0/1134774163' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.391133+0000 mon.a (mon.0) 988 : audit 1 from='client.25322 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.401221+0000 mon.a (mon.0) 989 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.401633+0000 mon.a (mon.0) 990 : audit 1 from='client.24919 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.401934+0000 mon.a (mon.0) 991 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.402164+0000 mon.a (mon.0) 992 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.409259+0000 mon.a (mon.0) 993 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.443055+0000 mon.a (mon.0) 994 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.447676+0000 mon.a (mon.0) 995 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.448635+0000 mon.b (mon.1) 134 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.755334+0000 mon.c (mon.2) 98 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.916310+0000 mon.a (mon.0) 996 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:31 smithi111 bash[23388]: audit 2024-02-13T14:48:30.917279+0000 mon.a (mon.0) 997 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.365971+0000 mon.a (mon.0) 998 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-13T14:48:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.374607+0000 mon.b (mon.1) 135 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T14:48:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: cluster 2024-02-13T14:48:31.375221+0000 client.admin (client.25252) 0 : cluster 1 fourxx 2024-02-13T14:48:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.381206+0000 mon.a (mon.0) 999 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T14:48:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.382413+0000 mon.a (mon.0) 1000 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.382644+0000 mon.a (mon.0) 1001 : audit 1 from='client.25322 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.382834+0000 mon.a (mon.0) 1002 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.382999+0000 mon.a (mon.0) 1003 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.383125+0000 mon.a (mon.0) 1004 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.383250+0000 mon.a (mon.0) 1005 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.393378+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.394203+0000 mon.b (mon.1) 137 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.503901+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.599091+0000 mon.c (mon.2) 100 : audit 0 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.603954+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.365971+0000 mon.a (mon.0) 998 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.374607+0000 mon.b (mon.1) 135 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T14:48:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: cluster 2024-02-13T14:48:31.375221+0000 client.admin (client.25252) 0 : cluster 1 fourxx 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.381206+0000 mon.a (mon.0) 999 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.382413+0000 mon.a (mon.0) 1000 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.382644+0000 mon.a (mon.0) 1001 : audit 1 from='client.25322 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.382834+0000 mon.a (mon.0) 1002 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.382999+0000 mon.a (mon.0) 1003 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.383125+0000 mon.a (mon.0) 1004 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.383250+0000 mon.a (mon.0) 1005 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.393378+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.394203+0000 mon.b (mon.1) 137 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.503901+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.599091+0000 mon.c (mon.2) 100 : audit 0 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-13T14:48:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.603954+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.757020+0000 mon.c (mon.2) 102 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: cluster 2024-02-13T14:48:31.885311+0000 mon.a (mon.0) 1006 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.887698+0000 mon.a (mon.0) 1007 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-64828-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.892748+0000 mon.a (mon.0) 1008 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[28859]: audit 2024-02-13T14:48:31.893155+0000 mon.a (mon.0) 1009 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.757020+0000 mon.c (mon.2) 102 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: cluster 2024-02-13T14:48:31.885311+0000 mon.a (mon.0) 1006 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.887698+0000 mon.a (mon.0) 1007 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-64828-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.892748+0000 mon.a (mon.0) 1008 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:32 smithi062 bash[21479]: audit 2024-02-13T14:48:31.893155+0000 mon.a (mon.0) 1009 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.365971+0000 mon.a (mon.0) 998 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["threexx"]}]': finished 2024-02-13T14:48:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.374607+0000 mon.b (mon.1) 135 : audit 1 from='client.? v1:172.21.15.62:0/559686409' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: cluster 2024-02-13T14:48:31.375221+0000 client.admin (client.25252) 0 : cluster 1 fourxx 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.381206+0000 mon.a (mon.0) 999 : audit 1 from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["fourxx"]}]: dispatch 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.382413+0000 mon.a (mon.0) 1000 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.382644+0000 mon.a (mon.0) 1001 : audit 1 from='client.25322 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.382834+0000 mon.a (mon.0) 1002 : audit 1 from='client.24919 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectssmithi062-65398-1"}]': finished 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.382999+0000 mon.a (mon.0) 1003 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.383125+0000 mon.a (mon.0) 1004 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.383250+0000 mon.a (mon.0) 1005 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.393378+0000 mon.b (mon.1) 136 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.394203+0000 mon.b (mon.1) 137 : audit 1 from='client.? v1:172.21.15.62:0/2251203043' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.503901+0000 mon.c (mon.2) 99 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.599091+0000 mon.c (mon.2) 100 : audit 0 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd dump"}]: dispatch 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.603954+0000 mon.c (mon.2) 101 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.757020+0000 mon.c (mon.2) 102 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: cluster 2024-02-13T14:48:31.885311+0000 mon.a (mon.0) 1006 : cluster 0 osdmap e89: 8 total, 8 up, 8 in 2024-02-13T14:48:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.887698+0000 mon.a (mon.0) 1007 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-64828-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.892748+0000 mon.a (mon.0) 1008 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:32 smithi111 bash[23388]: audit 2024-02-13T14:48:31.893155+0000 mon.a (mon.0) 1009 : audit 1 from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:32.758756+0000 mon.c (mon.2) 103 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:32.786763+0000 mon.a (mon.0) 1010 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:32.795496+0000 mon.a (mon.0) 1011 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:32.795723+0000 mon.a (mon.0) 1012 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:32.795790+0000 mon.a (mon.0) 1013 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:32.795840+0000 mon.a (mon.0) 1014 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:32.807011+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:33.242796+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.62:0/1516327479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: cluster 2024-02-13T14:48:33.693369+0000 mon.a (mon.0) 1015 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-02-13T14:48:34.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[28859]: audit 2024-02-13T14:48:33.760168+0000 mon.c (mon.2) 105 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:32.758756+0000 mon.c (mon.2) 103 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:32.786763+0000 mon.a (mon.0) 1010 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:32.795496+0000 mon.a (mon.0) 1011 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:32.795723+0000 mon.a (mon.0) 1012 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:32.795790+0000 mon.a (mon.0) 1013 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:32.795840+0000 mon.a (mon.0) 1014 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:32.807011+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:33.242796+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.62:0/1516327479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: cluster 2024-02-13T14:48:33.693369+0000 mon.a (mon.0) 1015 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-02-13T14:48:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:34 smithi062 bash[21479]: audit 2024-02-13T14:48:33.760168+0000 mon.c (mon.2) 105 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:32.758756+0000 mon.c (mon.2) 103 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:32.786763+0000 mon.a (mon.0) 1010 : audit 1 from='client.25252 ' entity='client.admin' cmd='[{"prefix":"log", "logtext":["fourxx"]}]': finished 2024-02-13T14:48:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:32.795496+0000 mon.a (mon.0) 1011 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:32.795723+0000 mon.a (mon.0) 1012 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosStatECPP_smithi062-64799-7", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:32.795790+0000 mon.a (mon.0) 1013 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-4", "overlaypool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:32.795840+0000 mon.a (mon.0) 1014 : audit 1 from='client.24796 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyECPP_smithi062-64853-1"}]': finished 2024-02-13T14:48:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:32.807011+0000 mon.b (mon.1) 138 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:48:34.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:33.242796+0000 mon.c (mon.2) 104 : audit 1 from='client.? v1:172.21.15.62:0/1516327479' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:34.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: cluster 2024-02-13T14:48:33.693369+0000 mon.a (mon.0) 1015 : cluster 0 osdmap e90: 8 total, 8 up, 8 in 2024-02-13T14:48:34.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:34 smithi111 bash[23388]: audit 2024-02-13T14:48:33.760168+0000 mon.c (mon.2) 105 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:34.793 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN 0 mon.a [INF] from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:34.793 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.402164+0000 mon.a [INF] from='client.24796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyECPP_smithi062-64853-1"}]: dispatch 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.409259+0000 mon.a [INF] from='client.25252 ' entity='client.admin' cmd=[{"prefix":"log", "logtext":["threexx"]}]: dispatch 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.443055+0000 mon.a [INF] from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.447676+0000 mon.a [INF] from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.916310+0000 mon.a [INF] from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: got: 2024-02-13T14:48:30.917279+0000 mon.a [INF] from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ OK ] LibRadosCmd.WatchLog (16478 ms) 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [----------] 4 tests from LibRadosCmd (35978 ms total) 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [----------] Global test environment tear-down 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [==========] 4 tests from 1 test suite ran. (35979 ms total) 2024-02-13T14:48:34.794 INFO:tasks.workunit.client.0.smithi062.stdout: api_cmd: [ PASSED ] 4 tests. 2024-02-13T14:48:35.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: cluster 2024-02-13T14:48:31.351290+0000 mgr.y (mgr.14613) 195 : cluster 0 pgmap v141: 916 pgs: 96 unknown, 144 creating+peering, 676 active+clean; 145 MiB data, 751 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 1 op/s 2024-02-13T14:48:35.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: cluster 2024-02-13T14:48:33.352766+0000 mgr.y (mgr.14613) 196 : cluster 0 pgmap v144: 828 pgs: 136 unknown, 144 creating+peering, 548 active+clean; 145 MiB data, 751 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:35.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: cluster 2024-02-13T14:48:34.151685+0000 mon.a (mon.0) 1016 : cluster 3 Health check update: 18 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:35.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:34.161691+0000 mon.a (mon.0) 1017 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-64828-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:35.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:34.161785+0000 mon.a (mon.0) 1018 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:35.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: cluster 2024-02-13T14:48:34.167385+0000 mon.a (mon.0) 1019 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-02-13T14:48:35.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:34.168486+0000 mon.c (mon.2) 106 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:34.173988+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.62:0/1582825558' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:34.184976+0000 mon.a (mon.0) 1020 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:34.657352+0000 mon.a (mon.0) 1021 : audit 1 from='client.25355 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:34.761390+0000 mon.c (mon.2) 108 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:35.108601+0000 mon.a (mon.0) 1022 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:35.108911+0000 mon.a (mon.0) 1023 : audit 1 from='client.25358 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[28859]: audit 2024-02-13T14:48:35.112572+0000 mon.a (mon.0) 1024 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: cluster 2024-02-13T14:48:31.351290+0000 mgr.y (mgr.14613) 195 : cluster 0 pgmap v141: 916 pgs: 96 unknown, 144 creating+peering, 676 active+clean; 145 MiB data, 751 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 1 op/s 2024-02-13T14:48:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: cluster 2024-02-13T14:48:33.352766+0000 mgr.y (mgr.14613) 196 : cluster 0 pgmap v144: 828 pgs: 136 unknown, 144 creating+peering, 548 active+clean; 145 MiB data, 751 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: cluster 2024-02-13T14:48:34.151685+0000 mon.a (mon.0) 1016 : cluster 3 Health check update: 18 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:34.161691+0000 mon.a (mon.0) 1017 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-64828-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:34.161785+0000 mon.a (mon.0) 1018 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: cluster 2024-02-13T14:48:34.167385+0000 mon.a (mon.0) 1019 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:34.168486+0000 mon.c (mon.2) 106 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:34.173988+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.62:0/1582825558' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:34.184976+0000 mon.a (mon.0) 1020 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:34.657352+0000 mon.a (mon.0) 1021 : audit 1 from='client.25355 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:34.761390+0000 mon.c (mon.2) 108 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:35.108601+0000 mon.a (mon.0) 1022 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:35.108911+0000 mon.a (mon.0) 1023 : audit 1 from='client.25358 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:35 smithi062 bash[21479]: audit 2024-02-13T14:48:35.112572+0000 mon.a (mon.0) 1024 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:48:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: cluster 2024-02-13T14:48:31.351290+0000 mgr.y (mgr.14613) 195 : cluster 0 pgmap v141: 916 pgs: 96 unknown, 144 creating+peering, 676 active+clean; 145 MiB data, 751 MiB used, 714 GiB / 715 GiB avail; 5.2 KiB/s rd, 1 op/s 2024-02-13T14:48:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: cluster 2024-02-13T14:48:33.352766+0000 mgr.y (mgr.14613) 196 : cluster 0 pgmap v144: 828 pgs: 136 unknown, 144 creating+peering, 548 active+clean; 145 MiB data, 751 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:48:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: cluster 2024-02-13T14:48:34.151685+0000 mon.a (mon.0) 1016 : cluster 3 Health check update: 18 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:34.161691+0000 mon.a (mon.0) 1017 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosWatchNotifyEC_smithi062-64828-12", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:34.161785+0000 mon.a (mon.0) 1018 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsNSsmithi062-65398-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: cluster 2024-02-13T14:48:34.167385+0000 mon.a (mon.0) 1019 : cluster 0 osdmap e91: 8 total, 8 up, 8 in 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:34.168486+0000 mon.c (mon.2) 106 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:34.173988+0000 mon.c (mon.2) 107 : audit 1 from='client.? v1:172.21.15.62:0/1582825558' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:34.184976+0000 mon.a (mon.0) 1020 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:34.657352+0000 mon.a (mon.0) 1021 : audit 1 from='client.25355 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:34.761390+0000 mon.c (mon.2) 108 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:35.108601+0000 mon.a (mon.0) 1022 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:35.108911+0000 mon.a (mon.0) 1023 : audit 1 from='client.25358 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:35 smithi111 bash[23388]: audit 2024-02-13T14:48:35.112572+0000 mon.a (mon.0) 1024 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: Running main() from gmock_main.cc 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [==========] Running 3 tests from 1 test suite. 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [----------] Global test environment set-up. 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [----------] 3 tests from NeoRadosCmd 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ RUN ] NeoRadosCmd.MonDescribe 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ OK ] NeoRadosCmd.MonDescribe (17345 ms) 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ RUN ] NeoRadosCmd.OSDCmd 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ OK ] NeoRadosCmd.OSDCmd (8606 ms) 2024-02-13T14:48:35.651 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ RUN ] NeoRadosCmd.PGCmd 2024-02-13T14:48:35.652 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ OK ] NeoRadosCmd.PGCmd (10741 ms) 2024-02-13T14:48:35.652 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [----------] 3 tests from NeoRadosCmd (36692 ms total) 2024-02-13T14:48:35.652 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: 2024-02-13T14:48:35.652 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [----------] Global test environment tear-down 2024-02-13T14:48:35.652 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [==========] 3 tests from 1 test suite ran. (36693 ms total) 2024-02-13T14:48:35.652 INFO:tasks.workunit.client.0.smithi062.stdout: cmd: [ PASSED ] 3 tests. 2024-02-13T14:48:36.529 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:48:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:48:36.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: cluster 2024-02-13T14:48:35.167803+0000 mon.a (mon.0) 1025 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:48:36.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.174668+0000 mon.a (mon.0) 1026 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.174756+0000 mon.a (mon.0) 1027 : audit 1 from='client.25355 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.174851+0000 mon.a (mon.0) 1028 : audit 1 from='client.25358 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.174915+0000 mon.a (mon.0) 1029 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]': finished 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.188814+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2"}]: dispatch 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.189378+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.190248+0000 mon.c (mon.2) 111 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.190737+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.191295+0000 mon.c (mon.2) 113 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.192023+0000 mon.c (mon.2) 114 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.192205+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.192371+0000 mon.c (mon.2) 116 : audit 1 from='client.? v1:172.21.15.62:0/3095001638' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.331494+0000 mon.b (mon.1) 139 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]: dispatch 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: cluster 2024-02-13T14:48:35.167803+0000 mon.a (mon.0) 1025 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.174668+0000 mon.a (mon.0) 1026 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.174756+0000 mon.a (mon.0) 1027 : audit 1 from='client.25355 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.174851+0000 mon.a (mon.0) 1028 : audit 1 from='client.25358 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.174915+0000 mon.a (mon.0) 1029 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]': finished 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.188814+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2"}]: dispatch 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.189378+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.190248+0000 mon.c (mon.2) 111 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.190737+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.191295+0000 mon.c (mon.2) 113 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.192023+0000 mon.c (mon.2) 114 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.192205+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:36.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.192371+0000 mon.c (mon.2) 116 : audit 1 from='client.? v1:172.21.15.62:0/3095001638' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.331494+0000 mon.b (mon.1) 139 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]: dispatch 2024-02-13T14:48:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: cluster 2024-02-13T14:48:35.643264+0000 mon.a (mon.0) 1030 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-02-13T14:48:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.646469+0000 mon.b (mon.1) 140 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.646772+0000 mon.a (mon.0) 1031 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.647132+0000 mon.b (mon.1) 141 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.647382+0000 mon.a (mon.0) 1032 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.648008+0000 mon.a (mon.0) 1033 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.648461+0000 mon.a (mon.0) 1034 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.648969+0000 mon.a (mon.0) 1035 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.649331+0000 mon.a (mon.0) 1036 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.649694+0000 mon.a (mon.0) 1037 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[21479]: audit 2024-02-13T14:48:35.762507+0000 mon.c (mon.2) 117 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: cluster 2024-02-13T14:48:35.643264+0000 mon.a (mon.0) 1030 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.646469+0000 mon.b (mon.1) 140 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.646772+0000 mon.a (mon.0) 1031 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.647132+0000 mon.b (mon.1) 141 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:36.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.647382+0000 mon.a (mon.0) 1032 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:36.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.648008+0000 mon.a (mon.0) 1033 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:36.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.648461+0000 mon.a (mon.0) 1034 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.648969+0000 mon.a (mon.0) 1035 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:36.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.649331+0000 mon.a (mon.0) 1036 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:36.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.649694+0000 mon.a (mon.0) 1037 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:36 smithi062 bash[28859]: audit 2024-02-13T14:48:35.762507+0000 mon.c (mon.2) 117 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:36.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: cluster 2024-02-13T14:48:35.167803+0000 mon.a (mon.0) 1025 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:48:36.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.174668+0000 mon.a (mon.0) 1026 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.174756+0000 mon.a (mon.0) 1027 : audit 1 from='client.25355 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafe_smithi062-64504-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.174851+0000 mon.a (mon.0) 1028 : audit 1 from='client.25358 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:36.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.174915+0000 mon.a (mon.0) 1029 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-4-cache", "mode": "writeback"}]': finished 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.188814+0000 mon.c (mon.2) 109 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2"}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.189378+0000 mon.c (mon.2) 110 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.190248+0000 mon.c (mon.2) 111 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.190737+0000 mon.c (mon.2) 112 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.191295+0000 mon.c (mon.2) 113 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.192023+0000 mon.c (mon.2) 114 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.192205+0000 mon.c (mon.2) 115 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.192371+0000 mon.c (mon.2) 116 : audit 1 from='client.? v1:172.21.15.62:0/3095001638' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.331494+0000 mon.b (mon.1) 139 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: cluster 2024-02-13T14:48:35.643264+0000 mon.a (mon.0) 1030 : cluster 0 osdmap e92: 8 total, 8 up, 8 in 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.646469+0000 mon.b (mon.1) 140 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.646772+0000 mon.a (mon.0) 1031 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.647132+0000 mon.b (mon.1) 141 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.647382+0000 mon.a (mon.0) 1032 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.648008+0000 mon.a (mon.0) 1033 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.648461+0000 mon.a (mon.0) 1034 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.648969+0000 mon.a (mon.0) 1035 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.649331+0000 mon.a (mon.0) 1036 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.649694+0000 mon.a (mon.0) 1037 : audit 1 from='client.25376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:36 smithi111 bash[23388]: audit 2024-02-13T14:48:35.762507+0000 mon.c (mon.2) 117 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: Running main() from gmock_main.cc 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [==========] Running 2 tests from 1 test suite. 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [----------] Global test environment set-up. 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [----------] 2 tests from NeoRadosECIo 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ RUN ] NeoRadosECIo.SimpleWrite 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ OK ] NeoRadosECIo.SimpleWrite (24902 ms) 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ RUN ] NeoRadosECIo.ReadOp 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ OK ] NeoRadosECIo.ReadOp (14095 ms) 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [----------] 2 tests from NeoRadosECIo (38997 ms total) 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [----------] Global test environment tear-down 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [==========] 2 tests from 1 test suite ran. (38997 ms total) 2024-02-13T14:48:37.993 INFO:tasks.workunit.client.0.smithi062.stdout: ec_io: [ PASSED ] 2 tests. 2024-02-13T14:48:38.014 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: Running main() from gmock_main.cc 2024-02-13T14:48:38.014 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [==========] Running 16 tests from 2 test suites. 2024-02-13T14:48:38.014 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] Global test environment set-up. 2024-02-13T14:48:38.014 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: seed 64557 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusivePP 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusivePP (152 ms) 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedPP 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedPP (1211 ms) 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockExclusiveDurPP 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockExclusiveDurPP (1020 ms) 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockSharedDurPP 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockSharedDurPP (1028 ms) 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.LockMayRenewPP 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.LockMayRenewPP (5 ms) 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.UnlockPP 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.UnlockPP (4 ms) 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.ListLockersPP 2024-02-13T14:48:38.015 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.ListLockersPP (5 ms) 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockPP.BreakLockPP 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockPP.BreakLockPP (2 ms) 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockPP (3427 ms total) 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusivePP 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusivePP (2513 ms) 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedPP 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedPP (31 ms) 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockExclusiveDurPP 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockExclusiveDurPP (1008 ms) 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockSharedDurPP 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockSharedDurPP (1013 ms) 2024-02-13T14:48:38.016 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.LockMayRenewPP 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.LockMayRenewPP (9 ms) 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.UnlockPP 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.UnlockPP (12 ms) 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.ListLockersPP 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.ListLockersPP (14 ms) 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ RUN ] LibRadosLockECPP.BreakLockPP 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ OK ] LibRadosLockECPP.BreakLockPP (9 ms) 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] 8 tests from LibRadosLockECPP (4610 ms total) 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [----------] Global test environment tear-down 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [==========] 16 tests from 2 test suites ran. (39340 ms total) 2024-02-13T14:48:38.017 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock_pp: [ PASSED ] 16 tests. 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: Running main() from gmock_main.cc 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [==========] Running 3 tests from 1 test suite. 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [----------] Global test environment set-up. 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [----------] 3 tests from NeoradosList 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ RUN ] NeoradosList.ListObjects 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ OK ] NeoradosList.ListObjects (20346 ms) 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ RUN ] NeoradosList.ListObjectsNS 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ OK ] NeoradosList.ListObjectsNS (11033 ms) 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ RUN ] NeoradosList.ListObjectsMany 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ OK ] NeoradosList.ListObjectsMany (7627 ms) 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: [----------] 3 tests from NeoradosList (39006 ms total) 2024-02-13T14:48:38.018 INFO:tasks.workunit.client.0.smithi062.stdout: list: 2024-02-13T14:48:38.019 INFO:tasks.workunit.client.0.smithi062.stdout: list: [----------] Global test environment tear-down 2024-02-13T14:48:38.019 INFO:tasks.workunit.client.0.smithi062.stdout: list: [==========] 3 tests from 1 test suite ran. (39007 ms total) 2024-02-13T14:48:38.019 INFO:tasks.workunit.client.0.smithi062.stdout: list: [ PASSED ] 3 tests. 2024-02-13T14:48:38.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: Running main() from gmock_main.cc 2024-02-13T14:48:38.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [==========] Running 9 tests from 2 test suites. 2024-02-13T14:48:38.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] Global test environment set-up. 2024-02-13T14:48:38.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] 5 tests from LibRadosStat 2024-02-13T14:48:38.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.Stat 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.Stat (333 ms) 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.Stat2 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.Stat2 (62 ms) 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.StatNS 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.StatNS (12 ms) 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.ClusterStat 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.ClusterStat (0 ms) 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStat.PoolStat 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStat.PoolStat (26 ms) 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] 5 tests from LibRadosStat (433 ms total) 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] 4 tests from LibRadosStatEC 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStatEC.Stat 2024-02-13T14:48:38.027 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStatEC.Stat (2527 ms) 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStatEC.StatNS 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStatEC.StatNS (15 ms) 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStatEC.ClusterStat 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStatEC.ClusterStat (0 ms) 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ RUN ] LibRadosStatEC.PoolStat 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ OK ] LibRadosStatEC.PoolStat (4 ms) 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] 4 tests from LibRadosStatEC (2546 ms total) 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [----------] Global test environment tear-down 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [==========] 9 tests from 2 test suites ran. (39258 ms total) 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat: [ PASSED ] 9 tests. 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: Running main() from gmock_main.cc 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [==========] Running 16 tests from 2 test suites. 2024-02-13T14:48:38.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] Global test environment set-up. 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] 8 tests from LibRadosLock 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusive 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockExclusive (337 ms) 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockShared 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockShared (14 ms) 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockExclusiveDur 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockExclusiveDur (1010 ms) 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockSharedDur 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockSharedDur (1020 ms) 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.LockMayRenew 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.LockMayRenew (4 ms) 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.Unlock 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.Unlock (4 ms) 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.ListLockers 2024-02-13T14:48:38.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.ListLockers (5 ms) 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLock.BreakLock 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLock.BreakLock (4 ms) 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] 8 tests from LibRadosLock (2398 ms total) 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] 8 tests from LibRadosLockEC 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusive 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusive (1468 ms) 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockShared 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockShared (1069 ms) 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockExclusiveDur 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockExclusiveDur (1020 ms) 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockSharedDur 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockSharedDur (1013 ms) 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.LockMayRenew 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.LockMayRenew (11 ms) 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.Unlock 2024-02-13T14:48:38.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.Unlock (11 ms) 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.ListLockers 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.ListLockers (16 ms) 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ RUN ] LibRadosLockEC.BreakLock 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ OK ] LibRadosLockEC.BreakLock (6 ms) 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] 8 tests from LibRadosLockEC (4614 ms total) 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [----------] Global test environment tear-down 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [==========] 16 tests from 2 test suites ran. (39359 ms total) 2024-02-13T14:48:38.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_lock: [ PASSED ] 16 tests. 2024-02-13T14:48:38.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: cluster 2024-02-13T14:48:35.353505+0000 mgr.y (mgr.14613) 197 : cluster 0 pgmap v147: 820 pgs: 64 unknown, 112 creating+peering, 644 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:48:38.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.544539+0000 mon.a (mon.0) 1038 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:38.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.544832+0000 mon.a (mon.0) 1039 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.545022+0000 mon.a (mon.0) 1040 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:38.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.545195+0000 mon.a (mon.0) 1041 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:38.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.545367+0000 mon.a (mon.0) 1042 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.545555+0000 mon.a (mon.0) 1043 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.545754+0000 mon.a (mon.0) 1044 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.545930+0000 mon.a (mon.0) 1045 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.549049+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.549510+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.551173+0000 mon.c (mon.2) 120 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.551262+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.556463+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: cluster 2024-02-13T14:48:36.558793+0000 mon.a (mon.0) 1046 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: cluster 2024-02-13T14:48:35.353505+0000 mgr.y (mgr.14613) 197 : cluster 0 pgmap v147: 820 pgs: 64 unknown, 112 creating+peering, 644 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:48:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.544539+0000 mon.a (mon.0) 1038 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.544832+0000 mon.a (mon.0) 1039 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.545022+0000 mon.a (mon.0) 1040 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.545195+0000 mon.a (mon.0) 1041 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.545367+0000 mon.a (mon.0) 1042 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.545555+0000 mon.a (mon.0) 1043 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.545754+0000 mon.a (mon.0) 1044 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.545930+0000 mon.a (mon.0) 1045 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.549049+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.549510+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.551173+0000 mon.c (mon.2) 120 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.551262+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.556463+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-13T14:48:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: cluster 2024-02-13T14:48:36.558793+0000 mon.a (mon.0) 1046 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.560003+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.588195+0000 mon.a (mon.0) 1047 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.588645+0000 mon.a (mon.0) 1048 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.588994+0000 mon.a (mon.0) 1049 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.589360+0000 mon.a (mon.0) 1050 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.591299+0000 mon.a (mon.0) 1051 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.592255+0000 mon.a (mon.0) 1052 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.592513+0000 mon.a (mon.0) 1053 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.596007+0000 mon.a (mon.0) 1054 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.596273+0000 mon.a (mon.0) 1055 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.674696+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]: dispatch 2024-02-13T14:48:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[21479]: audit 2024-02-13T14:48:36.763888+0000 mon.c (mon.2) 125 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.560003+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.588195+0000 mon.a (mon.0) 1047 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.588645+0000 mon.a (mon.0) 1048 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.588994+0000 mon.a (mon.0) 1049 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.589360+0000 mon.a (mon.0) 1050 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.591299+0000 mon.a (mon.0) 1051 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.592255+0000 mon.a (mon.0) 1052 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.592513+0000 mon.a (mon.0) 1053 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.596007+0000 mon.a (mon.0) 1054 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.596273+0000 mon.a (mon.0) 1055 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.674696+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]: dispatch 2024-02-13T14:48:38.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:37 smithi062 bash[28859]: audit 2024-02-13T14:48:36.763888+0000 mon.c (mon.2) 125 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: cluster 2024-02-13T14:48:35.353505+0000 mgr.y (mgr.14613) 197 : cluster 0 pgmap v147: 820 pgs: 64 unknown, 112 creating+peering, 644 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:48:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.544539+0000 mon.a (mon.0) 1038 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsNSsmithi062-65398-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.544832+0000 mon.a (mon.0) 1039 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMisc_smithi062-64628-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.545022+0000 mon.a (mon.0) 1040 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.545195+0000 mon.a (mon.0) 1041 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.545367+0000 mon.a (mon.0) 1042 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.545555+0000 mon.a (mon.0) 1043 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.545754+0000 mon.a (mon.0) 1044 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.545930+0000 mon.a (mon.0) 1045 : audit 1 from='client.25376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.549049+0000 mon.c (mon.2) 118 : audit 1 from='client.? v1:172.21.15.62:0/2546970720' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.549510+0000 mon.c (mon.2) 119 : audit 1 from='client.? v1:172.21.15.62:0/2900085579' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.551173+0000 mon.c (mon.2) 120 : audit 1 from='client.? v1:172.21.15.62:0/2182120422' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.551262+0000 mon.c (mon.2) 121 : audit 1 from='client.? v1:172.21.15.62:0/2663081076' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.556463+0000 mon.c (mon.2) 122 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"dne","key":"key","value":"value"}]: dispatch 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: cluster 2024-02-13T14:48:36.558793+0000 mon.a (mon.0) 1046 : cluster 0 osdmap e93: 8 total, 8 up, 8 in 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.560003+0000 mon.c (mon.2) 123 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.588195+0000 mon.a (mon.0) 1047 : audit 1 from='client.25247 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]: dispatch 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.588645+0000 mon.a (mon.0) 1048 : audit 1 from='client.25268 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]: dispatch 2024-02-13T14:48:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.588994+0000 mon.a (mon.0) 1049 : audit 1 from='client.25295 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]: dispatch 2024-02-13T14:48:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.589360+0000 mon.a (mon.0) 1050 : audit 1 from='client.25301 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]: dispatch 2024-02-13T14:48:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.591299+0000 mon.a (mon.0) 1051 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:48:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.592255+0000 mon.a (mon.0) 1052 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.592513+0000 mon.a (mon.0) 1053 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]: dispatch 2024-02-13T14:48:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.596007+0000 mon.a (mon.0) 1054 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.596273+0000 mon.a (mon.0) 1055 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.674696+0000 mon.c (mon.2) 124 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]: dispatch 2024-02-13T14:48:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:37 smithi111 bash[23388]: audit 2024-02-13T14:48:36.763888+0000 mon.c (mon.2) 125 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:39.019 INFO:tasks.workunit.client.0.smithi062.stdout: ] LibRadosIoECPP.OverlappingWriteRoundTripPP 2024-02-13T14:48:39.019 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.OverlappingWriteRoundTripPP (4 ms) 2024-02-13T14:48:39.020 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP 2024-02-13T14:48:39.020 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP (6 ms) 2024-02-13T14:48:39.020 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.WriteFullRoundTripPP2 2024-02-13T14:48:39.020 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.WriteFullRoundTripPP2 (7 ms) 2024-02-13T14:48:39.020 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.AppendRoundTripPP 2024-02-13T14:48:39.020 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.AppendRoundTripPP (5 ms) 2024-02-13T14:48:39.020 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.TruncTestPP 2024-02-13T14:48:39.020 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.TruncTestPP (5 ms) 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RemoveTestPP 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RemoveTestPP (3 ms) 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrsRoundTripPP 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrsRoundTripPP (3 ms) 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.RmXattrPP 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.RmXattrPP (10 ms) 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.XattrListPP 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.XattrListPP (4 ms) 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtPP 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtPP (6 ms) 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtDNEPP 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtDNEPP (4 ms) 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ RUN ] LibRadosIoECPP.CmpExtMismatchPP 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ OK ] LibRadosIoECPP.CmpExtMismatchPP (5 ms) 2024-02-13T14:48:39.021 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] 17 tests from LibRadosIoECPP (2628 ms total) 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [----------] Global test environment tear-down 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [==========] 37 tests from 2 test suites ran. (40366 ms total) 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io_pp: [ PASSED ] 37 tests. 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: Running main() from gmock_main.cc 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [==========] Running 24 tests from 2 test suites. 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] Global test environment set-up. 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] 14 tests from LibRadosIo 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.SimpleWrite 2024-02-13T14:48:39.022 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.SimpleWrite (391 ms) 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.TooBig 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.TooBig (0 ms) 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.ReadTimeout 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: no timeout :/ 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.ReadTimeout (92 ms) 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.RoundTrip 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.RoundTrip (22 ms) 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.Checksum 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.Checksum (3 ms) 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.OverlappingWriteRoundTrip 2024-02-13T14:48:39.023 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.OverlappingWriteRoundTrip (9 ms) 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.WriteFullRoundTrip 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.WriteFullRoundTrip (15 ms) 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.AppendRoundTrip 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.AppendRoundTrip (7 ms) 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.ZeroLenZero 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.ZeroLenZero (2 ms) 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.TruncTest 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.TruncTest (8 ms) 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.RemoveTest 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.RemoveTest (4 ms) 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.XattrsRoundTrip 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.XattrsRoundTrip (5 ms) 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.RmXattr 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.RmXattr (35 ms) 2024-02-13T14:48:39.024 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIo.XattrIter 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIo.XattrIter (8 ms) 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] 14 tests from LibRadosIo (601 ms total) 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] 10 tests from LibRadosIoEC 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.SimpleWrite 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.SimpleWrite (2544 ms) 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.RoundTrip 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.RoundTrip (6 ms) 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.OverlappingWriteRoundTrip 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.OverlappingWriteRoundTrip (7 ms) 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.WriteFullRoundTrip 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.WriteFullRoundTrip (5 ms) 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.AppendRoundTrip 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.AppendRoundTrip (10 ms) 2024-02-13T14:48:39.025 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.TruncTest 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.TruncTest (4 ms) 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.RemoveTest 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.RemoveTest (4 ms) 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.XattrsRoundTrip 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.XattrsRoundTrip (3 ms) 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.RmXattr 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.RmXattr (11 ms) 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ RUN ] LibRadosIoEC.XattrIter 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ OK ] LibRadosIoEC.XattrIter (5 ms) 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] 10 tests from LibRadosIoEC (2599 ms total) 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [----------] Global test environment tear-down 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [==========] 24 tests from 2 test suites ran. (40373 ms total) 2024-02-13T14:48:39.026 INFO:tasks.workunit.client.0.smithi062.stdout: api_io: [ PASSED ] 24 tests. 2024-02-13T14:48:39.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: Running main() from gmock_main.cc 2024-02-13T14:48:39.028 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [==========] Running 11 tests from 2 test suites. 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] Global test environment set-up. 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify_test_cb 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify (345 ms) 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch2Delete 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94347203256880 err -107 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch2Delete (33 ms) 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94347203258928 err -107 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: waiting up to 300 for disconnect notification ... 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete (32 ms) 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2 2024-02-13T14:48:39.029 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 24761 notify_id 339302416385 cookie 94347203263216 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2 (13 ms) 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchNotify2 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 24761 notify_id 339302416384 cookie 94347203263216 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchNotify2 (30 ms) 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioNotify 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 24761 notify_id 339302416386 cookie 94347203263216 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioNotify (8 ms) 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Multi 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 24761 notify_id 339302416384 cookie 94347203263216 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 24761 notify_id 339302416384 cookie 94347203288576 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Multi (17 ms) 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.WatchNotify2Timeout 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 24761 notify_id 339302416384 cookie 94347203263216 2024-02-13T14:48:39.030 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 24761 notify_id 343597383681 cookie 94347203263216 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.WatchNotify2Timeout (3010 ms) 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.Watch3Timeout 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: waiting up to 1024 for osd to time us out ... 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94347203288512 err -107 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_cb from 24761 notify_id 360777252867 cookie 94347203288512 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.Watch3Timeout (5041 ms) 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotify.AioWatchDelete2 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: waiting up to 30 for disconnect notification ... 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify2_test_errcb cookie 94347203333600 err -107 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotify.AioWatchDelete2 (1011 ms) 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] 10 tests from LibRadosWatchNotify (9540 ms total) 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ RUN ] LibRadosWatchNotifyEC.WatchNotify 2024-02-13T14:48:39.031 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: watch_notify_test_cb 2024-02-13T14:48:39.032 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ OK ] LibRadosWatchNotifyEC.WatchNotify (1150 ms) 2024-02-13T14:48:39.032 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] 1 test from LibRadosWatchNotifyEC (1150 ms total) 2024-02-13T14:48:39.032 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: 2024-02-13T14:48:39.032 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [----------] Global test environment tear-down 2024-02-13T14:48:39.032 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [==========] 11 tests from 2 test suites ran. (40239 ms total) 2024-02-13T14:48:39.032 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify: [ PASSED ] 11 tests. 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.513311+0000 mon.a (mon.0) 1056 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]: dispatch 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.765325+0000 mon.c (mon.2) 126 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.982807+0000 mon.a (mon.0) 1057 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.982957+0000 mon.a (mon.0) 1058 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.983152+0000 mon.a (mon.0) 1059 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.983293+0000 mon.a (mon.0) 1060 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.983418+0000 mon.a (mon.0) 1061 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.983562+0000 mon.a (mon.0) 1062 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.983665+0000 mon.a (mon.0) 1063 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]': finished 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.983794+0000 mon.a (mon.0) 1064 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.983983+0000 mon.a (mon.0) 1065 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:39.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.984190+0000 mon.a (mon.0) 1066 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]': finished 2024-02-13T14:48:39.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.993458+0000 mon.c (mon.2) 127 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:39.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.994711+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:39.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.995081+0000 mon.b (mon.1) 143 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:39.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.513311+0000 mon.a (mon.0) 1056 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]: dispatch 2024-02-13T14:48:39.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.765325+0000 mon.c (mon.2) 126 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:39.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.982807+0000 mon.a (mon.0) 1057 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.982957+0000 mon.a (mon.0) 1058 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.983152+0000 mon.a (mon.0) 1059 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.983293+0000 mon.a (mon.0) 1060 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.983418+0000 mon.a (mon.0) 1061 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.983562+0000 mon.a (mon.0) 1062 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:38 smithi062 bash[28859]: audit 2024-02-13T14:48:37.983665+0000 mon.a (mon.0) 1063 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:37.983794+0000 mon.a (mon.0) 1064 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:37.983983+0000 mon.a (mon.0) 1065 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:37.984190+0000 mon.a (mon.0) 1066 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]': finished 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:37.993458+0000 mon.c (mon.2) 127 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:37.994711+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:37.995081+0000 mon.b (mon.1) 143 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:37.995469+0000 mon.b (mon.1) 144 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: cluster 2024-02-13T14:48:38.001742+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.011941+0000 mon.c (mon.2) 128 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.017889+0000 mon.a (mon.0) 1068 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.018759+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.62:0/1980709386' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.019239+0000 mon.a (mon.0) 1069 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.019468+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.020489+0000 mon.a (mon.0) 1070 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.034525+0000 mon.a (mon.0) 1071 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.034820+0000 mon.a (mon.0) 1072 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.035391+0000 mon.a (mon.0) 1073 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.035725+0000 mon.a (mon.0) 1074 : audit 1 from='client.25397 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.036594+0000 mon.a (mon.0) 1075 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[21479]: audit 2024-02-13T14:48:38.038862+0000 mon.a (mon.0) 1076 : audit 1 from='client.? v1:172.21.15.62:0/458610112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:37.995469+0000 mon.b (mon.1) 144 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: cluster 2024-02-13T14:48:38.001742+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.011941+0000 mon.c (mon.2) 128 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.017889+0000 mon.a (mon.0) 1068 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.018759+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.62:0/1980709386' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.019239+0000 mon.a (mon.0) 1069 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.019468+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.020489+0000 mon.a (mon.0) 1070 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:39.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.034525+0000 mon.a (mon.0) 1071 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:39.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.034820+0000 mon.a (mon.0) 1072 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:39.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.035391+0000 mon.a (mon.0) 1073 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:48:39.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.035725+0000 mon.a (mon.0) 1074 : audit 1 from='client.25397 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:39.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.036594+0000 mon.a (mon.0) 1075 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:39.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:39 smithi062 bash[28859]: audit 2024-02-13T14:48:38.038862+0000 mon.a (mon.0) 1076 : audit 1 from='client.? v1:172.21.15.62:0/458610112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:39.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.513311+0000 mon.a (mon.0) 1056 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]: dispatch 2024-02-13T14:48:39.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.765325+0000 mon.c (mon.2) 126 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.982807+0000 mon.a (mon.0) 1057 : audit 1 from='client.25247 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatEC_smithi062-64770-7"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.982957+0000 mon.a (mon.0) 1058 : audit 1 from='client.25268 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockEC_smithi062-64549-10"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.983152+0000 mon.a (mon.0) 1059 : audit 1 from='client.25295 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosLockECPP_smithi062-64557-10"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.983293+0000 mon.a (mon.0) 1060 : audit 1 from='client.25301 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReadOpsmithi062-65304-2"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.983418+0000 mon.a (mon.0) 1061 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.983562+0000 mon.a (mon.0) 1062 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.983665+0000 mon.a (mon.0) 1063 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-4"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.983794+0000 mon.a (mon.0) 1064 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.983983+0000 mon.a (mon.0) 1065 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.984190+0000 mon.a (mon.0) 1066 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64853-6", "pg_num": 4}]': finished 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.993458+0000 mon.c (mon.2) 127 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.994711+0000 mon.b (mon.1) 142 : audit 1 from='client.? v1:172.21.15.62:0/4196534542' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.995081+0000 mon.b (mon.1) 143 : audit 1 from='client.? v1:172.21.15.62:0/2015701429' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:37.995469+0000 mon.b (mon.1) 144 : audit 1 from='client.? v1:172.21.15.62:0/847623985' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: cluster 2024-02-13T14:48:38.001742+0000 mon.a (mon.0) 1067 : cluster 0 osdmap e94: 8 total, 8 up, 8 in 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.011941+0000 mon.c (mon.2) 128 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.017889+0000 mon.a (mon.0) 1068 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.018759+0000 mon.c (mon.2) 129 : audit 1 from='client.? v1:172.21.15.62:0/1980709386' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.019239+0000 mon.a (mon.0) 1069 : audit 1 from='client.25249 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.019468+0000 mon.b (mon.1) 145 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.020489+0000 mon.a (mon.0) 1070 : audit 1 from='client.25219 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.034525+0000 mon.a (mon.0) 1071 : audit 1 from='client.25081 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.034820+0000 mon.a (mon.0) 1072 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.035391+0000 mon.a (mon.0) 1073 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.035725+0000 mon.a (mon.0) 1074 : audit 1 from='client.25397 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.036594+0000 mon.a (mon.0) 1075 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:39.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:39 smithi111 bash[23388]: audit 2024-02-13T14:48:38.038862+0000 mon.a (mon.0) 1076 : audit 1 from='client.? v1:172.21.15.62:0/458610112' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:40.420 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:48:40.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: cluster 2024-02-13T14:48:37.354941+0000 mgr.y (mgr.14613) 198 : cluster 0 pgmap v149: 820 pgs: 136 unknown, 40 creating+peering, 644 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2024-02-13T14:48:40.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.766846+0000 mon.c (mon.2) 130 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: cluster 2024-02-13T14:48:38.985854+0000 mon.a (mon.0) 1077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.996332+0000 mon.a (mon.0) 1078 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.996489+0000 mon.a (mon.0) 1079 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.996627+0000 mon.a (mon.0) 1080 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.996775+0000 mon.a (mon.0) 1081 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.996943+0000 mon.a (mon.0) 1082 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.997243+0000 mon.a (mon.0) 1083 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.997477+0000 mon.a (mon.0) 1084 : audit 1 from='client.25397 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.997666+0000 mon.a (mon.0) 1085 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:38.997852+0000 mon.a (mon.0) 1086 : audit 1 from='client.? v1:172.21.15.62:0/458610112' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.002214+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: cluster 2024-02-13T14:48:39.013369+0000 mon.a (mon.0) 1087 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-02-13T14:48:40.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.013840+0000 mon.b (mon.1) 146 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: cluster 2024-02-13T14:48:37.354941+0000 mgr.y (mgr.14613) 198 : cluster 0 pgmap v149: 820 pgs: 136 unknown, 40 creating+peering, 644 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.766846+0000 mon.c (mon.2) 130 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: cluster 2024-02-13T14:48:38.985854+0000 mon.a (mon.0) 1077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.996332+0000 mon.a (mon.0) 1078 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.996489+0000 mon.a (mon.0) 1079 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.996627+0000 mon.a (mon.0) 1080 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.996775+0000 mon.a (mon.0) 1081 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.996943+0000 mon.a (mon.0) 1082 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.997243+0000 mon.a (mon.0) 1083 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.997477+0000 mon.a (mon.0) 1084 : audit 1 from='client.25397 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.997666+0000 mon.a (mon.0) 1085 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:38.997852+0000 mon.a (mon.0) 1086 : audit 1 from='client.? v1:172.21.15.62:0/458610112' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.002214+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: cluster 2024-02-13T14:48:39.013369+0000 mon.a (mon.0) 1087 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.013840+0000 mon.b (mon.1) 146 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.016394+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.018767+0000 mon.a (mon.0) 1088 : audit 1 from='client.? v1:172.21.15.62:0/2833196118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi062-64731-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.025594+0000 mon.a (mon.0) 1089 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: cluster 2024-02-13T14:48:39.489283+0000 mon.a (mon.0) 1090 : cluster 3 Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: cluster 2024-02-13T14:48:39.489904+0000 mon.a (mon.0) 1091 : cluster 3 pool 'PoolQuotaPP_smithi062-64512-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: cluster 2024-02-13T14:48:39.492614+0000 mon.a (mon.0) 1092 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.495008+0000 mon.a (mon.0) 1093 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.495474+0000 mon.a (mon.0) 1094 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.495847+0000 mon.a (mon.0) 1095 : audit 1 from='client.? v1:172.21.15.62:0/2833196118' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi062-64731-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.496003+0000 mon.a (mon.0) 1096 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]': finished 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.508874+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]: dispatch 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.511893+0000 mon.c (mon.2) 134 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: audit 2024-02-13T14:48:39.768366+0000 mon.c (mon.2) 135 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[21479]: cluster 2024-02-13T14:48:39.965408+0000 mon.a (mon.0) 1097 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.016394+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.018767+0000 mon.a (mon.0) 1088 : audit 1 from='client.? v1:172.21.15.62:0/2833196118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi062-64731-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.025594+0000 mon.a (mon.0) 1089 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: cluster 2024-02-13T14:48:39.489283+0000 mon.a (mon.0) 1090 : cluster 3 Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: cluster 2024-02-13T14:48:39.489904+0000 mon.a (mon.0) 1091 : cluster 3 pool 'PoolQuotaPP_smithi062-64512-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: cluster 2024-02-13T14:48:39.492614+0000 mon.a (mon.0) 1092 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.495008+0000 mon.a (mon.0) 1093 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.495474+0000 mon.a (mon.0) 1094 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.495847+0000 mon.a (mon.0) 1095 : audit 1 from='client.? v1:172.21.15.62:0/2833196118' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi062-64731-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.496003+0000 mon.a (mon.0) 1096 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]': finished 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.508874+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]: dispatch 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.511893+0000 mon.c (mon.2) 134 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: audit 2024-02-13T14:48:39.768366+0000 mon.c (mon.2) 135 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:40 smithi062 bash[28859]: cluster 2024-02-13T14:48:39.965408+0000 mon.a (mon.0) 1097 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-02-13T14:48:40.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: cluster 2024-02-13T14:48:37.354941+0000 mgr.y (mgr.14613) 198 : cluster 0 pgmap v149: 820 pgs: 136 unknown, 40 creating+peering, 644 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 6.4 KiB/s wr, 5 op/s 2024-02-13T14:48:40.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.766846+0000 mon.c (mon.2) 130 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:40.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: cluster 2024-02-13T14:48:38.985854+0000 mon.a (mon.0) 1077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:48:40.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.996332+0000 mon.a (mon.0) 1078 : audit 1 from='client.? v1:172.21.15.62:0/4212254431' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosWatchNotifyEC_smithi062-64828-12"}]': finished 2024-02-13T14:48:40.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.996489+0000 mon.a (mon.0) 1079 : audit 1 from='client.25249 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoEC_smithi062-64520-16"}]': finished 2024-02-13T14:48:40.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.996627+0000 mon.a (mon.0) 1080 : audit 1 from='client.25219 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosIoECPP_smithi062-64528-22"}]': finished 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.996775+0000 mon.a (mon.0) 1081 : audit 1 from='client.25081 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-4", "tierpool": "test-rados-api-smithi062-64695-4-cache"}]': finished 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.996943+0000 mon.a (mon.0) 1082 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.997243+0000 mon.a (mon.0) 1083 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.997477+0000 mon.a (mon.0) 1084 : audit 1 from='client.25397 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip_smithi062-64504-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.997666+0000 mon.a (mon.0) 1085 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:38.997852+0000 mon.a (mon.0) 1086 : audit 1 from='client.? v1:172.21.15.62:0/458610112' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.002214+0000 mon.c (mon.2) 131 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: cluster 2024-02-13T14:48:39.013369+0000 mon.a (mon.0) 1087 : cluster 0 osdmap e95: 8 total, 8 up, 8 in 2024-02-13T14:48:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.013840+0000 mon.b (mon.1) 146 : audit 1 from='client.? v1:172.21.15.62:0/2565029066' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.016394+0000 mon.c (mon.2) 132 : audit 1 from='client.? v1:172.21.15.62:0/2730625795' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.018767+0000 mon.a (mon.0) 1088 : audit 1 from='client.? v1:172.21.15.62:0/2833196118' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi062-64731-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.025594+0000 mon.a (mon.0) 1089 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: cluster 2024-02-13T14:48:39.489283+0000 mon.a (mon.0) 1090 : cluster 3 Health check update: 11 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: cluster 2024-02-13T14:48:39.489904+0000 mon.a (mon.0) 1091 : cluster 3 pool 'PoolQuotaPP_smithi062-64512-3' is full (reached quota's max_bytes: 4 KiB) 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: cluster 2024-02-13T14:48:39.492614+0000 mon.a (mon.0) 1092 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.495008+0000 mon.a (mon.0) 1093 : audit 1 from='client.25316 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.495474+0000 mon.a (mon.0) 1094 : audit 1 from='client.25264 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]: dispatch 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.495847+0000 mon.a (mon.0) 1095 : audit 1 from='client.? v1:172.21.15.62:0/2833196118' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManaged_smithi062-64731-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.496003+0000 mon.a (mon.0) 1096 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "overlaypool": "test-rados-api-smithi062-64853-6"}]': finished 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.508874+0000 mon.c (mon.2) 133 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]: dispatch 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.511893+0000 mon.c (mon.2) 134 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: audit 2024-02-13T14:48:39.768366+0000 mon.c (mon.2) 135 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:40.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:40 smithi111 bash[23388]: cluster 2024-02-13T14:48:39.965408+0000 mon.a (mon.0) 1097 : cluster 0 osdmap e96: 8 total, 8 up, 8 in 2024-02-13T14:48:40.938 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: Running main() from gmock_main.cc 2024-02-13T14:48:40.938 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [==========] Running 9 tests from 2 test suites. 2024-02-13T14:48:40.938 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] Global test environment set-up. 2024-02-13T14:48:40.938 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: seed 64799 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPP 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPP (352 ms) 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.Stat2Mtime2PP 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.Stat2Mtime2PP (8 ms) 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.ClusterStatPP 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.ClusterStatPP (0 ms) 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.PoolStatPP 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.PoolStatPP (5 ms) 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatPP.StatPPNS 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatPP.StatPPNS (20 ms) 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] 5 tests from LibRadosStatPP (386 ms total) 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP 2024-02-13T14:48:40.939 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPP 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPP (2513 ms) 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.ClusterStatPP 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.ClusterStatPP (1 ms) 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.PoolStatPP 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.PoolStatPP (2 ms) 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ RUN ] LibRadosStatECPP.StatPPNS 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ OK ] LibRadosStatECPP.StatPPNS (9 ms) 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] 4 tests from LibRadosStatECPP (2525 ms total) 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [----------] Global test environment tear-down 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [==========] 9 tests from 2 test suites ran. (42152 ms total) 2024-02-13T14:48:40.940 INFO:tasks.workunit.client.0.smithi062.stdout: api_stat_pp: [ PASSED ] 9 tests. 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: Running main() from gmock_main.cc 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [==========] Running 6 tests from 1 test suite. 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [----------] Global test environment set-up. 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [----------] 6 tests from NeoRadosPools 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolList 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolList (17750 ms) 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolLookup 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolLookup (2560 ms) 2024-02-13T14:48:40.999 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolLookupOtherInstance 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolLookupOtherInstance (9223 ms) 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolDelete 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolDelete (6622 ms) 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateDelete 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolCreateDelete (2816 ms) 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ RUN ] NeoRadosPools.PoolCreateWithCrushRule 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ OK ] NeoRadosPools.PoolCreateWithCrushRule (2965 ms) 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [----------] 6 tests from NeoRadosPools (41937 ms total) 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [----------] Global test environment tear-down 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [==========] 6 tests from 1 test suite ran. (41937 ms total) 2024-02-13T14:48:41.000 INFO:tasks.workunit.client.0.smithi062.stdout: pool: [ PASSED ] 6 tests. 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: cluster 2024-02-13T14:48:39.356227+0000 mgr.y (mgr.14613) 199 : cluster 0 pgmap v152: 752 pgs: 204 unknown, 548 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.123262+0000 mgr.y (mgr.14613) 200 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.441007+0000 mon.a (mon.0) 1098 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]: dispatch 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.441607+0000 mon.a (mon.0) 1099 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.770000+0000 mon.c (mon.2) 136 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: cluster 2024-02-13T14:48:40.895377+0000 mon.a (mon.0) 1100 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.899332+0000 mon.a (mon.0) 1101 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]': finished 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.899633+0000 mon.a (mon.0) 1102 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.899875+0000 mon.a (mon.0) 1103 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]': finished 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.900158+0000 mon.a (mon.0) 1104 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.923590+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: cluster 2024-02-13T14:48:40.936697+0000 mon.a (mon.0) 1105 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.937580+0000 mon.b (mon.1) 147 : audit 1 from='client.? v1:172.21.15.62:0/3378682791' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.971305+0000 mon.a (mon.0) 1106 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[28859]: audit 2024-02-13T14:48:40.971680+0000 mon.a (mon.0) 1107 : audit 1 from='client.25429 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: cluster 2024-02-13T14:48:39.356227+0000 mgr.y (mgr.14613) 199 : cluster 0 pgmap v152: 752 pgs: 204 unknown, 548 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.123262+0000 mgr.y (mgr.14613) 200 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.441007+0000 mon.a (mon.0) 1098 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]: dispatch 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.441607+0000 mon.a (mon.0) 1099 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.770000+0000 mon.c (mon.2) 136 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: cluster 2024-02-13T14:48:40.895377+0000 mon.a (mon.0) 1100 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.899332+0000 mon.a (mon.0) 1101 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]': finished 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.899633+0000 mon.a (mon.0) 1102 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.899875+0000 mon.a (mon.0) 1103 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]': finished 2024-02-13T14:48:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.900158+0000 mon.a (mon.0) 1104 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.923590+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: cluster 2024-02-13T14:48:40.936697+0000 mon.a (mon.0) 1105 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-02-13T14:48:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.937580+0000 mon.b (mon.1) 147 : audit 1 from='client.? v1:172.21.15.62:0/3378682791' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.971305+0000 mon.a (mon.0) 1106 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:42 smithi062 bash[21479]: audit 2024-02-13T14:48:40.971680+0000 mon.a (mon.0) 1107 : audit 1 from='client.25429 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:42.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: cluster 2024-02-13T14:48:39.356227+0000 mgr.y (mgr.14613) 199 : cluster 0 pgmap v152: 752 pgs: 204 unknown, 548 active+clean; 145 MiB data, 765 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:48:42.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.123262+0000 mgr.y (mgr.14613) 200 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.441007+0000 mon.a (mon.0) 1098 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]: dispatch 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.441607+0000 mon.a (mon.0) 1099 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.770000+0000 mon.c (mon.2) 136 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: cluster 2024-02-13T14:48:40.895377+0000 mon.a (mon.0) 1100 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.899332+0000 mon.a (mon.0) 1101 : audit 1 from='client.25316 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMisc_smithi062-64628-1","app":"app1","key":"key1"}]': finished 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.899633+0000 mon.a (mon.0) 1102 : audit 1 from='client.25264 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosStatECPP_smithi062-64799-7"}]': finished 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.899875+0000 mon.a (mon.0) 1103 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64853-6", "mode": "writeback"}]': finished 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.900158+0000 mon.a (mon.0) 1104 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.923590+0000 mon.c (mon.2) 137 : audit 1 from='client.? v1:172.21.15.62:0/1056790046' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: cluster 2024-02-13T14:48:40.936697+0000 mon.a (mon.0) 1105 : cluster 0 osdmap e97: 8 total, 8 up, 8 in 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.937580+0000 mon.b (mon.1) 147 : audit 1 from='client.? v1:172.21.15.62:0/3378682791' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.971305+0000 mon.a (mon.0) 1106 : audit 1 from='client.25352 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]: dispatch 2024-02-13T14:48:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:42 smithi111 bash[23388]: audit 2024-02-13T14:48:40.971680+0000 mon.a (mon.0) 1107 : audit 1 from='client.25429 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: cluster 2024-02-13T14:48:41.356900+0000 mgr.y (mgr.14613) 201 : cluster 0 pgmap v155: 712 pgs: 61 creating+peering, 99 unknown, 552 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 4.5 KiB/s wr, 2 op/s 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:41.774458+0000 mon.c (mon.2) 138 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:42.029063+0000 mon.a (mon.0) 1108 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:42.029161+0000 mon.a (mon.0) 1109 : audit 1 from='client.25429 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: cluster 2024-02-13T14:48:42.037369+0000 mon.a (mon.0) 1110 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:42.084163+0000 mon.b (mon.1) 148 : audit 1 from='client.? v1:172.21.15.62:0/1462364618' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:42.084656+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.62:0/1834152627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:42.105688+0000 mon.a (mon.0) 1111 : audit 1 from='client.25444 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:42.106914+0000 mon.a (mon.0) 1112 : audit 1 from='client.25447 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:42.127491+0000 mon.a (mon.0) 1113 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-65398-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[21479]: audit 2024-02-13T14:48:42.775781+0000 mon.c (mon.2) 139 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: cluster 2024-02-13T14:48:41.356900+0000 mgr.y (mgr.14613) 201 : cluster 0 pgmap v155: 712 pgs: 61 creating+peering, 99 unknown, 552 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 4.5 KiB/s wr, 2 op/s 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:41.774458+0000 mon.c (mon.2) 138 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:42.029063+0000 mon.a (mon.0) 1108 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:42.029161+0000 mon.a (mon.0) 1109 : audit 1 from='client.25429 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: cluster 2024-02-13T14:48:42.037369+0000 mon.a (mon.0) 1110 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:42.084163+0000 mon.b (mon.1) 148 : audit 1 from='client.? v1:172.21.15.62:0/1462364618' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:42.084656+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.62:0/1834152627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:42.105688+0000 mon.a (mon.0) 1111 : audit 1 from='client.25444 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:42.106914+0000 mon.a (mon.0) 1112 : audit 1 from='client.25447 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:42.127491+0000 mon.a (mon.0) 1113 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-65398-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:43 smithi062 bash[28859]: audit 2024-02-13T14:48:42.775781+0000 mon.c (mon.2) 139 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:43.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: cluster 2024-02-13T14:48:41.356900+0000 mgr.y (mgr.14613) 201 : cluster 0 pgmap v155: 712 pgs: 61 creating+peering, 99 unknown, 552 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 4.5 KiB/s wr, 2 op/s 2024-02-13T14:48:43.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:41.774458+0000 mon.c (mon.2) 138 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:43.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:42.029063+0000 mon.a (mon.0) 1108 : audit 1 from='client.25352 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsNSsmithi062-65398-2"}]': finished 2024-02-13T14:48:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:42.029161+0000 mon.a (mon.0) 1109 : audit 1 from='client.25429 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: cluster 2024-02-13T14:48:42.037369+0000 mon.a (mon.0) 1110 : cluster 0 osdmap e98: 8 total, 8 up, 8 in 2024-02-13T14:48:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:42.084163+0000 mon.b (mon.1) 148 : audit 1 from='client.? v1:172.21.15.62:0/1462364618' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:42.084656+0000 mon.b (mon.1) 149 : audit 1 from='client.? v1:172.21.15.62:0/1834152627' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:42.105688+0000 mon.a (mon.0) 1111 : audit 1 from='client.25444 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:42.106914+0000 mon.a (mon.0) 1112 : audit 1 from='client.25447 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:42.127491+0000 mon.a (mon.0) 1113 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-65398-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:48:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:43 smithi111 bash[23388]: audit 2024-02-13T14:48:42.775781+0000 mon.c (mon.2) 139 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:44.158 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: Running main() from gmock_main.cc 2024-02-13T14:48:44.158 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [==========] Running 16 tests from 2 test suites. 2024-02-13T14:48:44.158 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] Global test environment set-up. 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotify 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotify (4653 ms) 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyECPP.WatchNotifyTimeout 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyECPP.WatchNotifyTimeout (7 ms) 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] 2 tests from LibRadosWatchNotifyECPP (4660 ms total) 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/0 (117 ms) 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 2024-02-13T14:48:44.159 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify/1 (4350 ms) 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/0 (10 ms) 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotifyTimeout/1 (31 ms) 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235973648 notify_id 416611827716 notifier_gid 25364 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/0 (14 ms) 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235973648 notify_id 416611827717 notifier_gid 25364 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2/1 (6 ms) 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 2024-02-13T14:48:44.160 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235973648 notify_id 416611827718 notifier_gid 25364 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/0 (13 ms) 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235988016 notify_id 416611827716 notifier_gid 25364 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioWatchNotify2/1 (17 ms) 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235988016 notify_id 416611827719 notifier_gid 25364 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/0 (17 ms) 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235973568 notify_id 416611827712 notifier_gid 25364 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.AioNotify/1 (10 ms) 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: trying... 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235973568 notify_id 416611827717 notifier_gid 25364 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: timed out 2024-02-13T14:48:44.161 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushing 2024-02-13T14:48:46.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:45 smithi111 bash[23388]: audit 2024-02-13T14:48:43.043245+0000 mon.a (mon.0) 1114 : audit 1 from='client.25444 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:46.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:45 smithi111 bash[23388]: audit 2024-02-13T14:48:43.043462+0000 mon.a (mon.0) 1115 : audit 1 from='client.25447 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:46.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:45 smithi111 bash[23388]: audit 2024-02-13T14:48:43.043570+0000 mon.a (mon.0) 1116 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-65398-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:46.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:45 smithi111 bash[23388]: cluster 2024-02-13T14:48:43.049003+0000 mon.a (mon.0) 1117 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-02-13T14:48:46.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:45 smithi111 bash[23388]: audit 2024-02-13T14:48:43.061700+0000 mon.a (mon.0) 1118 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi062-65398-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:46.222 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[28859]: audit 2024-02-13T14:48:43.043245+0000 mon.a (mon.0) 1114 : audit 1 from='client.25444 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:46.222 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[28859]: audit 2024-02-13T14:48:43.043462+0000 mon.a (mon.0) 1115 : audit 1 from='client.25447 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:46.223 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[28859]: audit 2024-02-13T14:48:43.043570+0000 mon.a (mon.0) 1116 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-65398-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:46.223 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[28859]: cluster 2024-02-13T14:48:43.049003+0000 mon.a (mon.0) 1117 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-02-13T14:48:46.223 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[28859]: audit 2024-02-13T14:48:43.061700+0000 mon.a (mon.0) 1118 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi062-65398-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:46.223 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[21479]: audit 2024-02-13T14:48:43.043245+0000 mon.a (mon.0) 1114 : audit 1 from='client.25444 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:46.223 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[21479]: audit 2024-02-13T14:48:43.043462+0000 mon.a (mon.0) 1115 : audit 1 from='client.25447 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip2_smithi062-64504-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:46.223 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[21479]: audit 2024-02-13T14:48:43.043570+0000 mon.a (mon.0) 1116 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ListObjectsManysmithi062-65398-3", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:48:46.223 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[21479]: cluster 2024-02-13T14:48:43.049003+0000 mon.a (mon.0) 1117 : cluster 0 osdmap e99: 8 total, 8 up, 8 in 2024-02-13T14:48:46.224 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:45 smithi062 bash[21479]: audit 2024-02-13T14:48:43.061700+0000 mon.a (mon.0) 1118 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi062-65398-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:46.224 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:48:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:48:47.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: cluster 2024-02-13T14:48:43.357617+0000 mgr.y (mgr.14613) 202 : cluster 0 pgmap v158: 616 pgs: 32 creating+peering, 96 unknown, 488 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.5 KiB/s wr, 2 op/s 2024-02-13T14:48:47.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: audit 2024-02-13T14:48:43.777061+0000 mon.c (mon.2) 140 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: audit 2024-02-13T14:48:44.764131+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: audit 2024-02-13T14:48:44.765107+0000 mon.b (mon.1) 150 : audit 1 from='client.? v1:172.21.15.62:0/4171158894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: audit 2024-02-13T14:48:44.785367+0000 mon.c (mon.2) 142 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: audit 2024-02-13T14:48:45.791183+0000 mon.c (mon.2) 143 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: cluster 2024-02-13T14:48:45.817824+0000 mon.a (mon.0) 1119 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-02-13T14:48:47.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: cluster 2024-02-13T14:48:45.827015+0000 mon.a (mon.0) 1120 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: audit 2024-02-13T14:48:45.844429+0000 mon.a (mon.0) 1121 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: audit 2024-02-13T14:48:45.845081+0000 mon.a (mon.0) 1122 : audit 1 from='client.26863 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: audit 2024-02-13T14:48:45.851753+0000 mon.a (mon.0) 1123 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi062-65398-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[28859]: cluster 2024-02-13T14:48:46.445071+0000 mon.a (mon.0) 1124 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: cluster 2024-02-13T14:48:43.357617+0000 mgr.y (mgr.14613) 202 : cluster 0 pgmap v158: 616 pgs: 32 creating+peering, 96 unknown, 488 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.5 KiB/s wr, 2 op/s 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: audit 2024-02-13T14:48:43.777061+0000 mon.c (mon.2) 140 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: audit 2024-02-13T14:48:44.764131+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: audit 2024-02-13T14:48:44.765107+0000 mon.b (mon.1) 150 : audit 1 from='client.? v1:172.21.15.62:0/4171158894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: audit 2024-02-13T14:48:44.785367+0000 mon.c (mon.2) 142 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: audit 2024-02-13T14:48:45.791183+0000 mon.c (mon.2) 143 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: cluster 2024-02-13T14:48:45.817824+0000 mon.a (mon.0) 1119 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-02-13T14:48:47.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: cluster 2024-02-13T14:48:45.827015+0000 mon.a (mon.0) 1120 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:47.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: audit 2024-02-13T14:48:45.844429+0000 mon.a (mon.0) 1121 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: audit 2024-02-13T14:48:45.845081+0000 mon.a (mon.0) 1122 : audit 1 from='client.26863 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: audit 2024-02-13T14:48:45.851753+0000 mon.a (mon.0) 1123 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi062-65398-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:47.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:46 smithi062 bash[21479]: cluster 2024-02-13T14:48:46.445071+0000 mon.a (mon.0) 1124 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-02-13T14:48:47.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: cluster 2024-02-13T14:48:43.357617+0000 mgr.y (mgr.14613) 202 : cluster 0 pgmap v158: 616 pgs: 32 creating+peering, 96 unknown, 488 active+clean; 145 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.5 KiB/s wr, 2 op/s 2024-02-13T14:48:47.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: audit 2024-02-13T14:48:43.777061+0000 mon.c (mon.2) 140 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: audit 2024-02-13T14:48:44.764131+0000 mon.c (mon.2) 141 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: audit 2024-02-13T14:48:44.765107+0000 mon.b (mon.1) 150 : audit 1 from='client.? v1:172.21.15.62:0/4171158894' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: audit 2024-02-13T14:48:44.785367+0000 mon.c (mon.2) 142 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: audit 2024-02-13T14:48:45.791183+0000 mon.c (mon.2) 143 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: cluster 2024-02-13T14:48:45.817824+0000 mon.a (mon.0) 1119 : cluster 0 osdmap e100: 8 total, 8 up, 8 in 2024-02-13T14:48:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: cluster 2024-02-13T14:48:45.827015+0000 mon.a (mon.0) 1120 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: audit 2024-02-13T14:48:45.844429+0000 mon.a (mon.0) 1121 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: audit 2024-02-13T14:48:45.845081+0000 mon.a (mon.0) 1122 : audit 1 from='client.26863 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: audit 2024-02-13T14:48:45.851753+0000 mon.a (mon.0) 1123 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ListObjectsManysmithi062-65398-3", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:46 smithi111 bash[23388]: cluster 2024-02-13T14:48:46.445071+0000 mon.a (mon.0) 1124 : cluster 0 osdmap e101: 8 total, 8 up, 8 in 2024-02-13T14:48:49.058 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[28859]: audit 2024-02-13T14:48:46.793869+0000 mon.c (mon.2) 144 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[28859]: cluster 2024-02-13T14:48:46.920431+0000 mon.a (mon.0) 1125 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[28859]: audit 2024-02-13T14:48:46.926974+0000 mon.a (mon.0) 1126 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[28859]: audit 2024-02-13T14:48:46.942377+0000 mon.b (mon.1) 151 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[28859]: audit 2024-02-13T14:48:46.947435+0000 mon.a (mon.0) 1127 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[28859]: audit 2024-02-13T14:48:46.947513+0000 mon.a (mon.0) 1128 : audit 1 from='client.26863 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[28859]: cluster 2024-02-13T14:48:46.957573+0000 mon.a (mon.0) 1129 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[28859]: audit 2024-02-13T14:48:47.024340+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.62:0/228795072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[21479]: audit 2024-02-13T14:48:46.793869+0000 mon.c (mon.2) 144 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[21479]: cluster 2024-02-13T14:48:46.920431+0000 mon.a (mon.0) 1125 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T14:48:49.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[21479]: audit 2024-02-13T14:48:46.926974+0000 mon.a (mon.0) 1126 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[21479]: audit 2024-02-13T14:48:46.942377+0000 mon.b (mon.1) 151 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[21479]: audit 2024-02-13T14:48:46.947435+0000 mon.a (mon.0) 1127 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[21479]: audit 2024-02-13T14:48:46.947513+0000 mon.a (mon.0) 1128 : audit 1 from='client.26863 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[21479]: cluster 2024-02-13T14:48:46.957573+0000 mon.a (mon.0) 1129 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-02-13T14:48:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:48 smithi062 bash[21479]: audit 2024-02-13T14:48:47.024340+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.62:0/228795072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:48 smithi111 bash[23388]: audit 2024-02-13T14:48:46.793869+0000 mon.c (mon.2) 144 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:48 smithi111 bash[23388]: cluster 2024-02-13T14:48:46.920431+0000 mon.a (mon.0) 1125 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T14:48:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:48 smithi111 bash[23388]: audit 2024-02-13T14:48:46.926974+0000 mon.a (mon.0) 1126 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:48:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:48 smithi111 bash[23388]: audit 2024-02-13T14:48:46.942377+0000 mon.b (mon.1) 151 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:48:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:48 smithi111 bash[23388]: audit 2024-02-13T14:48:46.947435+0000 mon.a (mon.0) 1127 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:48 smithi111 bash[23388]: audit 2024-02-13T14:48:46.947513+0000 mon.a (mon.0) 1128 : audit 1 from='client.26863 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:48 smithi111 bash[23388]: cluster 2024-02-13T14:48:46.957573+0000 mon.a (mon.0) 1129 : cluster 0 osdmap e102: 8 total, 8 up, 8 in 2024-02-13T14:48:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:48 smithi111 bash[23388]: audit 2024-02-13T14:48:47.024340+0000 mon.c (mon.2) 145 : audit 1 from='client.? v1:172.21.15.62:0/228795072' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: cluster 2024-02-13T14:48:45.360291+0000 mgr.y (mgr.14613) 203 : cluster 0 pgmap v160: 648 pgs: 48 creating+peering, 16 unknown, 584 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-02-13T14:48:50.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: cluster 2024-02-13T14:48:47.363122+0000 mgr.y (mgr.14613) 204 : cluster 0 pgmap v163: 656 pgs: 48 creating+peering, 152 unknown, 456 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-02-13T14:48:50.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:47.795958+0000 mon.c (mon.2) 146 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:50.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:48.074293+0000 mon.a (mon.0) 1130 : audit 1 from='client.28331 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:48.103093+0000 mon.b (mon.1) 152 : audit 1 from='client.? v1:172.21.15.62:0/3817093635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:48.108900+0000 mon.b (mon.1) 153 : audit 1 from='client.? v1:172.21.15.62:0/1801345195' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: cluster 2024-02-13T14:48:48.659537+0000 mon.a (mon.0) 1131 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-02-13T14:48:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:48.683969+0000 mon.a (mon.0) 1132 : audit 1 from='client.29488 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:48.684197+0000 mon.a (mon.0) 1133 : audit 1 from='client.29533 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:48.806623+0000 mon.c (mon.2) 147 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:49.086854+0000 mon.a (mon.0) 1134 : audit 1 from='client.28331 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:49.086914+0000 mon.a (mon.0) 1135 : audit 1 from='client.29488 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:49.086959+0000 mon.a (mon.0) 1136 : audit 1 from='client.29533 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: cluster 2024-02-13T14:48:49.092184+0000 mon.a (mon.0) 1137 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-02-13T14:48:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:49.115810+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[28859]: audit 2024-02-13T14:48:49.118092+0000 mon.a (mon.0) 1138 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: cluster 2024-02-13T14:48:45.360291+0000 mgr.y (mgr.14613) 203 : cluster 0 pgmap v160: 648 pgs: 48 creating+peering, 16 unknown, 584 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-02-13T14:48:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: cluster 2024-02-13T14:48:47.363122+0000 mgr.y (mgr.14613) 204 : cluster 0 pgmap v163: 656 pgs: 48 creating+peering, 152 unknown, 456 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-02-13T14:48:50.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:47.795958+0000 mon.c (mon.2) 146 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:50.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:48.074293+0000 mon.a (mon.0) 1130 : audit 1 from='client.28331 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:48.103093+0000 mon.b (mon.1) 152 : audit 1 from='client.? v1:172.21.15.62:0/3817093635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:48.108900+0000 mon.b (mon.1) 153 : audit 1 from='client.? v1:172.21.15.62:0/1801345195' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: cluster 2024-02-13T14:48:48.659537+0000 mon.a (mon.0) 1131 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-02-13T14:48:50.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:48.683969+0000 mon.a (mon.0) 1132 : audit 1 from='client.29488 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:48.684197+0000 mon.a (mon.0) 1133 : audit 1 from='client.29533 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:48.806623+0000 mon.c (mon.2) 147 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:50.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:49.086854+0000 mon.a (mon.0) 1134 : audit 1 from='client.28331 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:49.086914+0000 mon.a (mon.0) 1135 : audit 1 from='client.29488 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:49.086959+0000 mon.a (mon.0) 1136 : audit 1 from='client.29533 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: cluster 2024-02-13T14:48:49.092184+0000 mon.a (mon.0) 1137 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-02-13T14:48:50.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:49.115810+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:50 smithi062 bash[21479]: audit 2024-02-13T14:48:49.118092+0000 mon.a (mon.0) 1138 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:48:50.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: cluster 2024-02-13T14:48:45.360291+0000 mgr.y (mgr.14613) 203 : cluster 0 pgmap v160: 648 pgs: 48 creating+peering, 16 unknown, 584 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.2 KiB/s wr, 5 op/s 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: cluster 2024-02-13T14:48:47.363122+0000 mgr.y (mgr.14613) 204 : cluster 0 pgmap v163: 656 pgs: 48 creating+peering, 152 unknown, 456 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 3 op/s 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:47.795958+0000 mon.c (mon.2) 146 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:48.074293+0000 mon.a (mon.0) 1130 : audit 1 from='client.28331 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:48.103093+0000 mon.b (mon.1) 152 : audit 1 from='client.? v1:172.21.15.62:0/3817093635' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:48.108900+0000 mon.b (mon.1) 153 : audit 1 from='client.? v1:172.21.15.62:0/1801345195' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: cluster 2024-02-13T14:48:48.659537+0000 mon.a (mon.0) 1131 : cluster 0 osdmap e103: 8 total, 8 up, 8 in 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:48.683969+0000 mon.a (mon.0) 1132 : audit 1 from='client.29488 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:48.684197+0000 mon.a (mon.0) 1133 : audit 1 from='client.29533 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:48.806623+0000 mon.c (mon.2) 147 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:49.086854+0000 mon.a (mon.0) 1134 : audit 1 from='client.28331 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosSnapshotsSelfManagedPP_smithi062-64736-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:49.086914+0000 mon.a (mon.0) 1135 : audit 1 from='client.29488 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:49.086959+0000 mon.a (mon.0) 1136 : audit 1 from='client.29533 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTrip3_smithi062-64504-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: cluster 2024-02-13T14:48:49.092184+0000 mon.a (mon.0) 1137 : cluster 0 osdmap e104: 8 total, 8 up, 8 in 2024-02-13T14:48:50.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:49.115810+0000 mon.c (mon.2) 148 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:50.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:50 smithi111 bash[23388]: audit 2024-02-13T14:48:49.118092+0000 mon.a (mon.0) 1138 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.811006+0000 mon.c (mon.2) 149 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.857210+0000 mon.c (mon.2) 150 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.863925+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.866053+0000 mon.c (mon.2) 152 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.878747+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.883377+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.884912+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.890206+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.891971+0000 mon.c (mon.2) 157 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:51.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.892977+0000 mon.c (mon.2) 158 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:51.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:49.895441+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:51.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.256086+0000 osd.1 (osd.1) 5 : cluster 0 16.9 deep-scrub starts 2024-02-13T14:48:51.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.345956+0000 osd.1 (osd.1) 6 : cluster 0 16.9 deep-scrub ok 2024-02-13T14:48:51.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:50.349771+0000 mon.a (mon.0) 1139 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:51.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:50.384800+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.62:0/1633813345' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:51.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:50.439417+0000 mon.c (mon.2) 161 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:51.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: audit 2024-02-13T14:48:50.814351+0000 mon.c (mon.2) 162 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:51.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.957658+0000 mon.a (mon.0) 1140 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-02-13T14:48:51.846 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:51 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.957974+0000 mon.a (mon.0) 1141 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.811006+0000 mon.c (mon.2) 149 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.857210+0000 mon.c (mon.2) 150 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.863925+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.866053+0000 mon.c (mon.2) 152 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.878747+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.883377+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.884912+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.890206+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.891971+0000 mon.c (mon.2) 157 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.892977+0000 mon.c (mon.2) 158 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:49.895441+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.256086+0000 osd.1 (osd.1) 5 : cluster 0 16.9 deep-scrub starts 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.345956+0000 osd.1 (osd.1) 6 : cluster 0 16.9 deep-scrub ok 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:50.349771+0000 mon.a (mon.0) 1139 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:50.384800+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.62:0/1633813345' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:50.439417+0000 mon.c (mon.2) 161 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: audit 2024-02-13T14:48:50.814351+0000 mon.c (mon.2) 162 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.957658+0000 mon.a (mon.0) 1140 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.957974+0000 mon.a (mon.0) 1141 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.811006+0000 mon.c (mon.2) 149 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.857210+0000 mon.c (mon.2) 150 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.863925+0000 mon.c (mon.2) 151 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.866053+0000 mon.c (mon.2) 152 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.878747+0000 mon.c (mon.2) 153 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.883377+0000 mon.c (mon.2) 154 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.884912+0000 mon.c (mon.2) 155 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.890206+0000 mon.c (mon.2) 156 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.891971+0000 mon.c (mon.2) 157 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.892977+0000 mon.c (mon.2) 158 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:49.895441+0000 mon.c (mon.2) 159 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.256086+0000 osd.1 (osd.1) 5 : cluster 0 16.9 deep-scrub starts 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.345956+0000 osd.1 (osd.1) 6 : cluster 0 16.9 deep-scrub ok 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:50.349771+0000 mon.a (mon.0) 1139 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:50.384800+0000 mon.c (mon.2) 160 : audit 1 from='client.? v1:172.21.15.62:0/1633813345' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:52.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:50.439417+0000 mon.c (mon.2) 161 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:52.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: audit 2024-02-13T14:48:50.814351+0000 mon.c (mon.2) 162 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:52.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.957658+0000 mon.a (mon.0) 1140 : cluster 0 osdmap e105: 8 total, 8 up, 8 in 2024-02-13T14:48:52.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:51 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.957974+0000 mon.a (mon.0) 1141 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:49.363879+0000 mgr.y (mgr.14613) 205 : cluster 0 pgmap v166: 624 pgs: 22 creating+peering, 178 unknown, 424 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.858289+0000 mgr.y (mgr.14613) 206 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.864150+0000 mgr.y (mgr.14613) 207 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.870571+0000 mgr.y (mgr.14613) 208 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.879838+0000 mgr.y (mgr.14613) 209 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.884292+0000 mgr.y (mgr.14613) 210 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.885262+0000 mgr.y (mgr.14613) 211 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.890654+0000 mgr.y (mgr.14613) 212 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.892375+0000 mgr.y (mgr.14613) 213 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.894366+0000 mgr.y (mgr.14613) 214 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:53.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:49.895782+0000 mgr.y (mgr.14613) 215 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.006563+0000 osd.3 (osd.3) 7 : cluster 0 16.4 deep-scrub starts 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.011252+0000 osd.3 (osd.3) 8 : cluster 0 16.4 deep-scrub ok 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:50.130279+0000 mgr.y (mgr.14613) 216 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.391042+0000 osd.4 (osd.4) 5 : cluster 0 16.2 deep-scrub starts 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.413803+0000 osd.4 (osd.4) 6 : cluster 0 16.2 deep-scrub ok 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.511664+0000 osd.0 (osd.0) 9 : cluster 0 16.0 deep-scrub starts 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.523122+0000 osd.0 (osd.0) 10 : cluster 0 16.0 deep-scrub ok 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.830550+0000 osd.2 (osd.2) 5 : cluster 0 16.1 deep-scrub starts 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.834396+0000 osd.2 (osd.2) 6 : cluster 0 16.1 deep-scrub ok 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.871064+0000 osd.5 (osd.5) 5 : cluster 0 16.3 deep-scrub starts 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.875028+0000 osd.5 (osd.5) 6 : cluster 0 16.3 deep-scrub ok 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.876554+0000 osd.6 (osd.6) 5 : cluster 0 16.6 deep-scrub starts 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:50.973547+0000 osd.6 (osd.6) 6 : cluster 0 16.6 deep-scrub ok 2024-02-13T14:48:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:51.015112+0000 osd.3 (osd.3) 9 : cluster 0 16.7 deep-scrub starts 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:51.052903+0000 osd.3 (osd.3) 10 : cluster 0 16.7 deep-scrub ok 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:51.543950+0000 mon.a (mon.0) 1142 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:51.554541+0000 mon.a (mon.0) 1143 : audit 1 from='client.31808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:51.557042+0000 mon.a (mon.0) 1144 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:51.816300+0000 mon.c (mon.2) 163 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:51.973396+0000 mon.a (mon.0) 1145 : audit 1 from='client.31808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:51.973510+0000 mon.a (mon.0) 1146 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: cluster 2024-02-13T14:48:51.977064+0000 mon.a (mon.0) 1147 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:51.983497+0000 mon.a (mon.0) 1148 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:52.013840+0000 mon.c (mon.2) 164 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[21479]: audit 2024-02-13T14:48:52.028474+0000 mon.a (mon.0) 1149 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:49.363879+0000 mgr.y (mgr.14613) 205 : cluster 0 pgmap v166: 624 pgs: 22 creating+peering, 178 unknown, 424 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.858289+0000 mgr.y (mgr.14613) 206 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.864150+0000 mgr.y (mgr.14613) 207 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.870571+0000 mgr.y (mgr.14613) 208 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.879838+0000 mgr.y (mgr.14613) 209 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.884292+0000 mgr.y (mgr.14613) 210 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.885262+0000 mgr.y (mgr.14613) 211 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.890654+0000 mgr.y (mgr.14613) 212 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.892375+0000 mgr.y (mgr.14613) 213 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.894366+0000 mgr.y (mgr.14613) 214 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:49.895782+0000 mgr.y (mgr.14613) 215 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.006563+0000 osd.3 (osd.3) 7 : cluster 0 16.4 deep-scrub starts 2024-02-13T14:48:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.011252+0000 osd.3 (osd.3) 8 : cluster 0 16.4 deep-scrub ok 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:50.130279+0000 mgr.y (mgr.14613) 216 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.391042+0000 osd.4 (osd.4) 5 : cluster 0 16.2 deep-scrub starts 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.413803+0000 osd.4 (osd.4) 6 : cluster 0 16.2 deep-scrub ok 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.511664+0000 osd.0 (osd.0) 9 : cluster 0 16.0 deep-scrub starts 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.523122+0000 osd.0 (osd.0) 10 : cluster 0 16.0 deep-scrub ok 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.830550+0000 osd.2 (osd.2) 5 : cluster 0 16.1 deep-scrub starts 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.834396+0000 osd.2 (osd.2) 6 : cluster 0 16.1 deep-scrub ok 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.871064+0000 osd.5 (osd.5) 5 : cluster 0 16.3 deep-scrub starts 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.875028+0000 osd.5 (osd.5) 6 : cluster 0 16.3 deep-scrub ok 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.876554+0000 osd.6 (osd.6) 5 : cluster 0 16.6 deep-scrub starts 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:50.973547+0000 osd.6 (osd.6) 6 : cluster 0 16.6 deep-scrub ok 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:51.015112+0000 osd.3 (osd.3) 9 : cluster 0 16.7 deep-scrub starts 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:51.052903+0000 osd.3 (osd.3) 10 : cluster 0 16.7 deep-scrub ok 2024-02-13T14:48:53.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:51.543950+0000 mon.a (mon.0) 1142 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:51.554541+0000 mon.a (mon.0) 1143 : audit 1 from='client.31808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:51.557042+0000 mon.a (mon.0) 1144 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:51.816300+0000 mon.c (mon.2) 163 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:51.973396+0000 mon.a (mon.0) 1145 : audit 1 from='client.31808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:51.973510+0000 mon.a (mon.0) 1146 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: cluster 2024-02-13T14:48:51.977064+0000 mon.a (mon.0) 1147 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:51.983497+0000 mon.a (mon.0) 1148 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:52.013840+0000 mon.c (mon.2) 164 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:53.566 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:53 smithi062 bash[28859]: audit 2024-02-13T14:48:52.028474+0000 mon.a (mon.0) 1149 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:49.363879+0000 mgr.y (mgr.14613) 205 : cluster 0 pgmap v166: 624 pgs: 22 creating+peering, 178 unknown, 424 active+clean; 145 MiB data, 755 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:48:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.858289+0000 mgr.y (mgr.14613) 206 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.0"}]: dispatch 2024-02-13T14:48:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.864150+0000 mgr.y (mgr.14613) 207 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.1"}]: dispatch 2024-02-13T14:48:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.870571+0000 mgr.y (mgr.14613) 208 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.2"}]: dispatch 2024-02-13T14:48:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.879838+0000 mgr.y (mgr.14613) 209 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.3"}]: dispatch 2024-02-13T14:48:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.884292+0000 mgr.y (mgr.14613) 210 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.4"}]: dispatch 2024-02-13T14:48:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.885262+0000 mgr.y (mgr.14613) 211 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.5"}]: dispatch 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.890654+0000 mgr.y (mgr.14613) 212 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.6"}]: dispatch 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.892375+0000 mgr.y (mgr.14613) 213 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.7"}]: dispatch 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.894366+0000 mgr.y (mgr.14613) 214 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.8"}]: dispatch 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:49.895782+0000 mgr.y (mgr.14613) 215 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "16.9"}]: dispatch 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.006563+0000 osd.3 (osd.3) 7 : cluster 0 16.4 deep-scrub starts 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.011252+0000 osd.3 (osd.3) 8 : cluster 0 16.4 deep-scrub ok 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:50.130279+0000 mgr.y (mgr.14613) 216 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.391042+0000 osd.4 (osd.4) 5 : cluster 0 16.2 deep-scrub starts 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.413803+0000 osd.4 (osd.4) 6 : cluster 0 16.2 deep-scrub ok 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.511664+0000 osd.0 (osd.0) 9 : cluster 0 16.0 deep-scrub starts 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.523122+0000 osd.0 (osd.0) 10 : cluster 0 16.0 deep-scrub ok 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.830550+0000 osd.2 (osd.2) 5 : cluster 0 16.1 deep-scrub starts 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.834396+0000 osd.2 (osd.2) 6 : cluster 0 16.1 deep-scrub ok 2024-02-13T14:48:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.871064+0000 osd.5 (osd.5) 5 : cluster 0 16.3 deep-scrub starts 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.875028+0000 osd.5 (osd.5) 6 : cluster 0 16.3 deep-scrub ok 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.876554+0000 osd.6 (osd.6) 5 : cluster 0 16.6 deep-scrub starts 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:50.973547+0000 osd.6 (osd.6) 6 : cluster 0 16.6 deep-scrub ok 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:51.015112+0000 osd.3 (osd.3) 9 : cluster 0 16.7 deep-scrub starts 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:51.052903+0000 osd.3 (osd.3) 10 : cluster 0 16.7 deep-scrub ok 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:51.543950+0000 mon.a (mon.0) 1142 : cluster 0 osdmap e106: 8 total, 8 up, 8 in 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:51.554541+0000 mon.a (mon.0) 1143 : audit 1 from='client.31808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:51.557042+0000 mon.a (mon.0) 1144 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:51.816300+0000 mon.c (mon.2) 163 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:51.973396+0000 mon.a (mon.0) 1145 : audit 1 from='client.31808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-4","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:51.973510+0000 mon.a (mon.0) 1146 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: cluster 2024-02-13T14:48:51.977064+0000 mon.a (mon.0) 1147 : cluster 0 osdmap e107: 8 total, 8 up, 8 in 2024-02-13T14:48:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:51.983497+0000 mon.a (mon.0) 1148 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:53.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:52.013840+0000 mon.c (mon.2) 164 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:53.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:53 smithi111 bash[23388]: audit 2024-02-13T14:48:52.028474+0000 mon.a (mon.0) 1149 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: a ec_list: Running main() from gmock_main.cc 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [==========] Running 3 tests from 1 test suite. 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [----------] Global test environment set-up. 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [----------] 3 tests from NeoradosECList 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ RUN ] NeoradosECList.ListObjects 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ OK ] NeoradosECList.ListObjects (32375 ms) 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsNS 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsNS (10660 ms) 2024-02-13T14:48:54.331 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ RUN ] NeoradosECList.ListObjectsMany 2024-02-13T14:48:54.332 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ OK ] NeoradosECList.ListObjectsMany (12269 ms) 2024-02-13T14:48:54.332 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [----------] 3 tests from NeoradosECList (55304 ms total) 2024-02-13T14:48:54.332 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: 2024-02-13T14:48:54.332 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [----------] Global test environment tear-down 2024-02-13T14:48:54.332 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [==========] 3 tests from 1 test suite ran. (55305 ms total) 2024-02-13T14:48:54.332 INFO:tasks.workunit.client.0.smithi062.stdout: ec_list: [ PASSED ] 3 tests. 2024-02-13T14:48:54.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: cluster 2024-02-13T14:48:51.364970+0000 mgr.y (mgr.14613) 217 : cluster 0 pgmap v169: 720 pgs: 96 unknown, 32 creating+peering, 592 active+clean; 193 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 12 MiB/s wr, 4 op/s 2024-02-13T14:48:54.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: cluster 2024-02-13T14:48:51.522883+0000 osd.0 (osd.0) 11 : cluster 0 16.8 deep-scrub starts 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: cluster 2024-02-13T14:48:51.525128+0000 osd.0 (osd.0) 12 : cluster 0 16.8 deep-scrub ok 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:52.818841+0000 mon.c (mon.2) 165 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.169003+0000 mon.a (mon.0) 1150 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.169078+0000 mon.a (mon.0) 1151 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]': finished 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.202316+0000 mon.b (mon.1) 154 : audit 1 from='client.? v1:172.21.15.62:0/1418414970' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.207984+0000 mon.b (mon.1) 155 : audit 1 from='client.? v1:172.21.15.62:0/4133945508' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.299914+0000 mon.c (mon.2) 166 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]: dispatch 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.374758+0000 mon.c (mon.2) 167 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: cluster 2024-02-13T14:48:53.761099+0000 mon.a (mon.0) 1152 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.771342+0000 mon.a (mon.0) 1153 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.774414+0000 mon.a (mon.0) 1154 : audit 1 from='client.34729 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[21479]: audit 2024-02-13T14:48:53.775138+0000 mon.a (mon.0) 1155 : audit 1 from='client.34723 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: cluster 2024-02-13T14:48:51.364970+0000 mgr.y (mgr.14613) 217 : cluster 0 pgmap v169: 720 pgs: 96 unknown, 32 creating+peering, 592 active+clean; 193 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 12 MiB/s wr, 4 op/s 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: cluster 2024-02-13T14:48:51.522883+0000 osd.0 (osd.0) 11 : cluster 0 16.8 deep-scrub starts 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: cluster 2024-02-13T14:48:51.525128+0000 osd.0 (osd.0) 12 : cluster 0 16.8 deep-scrub ok 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:52.818841+0000 mon.c (mon.2) 165 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.169003+0000 mon.a (mon.0) 1150 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.169078+0000 mon.a (mon.0) 1151 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]': finished 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.202316+0000 mon.b (mon.1) 154 : audit 1 from='client.? v1:172.21.15.62:0/1418414970' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.207984+0000 mon.b (mon.1) 155 : audit 1 from='client.? v1:172.21.15.62:0/4133945508' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.299914+0000 mon.c (mon.2) 166 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]: dispatch 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.374758+0000 mon.c (mon.2) 167 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:48:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: cluster 2024-02-13T14:48:53.761099+0000 mon.a (mon.0) 1152 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-02-13T14:48:54.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.771342+0000 mon.a (mon.0) 1153 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:54.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.774414+0000 mon.a (mon.0) 1154 : audit 1 from='client.34729 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:54 smithi062 bash[28859]: audit 2024-02-13T14:48:53.775138+0000 mon.a (mon.0) 1155 : audit 1 from='client.34723 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: cluster 2024-02-13T14:48:51.364970+0000 mgr.y (mgr.14613) 217 : cluster 0 pgmap v169: 720 pgs: 96 unknown, 32 creating+peering, 592 active+clean; 193 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 2.2 KiB/s rd, 12 MiB/s wr, 4 op/s 2024-02-13T14:48:54.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: cluster 2024-02-13T14:48:51.522883+0000 osd.0 (osd.0) 11 : cluster 0 16.8 deep-scrub starts 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: cluster 2024-02-13T14:48:51.525128+0000 osd.0 (osd.0) 12 : cluster 0 16.8 deep-scrub ok 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:52.818841+0000 mon.c (mon.2) 165 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.169003+0000 mon.a (mon.0) 1150 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.169078+0000 mon.a (mon.0) 1151 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-7"}]': finished 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.202316+0000 mon.b (mon.1) 154 : audit 1 from='client.? v1:172.21.15.62:0/1418414970' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.207984+0000 mon.b (mon.1) 155 : audit 1 from='client.? v1:172.21.15.62:0/4133945508' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.299914+0000 mon.c (mon.2) 166 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]: dispatch 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.374758+0000 mon.c (mon.2) 167 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: cluster 2024-02-13T14:48:53.761099+0000 mon.a (mon.0) 1152 : cluster 0 osdmap e108: 8 total, 8 up, 8 in 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.771342+0000 mon.a (mon.0) 1153 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi062-65398-3"}]: dispatch 2024-02-13T14:48:54.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.774414+0000 mon.a (mon.0) 1154 : audit 1 from='client.34729 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:54 smithi111 bash[23388]: audit 2024-02-13T14:48:53.775138+0000 mon.a (mon.0) 1155 : audit 1 from='client.34723 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: cluster 2024-02-13T14:48:52.499760+0000 osd.0 (osd.0) 13 : cluster 0 16.5 deep-scrub starts 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: cluster 2024-02-13T14:48:52.548689+0000 osd.0 (osd.0) 14 : cluster 0 16.5 deep-scrub ok 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: cluster 2024-02-13T14:48:53.367024+0000 mgr.y (mgr.14613) 218 : cluster 0 pgmap v172: 648 pgs: 96 unknown, 32 creating+peering, 520 active+clean; 193 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 12 MiB/s wr, 3 op/s 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:53.819964+0000 mon.c (mon.2) 168 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.316754+0000 mon.a (mon.0) 1156 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]: dispatch 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.316976+0000 mon.a (mon.0) 1157 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.327016+0000 mon.a (mon.0) 1158 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.327091+0000 mon.a (mon.0) 1159 : audit 1 from='client.34729 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.327161+0000 mon.a (mon.0) 1160 : audit 1 from='client.34723 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.374453+0000 mon.c (mon.2) 169 : audit 1 from='client.? v1:172.21.15.62:0/130442061' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.381627+0000 mon.b (mon.1) 156 : audit 1 from='client.? v1:172.21.15.62:0/1184307759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.822548+0000 mon.c (mon.2) 170 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: cluster 2024-02-13T14:48:54.914102+0000 mon.a (mon.0) 1161 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.932434+0000 mon.a (mon.0) 1162 : audit 1 from='client.34715 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[21479]: audit 2024-02-13T14:48:54.932854+0000 mon.a (mon.0) 1163 : audit 1 from='client.34762 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: cluster 2024-02-13T14:48:52.499760+0000 osd.0 (osd.0) 13 : cluster 0 16.5 deep-scrub starts 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: cluster 2024-02-13T14:48:52.548689+0000 osd.0 (osd.0) 14 : cluster 0 16.5 deep-scrub ok 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: cluster 2024-02-13T14:48:53.367024+0000 mgr.y (mgr.14613) 218 : cluster 0 pgmap v172: 648 pgs: 96 unknown, 32 creating+peering, 520 active+clean; 193 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 12 MiB/s wr, 3 op/s 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:53.819964+0000 mon.c (mon.2) 168 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.316754+0000 mon.a (mon.0) 1156 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]: dispatch 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.316976+0000 mon.a (mon.0) 1157 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:48:55.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.327016+0000 mon.a (mon.0) 1158 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.327091+0000 mon.a (mon.0) 1159 : audit 1 from='client.34729 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.327161+0000 mon.a (mon.0) 1160 : audit 1 from='client.34723 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.374453+0000 mon.c (mon.2) 169 : audit 1 from='client.? v1:172.21.15.62:0/130442061' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.381627+0000 mon.b (mon.1) 156 : audit 1 from='client.? v1:172.21.15.62:0/1184307759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.822548+0000 mon.c (mon.2) 170 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: cluster 2024-02-13T14:48:54.914102+0000 mon.a (mon.0) 1161 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-02-13T14:48:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.932434+0000 mon.a (mon.0) 1162 : audit 1 from='client.34715 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:55 smithi062 bash[28859]: audit 2024-02-13T14:48:54.932854+0000 mon.a (mon.0) 1163 : audit 1 from='client.34762 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: cluster 2024-02-13T14:48:52.499760+0000 osd.0 (osd.0) 13 : cluster 0 16.5 deep-scrub starts 2024-02-13T14:48:55.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: cluster 2024-02-13T14:48:52.548689+0000 osd.0 (osd.0) 14 : cluster 0 16.5 deep-scrub ok 2024-02-13T14:48:55.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: cluster 2024-02-13T14:48:53.367024+0000 mgr.y (mgr.14613) 218 : cluster 0 pgmap v172: 648 pgs: 96 unknown, 32 creating+peering, 520 active+clean; 193 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 12 MiB/s wr, 3 op/s 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:53.819964+0000 mon.c (mon.2) 168 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.316754+0000 mon.a (mon.0) 1156 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]: dispatch 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.316976+0000 mon.a (mon.0) 1157 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.327016+0000 mon.a (mon.0) 1158 : audit 1 from='client.? v1:172.21.15.62:0/3389589474' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ListObjectsManysmithi062-65398-3"}]': finished 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.327091+0000 mon.a (mon.0) 1159 : audit 1 from='client.34729 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppend_smithi062-64504-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.327161+0000 mon.a (mon.0) 1160 : audit 1 from='client.34723 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64956-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.374453+0000 mon.c (mon.2) 169 : audit 1 from='client.? v1:172.21.15.62:0/130442061' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.381627+0000 mon.b (mon.1) 156 : audit 1 from='client.? v1:172.21.15.62:0/1184307759' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.822548+0000 mon.c (mon.2) 170 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: cluster 2024-02-13T14:48:54.914102+0000 mon.a (mon.0) 1161 : cluster 0 osdmap e109: 8 total, 8 up, 8 in 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.932434+0000 mon.a (mon.0) 1162 : audit 1 from='client.34715 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:55 smithi111 bash[23388]: audit 2024-02-13T14:48:54.932854+0000 mon.a (mon.0) 1163 : audit 1 from='client.34762 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:48:56.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:48:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:48:57.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:55.478925+0000 mon.a (mon.0) 1164 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]': finished 2024-02-13T14:48:57.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:55.479077+0000 mon.a (mon.0) 1165 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:48:57.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:55.479167+0000 mon.a (mon.0) 1166 : audit 1 from='client.34715 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:55.479272+0000 mon.a (mon.0) 1167 : audit 1 from='client.34762 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:55.504991+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:55.510197+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:55.823836+0000 mon.c (mon.2) 173 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: cluster 2024-02-13T14:48:56.065555+0000 mon.a (mon.0) 1168 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: cluster 2024-02-13T14:48:56.077410+0000 mon.a (mon.0) 1169 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:56.080515+0000 mon.a (mon.0) 1170 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[21479]: audit 2024-02-13T14:48:56.082411+0000 mon.a (mon.0) 1171 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:55.478925+0000 mon.a (mon.0) 1164 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]': finished 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:55.479077+0000 mon.a (mon.0) 1165 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:48:57.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:55.479167+0000 mon.a (mon.0) 1166 : audit 1 from='client.34715 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:55.479272+0000 mon.a (mon.0) 1167 : audit 1 from='client.34762 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:55.504991+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:55.510197+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:55.823836+0000 mon.c (mon.2) 173 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: cluster 2024-02-13T14:48:56.065555+0000 mon.a (mon.0) 1168 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-02-13T14:48:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: cluster 2024-02-13T14:48:56.077410+0000 mon.a (mon.0) 1169 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:56.080515+0000 mon.a (mon.0) 1170 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:56 smithi062 bash[28859]: audit 2024-02-13T14:48:56.082411+0000 mon.a (mon.0) 1171 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:57.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:55.478925+0000 mon.a (mon.0) 1164 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4"}]': finished 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:55.479077+0000 mon.a (mon.0) 1165 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:55.479167+0000 mon.a (mon.0) 1166 : audit 1 from='client.34715 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleWritePP_smithi062-64512-5","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:55.479272+0000 mon.a (mon.0) 1167 : audit 1 from='client.34762 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:55.504991+0000 mon.c (mon.2) 171 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:55.510197+0000 mon.c (mon.2) 172 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:55.823836+0000 mon.c (mon.2) 173 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: cluster 2024-02-13T14:48:56.065555+0000 mon.a (mon.0) 1168 : cluster 0 osdmap e110: 8 total, 8 up, 8 in 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: cluster 2024-02-13T14:48:56.077410+0000 mon.a (mon.0) 1169 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:56.080515+0000 mon.a (mon.0) 1170 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]: dispatch 2024-02-13T14:48:57.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:56 smithi111 bash[23388]: audit 2024-02-13T14:48:56.082411+0000 mon.a (mon.0) 1171 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]: dispatch 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: cluster 2024-02-13T14:48:55.370933+0000 mgr.y (mgr.14613) 219 : cluster 0 pgmap v174: 648 pgs: 51 creating+peering, 24 unknown, 573 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 5.5 MiB/s wr, 4 op/s 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: cluster 2024-02-13T14:48:56.640121+0000 mon.a (mon.0) 1172 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: audit 2024-02-13T14:48:56.645044+0000 mon.a (mon.0) 1173 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]': finished 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: audit 2024-02-13T14:48:56.645176+0000 mon.a (mon.0) 1174 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]': finished 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: cluster 2024-02-13T14:48:56.653032+0000 mon.a (mon.0) 1175 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: audit 2024-02-13T14:48:56.671592+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: audit 2024-02-13T14:48:56.689600+0000 mon.a (mon.0) 1176 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: audit 2024-02-13T14:48:56.825079+0000 mon.c (mon.2) 175 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:58.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: audit 2024-02-13T14:48:57.651769+0000 mon.a (mon.0) 1177 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[28859]: cluster 2024-02-13T14:48:57.656027+0000 mon.a (mon.0) 1178 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: cluster 2024-02-13T14:48:55.370933+0000 mgr.y (mgr.14613) 219 : cluster 0 pgmap v174: 648 pgs: 51 creating+peering, 24 unknown, 573 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 5.5 MiB/s wr, 4 op/s 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: cluster 2024-02-13T14:48:56.640121+0000 mon.a (mon.0) 1172 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: audit 2024-02-13T14:48:56.645044+0000 mon.a (mon.0) 1173 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]': finished 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: audit 2024-02-13T14:48:56.645176+0000 mon.a (mon.0) 1174 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]': finished 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: cluster 2024-02-13T14:48:56.653032+0000 mon.a (mon.0) 1175 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: audit 2024-02-13T14:48:56.671592+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: audit 2024-02-13T14:48:56.689600+0000 mon.a (mon.0) 1176 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: audit 2024-02-13T14:48:56.825079+0000 mon.c (mon.2) 175 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: audit 2024-02-13T14:48:57.651769+0000 mon.a (mon.0) 1177 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T14:48:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:57 smithi062 bash[21479]: cluster 2024-02-13T14:48:57.656027+0000 mon.a (mon.0) 1178 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-02-13T14:48:58.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: cluster 2024-02-13T14:48:55.370933+0000 mgr.y (mgr.14613) 219 : cluster 0 pgmap v174: 648 pgs: 51 creating+peering, 24 unknown, 573 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 5.5 MiB/s wr, 4 op/s 2024-02-13T14:48:58.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: cluster 2024-02-13T14:48:56.640121+0000 mon.a (mon.0) 1172 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:48:58.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: audit 2024-02-13T14:48:56.645044+0000 mon.a (mon.0) 1173 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-7"}]': finished 2024-02-13T14:48:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: audit 2024-02-13T14:48:56.645176+0000 mon.a (mon.0) 1174 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP_smithi062-64853-4", "tierpool": "test-rados-api-smithi062-64853-6"}]': finished 2024-02-13T14:48:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: cluster 2024-02-13T14:48:56.653032+0000 mon.a (mon.0) 1175 : cluster 0 osdmap e111: 8 total, 8 up, 8 in 2024-02-13T14:48:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: audit 2024-02-13T14:48:56.671592+0000 mon.c (mon.2) 174 : audit 1 from='client.? v1:172.21.15.62:0/2236740851' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T14:48:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: audit 2024-02-13T14:48:56.689600+0000 mon.a (mon.0) 1176 : audit 1 from='client.25364 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T14:48:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: audit 2024-02-13T14:48:56.825079+0000 mon.c (mon.2) 175 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: audit 2024-02-13T14:48:57.651769+0000 mon.a (mon.0) 1177 : audit 1 from='client.25364 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "test-rados-api-smithi062-64853-6", "pool2": "test-rados-api-smithi062-64853-6", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T14:48:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:57 smithi111 bash[23388]: cluster 2024-02-13T14:48:57.656027+0000 mon.a (mon.0) 1178 : cluster 0 osdmap e112: 8 total, 8 up, 8 in 2024-02-13T14:48:58.886 INFO:tasks.workunit.client.0.smithi062.stdout:pi_watch_notify_pp: flushed 2024-02-13T14:48:58.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/0 (3020 ms) 2024-02-13T14:48:58.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 2024-02-13T14:48:58.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: trying... 2024-02-13T14:48:58.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235988016 notify_id 425201762312 notifier_gid 25364 2024-02-13T14:48:58.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: timed out 2024-02-13T14:48:58.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushing 2024-02-13T14:48:58.887 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushed 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify2Timeout/1 (3010 ms) 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: List watches 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify2 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235988016 notify_id 438086664201 notifier_gid 25364 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify2 done 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: watch_check 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: unwatch2 2024-02-13T14:48:58.888 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushing 2024-02-13T14:48:58.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: done 2024-02-13T14:48:58.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/0 (3034 ms) 2024-02-13T14:48:58.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ RUN ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 2024-02-13T14:48:58.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: List watches 2024-02-13T14:48:58.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify2 2024-02-13T14:48:58.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: handle_notify cookie 94381235973568 notify_id 446676598794 notifier_gid 25364 2024-02-13T14:48:58.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: notify2 done 2024-02-13T14:48:58.889 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: watch_check 2024-02-13T14:48:58.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: unwatch2 2024-02-13T14:48:58.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: flushing 2024-02-13T14:48:58.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: done 2024-02-13T14:48:58.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ OK ] LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP.WatchNotify3/1 (3093 ms) 2024-02-13T14:48:58.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] 14 tests from LibRadosWatchNotifyPPTests/LibRadosWatchNotifyPP (16742 ms total) 2024-02-13T14:48:58.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: 2024-02-13T14:48:58.890 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [----------] Global test environment tear-down 2024-02-13T14:48:58.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [==========] 16 tests from 2 test suites ran. (60068 ms total) 2024-02-13T14:48:58.891 INFO:tasks.workunit.client.0.smithi062.stdout: api_watch_notify_pp: [ PASSED ] 16 tests. 2024-02-13T14:48:59.058 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:48:58 smithi062 bash[21479]: audit 2024-02-13T14:48:57.846726+0000 mon.c (mon.2) 176 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:59.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:48:58 smithi062 bash[28859]: audit 2024-02-13T14:48:57.846726+0000 mon.c (mon.2) 176 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:48:59.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:48:58 smithi111 bash[23388]: audit 2024-02-13T14:48:57.846726+0000 mon.c (mon.2) 176 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:00.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:49:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:49:01.171 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: Running main() from gmock_main.cc 2024-02-13T14:49:01.171 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [==========] Running 8 tests from 2 test suites. 2024-02-13T14:49:01.171 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] Global test environment set-up. 2024-02-13T14:49:01.171 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibradosCWriteOps.NewDelete 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibradosCWriteOps.NewDelete (0 ms) 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] 1 test from LibradosCWriteOps (0 ms total) 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.assertExists 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.assertExists (19468 ms) 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteOpAssertVersion 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteOpAssertVersion (13087 ms) 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Xattrs 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Xattrs (5151 ms) 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Write 2024-02-13T14:49:01.172 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Write (4374 ms) 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.Exec 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.Exec (4950 ms) 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.WriteSame 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.WriteSame (6123 ms) 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ RUN ] LibRadosCWriteOps.CmpExt 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ OK ] LibRadosCWriteOps.CmpExt (9165 ms) 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] 7 tests from LibRadosCWriteOps (62318 ms total) 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [----------] Global test environment tear-down 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [==========] 8 tests from 2 test suites ran. (62318 ms total) 2024-02-13T14:49:01.173 INFO:tasks.workunit.client.0.smithi062.stdout: api_c_write_operations: [ PASSED ] 8 tests. 2024-02-13T14:49:01.308 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:01 smithi062 bash[21479]: cluster 2024-02-13T14:48:58.808766+0000 mon.a (mon.0) 1179 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-02-13T14:49:01.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:01 smithi062 bash[21479]: audit 2024-02-13T14:48:58.858198+0000 mon.c (mon.2) 177 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:01.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:01 smithi062 bash[21479]: audit 2024-02-13T14:48:58.868449+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:01.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:01 smithi062 bash[28859]: cluster 2024-02-13T14:48:58.808766+0000 mon.a (mon.0) 1179 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-02-13T14:49:01.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:01 smithi062 bash[28859]: audit 2024-02-13T14:48:58.858198+0000 mon.c (mon.2) 177 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:01.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:01 smithi062 bash[28859]: audit 2024-02-13T14:48:58.868449+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:01.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:01 smithi111 bash[23388]: cluster 2024-02-13T14:48:58.808766+0000 mon.a (mon.0) 1179 : cluster 0 osdmap e113: 8 total, 8 up, 8 in 2024-02-13T14:49:01.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:01 smithi111 bash[23388]: audit 2024-02-13T14:48:58.858198+0000 mon.c (mon.2) 177 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:01.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:01 smithi111 bash[23388]: audit 2024-02-13T14:48:58.868449+0000 mon.c (mon.2) 178 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: cluster 2024-02-13T14:48:57.371896+0000 mgr.y (mgr.14613) 220 : cluster 0 pgmap v177: 776 pgs: 51 creating+peering, 152 unknown, 573 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 2.9 KiB/s rd, 5.7 MiB/s wr, 5 op/s 2024-02-13T14:49:02.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: cluster 2024-02-13T14:48:59.372661+0000 mgr.y (mgr.14613) 221 : cluster 0 pgmap v180: 612 pgs: 8 creating+peering, 128 unknown, 476 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:02.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:48:59.864270+0000 mon.c (mon.2) 179 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:02.309 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:48:59.982597+0000 mon.a (mon.0) 1180 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:00.025289+0000 mon.b (mon.1) 157 : audit 1 from='client.? v1:172.21.15.62:0/732234174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:00.036558+0000 mon.b (mon.1) 158 : audit 1 from='client.? v1:172.21.15.62:0/2013581214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:00.140461+0000 mgr.y (mgr.14613) 222 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: cluster 2024-02-13T14:49:00.587439+0000 mon.a (mon.0) 1181 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:00.593012+0000 mon.a (mon.0) 1182 : audit 1 from='client.39790 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:00.593591+0000 mon.a (mon.0) 1183 : audit 1 from='client.39793 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:00.865343+0000 mon.c (mon.2) 180 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:01.078395+0000 mon.a (mon.0) 1184 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:01.078687+0000 mon.a (mon.0) 1185 : audit 1 from='client.39790 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:01.079085+0000 mon.a (mon.0) 1186 : audit 1 from='client.39793 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: cluster 2024-02-13T14:49:01.085347+0000 mon.a (mon.0) 1187 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:01.164707+0000 mon.b (mon.1) 159 : audit 1 from='client.? v1:172.21.15.62:0/2592561470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: cluster 2024-02-13T14:49:01.173985+0000 mon.a (mon.0) 1188 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-02-13T14:49:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:01.211305+0000 mon.a (mon.0) 1189 : audit 1 from='client.40489 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:01.255655+0000 mon.c (mon.2) 181 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:01.256441+0000 mon.a (mon.0) 1190 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[21479]: audit 2024-02-13T14:49:01.866650+0000 mon.c (mon.2) 182 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: cluster 2024-02-13T14:48:57.371896+0000 mgr.y (mgr.14613) 220 : cluster 0 pgmap v177: 776 pgs: 51 creating+peering, 152 unknown, 573 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 2.9 KiB/s rd, 5.7 MiB/s wr, 5 op/s 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: cluster 2024-02-13T14:48:59.372661+0000 mgr.y (mgr.14613) 221 : cluster 0 pgmap v180: 612 pgs: 8 creating+peering, 128 unknown, 476 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:48:59.864270+0000 mon.c (mon.2) 179 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:48:59.982597+0000 mon.a (mon.0) 1180 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:00.025289+0000 mon.b (mon.1) 157 : audit 1 from='client.? v1:172.21.15.62:0/732234174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:00.036558+0000 mon.b (mon.1) 158 : audit 1 from='client.? v1:172.21.15.62:0/2013581214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:00.140461+0000 mgr.y (mgr.14613) 222 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: cluster 2024-02-13T14:49:00.587439+0000 mon.a (mon.0) 1181 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-02-13T14:49:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:00.593012+0000 mon.a (mon.0) 1182 : audit 1 from='client.39790 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:00.593591+0000 mon.a (mon.0) 1183 : audit 1 from='client.39793 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:00.865343+0000 mon.c (mon.2) 180 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:01.078395+0000 mon.a (mon.0) 1184 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:01.078687+0000 mon.a (mon.0) 1185 : audit 1 from='client.39790 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:01.079085+0000 mon.a (mon.0) 1186 : audit 1 from='client.39793 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: cluster 2024-02-13T14:49:01.085347+0000 mon.a (mon.0) 1187 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:01.164707+0000 mon.b (mon.1) 159 : audit 1 from='client.? v1:172.21.15.62:0/2592561470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: cluster 2024-02-13T14:49:01.173985+0000 mon.a (mon.0) 1188 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:01.211305+0000 mon.a (mon.0) 1189 : audit 1 from='client.40489 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:01.255655+0000 mon.c (mon.2) 181 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:01.256441+0000 mon.a (mon.0) 1190 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:02 smithi062 bash[28859]: audit 2024-02-13T14:49:01.866650+0000 mon.c (mon.2) 182 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: cluster 2024-02-13T14:48:57.371896+0000 mgr.y (mgr.14613) 220 : cluster 0 pgmap v177: 776 pgs: 51 creating+peering, 152 unknown, 573 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail; 2.9 KiB/s rd, 5.7 MiB/s wr, 5 op/s 2024-02-13T14:49:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: cluster 2024-02-13T14:48:59.372661+0000 mgr.y (mgr.14613) 221 : cluster 0 pgmap v180: 612 pgs: 8 creating+peering, 128 unknown, 476 active+clean; 217 MiB data, 1000 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:48:59.864270+0000 mon.c (mon.2) 179 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:48:59.982597+0000 mon.a (mon.0) 1180 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:00.025289+0000 mon.b (mon.1) 157 : audit 1 from='client.? v1:172.21.15.62:0/732234174' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:00.036558+0000 mon.b (mon.1) 158 : audit 1 from='client.? v1:172.21.15.62:0/2013581214' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:00.140461+0000 mgr.y (mgr.14613) 222 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: cluster 2024-02-13T14:49:00.587439+0000 mon.a (mon.0) 1181 : cluster 0 osdmap e114: 8 total, 8 up, 8 in 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:00.593012+0000 mon.a (mon.0) 1182 : audit 1 from='client.39790 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:00.593591+0000 mon.a (mon.0) 1183 : audit 1 from='client.39793 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:00.865343+0000 mon.c (mon.2) 180 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:01.078395+0000 mon.a (mon.0) 1184 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:01.078687+0000 mon.a (mon.0) 1185 : audit 1 from='client.39790 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "WaitForSafePP_smithi062-64512-6","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:01.079085+0000 mon.a (mon.0) 1186 : audit 1 from='client.39793 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTest_smithi062-64504-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: cluster 2024-02-13T14:49:01.085347+0000 mon.a (mon.0) 1187 : cluster 0 osdmap e115: 8 total, 8 up, 8 in 2024-02-13T14:49:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:01.164707+0000 mon.b (mon.1) 159 : audit 1 from='client.? v1:172.21.15.62:0/2592561470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: cluster 2024-02-13T14:49:01.173985+0000 mon.a (mon.0) 1188 : cluster 0 osdmap e116: 8 total, 8 up, 8 in 2024-02-13T14:49:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:01.211305+0000 mon.a (mon.0) 1189 : audit 1 from='client.40489 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:01.255655+0000 mon.c (mon.2) 181 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:01.256441+0000 mon.a (mon.0) 1190 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:02 smithi111 bash[23388]: audit 2024-02-13T14:49:01.866650+0000 mon.c (mon.2) 182 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:03.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[21479]: audit 2024-02-13T14:49:02.085867+0000 mon.a (mon.0) 1191 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[21479]: audit 2024-02-13T14:49:02.089942+0000 mon.b (mon.1) 160 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[21479]: audit 2024-02-13T14:49:02.177118+0000 mon.a (mon.0) 1192 : audit 1 from='client.40489 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[21479]: audit 2024-02-13T14:49:02.177220+0000 mon.a (mon.0) 1193 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[21479]: cluster 2024-02-13T14:49:02.181644+0000 mon.a (mon.0) 1194 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-02-13T14:49:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[21479]: audit 2024-02-13T14:49:02.193044+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[21479]: audit 2024-02-13T14:49:02.201550+0000 mon.a (mon.0) 1195 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[21479]: audit 2024-02-13T14:49:02.338407+0000 mon.b (mon.1) 161 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:03.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[28859]: audit 2024-02-13T14:49:02.085867+0000 mon.a (mon.0) 1191 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:03.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[28859]: audit 2024-02-13T14:49:02.089942+0000 mon.b (mon.1) 160 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:03.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[28859]: audit 2024-02-13T14:49:02.177118+0000 mon.a (mon.0) 1192 : audit 1 from='client.40489 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:03.817 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[28859]: audit 2024-02-13T14:49:02.177220+0000 mon.a (mon.0) 1193 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:03.818 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[28859]: cluster 2024-02-13T14:49:02.181644+0000 mon.a (mon.0) 1194 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-02-13T14:49:03.818 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[28859]: audit 2024-02-13T14:49:02.193044+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:03.818 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[28859]: audit 2024-02-13T14:49:02.201550+0000 mon.a (mon.0) 1195 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:03.818 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:03 smithi062 bash[28859]: audit 2024-02-13T14:49:02.338407+0000 mon.b (mon.1) 161 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:03.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:03 smithi111 bash[23388]: audit 2024-02-13T14:49:02.085867+0000 mon.a (mon.0) 1191 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:03.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:03 smithi111 bash[23388]: audit 2024-02-13T14:49:02.089942+0000 mon.b (mon.1) 160 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:03.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:03 smithi111 bash[23388]: audit 2024-02-13T14:49:02.177118+0000 mon.a (mon.0) 1192 : audit 1 from='client.40489 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:03.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:03 smithi111 bash[23388]: audit 2024-02-13T14:49:02.177220+0000 mon.a (mon.0) 1193 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:03.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:03 smithi111 bash[23388]: cluster 2024-02-13T14:49:02.181644+0000 mon.a (mon.0) 1194 : cluster 0 osdmap e117: 8 total, 8 up, 8 in 2024-02-13T14:49:03.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:03 smithi111 bash[23388]: audit 2024-02-13T14:49:02.193044+0000 mon.c (mon.2) 183 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:03.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:03 smithi111 bash[23388]: audit 2024-02-13T14:49:02.201550+0000 mon.a (mon.0) 1195 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:03.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:03 smithi111 bash[23388]: audit 2024-02-13T14:49:02.338407+0000 mon.b (mon.1) 161 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:04.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:04 smithi062 bash[21479]: cluster 2024-02-13T14:49:01.373462+0000 mgr.y (mgr.14613) 223 : cluster 0 pgmap v184: 676 pgs: 64 creating+peering, 128 unknown, 484 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-02-13T14:49:04.809 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:04 smithi062 bash[21479]: audit 2024-02-13T14:49:02.868897+0000 mon.c (mon.2) 184 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:04.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:04 smithi062 bash[28859]: cluster 2024-02-13T14:49:01.373462+0000 mgr.y (mgr.14613) 223 : cluster 0 pgmap v184: 676 pgs: 64 creating+peering, 128 unknown, 484 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-02-13T14:49:04.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:04 smithi062 bash[28859]: audit 2024-02-13T14:49:02.868897+0000 mon.c (mon.2) 184 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:04.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:04 smithi111 bash[23388]: cluster 2024-02-13T14:49:01.373462+0000 mgr.y (mgr.14613) 223 : cluster 0 pgmap v184: 676 pgs: 64 creating+peering, 128 unknown, 484 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-02-13T14:49:04.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:04 smithi111 bash[23388]: audit 2024-02-13T14:49:02.868897+0000 mon.c (mon.2) 184 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: cluster 2024-02-13T14:49:03.374158+0000 mgr.y (mgr.14613) 224 : cluster 0 pgmap v186: 548 pgs: 32 creating+peering, 64 unknown, 452 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T14:49:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:03.405721+0000 mon.a (mon.0) 1196 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:03.407873+0000 mon.a (mon.0) 1197 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]': finished 2024-02-13T14:49:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:03.420784+0000 mon.c (mon.2) 185 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]: dispatch 2024-02-13T14:49:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:03.435126+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.62:0/3565440595' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:03.875300+0000 mon.c (mon.2) 187 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:03.961960+0000 mon.b (mon.1) 162 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: cluster 2024-02-13T14:49:04.509742+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: cluster 2024-02-13T14:49:04.511595+0000 mon.a (mon.0) 1199 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:04.521475+0000 mon.a (mon.0) 1200 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]: dispatch 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:04.528834+0000 mon.a (mon.0) 1201 : audit 1 from='client.41981 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:04.529099+0000 mon.a (mon.0) 1202 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: cluster 2024-02-13T14:49:04.539054+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:04.543695+0000 mon.b (mon.1) 163 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:04.546903+0000 mon.a (mon.0) 1204 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:04.547388+0000 mon.b (mon.1) 164 : audit 1 from='client.? v1:172.21.15.62:0/2083120675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:04.548764+0000 mon.a (mon.0) 1205 : audit 1 from='client.43360 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[21479]: audit 2024-02-13T14:49:04.882608+0000 mon.c (mon.2) 188 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:05.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: cluster 2024-02-13T14:49:03.374158+0000 mgr.y (mgr.14613) 224 : cluster 0 pgmap v186: 548 pgs: 32 creating+peering, 64 unknown, 452 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:03.405721+0000 mon.a (mon.0) 1196 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:03.407873+0000 mon.a (mon.0) 1197 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]': finished 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:03.420784+0000 mon.c (mon.2) 185 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]: dispatch 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:03.435126+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.62:0/3565440595' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:03.875300+0000 mon.c (mon.2) 187 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:03.961960+0000 mon.b (mon.1) 162 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: cluster 2024-02-13T14:49:04.509742+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: cluster 2024-02-13T14:49:04.511595+0000 mon.a (mon.0) 1199 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:04.521475+0000 mon.a (mon.0) 1200 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]: dispatch 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:04.528834+0000 mon.a (mon.0) 1201 : audit 1 from='client.41981 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:04.529099+0000 mon.a (mon.0) 1202 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: cluster 2024-02-13T14:49:04.539054+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-02-13T14:49:05.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:04.543695+0000 mon.b (mon.1) 163 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:05.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:04.546903+0000 mon.a (mon.0) 1204 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:05.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:04.547388+0000 mon.b (mon.1) 164 : audit 1 from='client.? v1:172.21.15.62:0/2083120675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:04.548764+0000 mon.a (mon.0) 1205 : audit 1 from='client.43360 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:05 smithi062 bash[28859]: audit 2024-02-13T14:49:04.882608+0000 mon.c (mon.2) 188 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:05.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: cluster 2024-02-13T14:49:03.374158+0000 mgr.y (mgr.14613) 224 : cluster 0 pgmap v186: 548 pgs: 32 creating+peering, 64 unknown, 452 active+clean; 217 MiB data, 1008 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 1 op/s 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:03.405721+0000 mon.a (mon.0) 1196 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:03.407873+0000 mon.a (mon.0) 1197 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-9"}]': finished 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:03.420784+0000 mon.c (mon.2) 185 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]: dispatch 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:03.435126+0000 mon.c (mon.2) 186 : audit 1 from='client.? v1:172.21.15.62:0/3565440595' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:03.875300+0000 mon.c (mon.2) 187 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:03.961960+0000 mon.b (mon.1) 162 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: cluster 2024-02-13T14:49:04.509742+0000 mon.a (mon.0) 1198 : cluster 0 osdmap e118: 8 total, 8 up, 8 in 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: cluster 2024-02-13T14:49:04.511595+0000 mon.a (mon.0) 1199 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:04.521475+0000 mon.a (mon.0) 1200 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]: dispatch 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:04.528834+0000 mon.a (mon.0) 1201 : audit 1 from='client.41981 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:04.529099+0000 mon.a (mon.0) 1202 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: cluster 2024-02-13T14:49:04.539054+0000 mon.a (mon.0) 1203 : cluster 0 osdmap e119: 8 total, 8 up, 8 in 2024-02-13T14:49:05.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:04.543695+0000 mon.b (mon.1) 163 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:04.546903+0000 mon.a (mon.0) 1204 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:04.547388+0000 mon.b (mon.1) 164 : audit 1 from='client.? v1:172.21.15.62:0/2083120675' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:04.548764+0000 mon.a (mon.0) 1205 : audit 1 from='client.43360 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:05 smithi111 bash[23388]: audit 2024-02-13T14:49:04.882608+0000 mon.c (mon.2) 188 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:06.570 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:49:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:49:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:49:07.558 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: cluster 2024-02-13T14:49:05.535382+0000 mon.a (mon.0) 1206 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: audit 2024-02-13T14:49:05.543806+0000 mon.a (mon.0) 1207 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]': finished 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: audit 2024-02-13T14:49:05.543916+0000 mon.a (mon.0) 1208 : audit 1 from='client.41981 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: audit 2024-02-13T14:49:05.544011+0000 mon.a (mon.0) 1209 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: audit 2024-02-13T14:49:05.544110+0000 mon.a (mon.0) 1210 : audit 1 from='client.43360 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: cluster 2024-02-13T14:49:05.548073+0000 mon.a (mon.0) 1211 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: audit 2024-02-13T14:49:05.577071+0000 mon.b (mon.1) 165 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: audit 2024-02-13T14:49:05.578563+0000 mon.a (mon.0) 1212 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: audit 2024-02-13T14:49:05.746586+0000 mon.c (mon.2) 189 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[21479]: audit 2024-02-13T14:49:05.890279+0000 mon.c (mon.2) 190 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:07.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: cluster 2024-02-13T14:49:05.535382+0000 mon.a (mon.0) 1206 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: audit 2024-02-13T14:49:05.543806+0000 mon.a (mon.0) 1207 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]': finished 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: audit 2024-02-13T14:49:05.543916+0000 mon.a (mon.0) 1208 : audit 1 from='client.41981 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: audit 2024-02-13T14:49:05.544011+0000 mon.a (mon.0) 1209 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: audit 2024-02-13T14:49:05.544110+0000 mon.a (mon.0) 1210 : audit 1 from='client.43360 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: cluster 2024-02-13T14:49:05.548073+0000 mon.a (mon.0) 1211 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: audit 2024-02-13T14:49:05.577071+0000 mon.b (mon.1) 165 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: audit 2024-02-13T14:49:05.578563+0000 mon.a (mon.0) 1212 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: audit 2024-02-13T14:49:05.746586+0000 mon.c (mon.2) 189 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:07.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:07 smithi062 bash[28859]: audit 2024-02-13T14:49:05.890279+0000 mon.c (mon.2) 190 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: cluster 2024-02-13T14:49:05.535382+0000 mon.a (mon.0) 1206 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: audit 2024-02-13T14:49:05.543806+0000 mon.a (mon.0) 1207 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-9", "mode": "writeback"}]': finished 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: audit 2024-02-13T14:49:05.543916+0000 mon.a (mon.0) 1208 : audit 1 from='client.41981 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTrip_smithi062-64504-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: audit 2024-02-13T14:49:05.544011+0000 mon.a (mon.0) 1209 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: audit 2024-02-13T14:49:05.544110+0000 mon.a (mon.0) 1210 : audit 1 from='client.43360 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP_smithi062-64512-7","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: cluster 2024-02-13T14:49:05.548073+0000 mon.a (mon.0) 1211 : cluster 0 osdmap e120: 8 total, 8 up, 8 in 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: audit 2024-02-13T14:49:05.577071+0000 mon.b (mon.1) 165 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: audit 2024-02-13T14:49:05.578563+0000 mon.a (mon.0) 1212 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: audit 2024-02-13T14:49:05.746586+0000 mon.c (mon.2) 189 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:07.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:07 smithi111 bash[23388]: audit 2024-02-13T14:49:05.890279+0000 mon.c (mon.2) 190 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:08.334 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [==========] Running 12 tests from 4 test suites. 2024-02-13T14:49:08.334 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] Global test environment set-up. 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMiscVersion.Version 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMiscVersion.Version (0 ms) 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectFailure 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: unable to get monitor info from DNS SRV with service name: ceph-mon 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-13T14:47:58.766+0000 7f389547a880 -1 failed for service _ceph-mon._tcp 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-13T14:47:58.766+0000 7f389547a880 -1 monclient: get_monmap_and_config cannot identify monitors to contact 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectFailure (47 ms) 2024-02-13T14:49:08.335 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMiscConnectFailure.ConnectTimeout 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMiscConnectFailure.ConnectTimeout (2017 ms) 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 2 tests from LibRadosMiscConnectFailure (2064 ms total) 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 1 test from LibRadosMiscPool 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMiscPool.PoolCreationRace 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x561db98f32a0 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 0x561db9c18f40 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: started 2 aios 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x561db98f32a0 2024-02-13T14:49:08.336 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: waiting 0x561db9c18f40 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: done. 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMiscPool.PoolCreationRace (24167 ms) 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 1 test from LibRadosMiscPool (24167 ms total) 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 8 tests from LibRadosMisc 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.ClusterFSID 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.ClusterFSID (0 ms) 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.Exec 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.Exec (146 ms) 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.WriteSame 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.WriteSame (46 ms) 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.CmpExt 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.CmpExt (9 ms) 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.Applications 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.Applications (9357 ms) 2024-02-13T14:49:08.337 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatOSD 2024-02-13T14:49:08.338 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatOSD (1 ms) 2024-02-13T14:49:08.338 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.MinCompatClient 2024-02-13T14:49:08.338 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.MinCompatClient (0 ms) 2024-02-13T14:49:08.338 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ RUN ] LibRadosMisc.ShutdownRace 2024-02-13T14:49:08.338 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ OK ] LibRadosMisc.ShutdownRace (26622 ms) 2024-02-13T14:49:08.338 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] 8 tests from LibRadosMisc (36181 ms total) 2024-02-13T14:49:08.338 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: 2024-02-13T14:49:08.338 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [----------] Global test environment tear-down 2024-02-13T14:49:08.339 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [==========] 12 tests from 4 test suites ran. (69576 ms total) 2024-02-13T14:49:08.339 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc: [ PASSED ] 12 tests. 2024-02-13T14:49:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: cluster 2024-02-13T14:49:05.376806+0000 mgr.y (mgr.14613) 225 : cluster 0 pgmap v189: 644 pgs: 128 creating+peering, 516 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 487 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-13T14:49:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: cluster 2024-02-13T14:49:06.796367+0000 mon.a (mon.0) 1213 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-02-13T14:49:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:06.807953+0000 mon.a (mon.0) 1214 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:06.891300+0000 mon.c (mon.2) 191 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:07.266532+0000 mon.a (mon.0) 1215 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:07.266649+0000 mon.a (mon.0) 1216 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:07.270358+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: cluster 2024-02-13T14:49:07.275367+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:07.295168+0000 mon.a (mon.0) 1218 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:07.302990+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:07.304012+0000 mon.a (mon.0) 1219 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[28859]: audit 2024-02-13T14:49:07.892232+0000 mon.c (mon.2) 194 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: cluster 2024-02-13T14:49:05.376806+0000 mgr.y (mgr.14613) 225 : cluster 0 pgmap v189: 644 pgs: 128 creating+peering, 516 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 487 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: cluster 2024-02-13T14:49:06.796367+0000 mon.a (mon.0) 1213 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-02-13T14:49:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:06.807953+0000 mon.a (mon.0) 1214 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:06.891300+0000 mon.c (mon.2) 191 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:07.266532+0000 mon.a (mon.0) 1215 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:07.266649+0000 mon.a (mon.0) 1216 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:07.270358+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: cluster 2024-02-13T14:49:07.275367+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:07.295168+0000 mon.a (mon.0) 1218 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:07.302990+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:07.304012+0000 mon.a (mon.0) 1219 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:08.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:08 smithi062 bash[21479]: audit 2024-02-13T14:49:07.892232+0000 mon.c (mon.2) 194 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: cluster 2024-02-13T14:49:05.376806+0000 mgr.y (mgr.14613) 225 : cluster 0 pgmap v189: 644 pgs: 128 creating+peering, 516 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 487 B/s rd, 1.2 KiB/s wr, 1 op/s 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: cluster 2024-02-13T14:49:06.796367+0000 mon.a (mon.0) 1213 : cluster 0 osdmap e121: 8 total, 8 up, 8 in 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:06.807953+0000 mon.a (mon.0) 1214 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:06.891300+0000 mon.c (mon.2) 191 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:07.266532+0000 mon.a (mon.0) 1215 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsEC_smithi062-64731-10", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:07.266649+0000 mon.a (mon.0) 1216 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:07.270358+0000 mon.c (mon.2) 192 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: cluster 2024-02-13T14:49:07.275367+0000 mon.a (mon.0) 1217 : cluster 0 osdmap e122: 8 total, 8 up, 8 in 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:07.295168+0000 mon.a (mon.0) 1218 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]: dispatch 2024-02-13T14:49:08.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:07.302990+0000 mon.c (mon.2) 193 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:07.304012+0000 mon.a (mon.0) 1219 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:08 smithi111 bash[23388]: audit 2024-02-13T14:49:07.892232+0000 mon.c (mon.2) 194 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:10.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[21479]: cluster 2024-02-13T14:49:07.377609+0000 mgr.y (mgr.14613) 226 : cluster 0 pgmap v193: 620 pgs: 104 unknown, 64 creating+peering, 452 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-02-13T14:49:10.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[21479]: cluster 2024-02-13T14:49:08.268725+0000 mon.a (mon.0) 1220 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:49:10.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[21479]: audit 2024-02-13T14:49:08.277062+0000 mon.a (mon.0) 1221 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]': finished 2024-02-13T14:49:10.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[21479]: audit 2024-02-13T14:49:08.277296+0000 mon.a (mon.0) 1222 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:10.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[21479]: cluster 2024-02-13T14:49:08.286562+0000 mon.a (mon.0) 1223 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-02-13T14:49:10.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[21479]: audit 2024-02-13T14:49:08.781735+0000 mon.a (mon.0) 1224 : audit 1 from='client.? v1:172.21.15.62:0/2341726104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi062-64504-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:10.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[21479]: audit 2024-02-13T14:49:08.893792+0000 mon.c (mon.2) 195 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:10.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[28859]: cluster 2024-02-13T14:49:07.377609+0000 mgr.y (mgr.14613) 226 : cluster 0 pgmap v193: 620 pgs: 104 unknown, 64 creating+peering, 452 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-02-13T14:49:10.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[28859]: cluster 2024-02-13T14:49:08.268725+0000 mon.a (mon.0) 1220 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:49:10.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[28859]: audit 2024-02-13T14:49:08.277062+0000 mon.a (mon.0) 1221 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]': finished 2024-02-13T14:49:10.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[28859]: audit 2024-02-13T14:49:08.277296+0000 mon.a (mon.0) 1222 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:10.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[28859]: cluster 2024-02-13T14:49:08.286562+0000 mon.a (mon.0) 1223 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-02-13T14:49:10.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[28859]: audit 2024-02-13T14:49:08.781735+0000 mon.a (mon.0) 1224 : audit 1 from='client.? v1:172.21.15.62:0/2341726104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi062-64504-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:10.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:09 smithi062 bash[28859]: audit 2024-02-13T14:49:08.893792+0000 mon.c (mon.2) 195 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:10.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:09 smithi111 bash[23388]: cluster 2024-02-13T14:49:07.377609+0000 mgr.y (mgr.14613) 226 : cluster 0 pgmap v193: 620 pgs: 104 unknown, 64 creating+peering, 452 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.5 KiB/s wr, 4 op/s 2024-02-13T14:49:10.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:09 smithi111 bash[23388]: cluster 2024-02-13T14:49:08.268725+0000 mon.a (mon.0) 1220 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:49:10.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:09 smithi111 bash[23388]: audit 2024-02-13T14:49:08.277062+0000 mon.a (mon.0) 1221 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-9"}]': finished 2024-02-13T14:49:10.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:09 smithi111 bash[23388]: audit 2024-02-13T14:49:08.277296+0000 mon.a (mon.0) 1222 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64716-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:10.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:09 smithi111 bash[23388]: cluster 2024-02-13T14:49:08.286562+0000 mon.a (mon.0) 1223 : cluster 0 osdmap e123: 8 total, 8 up, 8 in 2024-02-13T14:49:10.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:09 smithi111 bash[23388]: audit 2024-02-13T14:49:08.781735+0000 mon.a (mon.0) 1224 : audit 1 from='client.? v1:172.21.15.62:0/2341726104' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattr_smithi062-64504-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:10.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:09 smithi111 bash[23388]: audit 2024-02-13T14:49:08.893792+0000 mon.c (mon.2) 195 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:10.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:49:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: cluster 2024-02-13T14:49:09.378681+0000 mgr.y (mgr.14613) 227 : cluster 0 pgmap v195: 524 pgs: 104 unknown, 420 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: audit 2024-02-13T14:49:09.672691+0000 mon.a (mon.0) 1225 : audit 1 from='client.? v1:172.21.15.62:0/2341726104' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi062-64504-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: audit 2024-02-13T14:49:09.694998+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.62:0/1040162572' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: audit 2024-02-13T14:49:09.695689+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T14:49:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: audit 2024-02-13T14:49:09.895030+0000 mon.c (mon.2) 198 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: cluster 2024-02-13T14:49:10.145041+0000 mon.a (mon.0) 1226 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-02-13T14:49:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: audit 2024-02-13T14:49:10.148771+0000 mon.a (mon.0) 1227 : audit 1 from='client.46376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: audit 2024-02-13T14:49:10.150707+0000 mgr.y (mgr.14613) 228 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[21479]: audit 2024-02-13T14:49:10.581752+0000 mon.a (mon.0) 1228 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: cluster 2024-02-13T14:49:09.378681+0000 mgr.y (mgr.14613) 227 : cluster 0 pgmap v195: 524 pgs: 104 unknown, 420 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: audit 2024-02-13T14:49:09.672691+0000 mon.a (mon.0) 1225 : audit 1 from='client.? v1:172.21.15.62:0/2341726104' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi062-64504-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: audit 2024-02-13T14:49:09.694998+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.62:0/1040162572' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: audit 2024-02-13T14:49:09.695689+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: audit 2024-02-13T14:49:09.895030+0000 mon.c (mon.2) 198 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: cluster 2024-02-13T14:49:10.145041+0000 mon.a (mon.0) 1226 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: audit 2024-02-13T14:49:10.148771+0000 mon.a (mon.0) 1227 : audit 1 from='client.46376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: audit 2024-02-13T14:49:10.150707+0000 mgr.y (mgr.14613) 228 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:10 smithi062 bash[28859]: audit 2024-02-13T14:49:10.581752+0000 mon.a (mon.0) 1228 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T14:49:11.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: cluster 2024-02-13T14:49:09.378681+0000 mgr.y (mgr.14613) 227 : cluster 0 pgmap v195: 524 pgs: 104 unknown, 420 active+clean; 217 MiB data, 977 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: audit 2024-02-13T14:49:09.672691+0000 mon.a (mon.0) 1225 : audit 1 from='client.? v1:172.21.15.62:0/2341726104' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattr_smithi062-64504-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: audit 2024-02-13T14:49:09.694998+0000 mon.c (mon.2) 196 : audit 1 from='client.? v1:172.21.15.62:0/1040162572' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: audit 2024-02-13T14:49:09.695689+0000 mon.c (mon.2) 197 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T14:49:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: audit 2024-02-13T14:49:09.895030+0000 mon.c (mon.2) 198 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: cluster 2024-02-13T14:49:10.145041+0000 mon.a (mon.0) 1226 : cluster 0 osdmap e124: 8 total, 8 up, 8 in 2024-02-13T14:49:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: audit 2024-02-13T14:49:10.148771+0000 mon.a (mon.0) 1227 : audit 1 from='client.46376 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: audit 2024-02-13T14:49:10.150707+0000 mgr.y (mgr.14613) 228 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:11.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:10 smithi111 bash[23388]: audit 2024-02-13T14:49:10.581752+0000 mon.a (mon.0) 1228 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]: dispatch 2024-02-13T14:49:12.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: cluster 2024-02-13T14:49:10.675963+0000 mon.a (mon.0) 1229 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:12.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: audit 2024-02-13T14:49:10.688842+0000 mon.a (mon.0) 1230 : audit 1 from='client.46376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:12.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: audit 2024-02-13T14:49:10.689075+0000 mon.a (mon.0) 1231 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]': finished 2024-02-13T14:49:12.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: cluster 2024-02-13T14:49:10.697969+0000 mon.a (mon.0) 1232 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-02-13T14:49:12.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: audit 2024-02-13T14:49:10.701875+0000 mon.c (mon.2) 199 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: audit 2024-02-13T14:49:10.707140+0000 mon.a (mon.0) 1233 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: audit 2024-02-13T14:49:10.710943+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: audit 2024-02-13T14:49:10.714849+0000 mon.a (mon.0) 1234 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[21479]: audit 2024-02-13T14:49:10.895857+0000 mon.c (mon.2) 201 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: cluster 2024-02-13T14:49:10.675963+0000 mon.a (mon.0) 1229 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: audit 2024-02-13T14:49:10.688842+0000 mon.a (mon.0) 1230 : audit 1 from='client.46376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: audit 2024-02-13T14:49:10.689075+0000 mon.a (mon.0) 1231 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]': finished 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: cluster 2024-02-13T14:49:10.697969+0000 mon.a (mon.0) 1232 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: audit 2024-02-13T14:49:10.701875+0000 mon.c (mon.2) 199 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: audit 2024-02-13T14:49:10.707140+0000 mon.a (mon.0) 1233 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: audit 2024-02-13T14:49:10.710943+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: audit 2024-02-13T14:49:10.714849+0000 mon.a (mon.0) 1234 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:11 smithi062 bash[28859]: audit 2024-02-13T14:49:10.895857+0000 mon.c (mon.2) 201 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:12.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: cluster 2024-02-13T14:49:10.675963+0000 mon.a (mon.0) 1229 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: audit 2024-02-13T14:49:10.688842+0000 mon.a (mon.0) 1230 : audit 1 from='client.46376 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP2_smithi062-64512-8","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: audit 2024-02-13T14:49:10.689075+0000 mon.a (mon.0) 1231 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache", "force_nonempty":""}]': finished 2024-02-13T14:49:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: cluster 2024-02-13T14:49:10.697969+0000 mon.a (mon.0) 1232 : cluster 0 osdmap e125: 8 total, 8 up, 8 in 2024-02-13T14:49:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: audit 2024-02-13T14:49:10.701875+0000 mon.c (mon.2) 199 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: audit 2024-02-13T14:49:10.707140+0000 mon.a (mon.0) 1233 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: audit 2024-02-13T14:49:10.710943+0000 mon.c (mon.2) 200 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: audit 2024-02-13T14:49:10.714849+0000 mon.a (mon.0) 1234 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:11 smithi111 bash[23388]: audit 2024-02-13T14:49:10.895857+0000 mon.c (mon.2) 201 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:13 smithi111 bash[23388]: audit 2024-02-13T14:49:11.694931+0000 mon.a (mon.0) 1235 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:13 smithi111 bash[23388]: audit 2024-02-13T14:49:11.695250+0000 mon.a (mon.0) 1236 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:13 smithi111 bash[23388]: cluster 2024-02-13T14:49:11.704460+0000 mon.a (mon.0) 1237 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-02-13T14:49:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:13 smithi111 bash[23388]: audit 2024-02-13T14:49:11.724163+0000 mon.a (mon.0) 1238 : audit 1 from='client.? v1:172.21.15.62:0/45814338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi062-64504-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:13 smithi111 bash[23388]: audit 2024-02-13T14:49:11.744986+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]: dispatch 2024-02-13T14:49:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:13 smithi111 bash[23388]: audit 2024-02-13T14:49:11.745706+0000 mon.a (mon.0) 1239 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]: dispatch 2024-02-13T14:49:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:13 smithi111 bash[23388]: audit 2024-02-13T14:49:11.896623+0000 mon.c (mon.2) 203 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:13 smithi111 bash[23388]: audit 2024-02-13T14:49:12.897688+0000 mon.c (mon.2) 204 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:14.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[28859]: audit 2024-02-13T14:49:11.694931+0000 mon.a (mon.0) 1235 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:14.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[28859]: audit 2024-02-13T14:49:11.695250+0000 mon.a (mon.0) 1236 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:14.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[28859]: cluster 2024-02-13T14:49:11.704460+0000 mon.a (mon.0) 1237 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-02-13T14:49:14.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[28859]: audit 2024-02-13T14:49:11.724163+0000 mon.a (mon.0) 1238 : audit 1 from='client.? v1:172.21.15.62:0/45814338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi062-64504-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:14.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[28859]: audit 2024-02-13T14:49:11.744986+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]: dispatch 2024-02-13T14:49:14.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[28859]: audit 2024-02-13T14:49:11.745706+0000 mon.a (mon.0) 1239 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]: dispatch 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[28859]: audit 2024-02-13T14:49:11.896623+0000 mon.c (mon.2) 203 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[28859]: audit 2024-02-13T14:49:12.897688+0000 mon.c (mon.2) 204 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[21479]: audit 2024-02-13T14:49:11.694931+0000 mon.a (mon.0) 1235 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64716-10-cache", "mode":"readonly", "yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[21479]: audit 2024-02-13T14:49:11.695250+0000 mon.a (mon.0) 1236 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[21479]: cluster 2024-02-13T14:49:11.704460+0000 mon.a (mon.0) 1237 : cluster 0 osdmap e126: 8 total, 8 up, 8 in 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[21479]: audit 2024-02-13T14:49:11.724163+0000 mon.a (mon.0) 1238 : audit 1 from='client.? v1:172.21.15.62:0/45814338' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrIter_smithi062-64504-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[21479]: audit 2024-02-13T14:49:11.744986+0000 mon.c (mon.2) 202 : audit 1 from='client.? v1:172.21.15.62:0/686937623' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]: dispatch 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[21479]: audit 2024-02-13T14:49:11.745706+0000 mon.a (mon.0) 1239 : audit 1 from='client.45557 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]: dispatch 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[21479]: audit 2024-02-13T14:49:11.896623+0000 mon.c (mon.2) 203 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:13 smithi062 bash[21479]: audit 2024-02-13T14:49:12.897688+0000 mon.c (mon.2) 204 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: cluster 2024-02-13T14:49:11.379845+0000 mgr.y (mgr.14613) 229 : cluster 0 pgmap v198: 620 pgs: 41 creating+peering, 119 unknown, 460 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 747 B/s rd, 249 B/s wr, 1 op/s 2024-02-13T14:49:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: audit 2024-02-13T14:49:13.106313+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.62:0/45814338' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi062-64504-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: audit 2024-02-13T14:49:13.106550+0000 mon.a (mon.0) 1241 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]': finished 2024-02-13T14:49:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: audit 2024-02-13T14:49:13.127058+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.62:0/2096234651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: cluster 2024-02-13T14:49:13.585243+0000 mon.a (mon.0) 1242 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-02-13T14:49:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: audit 2024-02-13T14:49:13.601387+0000 mon.a (mon.0) 1243 : audit 1 from='client.46391 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: audit 2024-02-13T14:49:13.899132+0000 mon.c (mon.2) 206 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: audit 2024-02-13T14:49:14.112002+0000 mon.a (mon.0) 1244 : audit 1 from='client.46391 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[28859]: cluster 2024-02-13T14:49:14.124482+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: cluster 2024-02-13T14:49:11.379845+0000 mgr.y (mgr.14613) 229 : cluster 0 pgmap v198: 620 pgs: 41 creating+peering, 119 unknown, 460 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 747 B/s rd, 249 B/s wr, 1 op/s 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: audit 2024-02-13T14:49:13.106313+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.62:0/45814338' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi062-64504-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: audit 2024-02-13T14:49:13.106550+0000 mon.a (mon.0) 1241 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]': finished 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: audit 2024-02-13T14:49:13.127058+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.62:0/2096234651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: cluster 2024-02-13T14:49:13.585243+0000 mon.a (mon.0) 1242 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: audit 2024-02-13T14:49:13.601387+0000 mon.a (mon.0) 1243 : audit 1 from='client.46391 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: audit 2024-02-13T14:49:13.899132+0000 mon.c (mon.2) 206 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: audit 2024-02-13T14:49:14.112002+0000 mon.a (mon.0) 1244 : audit 1 from='client.46391 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:14 smithi062 bash[21479]: cluster 2024-02-13T14:49:14.124482+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-02-13T14:49:15.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: cluster 2024-02-13T14:49:11.379845+0000 mgr.y (mgr.14613) 229 : cluster 0 pgmap v198: 620 pgs: 41 creating+peering, 119 unknown, 460 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 747 B/s rd, 249 B/s wr, 1 op/s 2024-02-13T14:49:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: audit 2024-02-13T14:49:13.106313+0000 mon.a (mon.0) 1240 : audit 1 from='client.? v1:172.21.15.62:0/45814338' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrIter_smithi062-64504-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: audit 2024-02-13T14:49:13.106550+0000 mon.a (mon.0) 1241 : audit 1 from='client.45557 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64716-10", "tierpool":"test-rados-api-smithi062-64716-10-cache"}]': finished 2024-02-13T14:49:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: audit 2024-02-13T14:49:13.127058+0000 mon.c (mon.2) 205 : audit 1 from='client.? v1:172.21.15.62:0/2096234651' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: cluster 2024-02-13T14:49:13.585243+0000 mon.a (mon.0) 1242 : cluster 0 osdmap e127: 8 total, 8 up, 8 in 2024-02-13T14:49:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: audit 2024-02-13T14:49:13.601387+0000 mon.a (mon.0) 1243 : audit 1 from='client.46391 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: audit 2024-02-13T14:49:13.899132+0000 mon.c (mon.2) 206 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: audit 2024-02-13T14:49:14.112002+0000 mon.a (mon.0) 1244 : audit 1 from='client.46391 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-9","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:14 smithi111 bash[23388]: cluster 2024-02-13T14:49:14.124482+0000 mon.a (mon.0) 1245 : cluster 0 osdmap e128: 8 total, 8 up, 8 in 2024-02-13T14:49:15.138 INFO:tasks.workunit.client.0.smithi062.stdout: misc: Running main() from gmock_main.cc 2024-02-13T14:49:15.138 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [==========] Running 12 tests from 1 test suite. 2024-02-13T14:49:15.138 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [----------] Global test environment set-up. 2024-02-13T14:49:15.138 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [----------] 12 tests from NeoRadosMisc 2024-02-13T14:49:15.138 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.Version 2024-02-13T14:49:15.138 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.Version (17759 ms) 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.WaitOSDMap 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.WaitOSDMap (8118 ms) 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.LongName 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.LongName (10742 ms) 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.LongLocator 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.LongLocator (3865 ms) 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.LongNamespace 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.LongNamespace (3557 ms) 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.LongAttrName 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.LongAttrName (6035 ms) 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.Exec 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.Exec (5270 ms) 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.Operate1 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.Operate1 (5685 ms) 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.Operate2 2024-02-13T14:49:15.139 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.Operate2 (4486 ms) 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.BigObject 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.BigObject (3774 ms) 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.BigAttr 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.BigAttr (3396 ms) 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ RUN ] NeoRadosMisc.WriteSame 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ OK ] NeoRadosMisc.WriteSame (3419 ms) 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [----------] 12 tests from NeoRadosMisc (76106 ms total) 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [----------] Global test environment tear-down 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [==========] 12 tests from 1 test suite ran. (76107 ms total) 2024-02-13T14:49:15.140 INFO:tasks.workunit.client.0.smithi062.stdout: misc: [ PASSED ] 12 tests. 2024-02-13T14:49:15.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: Running main() from gmock_main.cc 2024-02-13T14:49:15.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [==========] Running 9 tests from 1 test suite. 2024-02-13T14:49:15.141 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [----------] Global test environment set-up. 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [----------] 9 tests from LibRadosPools 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolList 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolList (19585 ms) 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup (9831 ms) 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookup2 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolLookup2 (5095 ms) 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolLookupOtherInstance 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolLookupOtherInstance (4790 ms) 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolReverseLookupOtherInstance 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolReverseLookupOtherInstance (5041 ms) 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolDelete 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolDelete (8935 ms) 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateDelete 2024-02-13T14:49:15.142 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateDelete (6835 ms) 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolCreateWithCrushRule 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolCreateWithCrushRule (7407 ms) 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ RUN ] LibRadosPools.PoolGetBaseTier 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ OK ] LibRadosPools.PoolGetBaseTier (8888 ms) 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [----------] 9 tests from LibRadosPools (76407 ms total) 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [----------] Global test environment tear-down 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [==========] 9 tests from 1 test suite ran. (76407 ms total) 2024-02-13T14:49:15.143 INFO:tasks.workunit.client.0.smithi062.stdout: api_pool: [ PASSED ] 9 tests. 2024-02-13T14:49:16.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: cluster 2024-02-13T14:49:13.380977+0000 mgr.y (mgr.14613) 230 : cluster 0 pgmap v201: 620 pgs: 15 creating+peering, 177 unknown, 428 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:49:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: audit 2024-02-13T14:49:14.248337+0000 mon.c (mon.2) 207 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: audit 2024-02-13T14:49:14.668592+0000 mon.a (mon.0) 1246 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: audit 2024-02-13T14:49:14.900798+0000 mon.c (mon.2) 208 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: audit 2024-02-13T14:49:15.116060+0000 mon.a (mon.0) 1247 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: cluster 2024-02-13T14:49:15.127554+0000 mon.a (mon.0) 1248 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-02-13T14:49:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: audit 2024-02-13T14:49:15.132509+0000 mon.c (mon.2) 209 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:16.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: audit 2024-02-13T14:49:15.143320+0000 mon.a (mon.0) 1249 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:16.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:16 smithi111 bash[23388]: audit 2024-02-13T14:49:15.143912+0000 mon.a (mon.0) 1250 : audit 1 from='client.? v1:172.21.15.62:0/3189221568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi062-64504-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:49:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: cluster 2024-02-13T14:49:13.380977+0000 mgr.y (mgr.14613) 230 : cluster 0 pgmap v201: 620 pgs: 15 creating+peering, 177 unknown, 428 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: audit 2024-02-13T14:49:14.248337+0000 mon.c (mon.2) 207 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: audit 2024-02-13T14:49:14.668592+0000 mon.a (mon.0) 1246 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: audit 2024-02-13T14:49:14.900798+0000 mon.c (mon.2) 208 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: audit 2024-02-13T14:49:15.116060+0000 mon.a (mon.0) 1247 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: cluster 2024-02-13T14:49:15.127554+0000 mon.a (mon.0) 1248 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: audit 2024-02-13T14:49:15.132509+0000 mon.c (mon.2) 209 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:16.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: audit 2024-02-13T14:49:15.143320+0000 mon.a (mon.0) 1249 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[28859]: audit 2024-02-13T14:49:15.143912+0000 mon.a (mon.0) 1250 : audit 1 from='client.? v1:172.21.15.62:0/3189221568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi062-64504-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: cluster 2024-02-13T14:49:13.380977+0000 mgr.y (mgr.14613) 230 : cluster 0 pgmap v201: 620 pgs: 15 creating+peering, 177 unknown, 428 active+clean; 217 MiB data, 1004 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: audit 2024-02-13T14:49:14.248337+0000 mon.c (mon.2) 207 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: audit 2024-02-13T14:49:14.668592+0000 mon.a (mon.0) 1246 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: audit 2024-02-13T14:49:14.900798+0000 mon.c (mon.2) 208 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: audit 2024-02-13T14:49:15.116060+0000 mon.a (mon.0) 1247 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: cluster 2024-02-13T14:49:15.127554+0000 mon.a (mon.0) 1248 : cluster 0 osdmap e129: 8 total, 8 up, 8 in 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: audit 2024-02-13T14:49:15.132509+0000 mon.c (mon.2) 209 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: audit 2024-02-13T14:49:15.143320+0000 mon.a (mon.0) 1249 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:16.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:16 smithi062 bash[21479]: audit 2024-02-13T14:49:15.143912+0000 mon.a (mon.0) 1250 : audit 1 from='client.? v1:172.21.15.62:0/3189221568' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsComplete_smithi062-64504-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: cluster 2024-02-13T14:49:15.382070+0000 mgr.y (mgr.14613) 231 : cluster 0 pgmap v204: 492 pgs: 32 creating+peering, 32 unknown, 428 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 3 op/s 2024-02-13T14:49:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:15.902436+0000 mon.c (mon.2) 210 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.120842+0000 mon.a (mon.0) 1251 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]': finished 2024-02-13T14:49:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.120911+0000 mon.a (mon.0) 1252 : audit 1 from='client.? v1:172.21.15.62:0/3189221568' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi062-64504-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: cluster 2024-02-13T14:49:16.124249+0000 mon.a (mon.0) 1253 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-02-13T14:49:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.131797+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]: dispatch 2024-02-13T14:49:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.133914+0000 mon.c (mon.2) 212 : audit 1 from='client.? v1:172.21.15.62:0/921269555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.137078+0000 mon.a (mon.0) 1254 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]: dispatch 2024-02-13T14:49:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.137394+0000 mon.a (mon.0) 1255 : audit 1 from='client.46412 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: cluster 2024-02-13T14:49:16.228387+0000 mon.a (mon.0) 1256 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: cluster 2024-02-13T14:49:16.229219+0000 mon.a (mon.0) 1257 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.230940+0000 mon.a (mon.0) 1258 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]': finished 2024-02-13T14:49:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.231037+0000 mon.a (mon.0) 1259 : audit 1 from='client.46412 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: cluster 2024-02-13T14:49:16.238927+0000 mon.a (mon.0) 1260 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-02-13T14:49:17.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:17 smithi111 bash[23388]: audit 2024-02-13T14:49:16.904012+0000 mon.c (mon.2) 213 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:17.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: cluster 2024-02-13T14:49:15.382070+0000 mgr.y (mgr.14613) 231 : cluster 0 pgmap v204: 492 pgs: 32 creating+peering, 32 unknown, 428 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 3 op/s 2024-02-13T14:49:17.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:15.902436+0000 mon.c (mon.2) 210 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:17.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.120842+0000 mon.a (mon.0) 1251 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]': finished 2024-02-13T14:49:17.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.120911+0000 mon.a (mon.0) 1252 : audit 1 from='client.? v1:172.21.15.62:0/3189221568' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi062-64504-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: cluster 2024-02-13T14:49:16.124249+0000 mon.a (mon.0) 1253 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.131797+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]: dispatch 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.133914+0000 mon.c (mon.2) 212 : audit 1 from='client.? v1:172.21.15.62:0/921269555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.137078+0000 mon.a (mon.0) 1254 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]: dispatch 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.137394+0000 mon.a (mon.0) 1255 : audit 1 from='client.46412 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: cluster 2024-02-13T14:49:16.228387+0000 mon.a (mon.0) 1256 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: cluster 2024-02-13T14:49:16.229219+0000 mon.a (mon.0) 1257 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.230940+0000 mon.a (mon.0) 1258 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]': finished 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.231037+0000 mon.a (mon.0) 1259 : audit 1 from='client.46412 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: cluster 2024-02-13T14:49:16.238927+0000 mon.a (mon.0) 1260 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-02-13T14:49:17.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[21479]: audit 2024-02-13T14:49:16.904012+0000 mon.c (mon.2) 213 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: cluster 2024-02-13T14:49:15.382070+0000 mgr.y (mgr.14613) 231 : cluster 0 pgmap v204: 492 pgs: 32 creating+peering, 32 unknown, 428 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 258 KiB/s wr, 3 op/s 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:15.902436+0000 mon.c (mon.2) 210 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.120842+0000 mon.a (mon.0) 1251 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-11"}]': finished 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.120911+0000 mon.a (mon.0) 1252 : audit 1 from='client.? v1:172.21.15.62:0/3189221568' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsComplete_smithi062-64504-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: cluster 2024-02-13T14:49:16.124249+0000 mon.a (mon.0) 1253 : cluster 0 osdmap e130: 8 total, 8 up, 8 in 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.131797+0000 mon.c (mon.2) 211 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]: dispatch 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.133914+0000 mon.c (mon.2) 212 : audit 1 from='client.? v1:172.21.15.62:0/921269555' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.137078+0000 mon.a (mon.0) 1254 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]: dispatch 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.137394+0000 mon.a (mon.0) 1255 : audit 1 from='client.46412 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: cluster 2024-02-13T14:49:16.228387+0000 mon.a (mon.0) 1256 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: cluster 2024-02-13T14:49:16.229219+0000 mon.a (mon.0) 1257 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:17.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.230940+0000 mon.a (mon.0) 1258 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-11", "mode": "writeback"}]': finished 2024-02-13T14:49:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.231037+0000 mon.a (mon.0) 1259 : audit 1 from='client.46412 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripSparseReadPP_smithi062-64512-10","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: cluster 2024-02-13T14:49:16.238927+0000 mon.a (mon.0) 1260 : cluster 0 osdmap e131: 8 total, 8 up, 8 in 2024-02-13T14:49:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:17 smithi062 bash[28859]: audit 2024-02-13T14:49:16.904012+0000 mon.c (mon.2) 213 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:18.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[21479]: audit 2024-02-13T14:49:17.118963+0000 mon.a (mon.0) 1261 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:18.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[21479]: audit 2024-02-13T14:49:17.122811+0000 mon.b (mon.1) 166 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:18.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[21479]: cluster 2024-02-13T14:49:17.259251+0000 mon.a (mon.0) 1262 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-02-13T14:49:18.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[21479]: audit 2024-02-13T14:49:17.264913+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.62:0/98632822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:18.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[21479]: audit 2024-02-13T14:49:17.270564+0000 mon.a (mon.0) 1263 : audit 1 from='client.46418 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:18.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[21479]: audit 2024-02-13T14:49:17.366812+0000 mon.c (mon.2) 215 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[28859]: audit 2024-02-13T14:49:17.118963+0000 mon.a (mon.0) 1261 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[28859]: audit 2024-02-13T14:49:17.122811+0000 mon.b (mon.1) 166 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[28859]: cluster 2024-02-13T14:49:17.259251+0000 mon.a (mon.0) 1262 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-02-13T14:49:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[28859]: audit 2024-02-13T14:49:17.264913+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.62:0/98632822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[28859]: audit 2024-02-13T14:49:17.270564+0000 mon.a (mon.0) 1263 : audit 1 from='client.46418 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:18.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:18 smithi062 bash[28859]: audit 2024-02-13T14:49:17.366812+0000 mon.c (mon.2) 215 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:18.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:18 smithi111 bash[23388]: audit 2024-02-13T14:49:17.118963+0000 mon.a (mon.0) 1261 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:18.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:18 smithi111 bash[23388]: audit 2024-02-13T14:49:17.122811+0000 mon.b (mon.1) 166 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:18.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:18 smithi111 bash[23388]: cluster 2024-02-13T14:49:17.259251+0000 mon.a (mon.0) 1262 : cluster 0 osdmap e132: 8 total, 8 up, 8 in 2024-02-13T14:49:18.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:18 smithi111 bash[23388]: audit 2024-02-13T14:49:17.264913+0000 mon.c (mon.2) 214 : audit 1 from='client.? v1:172.21.15.62:0/98632822' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:18.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:18 smithi111 bash[23388]: audit 2024-02-13T14:49:17.270564+0000 mon.a (mon.0) 1263 : audit 1 from='client.46418 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:18.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:18 smithi111 bash[23388]: audit 2024-02-13T14:49:17.366812+0000 mon.c (mon.2) 215 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:19.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: cluster 2024-02-13T14:49:17.382712+0000 mgr.y (mgr.14613) 232 : cluster 0 pgmap v208: 492 pgs: 32 creating+peering, 32 unknown, 428 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 316 KiB/s wr, 5 op/s 2024-02-13T14:49:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:17.905544+0000 mon.c (mon.2) 216 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:18.193999+0000 mon.a (mon.0) 1264 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:18.260221+0000 mon.a (mon.0) 1265 : audit 1 from='client.46418 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:18.260401+0000 mon.a (mon.0) 1266 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:49:19.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: cluster 2024-02-13T14:49:18.268655+0000 mon.a (mon.0) 1267 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-02-13T14:49:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:18.273641+0000 mon.c (mon.2) 217 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:18.274725+0000 mon.c (mon.2) 218 : audit 1 from='client.? v1:172.21.15.62:0/1240994387' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:18.291377+0000 mon.a (mon.0) 1268 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:18.291893+0000 mon.a (mon.0) 1269 : audit 1 from='client.46430 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[21479]: audit 2024-02-13T14:49:18.907068+0000 mon.c (mon.2) 219 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: cluster 2024-02-13T14:49:17.382712+0000 mgr.y (mgr.14613) 232 : cluster 0 pgmap v208: 492 pgs: 32 creating+peering, 32 unknown, 428 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 316 KiB/s wr, 5 op/s 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:17.905544+0000 mon.c (mon.2) 216 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:18.193999+0000 mon.a (mon.0) 1264 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:18.260221+0000 mon.a (mon.0) 1265 : audit 1 from='client.46418 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:18.260401+0000 mon.a (mon.0) 1266 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: cluster 2024-02-13T14:49:18.268655+0000 mon.a (mon.0) 1267 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:18.273641+0000 mon.c (mon.2) 217 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:18.274725+0000 mon.c (mon.2) 218 : audit 1 from='client.? v1:172.21.15.62:0/1240994387' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:18.291377+0000 mon.a (mon.0) 1268 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:18.291893+0000 mon.a (mon.0) 1269 : audit 1 from='client.46430 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:19.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:19 smithi062 bash[28859]: audit 2024-02-13T14:49:18.907068+0000 mon.c (mon.2) 219 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: cluster 2024-02-13T14:49:17.382712+0000 mgr.y (mgr.14613) 232 : cluster 0 pgmap v208: 492 pgs: 32 creating+peering, 32 unknown, 428 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 316 KiB/s wr, 5 op/s 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:17.905544+0000 mon.c (mon.2) 216 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:18.193999+0000 mon.a (mon.0) 1264 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:18.260221+0000 mon.a (mon.0) 1265 : audit 1 from='client.46418 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafe_smithi062-64504-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:18.260401+0000 mon.a (mon.0) 1266 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: cluster 2024-02-13T14:49:18.268655+0000 mon.a (mon.0) 1267 : cluster 0 osdmap e133: 8 total, 8 up, 8 in 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:18.273641+0000 mon.c (mon.2) 217 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:18.274725+0000 mon.c (mon.2) 218 : audit 1 from='client.? v1:172.21.15.62:0/1240994387' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:18.291377+0000 mon.a (mon.0) 1268 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]: dispatch 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:18.291893+0000 mon.a (mon.0) 1269 : audit 1 from='client.46430 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:19.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:19 smithi111 bash[23388]: audit 2024-02-13T14:49:18.907068+0000 mon.c (mon.2) 219 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:20.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: cluster 2024-02-13T14:49:19.261870+0000 mon.a (mon.0) 1270 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:49:20.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: audit 2024-02-13T14:49:19.264574+0000 mon.a (mon.0) 1271 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]': finished 2024-02-13T14:49:20.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: audit 2024-02-13T14:49:19.264819+0000 mon.a (mon.0) 1272 : audit 1 from='client.46430 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:20.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: cluster 2024-02-13T14:49:19.275098+0000 mon.a (mon.0) 1273 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-02-13T14:49:20.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: audit 2024-02-13T14:49:19.278726+0000 mon.b (mon.1) 167 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:20.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: audit 2024-02-13T14:49:19.284539+0000 mon.a (mon.0) 1274 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:20.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: audit 2024-02-13T14:49:19.908681+0000 mon.c (mon.2) 220 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: audit 2024-02-13T14:49:19.913813+0000 mon.c (mon.2) 221 : audit 0 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: audit 2024-02-13T14:49:19.921272+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[21479]: audit 2024-02-13T14:49:19.921957+0000 mon.a (mon.0) 1275 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: cluster 2024-02-13T14:49:19.261870+0000 mon.a (mon.0) 1270 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: audit 2024-02-13T14:49:19.264574+0000 mon.a (mon.0) 1271 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]': finished 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: audit 2024-02-13T14:49:19.264819+0000 mon.a (mon.0) 1272 : audit 1 from='client.46430 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: cluster 2024-02-13T14:49:19.275098+0000 mon.a (mon.0) 1273 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: audit 2024-02-13T14:49:19.278726+0000 mon.b (mon.1) 167 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: audit 2024-02-13T14:49:19.284539+0000 mon.a (mon.0) 1274 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: audit 2024-02-13T14:49:19.908681+0000 mon.c (mon.2) 220 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:20.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: audit 2024-02-13T14:49:19.913813+0000 mon.c (mon.2) 221 : audit 0 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-13T14:49:20.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: audit 2024-02-13T14:49:19.921272+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:20.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:20 smithi062 bash[28859]: audit 2024-02-13T14:49:19.921957+0000 mon.a (mon.0) 1275 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:20.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: cluster 2024-02-13T14:49:19.261870+0000 mon.a (mon.0) 1270 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: audit 2024-02-13T14:49:19.264574+0000 mon.a (mon.0) 1271 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-11"}]': finished 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: audit 2024-02-13T14:49:19.264819+0000 mon.a (mon.0) 1272 : audit 1 from='client.46430 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsCompletePP_smithi062-64512-11","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: cluster 2024-02-13T14:49:19.275098+0000 mon.a (mon.0) 1273 : cluster 0 osdmap e134: 8 total, 8 up, 8 in 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: audit 2024-02-13T14:49:19.278726+0000 mon.b (mon.1) 167 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: audit 2024-02-13T14:49:19.284539+0000 mon.a (mon.0) 1274 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: audit 2024-02-13T14:49:19.908681+0000 mon.c (mon.2) 220 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: audit 2024-02-13T14:49:19.913813+0000 mon.c (mon.2) 221 : audit 0 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: audit 2024-02-13T14:49:19.921272+0000 mon.c (mon.2) 222 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:20 smithi111 bash[23388]: audit 2024-02-13T14:49:19.921957+0000 mon.a (mon.0) 1275 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: cluster 2024-02-13T14:49:19.383277+0000 mgr.y (mgr.14613) 233 : cluster 0 pgmap v211: 516 pgs: 96 unknown, 420 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:22.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.158730+0000 mgr.y (mgr.14613) 234 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:22.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.275188+0000 mon.a (mon.0) 1276 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:22.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.275415+0000 mon.a (mon.0) 1277 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.284643+0000 mon.b (mon.1) 168 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: cluster 2024-02-13T14:49:20.288236+0000 mon.a (mon.0) 1278 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.298036+0000 mon.c (mon.2) 223 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2"}]: dispatch 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.299212+0000 mon.c (mon.2) 224 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.308439+0000 mon.a (mon.0) 1279 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.309140+0000 mon.a (mon.0) 1280 : audit 1 from='client.? v1:172.21.15.62:0/4278444841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi062-64504-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.309739+0000 mon.a (mon.0) 1281 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[21479]: audit 2024-02-13T14:49:20.910117+0000 mon.c (mon.2) 225 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: cluster 2024-02-13T14:49:19.383277+0000 mgr.y (mgr.14613) 233 : cluster 0 pgmap v211: 516 pgs: 96 unknown, 420 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.158730+0000 mgr.y (mgr.14613) 234 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:22.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.275188+0000 mon.a (mon.0) 1276 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.275415+0000 mon.a (mon.0) 1277 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.284643+0000 mon.b (mon.1) 168 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: cluster 2024-02-13T14:49:20.288236+0000 mon.a (mon.0) 1278 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.298036+0000 mon.c (mon.2) 223 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2"}]: dispatch 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.299212+0000 mon.c (mon.2) 224 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.308439+0000 mon.a (mon.0) 1279 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.309140+0000 mon.a (mon.0) 1280 : audit 1 from='client.? v1:172.21.15.62:0/4278444841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi062-64504-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.309739+0000 mon.a (mon.0) 1281 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:21 smithi062 bash[28859]: audit 2024-02-13T14:49:20.910117+0000 mon.c (mon.2) 225 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:22.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: cluster 2024-02-13T14:49:19.383277+0000 mgr.y (mgr.14613) 233 : cluster 0 pgmap v211: 516 pgs: 96 unknown, 420 active+clean; 217 MiB data, 1015 MiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.158730+0000 mgr.y (mgr.14613) 234 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.275188+0000 mon.a (mon.0) 1276 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.275415+0000 mon.a (mon.0) 1277 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app1","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.284643+0000 mon.b (mon.1) 168 : audit 1 from='client.? v1:172.21.15.62:0/3051137163' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: cluster 2024-02-13T14:49:20.288236+0000 mon.a (mon.0) 1278 : cluster 0 osdmap e135: 8 total, 8 up, 8 in 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.298036+0000 mon.c (mon.2) 223 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2"}]: dispatch 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.299212+0000 mon.c (mon.2) 224 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.308439+0000 mon.a (mon.0) 1279 : audit 1 from='client.43345 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]: dispatch 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.309140+0000 mon.a (mon.0) 1280 : audit 1 from='client.? v1:172.21.15.62:0/4278444841' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi062-64504-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.309739+0000 mon.a (mon.0) 1281 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:22.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:21 smithi111 bash[23388]: audit 2024-02-13T14:49:20.910117+0000 mon.c (mon.2) 225 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:23.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: cluster 2024-02-13T14:49:21.384268+0000 mgr.y (mgr.14613) 235 : cluster 0 pgmap v213: 452 pgs: 32 creating+peering, 32 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 496 B/s wr, 2 op/s 2024-02-13T14:49:23.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: cluster 2024-02-13T14:49:21.673280+0000 mon.a (mon.0) 1282 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.682784+0000 mon.a (mon.0) 1283 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.683099+0000 mon.a (mon.0) 1284 : audit 1 from='client.? v1:172.21.15.62:0/4278444841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi062-64504-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.683319+0000 mon.a (mon.0) 1285 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: cluster 2024-02-13T14:49:21.696700+0000 mon.a (mon.0) 1286 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.703801+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.710641+0000 mon.b (mon.1) 169 : audit 1 from='client.? v1:172.21.15.62:0/1669301089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.728527+0000 mon.a (mon.0) 1287 : audit 1 from='client.48151 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.733146+0000 mon.a (mon.0) 1288 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.734816+0000 mon.c (mon.2) 227 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.743108+0000 mon.c (mon.2) 228 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.743639+0000 mon.a (mon.0) 1289 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.745925+0000 mon.c (mon.2) 229 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: cluster 2024-02-13T14:49:21.384268+0000 mgr.y (mgr.14613) 235 : cluster 0 pgmap v213: 452 pgs: 32 creating+peering, 32 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 496 B/s wr, 2 op/s 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: cluster 2024-02-13T14:49:21.673280+0000 mon.a (mon.0) 1282 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.682784+0000 mon.a (mon.0) 1283 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.683099+0000 mon.a (mon.0) 1284 : audit 1 from='client.? v1:172.21.15.62:0/4278444841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi062-64504-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.683319+0000 mon.a (mon.0) 1285 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: cluster 2024-02-13T14:49:21.696700+0000 mon.a (mon.0) 1286 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.703801+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.710641+0000 mon.b (mon.1) 169 : audit 1 from='client.? v1:172.21.15.62:0/1669301089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.728527+0000 mon.a (mon.0) 1287 : audit 1 from='client.48151 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.733146+0000 mon.a (mon.0) 1288 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.734816+0000 mon.c (mon.2) 227 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.743108+0000 mon.c (mon.2) 228 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.743639+0000 mon.a (mon.0) 1289 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.745925+0000 mon.c (mon.2) 229 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.746313+0000 mon.a (mon.0) 1290 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.748452+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.749113+0000 mon.a (mon.0) 1291 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.749569+0000 mon.c (mon.2) 231 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.749856+0000 mon.a (mon.0) 1292 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:21.911586+0000 mon.c (mon.2) 232 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:22.687048+0000 mon.a (mon.0) 1293 : audit 1 from='client.48151 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:22.687263+0000 mon.a (mon.0) 1294 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:22.687441+0000 mon.a (mon.0) 1295 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T14:49:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: audit 2024-02-13T14:49:22.687585+0000 mon.a (mon.0) 1296 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[21479]: cluster 2024-02-13T14:49:22.697905+0000 mon.a (mon.0) 1297 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.746313+0000 mon.a (mon.0) 1290 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.748452+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.749113+0000 mon.a (mon.0) 1291 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.749569+0000 mon.c (mon.2) 231 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.749856+0000 mon.a (mon.0) 1292 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:21.911586+0000 mon.c (mon.2) 232 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:22.687048+0000 mon.a (mon.0) 1293 : audit 1 from='client.48151 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:22.687263+0000 mon.a (mon.0) 1294 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:22.687441+0000 mon.a (mon.0) 1295 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: audit 2024-02-13T14:49:22.687585+0000 mon.a (mon.0) 1296 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:22 smithi062 bash[28859]: cluster 2024-02-13T14:49:22.697905+0000 mon.a (mon.0) 1297 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-02-13T14:49:23.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: cluster 2024-02-13T14:49:21.384268+0000 mgr.y (mgr.14613) 235 : cluster 0 pgmap v213: 452 pgs: 32 creating+peering, 32 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 496 B/s wr, 2 op/s 2024-02-13T14:49:23.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: cluster 2024-02-13T14:49:21.673280+0000 mon.a (mon.0) 1282 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:23.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.682784+0000 mon.a (mon.0) 1283 : audit 1 from='client.43345 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsEC_smithi062-64731-10"}]': finished 2024-02-13T14:49:23.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.683099+0000 mon.a (mon.0) 1284 : audit 1 from='client.? v1:172.21.15.62:0/4278444841' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValue_smithi062-64504-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.683319+0000 mon.a (mon.0) 1285 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosMiscPP_smithi062-64655-1","app": "app2","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: cluster 2024-02-13T14:49:21.696700+0000 mon.a (mon.0) 1286 : cluster 0 osdmap e136: 8 total, 8 up, 8 in 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.703801+0000 mon.c (mon.2) 226 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.710641+0000 mon.b (mon.1) 169 : audit 1 from='client.? v1:172.21.15.62:0/1669301089' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.728527+0000 mon.a (mon.0) 1287 : audit 1 from='client.48151 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.733146+0000 mon.a (mon.0) 1288 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.734816+0000 mon.c (mon.2) 227 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"dne","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.743108+0000 mon.c (mon.2) 228 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.743639+0000 mon.a (mon.0) 1289 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.745925+0000 mon.c (mon.2) 229 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.746313+0000 mon.a (mon.0) 1290 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.748452+0000 mon.c (mon.2) 230 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.749113+0000 mon.a (mon.0) 1291 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.749569+0000 mon.c (mon.2) 231 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.749856+0000 mon.a (mon.0) 1292 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:21.911586+0000 mon.c (mon.2) 232 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:22.687048+0000 mon.a (mon.0) 1293 : audit 1 from='client.48151 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "IsSafePP_smithi062-64512-12","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:22.687263+0000 mon.a (mon.0) 1294 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:22.687441+0000 mon.a (mon.0) 1295 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1","value":"value1"}]': finished 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: audit 2024-02-13T14:49:22.687585+0000 mon.a (mon.0) 1296 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:22 smithi111 bash[23388]: cluster 2024-02-13T14:49:22.697905+0000 mon.a (mon.0) 1297 : cluster 0 osdmap e137: 8 total, 8 up, 8 in 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: Running main() from gmock_main.cc 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: [==========] Running 14 tests from 1 test suite. 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: [----------] Global test environment set-up. 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: [----------] 14 tests from NeoRadosIo 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.Limits 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.Limits (19323 ms) 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.SimpleWrite 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.SimpleWrite (13083 ms) 2024-02-13T14:49:24.173 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.ReadOp 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.ReadOp (6617 ms) 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.SparseRead 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.SparseRead (5054 ms) 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.RoundTrip 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.RoundTrip (6035 ms) 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.ReadIntoBuufferlist 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.ReadIntoBuufferlist (4103 ms) 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.OverlappingWriteRoundTrip 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.OverlappingWriteRoundTrip (4473 ms) 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.WriteFullRoundTrip 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.WriteFullRoundTrip (4547 ms) 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.AppendRoundTrip 2024-02-13T14:49:24.174 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.AppendRoundTrip (6082 ms) 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.Trunc 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.Trunc (3415 ms) 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.Remove 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.Remove (3413 ms) 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.XattrsRoundTrip 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.XattrsRoundTrip (2135 ms) 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.RmXattr 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.RmXattr (3020 ms) 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ RUN ] NeoRadosIo.GetXattrs 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ OK ] NeoRadosIo.GetXattrs (3878 ms) 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [----------] 14 tests from NeoRadosIo (85178 ms total) 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: 2024-02-13T14:49:24.175 INFO:tasks.workunit.client.0.smithi062.stdout: io: [----------] Global test environment tear-down 2024-02-13T14:49:24.176 INFO:tasks.workunit.client.0.smithi062.stdout: io: [==========] 14 tests from 1 test suite ran. (85178 ms total) 2024-02-13T14:49:24.176 INFO:tasks.workunit.client.0.smithi062.stdout: io: [ PASSED ] 14 tests. 2024-02-13T14:49:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[28859]: audit 2024-02-13T14:49:22.706009+0000 mon.c (mon.2) 233 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[28859]: audit 2024-02-13T14:49:22.711766+0000 mon.c (mon.2) 234 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:49:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[28859]: audit 2024-02-13T14:49:22.720819+0000 mon.a (mon.0) 1298 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[28859]: audit 2024-02-13T14:49:22.721392+0000 mon.a (mon.0) 1299 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:49:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[28859]: audit 2024-02-13T14:49:22.913030+0000 mon.c (mon.2) 235 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[28859]: audit 2024-02-13T14:49:23.692092+0000 mon.a (mon.0) 1300 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T14:49:24.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[28859]: cluster 2024-02-13T14:49:24.168995+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-02-13T14:49:24.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[21479]: audit 2024-02-13T14:49:22.706009+0000 mon.c (mon.2) 233 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:24.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[21479]: audit 2024-02-13T14:49:22.711766+0000 mon.c (mon.2) 234 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:49:24.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[21479]: audit 2024-02-13T14:49:22.720819+0000 mon.a (mon.0) 1298 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:24.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[21479]: audit 2024-02-13T14:49:22.721392+0000 mon.a (mon.0) 1299 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:49:24.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[21479]: audit 2024-02-13T14:49:22.913030+0000 mon.c (mon.2) 235 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:24.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[21479]: audit 2024-02-13T14:49:23.692092+0000 mon.a (mon.0) 1300 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T14:49:24.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:24 smithi062 bash[21479]: cluster 2024-02-13T14:49:24.168995+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-02-13T14:49:24.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:24 smithi111 bash[23388]: audit 2024-02-13T14:49:22.706009+0000 mon.c (mon.2) 233 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:24.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:24 smithi111 bash[23388]: audit 2024-02-13T14:49:22.711766+0000 mon.c (mon.2) 234 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:49:24.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:24 smithi111 bash[23388]: audit 2024-02-13T14:49:22.720819+0000 mon.a (mon.0) 1298 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:24.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:24 smithi111 bash[23388]: audit 2024-02-13T14:49:22.721392+0000 mon.a (mon.0) 1299 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]: dispatch 2024-02-13T14:49:24.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:24 smithi111 bash[23388]: audit 2024-02-13T14:49:22.913030+0000 mon.c (mon.2) 235 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:24.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:24 smithi111 bash[23388]: audit 2024-02-13T14:49:23.692092+0000 mon.a (mon.0) 1300 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key2","value":"value2"}]': finished 2024-02-13T14:49:24.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:24 smithi111 bash[23388]: cluster 2024-02-13T14:49:24.168995+0000 mon.a (mon.0) 1301 : cluster 0 osdmap e138: 8 total, 8 up, 8 in 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: cluster 2024-02-13T14:49:23.385393+0000 mgr.y (mgr.14613) 236 : cluster 0 pgmap v216: 516 pgs: 32 creating+peering, 96 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 994 B/s wr, 3 op/s 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:23.708624+0000 mon.c (mon.2) 236 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:23.914228+0000 mon.c (mon.2) 237 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.170710+0000 mon.c (mon.2) 238 : audit 1 from='client.? v1:172.21.15.62:0/1026708347' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.172590+0000 mon.a (mon.0) 1302 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.173438+0000 mon.a (mon.0) 1303 : audit 1 from='client.46454 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.695789+0000 mon.a (mon.0) 1304 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.695927+0000 mon.a (mon.0) 1305 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]': finished 2024-02-13T14:49:25.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.696020+0000 mon.a (mon.0) 1306 : audit 1 from='client.46454 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: cluster 2024-02-13T14:49:24.706190+0000 mon.a (mon.0) 1307 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.710461+0000 mon.c (mon.2) 239 : audit 1 from='client.? v1:172.21.15.62:0/2605761932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.719990+0000 mon.a (mon.0) 1308 : audit 1 from='client.46460 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.915503+0000 mon.c (mon.2) 240 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[21479]: audit 2024-02-13T14:49:24.986944+0000 mon.b (mon.1) 170 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: cluster 2024-02-13T14:49:23.385393+0000 mgr.y (mgr.14613) 236 : cluster 0 pgmap v216: 516 pgs: 32 creating+peering, 96 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 994 B/s wr, 3 op/s 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:23.708624+0000 mon.c (mon.2) 236 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:23.914228+0000 mon.c (mon.2) 237 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.170710+0000 mon.c (mon.2) 238 : audit 1 from='client.? v1:172.21.15.62:0/1026708347' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.172590+0000 mon.a (mon.0) 1302 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.173438+0000 mon.a (mon.0) 1303 : audit 1 from='client.46454 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.695789+0000 mon.a (mon.0) 1304 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.695927+0000 mon.a (mon.0) 1305 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]': finished 2024-02-13T14:49:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.696020+0000 mon.a (mon.0) 1306 : audit 1 from='client.46454 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: cluster 2024-02-13T14:49:24.706190+0000 mon.a (mon.0) 1307 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-02-13T14:49:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.710461+0000 mon.c (mon.2) 239 : audit 1 from='client.? v1:172.21.15.62:0/2605761932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.719990+0000 mon.a (mon.0) 1308 : audit 1 from='client.46460 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.915503+0000 mon.c (mon.2) 240 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:25 smithi062 bash[28859]: audit 2024-02-13T14:49:24.986944+0000 mon.b (mon.1) 170 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:49:25.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: cluster 2024-02-13T14:49:23.385393+0000 mgr.y (mgr.14613) 236 : cluster 0 pgmap v216: 516 pgs: 32 creating+peering, 96 unknown, 388 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 994 B/s wr, 3 op/s 2024-02-13T14:49:25.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:23.708624+0000 mon.c (mon.2) 236 : audit 1 from='client.? v1:172.21.15.62:0/1735019620' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:49:25.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:23.914228+0000 mon.c (mon.2) 237 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.170710+0000 mon.c (mon.2) 238 : audit 1 from='client.? v1:172.21.15.62:0/1026708347' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.172590+0000 mon.a (mon.0) 1302 : audit 1 from='client.24725 ' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]: dispatch 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.173438+0000 mon.a (mon.0) 1303 : audit 1 from='client.46454 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.695789+0000 mon.a (mon.0) 1304 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedEC_smithi062-64731-15", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.695927+0000 mon.a (mon.0) 1305 : audit 1 from='client.24725 ' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"LibRadosMiscPP_smithi062-64655-1","app":"app1","key":"key1"}]': finished 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.696020+0000 mon.a (mon.0) 1306 : audit 1 from='client.46454 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Flush_smithi062-64504-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: cluster 2024-02-13T14:49:24.706190+0000 mon.a (mon.0) 1307 : cluster 0 osdmap e139: 8 total, 8 up, 8 in 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.710461+0000 mon.c (mon.2) 239 : audit 1 from='client.? v1:172.21.15.62:0/2605761932' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.719990+0000 mon.a (mon.0) 1308 : audit 1 from='client.46460 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.915503+0000 mon.c (mon.2) 240 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:25.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:25 smithi111 bash[23388]: audit 2024-02-13T14:49:24.986944+0000 mon.b (mon.1) 170 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [==========] Running 31 tests from 7 test suites. 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] Global test environment set-up. 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscVersion.VersionPP 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscVersion.VersionPP (0 ms) 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscVersion (0 ms total) 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: seed 64655 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WaitOSDMapPP 2024-02-13T14:49:25.718 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WaitOSDMapPP (1 ms) 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNamePP 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNamePP (415 ms) 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongLocatorPP 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongLocatorPP (12 ms) 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongNSpacePP 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongNSpacePP (15 ms) 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.LongAttrNamePP 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.LongAttrNamePP (20 ms) 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.ExecPP 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.ExecPP (4 ms) 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BadFlagsPP 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BadFlagsPP (4 ms) 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate1PP 2024-02-13T14:49:25.719 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate1PP (5 ms) 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Operate2PP 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Operate2PP (8 ms) 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigObjectPP 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigObjectPP (16 ms) 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AioOperatePP 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AioOperatePP (7 ms) 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertExistsPP 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertExistsPP (4 ms) 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.AssertVersionPP 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.AssertVersionPP (8 ms) 2024-02-13T14:49:25.720 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.BigAttrPP 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: osd_max_attr_size = 0 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: osd_max_attr_size == 0; skipping test 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.BigAttrPP (2182 ms) 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyPP 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyPP (462 ms) 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CopyScrubPP 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: waiting for initial deep scrubs... 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: done waiting, doing copies 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: waiting for final deep scrubs... 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: done waiting 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CopyScrubPP (60977 ms) 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.WriteSamePP 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.WriteSamePP (9 ms) 2024-02-13T14:49:25.721 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.CmpExtPP 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.CmpExtPP (8 ms) 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Applications 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Applications (4797 ms) 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatOSD 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatOSD (0 ms) 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.MinCompatClient 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.MinCompatClient (0 ms) 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscPP.Conf 2024-02-13T14:49:25.722 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscPP.Conf (0 ms) 2024-02-13T14:49:26.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:49:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:49:27.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: cluster 2024-02-13T14:49:25.389257+0000 mgr.y (mgr.14613) 237 : cluster 0 pgmap v219: 524 pgs: 4 active+clean+snaptrim, 17 creating+activating, 38 creating+peering, 3 active+clean+snaptrim_wait, 14 unknown, 448 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 54 KiB/s wr, 56 op/s 2024-02-13T14:49:27.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:25.698867+0000 mon.a (mon.0) 1309 : audit 1 from='client.46460 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:27.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: cluster 2024-02-13T14:49:25.709917+0000 mon.a (mon.0) 1310 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-02-13T14:49:27.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:25.759940+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:25.772255+0000 mon.b (mon.1) 171 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:25.774320+0000 mon.b (mon.1) 172 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: cluster 2024-02-13T14:49:25.776261+0000 mgr.y (mgr.14613) 238 : cluster 0 pgmap v221: 460 pgs: 4 active+clean+snaptrim, 26 creating+peering, 3 active+clean+snaptrim_wait, 14 unknown, 413 active+clean; 590 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:25.916374+0000 mon.c (mon.2) 242 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:26.207543+0000 mon.a (mon.0) 1311 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:26.213549+0000 mon.c (mon.2) 243 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:26.217831+0000 mon.a (mon.0) 1312 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:26.221437+0000 mon.a (mon.0) 1313 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:26.222398+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: audit 2024-02-13T14:49:26.223011+0000 mon.a (mon.0) 1314 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[21479]: cluster 2024-02-13T14:49:26.678880+0000 mon.a (mon.0) 1315 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:27.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: cluster 2024-02-13T14:49:25.389257+0000 mgr.y (mgr.14613) 237 : cluster 0 pgmap v219: 524 pgs: 4 active+clean+snaptrim, 17 creating+activating, 38 creating+peering, 3 active+clean+snaptrim_wait, 14 unknown, 448 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 54 KiB/s wr, 56 op/s 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:25.698867+0000 mon.a (mon.0) 1309 : audit 1 from='client.46460 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: cluster 2024-02-13T14:49:25.709917+0000 mon.a (mon.0) 1310 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:25.759940+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:25.772255+0000 mon.b (mon.1) 171 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:25.774320+0000 mon.b (mon.1) 172 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: cluster 2024-02-13T14:49:25.776261+0000 mgr.y (mgr.14613) 238 : cluster 0 pgmap v221: 460 pgs: 4 active+clean+snaptrim, 26 creating+peering, 3 active+clean+snaptrim_wait, 14 unknown, 413 active+clean; 590 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:25.916374+0000 mon.c (mon.2) 242 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:26.207543+0000 mon.a (mon.0) 1311 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:26.213549+0000 mon.c (mon.2) 243 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:26.217831+0000 mon.a (mon.0) 1312 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:26.221437+0000 mon.a (mon.0) 1313 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:26.222398+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: audit 2024-02-13T14:49:26.223011+0000 mon.a (mon.0) 1314 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:27.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:26 smithi062 bash[28859]: cluster 2024-02-13T14:49:26.678880+0000 mon.a (mon.0) 1315 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: cluster 2024-02-13T14:49:25.389257+0000 mgr.y (mgr.14613) 237 : cluster 0 pgmap v219: 524 pgs: 4 active+clean+snaptrim, 17 creating+activating, 38 creating+peering, 3 active+clean+snaptrim_wait, 14 unknown, 448 active+clean; 217 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 54 KiB/s wr, 56 op/s 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:25.698867+0000 mon.a (mon.0) 1309 : audit 1 from='client.46460 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReturnValuePP_smithi062-64512-13","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: cluster 2024-02-13T14:49:25.709917+0000 mon.a (mon.0) 1310 : cluster 0 osdmap e140: 8 total, 8 up, 8 in 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:25.759940+0000 mon.c (mon.2) 241 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:25.772255+0000 mon.b (mon.1) 171 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:25.774320+0000 mon.b (mon.1) 172 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: cluster 2024-02-13T14:49:25.776261+0000 mgr.y (mgr.14613) 238 : cluster 0 pgmap v221: 460 pgs: 4 active+clean+snaptrim, 26 creating+peering, 3 active+clean+snaptrim_wait, 14 unknown, 413 active+clean; 590 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:25.916374+0000 mon.c (mon.2) 242 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:26.207543+0000 mon.a (mon.0) 1311 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:26.213549+0000 mon.c (mon.2) 243 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:26.217831+0000 mon.a (mon.0) 1312 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:26.221437+0000 mon.a (mon.0) 1313 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:26.222398+0000 mon.c (mon.2) 244 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: audit 2024-02-13T14:49:26.223011+0000 mon.a (mon.0) 1314 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:26 smithi111 bash[23388]: cluster 2024-02-13T14:49:26.678880+0000 mon.a (mon.0) 1315 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:28.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: audit 2024-02-13T14:49:26.685918+0000 mon.a (mon.0) 1316 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: cluster 2024-02-13T14:49:26.693334+0000 mon.a (mon.0) 1317 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: audit 2024-02-13T14:49:26.700577+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: audit 2024-02-13T14:49:26.714849+0000 mon.a (mon.0) 1318 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: audit 2024-02-13T14:49:26.726884+0000 mon.a (mon.0) 1319 : audit 1 from='client.? v1:172.21.15.62:0/3966032067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi062-64504-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: audit 2024-02-13T14:49:26.917153+0000 mon.c (mon.2) 246 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: audit 2024-02-13T14:49:26.927243+0000 mon.c (mon.2) 247 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: cluster 2024-02-13T14:49:27.661224+0000 mon.a (mon.0) 1320 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: audit 2024-02-13T14:49:27.662889+0000 mon.a (mon.0) 1321 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:28.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[21479]: audit 2024-02-13T14:49:27.690691+0000 mon.a (mon.0) 1322 : audit 1 from='client.? v1:172.21.15.62:0/3966032067' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi062-64504-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: audit 2024-02-13T14:49:26.685918+0000 mon.a (mon.0) 1316 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: cluster 2024-02-13T14:49:26.693334+0000 mon.a (mon.0) 1317 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: audit 2024-02-13T14:49:26.700577+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: audit 2024-02-13T14:49:26.714849+0000 mon.a (mon.0) 1318 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: audit 2024-02-13T14:49:26.726884+0000 mon.a (mon.0) 1319 : audit 1 from='client.? v1:172.21.15.62:0/3966032067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi062-64504-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: audit 2024-02-13T14:49:26.917153+0000 mon.c (mon.2) 246 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: audit 2024-02-13T14:49:26.927243+0000 mon.c (mon.2) 247 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: cluster 2024-02-13T14:49:27.661224+0000 mon.a (mon.0) 1320 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: audit 2024-02-13T14:49:27.662889+0000 mon.a (mon.0) 1321 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:28.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:28 smithi062 bash[28859]: audit 2024-02-13T14:49:27.690691+0000 mon.a (mon.0) 1322 : audit 1 from='client.? v1:172.21.15.62:0/3966032067' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi062-64504-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: audit 2024-02-13T14:49:26.685918+0000 mon.a (mon.0) 1316 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64655-24", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: cluster 2024-02-13T14:49:26.693334+0000 mon.a (mon.0) 1317 : cluster 0 osdmap e141: 8 total, 8 up, 8 in 2024-02-13T14:49:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: audit 2024-02-13T14:49:26.700577+0000 mon.c (mon.2) 245 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: audit 2024-02-13T14:49:26.714849+0000 mon.a (mon.0) 1318 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: audit 2024-02-13T14:49:26.726884+0000 mon.a (mon.0) 1319 : audit 1 from='client.? v1:172.21.15.62:0/3966032067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi062-64504-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: audit 2024-02-13T14:49:26.917153+0000 mon.c (mon.2) 246 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: audit 2024-02-13T14:49:26.927243+0000 mon.c (mon.2) 247 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: cluster 2024-02-13T14:49:27.661224+0000 mon.a (mon.0) 1320 : cluster 1 Health check cleared: CEPHADM_STRAY_DAEMON (was: 2 stray daemon(s) not managed by cephadm) 2024-02-13T14:49:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: audit 2024-02-13T14:49:27.662889+0000 mon.a (mon.0) 1321 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:49:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:28 smithi111 bash[23388]: audit 2024-02-13T14:49:27.690691+0000 mon.a (mon.0) 1322 : audit 1 from='client.? v1:172.21.15.62:0/3966032067' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsync_smithi062-64504-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:30.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:27.690934+0000 mon.a (mon.0) 1323 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:30.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:27.701131+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:49:30.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: cluster 2024-02-13T14:49:27.776874+0000 mgr.y (mgr.14613) 239 : cluster 0 pgmap v224: 492 pgs: 5 creating+peering, 99 unknown, 388 active+clean; 588 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:30.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:27.918243+0000 mon.c (mon.2) 249 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:30.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: cluster 2024-02-13T14:49:28.161937+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-02-13T14:49:30.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:28.163235+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.62:0/3888224602' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:30.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:28.173088+0000 mon.a (mon.0) 1325 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:49:30.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:28.177832+0000 mon.a (mon.0) 1326 : audit 1 from='client.46478 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:28.695099+0000 mon.a (mon.0) 1327 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:28.695388+0000 mon.a (mon.0) 1328 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]': finished 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:28.695628+0000 mon.a (mon.0) 1329 : audit 1 from='client.46478 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: cluster 2024-02-13T14:49:28.704620+0000 mon.a (mon.0) 1330 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:28.708920+0000 mon.c (mon.2) 251 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]: dispatch 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[21479]: audit 2024-02-13T14:49:28.710304+0000 mon.a (mon.0) 1331 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]: dispatch 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:27.690934+0000 mon.a (mon.0) 1323 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:27.701131+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: cluster 2024-02-13T14:49:27.776874+0000 mgr.y (mgr.14613) 239 : cluster 0 pgmap v224: 492 pgs: 5 creating+peering, 99 unknown, 388 active+clean; 588 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:27.918243+0000 mon.c (mon.2) 249 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:30.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: cluster 2024-02-13T14:49:28.161937+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:28.163235+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.62:0/3888224602' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:28.173088+0000 mon.a (mon.0) 1325 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:28.177832+0000 mon.a (mon.0) 1326 : audit 1 from='client.46478 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:28.695099+0000 mon.a (mon.0) 1327 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:28.695388+0000 mon.a (mon.0) 1328 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]': finished 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:28.695628+0000 mon.a (mon.0) 1329 : audit 1 from='client.46478 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: cluster 2024-02-13T14:49:28.704620+0000 mon.a (mon.0) 1330 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:28.708920+0000 mon.c (mon.2) 251 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]: dispatch 2024-02-13T14:49:30.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:29 smithi062 bash[28859]: audit 2024-02-13T14:49:28.710304+0000 mon.a (mon.0) 1331 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]: dispatch 2024-02-13T14:49:30.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:27.690934+0000 mon.a (mon.0) 1323 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:27.701131+0000 mon.c (mon.2) 248 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: cluster 2024-02-13T14:49:27.776874+0000 mgr.y (mgr.14613) 239 : cluster 0 pgmap v224: 492 pgs: 5 creating+peering, 99 unknown, 388 active+clean; 588 KiB data, 1.0 GiB used, 714 GiB / 715 GiB avail 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:27.918243+0000 mon.c (mon.2) 249 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: cluster 2024-02-13T14:49:28.161937+0000 mon.a (mon.0) 1324 : cluster 0 osdmap e142: 8 total, 8 up, 8 in 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:28.163235+0000 mon.c (mon.2) 250 : audit 1 from='client.? v1:172.21.15.62:0/3888224602' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:28.173088+0000 mon.a (mon.0) 1325 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:28.177832+0000 mon.a (mon.0) 1326 : audit 1 from='client.46478 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:28.695099+0000 mon.a (mon.0) 1327 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64655-24", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:28.695388+0000 mon.a (mon.0) 1328 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-13"}]': finished 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:28.695628+0000 mon.a (mon.0) 1329 : audit 1 from='client.46478 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushPP_smithi062-64512-14","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: cluster 2024-02-13T14:49:28.704620+0000 mon.a (mon.0) 1330 : cluster 0 osdmap e143: 8 total, 8 up, 8 in 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:28.708920+0000 mon.c (mon.2) 251 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]: dispatch 2024-02-13T14:49:30.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:29 smithi111 bash[23388]: audit 2024-02-13T14:49:28.710304+0000 mon.a (mon.0) 1331 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]: dispatch 2024-02-13T14:49:30.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:49:31.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: audit 2024-02-13T14:49:28.919752+0000 mon.c (mon.2) 252 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:31.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: cluster 2024-02-13T14:49:29.696454+0000 mon.a (mon.0) 1332 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:31.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: audit 2024-02-13T14:49:29.700702+0000 mon.a (mon.0) 1333 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]': finished 2024-02-13T14:49:31.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: cluster 2024-02-13T14:49:29.714176+0000 mon.a (mon.0) 1334 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-02-13T14:49:31.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: audit 2024-02-13T14:49:29.724148+0000 mon.b (mon.1) 173 : audit 1 from='client.? v1:172.21.15.62:0/2269990100' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: audit 2024-02-13T14:49:29.724594+0000 mon.a (mon.0) 1335 : audit 1 from='client.48175 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: audit 2024-02-13T14:49:29.736083+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: audit 2024-02-13T14:49:29.737577+0000 mon.a (mon.0) 1336 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: cluster 2024-02-13T14:49:29.778412+0000 mgr.y (mgr.14613) 240 : cluster 0 pgmap v227: 500 pgs: 1 creating+activating, 34 creating+peering, 50 unknown, 415 active+clean; 1.6 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 309 KiB/s wr, 53 op/s 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: audit 2024-02-13T14:49:29.921072+0000 mon.c (mon.2) 254 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[21479]: audit 2024-02-13T14:49:30.166262+0000 mgr.y (mgr.14613) 241 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: audit 2024-02-13T14:49:28.919752+0000 mon.c (mon.2) 252 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: cluster 2024-02-13T14:49:29.696454+0000 mon.a (mon.0) 1332 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: audit 2024-02-13T14:49:29.700702+0000 mon.a (mon.0) 1333 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]': finished 2024-02-13T14:49:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: cluster 2024-02-13T14:49:29.714176+0000 mon.a (mon.0) 1334 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-02-13T14:49:31.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: audit 2024-02-13T14:49:29.724148+0000 mon.b (mon.1) 173 : audit 1 from='client.? v1:172.21.15.62:0/2269990100' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: audit 2024-02-13T14:49:29.724594+0000 mon.a (mon.0) 1335 : audit 1 from='client.48175 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: audit 2024-02-13T14:49:29.736083+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: audit 2024-02-13T14:49:29.737577+0000 mon.a (mon.0) 1336 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: cluster 2024-02-13T14:49:29.778412+0000 mgr.y (mgr.14613) 240 : cluster 0 pgmap v227: 500 pgs: 1 creating+activating, 34 creating+peering, 50 unknown, 415 active+clean; 1.6 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 309 KiB/s wr, 53 op/s 2024-02-13T14:49:31.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: audit 2024-02-13T14:49:29.921072+0000 mon.c (mon.2) 254 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:31.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:30 smithi062 bash[28859]: audit 2024-02-13T14:49:30.166262+0000 mgr.y (mgr.14613) 241 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:31.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: audit 2024-02-13T14:49:28.919752+0000 mon.c (mon.2) 252 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:31.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: cluster 2024-02-13T14:49:29.696454+0000 mon.a (mon.0) 1332 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: audit 2024-02-13T14:49:29.700702+0000 mon.a (mon.0) 1333 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-13", "mode": "writeback"}]': finished 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: cluster 2024-02-13T14:49:29.714176+0000 mon.a (mon.0) 1334 : cluster 0 osdmap e144: 8 total, 8 up, 8 in 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: audit 2024-02-13T14:49:29.724148+0000 mon.b (mon.1) 173 : audit 1 from='client.? v1:172.21.15.62:0/2269990100' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: audit 2024-02-13T14:49:29.724594+0000 mon.a (mon.0) 1335 : audit 1 from='client.48175 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: audit 2024-02-13T14:49:29.736083+0000 mon.c (mon.2) 253 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: audit 2024-02-13T14:49:29.737577+0000 mon.a (mon.0) 1336 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: cluster 2024-02-13T14:49:29.778412+0000 mgr.y (mgr.14613) 240 : cluster 0 pgmap v227: 500 pgs: 1 creating+activating, 34 creating+peering, 50 unknown, 415 active+clean; 1.6 MiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 309 KiB/s wr, 53 op/s 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: audit 2024-02-13T14:49:29.921072+0000 mon.c (mon.2) 254 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:30 smithi111 bash[23388]: audit 2024-02-13T14:49:30.166262+0000 mgr.y (mgr.14613) 241 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:32.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.705384+0000 mon.a (mon.0) 1337 : audit 1 from='client.48175 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.705751+0000 mon.a (mon.0) 1338 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: cluster 2024-02-13T14:49:30.716037+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.724189+0000 mon.c (mon.2) 255 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.724398+0000 mon.c (mon.2) 256 : audit 1 from='client.? v1:172.21.15.62:0/983344312' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.732527+0000 mon.a (mon.0) 1340 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.732931+0000 mon.a (mon.0) 1341 : audit 1 from='client.46487 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.909617+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.0"}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.909877+0000 mgr.y (mgr.14613) 242 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.0"}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.910527+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.1"}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.910702+0000 mgr.y (mgr.14613) 243 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.1"}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.911248+0000 mon.c (mon.2) 259 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.2"}]: dispatch 2024-02-13T14:49:32.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.911403+0000 mgr.y (mgr.14613) 244 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.2"}]: dispatch 2024-02-13T14:49:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.911904+0000 mon.c (mon.2) 260 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.3"}]: dispatch 2024-02-13T14:49:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.912044+0000 mgr.y (mgr.14613) 245 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.3"}]: dispatch 2024-02-13T14:49:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.912517+0000 mon.c (mon.2) 261 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.4"}]: dispatch 2024-02-13T14:49:32.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.705384+0000 mon.a (mon.0) 1337 : audit 1 from='client.48175 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:32.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.705751+0000 mon.a (mon.0) 1338 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:32.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: cluster 2024-02-13T14:49:30.716037+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-02-13T14:49:32.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.724189+0000 mon.c (mon.2) 255 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.724398+0000 mon.c (mon.2) 256 : audit 1 from='client.? v1:172.21.15.62:0/983344312' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.732527+0000 mon.a (mon.0) 1340 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.732931+0000 mon.a (mon.0) 1341 : audit 1 from='client.46487 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.909617+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.0"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.909877+0000 mgr.y (mgr.14613) 242 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.0"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.910527+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.1"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.910702+0000 mgr.y (mgr.14613) 243 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.1"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.911248+0000 mon.c (mon.2) 259 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.2"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.911403+0000 mgr.y (mgr.14613) 244 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.2"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.911904+0000 mon.c (mon.2) 260 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.3"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.912044+0000 mgr.y (mgr.14613) 245 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.3"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.912517+0000 mon.c (mon.2) 261 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.4"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.912669+0000 mgr.y (mgr.14613) 246 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.4"}]: dispatch 2024-02-13T14:49:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.913217+0000 mon.c (mon.2) 262 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.5"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.913367+0000 mgr.y (mgr.14613) 247 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.5"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.913896+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.6"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.914055+0000 mgr.y (mgr.14613) 248 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.6"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.914625+0000 mon.c (mon.2) 264 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.7"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.914778+0000 mgr.y (mgr.14613) 249 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.7"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.915260+0000 mon.c (mon.2) 265 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.8"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.915414+0000 mgr.y (mgr.14613) 250 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.8"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.915897+0000 mon.c (mon.2) 266 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.9"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.916061+0000 mgr.y (mgr.14613) 251 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.9"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: audit 2024-02-13T14:49:30.921842+0000 mon.c (mon.2) 267 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.075404+0000 osd.3 (osd.3) 11 : cluster 0 153.2 scrub starts 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.080726+0000 osd.3 (osd.3) 12 : cluster 0 153.2 scrub ok 2024-02-13T14:49:32.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.683410+0000 mon.a (mon.0) 1342 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.912669+0000 mgr.y (mgr.14613) 246 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.4"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.913217+0000 mon.c (mon.2) 262 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.5"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.913367+0000 mgr.y (mgr.14613) 247 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.5"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.913896+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.6"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.914055+0000 mgr.y (mgr.14613) 248 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.6"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.914625+0000 mon.c (mon.2) 264 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.7"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.914778+0000 mgr.y (mgr.14613) 249 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.7"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.915260+0000 mon.c (mon.2) 265 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.8"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.915414+0000 mgr.y (mgr.14613) 250 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.8"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.915897+0000 mon.c (mon.2) 266 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.9"}]: dispatch 2024-02-13T14:49:32.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.916061+0000 mgr.y (mgr.14613) 251 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.9"}]: dispatch 2024-02-13T14:49:32.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: audit 2024-02-13T14:49:30.921842+0000 mon.c (mon.2) 267 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:32.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.075404+0000 osd.3 (osd.3) 11 : cluster 0 153.2 scrub starts 2024-02-13T14:49:32.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.080726+0000 osd.3 (osd.3) 12 : cluster 0 153.2 scrub ok 2024-02-13T14:49:32.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:31 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.683410+0000 mon.a (mon.0) 1342 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.705384+0000 mon.a (mon.0) 1337 : audit 1 from='client.48175 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFull_smithi062-64504-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.705751+0000 mon.a (mon.0) 1338 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: cluster 2024-02-13T14:49:30.716037+0000 mon.a (mon.0) 1339 : cluster 0 osdmap e145: 8 total, 8 up, 8 in 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.724189+0000 mon.c (mon.2) 255 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.724398+0000 mon.c (mon.2) 256 : audit 1 from='client.? v1:172.21.15.62:0/983344312' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.732527+0000 mon.a (mon.0) 1340 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.732931+0000 mon.a (mon.0) 1341 : audit 1 from='client.46487 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.909617+0000 mon.c (mon.2) 257 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.0"}]: dispatch 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.909877+0000 mgr.y (mgr.14613) 242 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.0"}]: dispatch 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.910527+0000 mon.c (mon.2) 258 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.1"}]: dispatch 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.910702+0000 mgr.y (mgr.14613) 243 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.1"}]: dispatch 2024-02-13T14:49:32.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.911248+0000 mon.c (mon.2) 259 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.2"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.911403+0000 mgr.y (mgr.14613) 244 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.2"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.911904+0000 mon.c (mon.2) 260 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.3"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.912044+0000 mgr.y (mgr.14613) 245 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.3"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.912517+0000 mon.c (mon.2) 261 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.4"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.912669+0000 mgr.y (mgr.14613) 246 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.4"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.913217+0000 mon.c (mon.2) 262 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.5"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.913367+0000 mgr.y (mgr.14613) 247 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.5"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.913896+0000 mon.c (mon.2) 263 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.6"}]: dispatch 2024-02-13T14:49:32.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.914055+0000 mgr.y (mgr.14613) 248 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.6"}]: dispatch 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.914625+0000 mon.c (mon.2) 264 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.7"}]: dispatch 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.914778+0000 mgr.y (mgr.14613) 249 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.7"}]: dispatch 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.915260+0000 mon.c (mon.2) 265 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.8"}]: dispatch 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.915414+0000 mgr.y (mgr.14613) 250 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.8"}]: dispatch 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.915897+0000 mon.c (mon.2) 266 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "153.9"}]: dispatch 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.916061+0000 mgr.y (mgr.14613) 251 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "153.9"}]: dispatch 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: audit 2024-02-13T14:49:30.921842+0000 mon.c (mon.2) 267 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.075404+0000 osd.3 (osd.3) 11 : cluster 0 153.2 scrub starts 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.080726+0000 osd.3 (osd.3) 12 : cluster 0 153.2 scrub ok 2024-02-13T14:49:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:31 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.683410+0000 mon.a (mon.0) 1342 : cluster 3 Health check update: 9 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.374693+0000 osd.1 (osd.1) 7 : cluster 0 153.9 deep-scrub starts 2024-02-13T14:49:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.409166+0000 osd.1 (osd.1) 8 : cluster 0 153.9 deep-scrub ok 2024-02-13T14:49:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.685636+0000 osd.4 (osd.4) 7 : cluster 0 153.3 scrub starts 2024-02-13T14:49:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.689072+0000 osd.4 (osd.4) 8 : cluster 0 153.3 scrub ok 2024-02-13T14:49:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: audit 2024-02-13T14:49:31.708986+0000 mon.a (mon.0) 1343 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: audit 2024-02-13T14:49:31.709315+0000 mon.a (mon.0) 1344 : audit 1 from='client.46487 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:33.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.718818+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.779420+0000 mgr.y (mgr.14613) 252 : cluster 0 pgmap v230: 500 pgs: 1 creating+activating, 30 creating+peering, 39 unknown, 430 active+clean; 1.6 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 335 KiB/s wr, 77 op/s 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.808481+0000 osd.2 (osd.2) 7 : cluster 0 153.1 scrub starts 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.809604+0000 osd.2 (osd.2) 8 : cluster 0 153.1 scrub ok 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.833937+0000 osd.0 (osd.0) 15 : cluster 0 153.8 scrub starts 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:31.837867+0000 osd.0 (osd.0) 16 : cluster 0 153.8 scrub ok 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: audit 2024-02-13T14:49:31.922781+0000 mon.c (mon.2) 268 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:32.058766+0000 osd.3 (osd.3) 13 : cluster 0 153.4 scrub starts 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:32.063630+0000 osd.3 (osd.3) 14 : cluster 0 153.4 scrub ok 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: audit 2024-02-13T14:49:32.256708+0000 mon.a (mon.0) 1346 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: audit 2024-02-13T14:49:32.260543+0000 mon.b (mon.1) 174 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: cluster 2024-02-13T14:49:32.720808+0000 mon.a (mon.0) 1347 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-02-13T14:49:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[28859]: audit 2024-02-13T14:49:32.737113+0000 mon.a (mon.0) 1348 : audit 1 from='client.? v1:172.21.15.62:0/4198470830' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi062-64504-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.374693+0000 osd.1 (osd.1) 7 : cluster 0 153.9 deep-scrub starts 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.409166+0000 osd.1 (osd.1) 8 : cluster 0 153.9 deep-scrub ok 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.685636+0000 osd.4 (osd.4) 7 : cluster 0 153.3 scrub starts 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.689072+0000 osd.4 (osd.4) 8 : cluster 0 153.3 scrub ok 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: audit 2024-02-13T14:49:31.708986+0000 mon.a (mon.0) 1343 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: audit 2024-02-13T14:49:31.709315+0000 mon.a (mon.0) 1344 : audit 1 from='client.46487 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.718818+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.779420+0000 mgr.y (mgr.14613) 252 : cluster 0 pgmap v230: 500 pgs: 1 creating+activating, 30 creating+peering, 39 unknown, 430 active+clean; 1.6 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 335 KiB/s wr, 77 op/s 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.808481+0000 osd.2 (osd.2) 7 : cluster 0 153.1 scrub starts 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.809604+0000 osd.2 (osd.2) 8 : cluster 0 153.1 scrub ok 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.833937+0000 osd.0 (osd.0) 15 : cluster 0 153.8 scrub starts 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:31.837867+0000 osd.0 (osd.0) 16 : cluster 0 153.8 scrub ok 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: audit 2024-02-13T14:49:31.922781+0000 mon.c (mon.2) 268 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:32.058766+0000 osd.3 (osd.3) 13 : cluster 0 153.4 scrub starts 2024-02-13T14:49:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:32.063630+0000 osd.3 (osd.3) 14 : cluster 0 153.4 scrub ok 2024-02-13T14:49:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: audit 2024-02-13T14:49:32.256708+0000 mon.a (mon.0) 1346 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: audit 2024-02-13T14:49:32.260543+0000 mon.b (mon.1) 174 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: cluster 2024-02-13T14:49:32.720808+0000 mon.a (mon.0) 1347 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-02-13T14:49:33.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:32 smithi062 bash[21479]: audit 2024-02-13T14:49:32.737113+0000 mon.a (mon.0) 1348 : audit 1 from='client.? v1:172.21.15.62:0/4198470830' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi062-64504-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:33.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.374693+0000 osd.1 (osd.1) 7 : cluster 0 153.9 deep-scrub starts 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.409166+0000 osd.1 (osd.1) 8 : cluster 0 153.9 deep-scrub ok 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.685636+0000 osd.4 (osd.4) 7 : cluster 0 153.3 scrub starts 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.689072+0000 osd.4 (osd.4) 8 : cluster 0 153.3 scrub ok 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: audit 2024-02-13T14:49:31.708986+0000 mon.a (mon.0) 1343 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64655-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: audit 2024-02-13T14:49:31.709315+0000 mon.a (mon.0) 1344 : audit 1 from='client.46487 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "FlushAsyncPP_smithi062-64512-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.718818+0000 mon.a (mon.0) 1345 : cluster 0 osdmap e146: 8 total, 8 up, 8 in 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.779420+0000 mgr.y (mgr.14613) 252 : cluster 0 pgmap v230: 500 pgs: 1 creating+activating, 30 creating+peering, 39 unknown, 430 active+clean; 1.6 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 335 KiB/s wr, 77 op/s 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.808481+0000 osd.2 (osd.2) 7 : cluster 0 153.1 scrub starts 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.809604+0000 osd.2 (osd.2) 8 : cluster 0 153.1 scrub ok 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.833937+0000 osd.0 (osd.0) 15 : cluster 0 153.8 scrub starts 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:31.837867+0000 osd.0 (osd.0) 16 : cluster 0 153.8 scrub ok 2024-02-13T14:49:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: audit 2024-02-13T14:49:31.922781+0000 mon.c (mon.2) 268 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:32.058766+0000 osd.3 (osd.3) 13 : cluster 0 153.4 scrub starts 2024-02-13T14:49:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:32.063630+0000 osd.3 (osd.3) 14 : cluster 0 153.4 scrub ok 2024-02-13T14:49:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: audit 2024-02-13T14:49:32.256708+0000 mon.a (mon.0) 1346 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:49:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: audit 2024-02-13T14:49:32.260543+0000 mon.b (mon.1) 174 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: cluster 2024-02-13T14:49:32.720808+0000 mon.a (mon.0) 1347 : cluster 0 osdmap e147: 8 total, 8 up, 8 in 2024-02-13T14:49:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:32 smithi111 bash[23388]: audit 2024-02-13T14:49:32.737113+0000 mon.a (mon.0) 1348 : audit 1 from='client.? v1:172.21.15.62:0/4198470830' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi062-64504-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:34.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: cluster 2024-02-13T14:49:32.866679+0000 osd.0 (osd.0) 17 : cluster 0 153.0 scrub starts 2024-02-13T14:49:34.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: cluster 2024-02-13T14:49:32.870731+0000 osd.0 (osd.0) 18 : cluster 0 153.0 scrub ok 2024-02-13T14:49:34.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: audit 2024-02-13T14:49:32.923997+0000 mon.c (mon.2) 269 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:34.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: audit 2024-02-13T14:49:33.715767+0000 mon.a (mon.0) 1349 : audit 1 from='client.? v1:172.21.15.62:0/4198470830' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi062-64504-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: cluster 2024-02-13T14:49:33.727059+0000 mon.a (mon.0) 1350 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: audit 2024-02-13T14:49:33.730018+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: audit 2024-02-13T14:49:33.730577+0000 mon.a (mon.0) 1351 : audit 1 from='client.? v1:172.21.15.62:0/2143097287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi062-64512-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: audit 2024-02-13T14:49:33.730745+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: audit 2024-02-13T14:49:33.735185+0000 mon.a (mon.0) 1352 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[28859]: audit 2024-02-13T14:49:33.735772+0000 mon.a (mon.0) 1353 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: cluster 2024-02-13T14:49:32.866679+0000 osd.0 (osd.0) 17 : cluster 0 153.0 scrub starts 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: cluster 2024-02-13T14:49:32.870731+0000 osd.0 (osd.0) 18 : cluster 0 153.0 scrub ok 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: audit 2024-02-13T14:49:32.923997+0000 mon.c (mon.2) 269 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: audit 2024-02-13T14:49:33.715767+0000 mon.a (mon.0) 1349 : audit 1 from='client.? v1:172.21.15.62:0/4198470830' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi062-64504-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:34.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: cluster 2024-02-13T14:49:33.727059+0000 mon.a (mon.0) 1350 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-02-13T14:49:34.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: audit 2024-02-13T14:49:33.730018+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:34.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: audit 2024-02-13T14:49:33.730577+0000 mon.a (mon.0) 1351 : audit 1 from='client.? v1:172.21.15.62:0/2143097287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi062-64512-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:34.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: audit 2024-02-13T14:49:33.730745+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:34.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: audit 2024-02-13T14:49:33.735185+0000 mon.a (mon.0) 1352 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:34.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:33 smithi062 bash[21479]: audit 2024-02-13T14:49:33.735772+0000 mon.a (mon.0) 1353 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:34.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: cluster 2024-02-13T14:49:32.866679+0000 osd.0 (osd.0) 17 : cluster 0 153.0 scrub starts 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: cluster 2024-02-13T14:49:32.870731+0000 osd.0 (osd.0) 18 : cluster 0 153.0 scrub ok 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: audit 2024-02-13T14:49:32.923997+0000 mon.c (mon.2) 269 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: audit 2024-02-13T14:49:33.715767+0000 mon.a (mon.0) 1349 : audit 1 from='client.? v1:172.21.15.62:0/4198470830' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSame_smithi062-64504-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: cluster 2024-02-13T14:49:33.727059+0000 mon.a (mon.0) 1350 : cluster 0 osdmap e148: 8 total, 8 up, 8 in 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: audit 2024-02-13T14:49:33.730018+0000 mon.c (mon.2) 270 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: audit 2024-02-13T14:49:33.730577+0000 mon.a (mon.0) 1351 : audit 1 from='client.? v1:172.21.15.62:0/2143097287' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi062-64512-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: audit 2024-02-13T14:49:33.730745+0000 mon.c (mon.2) 271 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: audit 2024-02-13T14:49:33.735185+0000 mon.a (mon.0) 1352 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:33 smithi111 bash[23388]: audit 2024-02-13T14:49:33.735772+0000 mon.a (mon.0) 1353 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:35.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[21479]: cluster 2024-02-13T14:49:33.780099+0000 mgr.y (mgr.14613) 253 : cluster 0 pgmap v233: 484 pgs: 96 unknown, 388 active+clean; 591 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 17 op/s 2024-02-13T14:49:35.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[21479]: cluster 2024-02-13T14:49:33.908850+0000 osd.0 (osd.0) 19 : cluster 0 153.7 scrub starts 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[21479]: cluster 2024-02-13T14:49:33.913696+0000 osd.0 (osd.0) 20 : cluster 0 153.7 scrub ok 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[21479]: audit 2024-02-13T14:49:33.925661+0000 mon.c (mon.2) 272 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[21479]: audit 2024-02-13T14:49:34.719528+0000 mon.a (mon.0) 1354 : audit 1 from='client.? v1:172.21.15.62:0/2143097287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi062-64512-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[21479]: audit 2024-02-13T14:49:34.719733+0000 mon.a (mon.0) 1355 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[21479]: audit 2024-02-13T14:49:34.719924+0000 mon.a (mon.0) 1356 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[21479]: cluster 2024-02-13T14:49:34.728401+0000 mon.a (mon.0) 1357 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[28859]: cluster 2024-02-13T14:49:33.780099+0000 mgr.y (mgr.14613) 253 : cluster 0 pgmap v233: 484 pgs: 96 unknown, 388 active+clean; 591 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 17 op/s 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[28859]: cluster 2024-02-13T14:49:33.908850+0000 osd.0 (osd.0) 19 : cluster 0 153.7 scrub starts 2024-02-13T14:49:35.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[28859]: cluster 2024-02-13T14:49:33.913696+0000 osd.0 (osd.0) 20 : cluster 0 153.7 scrub ok 2024-02-13T14:49:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[28859]: audit 2024-02-13T14:49:33.925661+0000 mon.c (mon.2) 272 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[28859]: audit 2024-02-13T14:49:34.719528+0000 mon.a (mon.0) 1354 : audit 1 from='client.? v1:172.21.15.62:0/2143097287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi062-64512-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[28859]: audit 2024-02-13T14:49:34.719733+0000 mon.a (mon.0) 1355 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[28859]: audit 2024-02-13T14:49:34.719924+0000 mon.a (mon.0) 1356 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:34 smithi062 bash[28859]: cluster 2024-02-13T14:49:34.728401+0000 mon.a (mon.0) 1357 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-02-13T14:49:35.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:34 smithi111 bash[23388]: cluster 2024-02-13T14:49:33.780099+0000 mgr.y (mgr.14613) 253 : cluster 0 pgmap v233: 484 pgs: 96 unknown, 388 active+clean; 591 KiB data, 462 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 17 op/s 2024-02-13T14:49:35.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:34 smithi111 bash[23388]: cluster 2024-02-13T14:49:33.908850+0000 osd.0 (osd.0) 19 : cluster 0 153.7 scrub starts 2024-02-13T14:49:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:34 smithi111 bash[23388]: cluster 2024-02-13T14:49:33.913696+0000 osd.0 (osd.0) 20 : cluster 0 153.7 scrub ok 2024-02-13T14:49:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:34 smithi111 bash[23388]: audit 2024-02-13T14:49:33.925661+0000 mon.c (mon.2) 272 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:34 smithi111 bash[23388]: audit 2024-02-13T14:49:34.719528+0000 mon.a (mon.0) 1354 : audit 1 from='client.? v1:172.21.15.62:0/2143097287' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP_smithi062-64512-16","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:34 smithi111 bash[23388]: audit 2024-02-13T14:49:34.719733+0000 mon.a (mon.0) 1355 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:34 smithi111 bash[23388]: audit 2024-02-13T14:49:34.719924+0000 mon.a (mon.0) 1356 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:34 smithi111 bash[23388]: cluster 2024-02-13T14:49:34.728401+0000 mon.a (mon.0) 1357 : cluster 0 osdmap e149: 8 total, 8 up, 8 in 2024-02-13T14:49:35.731 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 22 tests from LibRadosMiscPP api_snapshots: Running main() from gmock_main.cc 2024-02-13T14:49:35.731 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [==========] Running 13 tests from 4 test suites. 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] Global test environment set-up. 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapList 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapList (3592 ms) 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapRemove 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapRemove (9221 ms) 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.Rollback 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshots.Rollback (3317 ms) 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshots.SnapGetName 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshots.SnapGetName (4670 ms) 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshots (20800 ms total) 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged 2024-02-13T14:49:35.732 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Snap 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Snap (4348 ms) 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.Rollback 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.Rollback (7339 ms) 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManaged.FutureSnapRollback 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManaged.FutureSnapRollback (9148 ms) 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 3 tests from LibRadosSnapshotsSelfManaged (20835 ms total) 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapList 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapList (4412 ms) 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapRemove 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapRemove (3422 ms) 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.Rollback 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.Rollback (1115 ms) 2024-02-13T14:49:35.733 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsEC.SnapGetName 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsEC.SnapGetName (2027 ms) 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 4 tests from LibRadosSnapshotsEC (10976 ms total) 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Snap 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Snap (4061 ms) 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ RUN ] LibRadosSnapshotsSelfManagedEC.Rollback 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ OK ] LibRadosSnapshotsSelfManagedEC.Rollback (4029 ms) 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] 2 tests from LibRadosSnapshotsSelfManagedEC (8090 ms total) 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [----------] Global test environment tear-down 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [==========] 13 tests from 4 test suites ran. (96989 ms total) 2024-02-13T14:49:35.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots: [ PASSED ] 13 tests. 2024-02-13T14:49:36.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:49:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:49:37.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:34.734436+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:37.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:34.738897+0000 mon.c (mon.2) 274 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:37.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:34.767483+0000 mon.a (mon.0) 1358 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:37.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:34.768012+0000 mon.a (mon.0) 1359 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:34.927106+0000 mon.c (mon.2) 275 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:35.722900+0000 mon.a (mon.0) 1360 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:35.722961+0000 mon.a (mon.0) 1361 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: cluster 2024-02-13T14:49:35.727205+0000 mon.a (mon.0) 1362 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:35.731440+0000 mon.a (mon.0) 1363 : audit 1 from='client.? v1:172.21.15.62:0/2696541868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi062-64504-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:35.731534+0000 mon.c (mon.2) 276 : audit 1 from='client.? v1:172.21.15.62:0/1579620774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[21479]: audit 2024-02-13T14:49:35.750283+0000 mon.a (mon.0) 1364 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:34.734436+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:34.738897+0000 mon.c (mon.2) 274 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:34.767483+0000 mon.a (mon.0) 1358 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:34.768012+0000 mon.a (mon.0) 1359 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:34.927106+0000 mon.c (mon.2) 275 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:35.722900+0000 mon.a (mon.0) 1360 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:35.722961+0000 mon.a (mon.0) 1361 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: cluster 2024-02-13T14:49:35.727205+0000 mon.a (mon.0) 1362 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-02-13T14:49:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:35.731440+0000 mon.a (mon.0) 1363 : audit 1 from='client.? v1:172.21.15.62:0/2696541868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi062-64504-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:35.731534+0000 mon.c (mon.2) 276 : audit 1 from='client.? v1:172.21.15.62:0/1579620774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:36 smithi062 bash[28859]: audit 2024-02-13T14:49:35.750283+0000 mon.a (mon.0) 1364 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:37.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:34.734436+0000 mon.c (mon.2) 273 : audit 1 from='client.? v1:172.21.15.62:0/1758550845' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:37.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:34.738897+0000 mon.c (mon.2) 274 : audit 1 from='client.? v1:172.21.15.62:0/2295403728' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:37.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:34.767483+0000 mon.a (mon.0) 1358 : audit 1 from='client.46448 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]: dispatch 2024-02-13T14:49:37.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:34.768012+0000 mon.a (mon.0) 1359 : audit 1 from='client.46472 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]: dispatch 2024-02-13T14:49:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:34.927106+0000 mon.c (mon.2) 275 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:35.722900+0000 mon.a (mon.0) 1360 : audit 1 from='client.46448 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedEC_smithi062-64731-15"}]': finished 2024-02-13T14:49:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:35.722961+0000 mon.a (mon.0) 1361 : audit 1 from='client.46472 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64655-24"}]': finished 2024-02-13T14:49:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: cluster 2024-02-13T14:49:35.727205+0000 mon.a (mon.0) 1362 : cluster 0 osdmap e150: 8 total, 8 up, 8 in 2024-02-13T14:49:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:35.731440+0000 mon.a (mon.0) 1363 : audit 1 from='client.? v1:172.21.15.62:0/2696541868' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi062-64504-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:35.731534+0000 mon.c (mon.2) 276 : audit 1 from='client.? v1:172.21.15.62:0/1579620774' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:36 smithi111 bash[23388]: audit 2024-02-13T14:49:35.750283+0000 mon.a (mon.0) 1364 : audit 1 from='client.46514 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: cluster 2024-02-13T14:49:35.780654+0000 mgr.y (mgr.14613) 254 : cluster 0 pgmap v236: 452 pgs: 11 creating+activating, 16 creating+peering, 64 unknown, 361 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 73 op/s 2024-02-13T14:49:38.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: audit 2024-02-13T14:49:35.928511+0000 mon.c (mon.2) 277 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:38.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: cluster 2024-02-13T14:49:36.684906+0000 mon.a (mon.0) 1365 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:38.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: audit 2024-02-13T14:49:36.727493+0000 mon.a (mon.0) 1366 : audit 1 from='client.? v1:172.21.15.62:0/2696541868' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi062-64504-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:38.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: audit 2024-02-13T14:49:36.727729+0000 mon.a (mon.0) 1367 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: cluster 2024-02-13T14:49:36.736720+0000 mon.a (mon.0) 1368 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: audit 2024-02-13T14:49:36.753709+0000 mon.a (mon.0) 1369 : audit 1 from='client.? v1:172.21.15.62:0/629121274' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi062-64655-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: audit 2024-02-13T14:49:36.782906+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.62:0/4281794758' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: audit 2024-02-13T14:49:36.787108+0000 mon.a (mon.0) 1370 : audit 1 from='client.46523 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[28859]: audit 2024-02-13T14:49:36.930140+0000 mon.c (mon.2) 279 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: cluster 2024-02-13T14:49:35.780654+0000 mgr.y (mgr.14613) 254 : cluster 0 pgmap v236: 452 pgs: 11 creating+activating, 16 creating+peering, 64 unknown, 361 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 73 op/s 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: audit 2024-02-13T14:49:35.928511+0000 mon.c (mon.2) 277 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: cluster 2024-02-13T14:49:36.684906+0000 mon.a (mon.0) 1365 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: audit 2024-02-13T14:49:36.727493+0000 mon.a (mon.0) 1366 : audit 1 from='client.? v1:172.21.15.62:0/2696541868' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi062-64504-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: audit 2024-02-13T14:49:36.727729+0000 mon.a (mon.0) 1367 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: cluster 2024-02-13T14:49:36.736720+0000 mon.a (mon.0) 1368 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-02-13T14:49:38.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: audit 2024-02-13T14:49:36.753709+0000 mon.a (mon.0) 1369 : audit 1 from='client.? v1:172.21.15.62:0/629121274' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi062-64655-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: audit 2024-02-13T14:49:36.782906+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.62:0/4281794758' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: audit 2024-02-13T14:49:36.787108+0000 mon.a (mon.0) 1370 : audit 1 from='client.46523 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:37 smithi062 bash[21479]: audit 2024-02-13T14:49:36.930140+0000 mon.c (mon.2) 279 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:38.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: cluster 2024-02-13T14:49:35.780654+0000 mgr.y (mgr.14613) 254 : cluster 0 pgmap v236: 452 pgs: 11 creating+activating, 16 creating+peering, 64 unknown, 361 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 54 KiB/s rd, 73 op/s 2024-02-13T14:49:38.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: audit 2024-02-13T14:49:35.928511+0000 mon.c (mon.2) 277 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:38.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: cluster 2024-02-13T14:49:36.684906+0000 mon.a (mon.0) 1365 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: audit 2024-02-13T14:49:36.727493+0000 mon.a (mon.0) 1366 : audit 1 from='client.? v1:172.21.15.62:0/2696541868' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStat_smithi062-64504-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: audit 2024-02-13T14:49:36.727729+0000 mon.a (mon.0) 1367 : audit 1 from='client.46514 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64736-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: cluster 2024-02-13T14:49:36.736720+0000 mon.a (mon.0) 1368 : cluster 0 osdmap e151: 8 total, 8 up, 8 in 2024-02-13T14:49:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: audit 2024-02-13T14:49:36.753709+0000 mon.a (mon.0) 1369 : audit 1 from='client.? v1:172.21.15.62:0/629121274' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi062-64655-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: audit 2024-02-13T14:49:36.782906+0000 mon.c (mon.2) 278 : audit 1 from='client.? v1:172.21.15.62:0/4281794758' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: audit 2024-02-13T14:49:36.787108+0000 mon.a (mon.0) 1370 : audit 1 from='client.46523 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:37 smithi111 bash[23388]: audit 2024-02-13T14:49:36.930140+0000 mon.c (mon.2) 279 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:39.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: audit 2024-02-13T14:49:37.731944+0000 mon.a (mon.0) 1371 : audit 1 from='client.? v1:172.21.15.62:0/629121274' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi062-64655-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:39.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: audit 2024-02-13T14:49:37.732114+0000 mon.a (mon.0) 1372 : audit 1 from='client.46523 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:39.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: cluster 2024-02-13T14:49:37.740799+0000 mon.a (mon.0) 1373 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-02-13T14:49:39.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: cluster 2024-02-13T14:49:37.781421+0000 mgr.y (mgr.14613) 255 : cluster 0 pgmap v239: 484 pgs: 128 unknown, 356 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 73 op/s 2024-02-13T14:49:39.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: cluster 2024-02-13T14:49:37.828613+0000 osd.2 (osd.2) 9 : cluster 0 153.5 scrub starts 2024-02-13T14:49:39.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: cluster 2024-02-13T14:49:37.830646+0000 osd.4 (osd.4) 9 : cluster 0 153.6 scrub starts 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: cluster 2024-02-13T14:49:37.831985+0000 osd.2 (osd.2) 10 : cluster 0 153.5 scrub ok 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: cluster 2024-02-13T14:49:37.832686+0000 osd.4 (osd.4) 10 : cluster 0 153.6 scrub ok 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[28859]: audit 2024-02-13T14:49:37.931600+0000 mon.c (mon.2) 280 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: audit 2024-02-13T14:49:37.731944+0000 mon.a (mon.0) 1371 : audit 1 from='client.? v1:172.21.15.62:0/629121274' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi062-64655-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: audit 2024-02-13T14:49:37.732114+0000 mon.a (mon.0) 1372 : audit 1 from='client.46523 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: cluster 2024-02-13T14:49:37.740799+0000 mon.a (mon.0) 1373 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: cluster 2024-02-13T14:49:37.781421+0000 mgr.y (mgr.14613) 255 : cluster 0 pgmap v239: 484 pgs: 128 unknown, 356 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 73 op/s 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: cluster 2024-02-13T14:49:37.828613+0000 osd.2 (osd.2) 9 : cluster 0 153.5 scrub starts 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: cluster 2024-02-13T14:49:37.830646+0000 osd.4 (osd.4) 9 : cluster 0 153.6 scrub starts 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: cluster 2024-02-13T14:49:37.831985+0000 osd.2 (osd.2) 10 : cluster 0 153.5 scrub ok 2024-02-13T14:49:39.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: cluster 2024-02-13T14:49:37.832686+0000 osd.4 (osd.4) 10 : cluster 0 153.6 scrub ok 2024-02-13T14:49:39.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:38 smithi062 bash[21479]: audit 2024-02-13T14:49:37.931600+0000 mon.c (mon.2) 280 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:39.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: audit 2024-02-13T14:49:37.731944+0000 mon.a (mon.0) 1371 : audit 1 from='client.? v1:172.21.15.62:0/629121274' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/0_smithi062-64655-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:39.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: audit 2024-02-13T14:49:37.732114+0000 mon.a (mon.0) 1372 : audit 1 from='client.46523 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:39.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: cluster 2024-02-13T14:49:37.740799+0000 mon.a (mon.0) 1373 : cluster 0 osdmap e152: 8 total, 8 up, 8 in 2024-02-13T14:49:39.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: cluster 2024-02-13T14:49:37.781421+0000 mgr.y (mgr.14613) 255 : cluster 0 pgmap v239: 484 pgs: 128 unknown, 356 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 56 KiB/s rd, 73 op/s 2024-02-13T14:49:39.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: cluster 2024-02-13T14:49:37.828613+0000 osd.2 (osd.2) 9 : cluster 0 153.5 scrub starts 2024-02-13T14:49:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: cluster 2024-02-13T14:49:37.830646+0000 osd.4 (osd.4) 9 : cluster 0 153.6 scrub starts 2024-02-13T14:49:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: cluster 2024-02-13T14:49:37.831985+0000 osd.2 (osd.2) 10 : cluster 0 153.5 scrub ok 2024-02-13T14:49:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: cluster 2024-02-13T14:49:37.832686+0000 osd.4 (osd.4) 10 : cluster 0 153.6 scrub ok 2024-02-13T14:49:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:38 smithi111 bash[23388]: audit 2024-02-13T14:49:37.931600+0000 mon.c (mon.2) 280 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:40.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:39 smithi062 bash[28859]: cluster 2024-02-13T14:49:38.756892+0000 mon.a (mon.0) 1374 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-02-13T14:49:40.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:39 smithi062 bash[28859]: audit 2024-02-13T14:49:38.763715+0000 mon.c (mon.2) 281 : audit 1 from='client.? v1:172.21.15.62:0/3094678694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:40.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:39 smithi062 bash[28859]: audit 2024-02-13T14:49:38.779897+0000 mon.a (mon.0) 1375 : audit 1 from='client.46541 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:40.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:39 smithi062 bash[28859]: audit 2024-02-13T14:49:38.933098+0000 mon.c (mon.2) 282 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:40.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:39 smithi062 bash[21479]: cluster 2024-02-13T14:49:38.756892+0000 mon.a (mon.0) 1374 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-02-13T14:49:40.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:39 smithi062 bash[21479]: audit 2024-02-13T14:49:38.763715+0000 mon.c (mon.2) 281 : audit 1 from='client.? v1:172.21.15.62:0/3094678694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:40.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:39 smithi062 bash[21479]: audit 2024-02-13T14:49:38.779897+0000 mon.a (mon.0) 1375 : audit 1 from='client.46541 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:40.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:39 smithi062 bash[21479]: audit 2024-02-13T14:49:38.933098+0000 mon.c (mon.2) 282 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:40.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:39 smithi111 bash[23388]: cluster 2024-02-13T14:49:38.756892+0000 mon.a (mon.0) 1374 : cluster 0 osdmap e153: 8 total, 8 up, 8 in 2024-02-13T14:49:40.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:39 smithi111 bash[23388]: audit 2024-02-13T14:49:38.763715+0000 mon.c (mon.2) 281 : audit 1 from='client.? v1:172.21.15.62:0/3094678694' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:40.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:39 smithi111 bash[23388]: audit 2024-02-13T14:49:38.779897+0000 mon.a (mon.0) 1375 : audit 1 from='client.46541 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:40.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:39 smithi111 bash[23388]: audit 2024-02-13T14:49:38.933098+0000 mon.c (mon.2) 282 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:40.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.749449+0000 mon.a (mon.0) 1376 : audit 1 from='client.46541 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: cluster 2024-02-13T14:49:39.753793+0000 mon.a (mon.0) 1377 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.757628+0000 mon.a (mon.0) 1378 : audit 1 from='client.? v1:172.21.15.62:0/3346531167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi062-64655-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.760504+0000 mon.b (mon.1) 175 : audit 1 from='client.? v1:172.21.15.62:0/3453266003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.781088+0000 mon.a (mon.0) 1379 : audit 1 from='client.48238 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: cluster 2024-02-13T14:49:39.782145+0000 mgr.y (mgr.14613) 256 : cluster 0 pgmap v242: 484 pgs: 16 creating+peering, 93 unknown, 375 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.838605+0000 mon.c (mon.2) 283 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.839044+0000 mon.a (mon.0) 1380 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.840721+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.841359+0000 mon.a (mon.0) 1381 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.842130+0000 mon.c (mon.2) 285 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.842457+0000 mon.a (mon.0) 1382 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:39.934509+0000 mon.c (mon.2) 286 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:40.177477+0000 mgr.y (mgr.14613) 257 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[21479]: audit 2024-02-13T14:49:40.753047+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.62:0/3346531167' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi062-64655-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.749449+0000 mon.a (mon.0) 1376 : audit 1 from='client.46541 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: cluster 2024-02-13T14:49:39.753793+0000 mon.a (mon.0) 1377 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.757628+0000 mon.a (mon.0) 1378 : audit 1 from='client.? v1:172.21.15.62:0/3346531167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi062-64655-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.760504+0000 mon.b (mon.1) 175 : audit 1 from='client.? v1:172.21.15.62:0/3453266003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.781088+0000 mon.a (mon.0) 1379 : audit 1 from='client.48238 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: cluster 2024-02-13T14:49:39.782145+0000 mgr.y (mgr.14613) 256 : cluster 0 pgmap v242: 484 pgs: 16 creating+peering, 93 unknown, 375 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.838605+0000 mon.c (mon.2) 283 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.839044+0000 mon.a (mon.0) 1380 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.840721+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.841359+0000 mon.a (mon.0) 1381 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.842130+0000 mon.c (mon.2) 285 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.842457+0000 mon.a (mon.0) 1382 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:39.934509+0000 mon.c (mon.2) 286 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:40.177477+0000 mgr.y (mgr.14613) 257 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:40 smithi062 bash[28859]: audit 2024-02-13T14:49:40.753047+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.62:0/3346531167' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi062-64655-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.749449+0000 mon.a (mon.0) 1376 : audit 1 from='client.46541 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64504-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: cluster 2024-02-13T14:49:39.753793+0000 mon.a (mon.0) 1377 : cluster 0 osdmap e154: 8 total, 8 up, 8 in 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.757628+0000 mon.a (mon.0) 1378 : audit 1 from='client.? v1:172.21.15.62:0/3346531167' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi062-64655-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.760504+0000 mon.b (mon.1) 175 : audit 1 from='client.? v1:172.21.15.62:0/3453266003' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.781088+0000 mon.a (mon.0) 1379 : audit 1 from='client.48238 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: cluster 2024-02-13T14:49:39.782145+0000 mgr.y (mgr.14613) 256 : cluster 0 pgmap v242: 484 pgs: 16 creating+peering, 93 unknown, 375 active+clean; 592 KiB data, 458 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.838605+0000 mon.c (mon.2) 283 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.839044+0000 mon.a (mon.0) 1380 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.840721+0000 mon.c (mon.2) 284 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.841359+0000 mon.a (mon.0) 1381 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:41.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.842130+0000 mon.c (mon.2) 285 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.842457+0000 mon.a (mon.0) 1382 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:39.934509+0000 mon.c (mon.2) 286 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:40.177477+0000 mgr.y (mgr.14613) 257 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:40 smithi111 bash[23388]: audit 2024-02-13T14:49:40.753047+0000 mon.a (mon.0) 1383 : audit 1 from='client.? v1:172.21.15.62:0/3346531167' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/1_smithi062-64655-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:42.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[21479]: audit 2024-02-13T14:49:40.753250+0000 mon.a (mon.0) 1384 : audit 1 from='client.48238 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:42.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[21479]: audit 2024-02-13T14:49:40.753488+0000 mon.a (mon.0) 1385 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:42.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[21479]: cluster 2024-02-13T14:49:40.760467+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-02-13T14:49:42.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[21479]: audit 2024-02-13T14:49:40.773127+0000 mon.c (mon.2) 287 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[21479]: audit 2024-02-13T14:49:40.797746+0000 mon.a (mon.0) 1387 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[21479]: audit 2024-02-13T14:49:40.935994+0000 mon.c (mon.2) 288 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[21479]: cluster 2024-02-13T14:49:41.686341+0000 mon.a (mon.0) 1388 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[28859]: audit 2024-02-13T14:49:40.753250+0000 mon.a (mon.0) 1384 : audit 1 from='client.48238 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[28859]: audit 2024-02-13T14:49:40.753488+0000 mon.a (mon.0) 1385 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[28859]: cluster 2024-02-13T14:49:40.760467+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[28859]: audit 2024-02-13T14:49:40.773127+0000 mon.c (mon.2) 287 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[28859]: audit 2024-02-13T14:49:40.797746+0000 mon.a (mon.0) 1387 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[28859]: audit 2024-02-13T14:49:40.935994+0000 mon.c (mon.2) 288 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:42.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:41 smithi062 bash[28859]: cluster 2024-02-13T14:49:41.686341+0000 mon.a (mon.0) 1388 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:42.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:41 smithi111 bash[23388]: audit 2024-02-13T14:49:40.753250+0000 mon.a (mon.0) 1384 : audit 1 from='client.48238 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP_smithi062-64512-18","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:42.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:41 smithi111 bash[23388]: audit 2024-02-13T14:49:40.753488+0000 mon.a (mon.0) 1385 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:42.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:41 smithi111 bash[23388]: cluster 2024-02-13T14:49:40.760467+0000 mon.a (mon.0) 1386 : cluster 0 osdmap e155: 8 total, 8 up, 8 in 2024-02-13T14:49:42.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:41 smithi111 bash[23388]: audit 2024-02-13T14:49:40.773127+0000 mon.c (mon.2) 287 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:42.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:41 smithi111 bash[23388]: audit 2024-02-13T14:49:40.797746+0000 mon.a (mon.0) 1387 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:42.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:41 smithi111 bash[23388]: audit 2024-02-13T14:49:40.935994+0000 mon.c (mon.2) 288 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:42.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:41 smithi111 bash[23388]: cluster 2024-02-13T14:49:41.686341+0000 mon.a (mon.0) 1388 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:43.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:43 smithi062 bash[28859]: audit 2024-02-13T14:49:41.937582+0000 mon.c (mon.2) 289 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:43.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:43 smithi062 bash[28859]: cluster 2024-02-13T14:49:42.273107+0000 mon.a (mon.0) 1389 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-02-13T14:49:43.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:43 smithi062 bash[28859]: audit 2024-02-13T14:49:42.274363+0000 mon.c (mon.2) 290 : audit 1 from='client.? v1:172.21.15.62:0/2422876397' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:43.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:43 smithi062 bash[28859]: audit 2024-02-13T14:49:42.277255+0000 mon.a (mon.0) 1390 : audit 1 from='client.46571 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:43.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:43 smithi062 bash[21479]: audit 2024-02-13T14:49:41.937582+0000 mon.c (mon.2) 289 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:43.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:43 smithi062 bash[21479]: cluster 2024-02-13T14:49:42.273107+0000 mon.a (mon.0) 1389 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-02-13T14:49:43.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:43 smithi062 bash[21479]: audit 2024-02-13T14:49:42.274363+0000 mon.c (mon.2) 290 : audit 1 from='client.? v1:172.21.15.62:0/2422876397' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:43.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:43 smithi062 bash[21479]: audit 2024-02-13T14:49:42.277255+0000 mon.a (mon.0) 1390 : audit 1 from='client.46571 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:43.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:43 smithi111 bash[23388]: audit 2024-02-13T14:49:41.937582+0000 mon.c (mon.2) 289 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:43.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:43 smithi111 bash[23388]: cluster 2024-02-13T14:49:42.273107+0000 mon.a (mon.0) 1389 : cluster 0 osdmap e156: 8 total, 8 up, 8 in 2024-02-13T14:49:43.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:43 smithi111 bash[23388]: audit 2024-02-13T14:49:42.274363+0000 mon.c (mon.2) 290 : audit 1 from='client.? v1:172.21.15.62:0/2422876397' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:43.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:43 smithi111 bash[23388]: audit 2024-02-13T14:49:42.277255+0000 mon.a (mon.0) 1390 : audit 1 from='client.46571 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: cluster 2024-02-13T14:49:41.783194+0000 mgr.y (mgr.14613) 258 : cluster 0 pgmap v244: 452 pgs: 35 creating+peering, 29 unknown, 388 active+clean; 592 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 253 B/s wr, 1 op/s 2024-02-13T14:49:44.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: audit 2024-02-13T14:49:42.939025+0000 mon.c (mon.2) 291 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:44.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: audit 2024-02-13T14:49:43.211085+0000 mon.a (mon.0) 1391 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:44.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: audit 2024-02-13T14:49:43.211197+0000 mon.a (mon.0) 1392 : audit 1 from='client.46571 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: cluster 2024-02-13T14:49:43.214714+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: audit 2024-02-13T14:49:43.217613+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.62:0/1522454499' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi062-64655-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: audit 2024-02-13T14:49:43.222975+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.62:0/4095141820' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: audit 2024-02-13T14:49:43.223576+0000 mon.a (mon.0) 1395 : audit 1 from='client.46583 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[28859]: audit 2024-02-13T14:49:43.940525+0000 mon.c (mon.2) 293 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: cluster 2024-02-13T14:49:41.783194+0000 mgr.y (mgr.14613) 258 : cluster 0 pgmap v244: 452 pgs: 35 creating+peering, 29 unknown, 388 active+clean; 592 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 253 B/s wr, 1 op/s 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: audit 2024-02-13T14:49:42.939025+0000 mon.c (mon.2) 291 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: audit 2024-02-13T14:49:43.211085+0000 mon.a (mon.0) 1391 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: audit 2024-02-13T14:49:43.211197+0000 mon.a (mon.0) 1392 : audit 1 from='client.46571 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: cluster 2024-02-13T14:49:43.214714+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-02-13T14:49:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: audit 2024-02-13T14:49:43.217613+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.62:0/1522454499' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi062-64655-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: audit 2024-02-13T14:49:43.222975+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.62:0/4095141820' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: audit 2024-02-13T14:49:43.223576+0000 mon.a (mon.0) 1395 : audit 1 from='client.46583 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:44 smithi062 bash[21479]: audit 2024-02-13T14:49:43.940525+0000 mon.c (mon.2) 293 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:44.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: cluster 2024-02-13T14:49:41.783194+0000 mgr.y (mgr.14613) 258 : cluster 0 pgmap v244: 452 pgs: 35 creating+peering, 29 unknown, 388 active+clean; 592 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 253 B/s wr, 1 op/s 2024-02-13T14:49:44.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: audit 2024-02-13T14:49:42.939025+0000 mon.c (mon.2) 291 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:44.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: audit 2024-02-13T14:49:43.211085+0000 mon.a (mon.0) 1391 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsECPP_smithi062-64736-16", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:44.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: audit 2024-02-13T14:49:43.211197+0000 mon.a (mon.0) 1392 : audit 1 from='client.46571 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "Operate2Mtime_smithi062-64504-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:44.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: cluster 2024-02-13T14:49:43.214714+0000 mon.a (mon.0) 1393 : cluster 0 osdmap e157: 8 total, 8 up, 8 in 2024-02-13T14:49:44.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: audit 2024-02-13T14:49:43.217613+0000 mon.a (mon.0) 1394 : audit 1 from='client.? v1:172.21.15.62:0/1522454499' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi062-64655-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: audit 2024-02-13T14:49:43.222975+0000 mon.c (mon.2) 292 : audit 1 from='client.? v1:172.21.15.62:0/4095141820' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: audit 2024-02-13T14:49:43.223576+0000 mon.a (mon.0) 1395 : audit 1 from='client.46583 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:44.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:44 smithi111 bash[23388]: audit 2024-02-13T14:49:43.940525+0000 mon.c (mon.2) 293 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:45.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[21479]: cluster 2024-02-13T14:49:43.784400+0000 mgr.y (mgr.14613) 259 : cluster 0 pgmap v247: 492 pgs: 104 unknown, 388 active+clean; 592 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 253 B/s wr, 0 op/s 2024-02-13T14:49:45.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[21479]: audit 2024-02-13T14:49:44.223726+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.62:0/1522454499' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi062-64655-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:45.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[21479]: audit 2024-02-13T14:49:44.223913+0000 mon.a (mon.0) 1397 : audit 1 from='client.46583 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:45.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[21479]: cluster 2024-02-13T14:49:44.231700+0000 mon.a (mon.0) 1398 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-02-13T14:49:45.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[21479]: audit 2024-02-13T14:49:44.942268+0000 mon.c (mon.2) 294 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:45.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[28859]: cluster 2024-02-13T14:49:43.784400+0000 mgr.y (mgr.14613) 259 : cluster 0 pgmap v247: 492 pgs: 104 unknown, 388 active+clean; 592 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 253 B/s wr, 0 op/s 2024-02-13T14:49:45.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[28859]: audit 2024-02-13T14:49:44.223726+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.62:0/1522454499' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi062-64655-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:45.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[28859]: audit 2024-02-13T14:49:44.223913+0000 mon.a (mon.0) 1397 : audit 1 from='client.46583 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:45.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[28859]: cluster 2024-02-13T14:49:44.231700+0000 mon.a (mon.0) 1398 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-02-13T14:49:45.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:45 smithi062 bash[28859]: audit 2024-02-13T14:49:44.942268+0000 mon.c (mon.2) 294 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:45.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:45 smithi111 bash[23388]: cluster 2024-02-13T14:49:43.784400+0000 mgr.y (mgr.14613) 259 : cluster 0 pgmap v247: 492 pgs: 104 unknown, 388 active+clean; 592 KiB data, 464 MiB used, 715 GiB / 715 GiB avail; 253 B/s wr, 0 op/s 2024-02-13T14:49:45.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:45 smithi111 bash[23388]: audit 2024-02-13T14:49:44.223726+0000 mon.a (mon.0) 1396 : audit 1 from='client.? v1:172.21.15.62:0/1522454499' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "LibRadosChecksum/2_smithi062-64655-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:45.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:45 smithi111 bash[23388]: audit 2024-02-13T14:49:44.223913+0000 mon.a (mon.0) 1397 : audit 1 from='client.46583 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteSamePP2_smithi062-64512-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:45.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:45 smithi111 bash[23388]: cluster 2024-02-13T14:49:44.231700+0000 mon.a (mon.0) 1398 : cluster 0 osdmap e158: 8 total, 8 up, 8 in 2024-02-13T14:49:45.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:45 smithi111 bash[23388]: audit 2024-02-13T14:49:44.942268+0000 mon.c (mon.2) 294 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:46.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:49:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:49:46.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: cluster 2024-02-13T14:49:45.239602+0000 mon.a (mon.0) 1399 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-02-13T14:49:46.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:45.261048+0000 mon.a (mon.0) 1400 : audit 1 from='client.? v1:172.21.15.62:0/848742659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi062-64504-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:45.300548+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:45.744572+0000 mon.a (mon.0) 1401 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:45.745466+0000 mon.c (mon.2) 296 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:45.745848+0000 mon.a (mon.0) 1402 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:45.746402+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:45.746832+0000 mon.a (mon.0) 1403 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:45.943994+0000 mon.c (mon.2) 298 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:46.231824+0000 mon.a (mon.0) 1404 : audit 1 from='client.? v1:172.21.15.62:0/848742659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi062-64504-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:46.232051+0000 mon.a (mon.0) 1405 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: cluster 2024-02-13T14:49:46.242059+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:46.246815+0000 mon.c (mon.2) 299 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:46.248556+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.62:0/2732932205' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: cluster 2024-02-13T14:49:45.239602+0000 mon.a (mon.0) 1399 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:45.261048+0000 mon.a (mon.0) 1400 : audit 1 from='client.? v1:172.21.15.62:0/848742659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi062-64504-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:45.300548+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:45.744572+0000 mon.a (mon.0) 1401 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:45.745466+0000 mon.c (mon.2) 296 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:45.745848+0000 mon.a (mon.0) 1402 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:45.746402+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:45.746832+0000 mon.a (mon.0) 1403 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:45.943994+0000 mon.c (mon.2) 298 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:46.231824+0000 mon.a (mon.0) 1404 : audit 1 from='client.? v1:172.21.15.62:0/848742659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi062-64504-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:46.232051+0000 mon.a (mon.0) 1405 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: cluster 2024-02-13T14:49:46.242059+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-02-13T14:49:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:46.246815+0000 mon.c (mon.2) 299 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:46.248556+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.62:0/2732932205' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:46.250068+0000 mon.a (mon.0) 1407 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[21479]: audit 2024-02-13T14:49:46.251002+0000 mon.a (mon.0) 1408 : audit 1 from='client.46595 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:46.250068+0000 mon.a (mon.0) 1407 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:46 smithi062 bash[28859]: audit 2024-02-13T14:49:46.251002+0000 mon.a (mon.0) 1408 : audit 1 from='client.46595 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:46.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: cluster 2024-02-13T14:49:45.239602+0000 mon.a (mon.0) 1399 : cluster 0 osdmap e159: 8 total, 8 up, 8 in 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:45.261048+0000 mon.a (mon.0) 1400 : audit 1 from='client.? v1:172.21.15.62:0/848742659' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi062-64504-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:45.300548+0000 mon.c (mon.2) 295 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:45.744572+0000 mon.a (mon.0) 1401 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:45.745466+0000 mon.c (mon.2) 296 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:45.745848+0000 mon.a (mon.0) 1402 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:45.746402+0000 mon.c (mon.2) 297 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:45.746832+0000 mon.a (mon.0) 1403 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:45.943994+0000 mon.c (mon.2) 298 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:46.231824+0000 mon.a (mon.0) 1404 : audit 1 from='client.? v1:172.21.15.62:0/848742659' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatNS_smithi062-64504-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:46.232051+0000 mon.a (mon.0) 1405 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: cluster 2024-02-13T14:49:46.242059+0000 mon.a (mon.0) 1406 : cluster 0 osdmap e160: 8 total, 8 up, 8 in 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:46.246815+0000 mon.c (mon.2) 299 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:46.248556+0000 mon.c (mon.2) 300 : audit 1 from='client.? v1:172.21.15.62:0/2732932205' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:46.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:46.250068+0000 mon.a (mon.0) 1407 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:46.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:46 smithi111 bash[23388]: audit 2024-02-13T14:49:46.251002+0000 mon.a (mon.0) 1408 : audit 1 from='client.46595 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:48.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:47 smithi062 bash[21479]: cluster 2024-02-13T14:49:45.785468+0000 mgr.y (mgr.14613) 260 : cluster 0 pgmap v250: 428 pgs: 32 unknown, 396 active+clean; 592 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:49:48.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:47 smithi062 bash[21479]: audit 2024-02-13T14:49:46.692669+0000 mon.a (mon.0) 1409 : audit 1 from='client.46595 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:48.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:47 smithi062 bash[21479]: audit 2024-02-13T14:49:46.945651+0000 mon.c (mon.2) 301 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:48.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:47 smithi062 bash[21479]: cluster 2024-02-13T14:49:47.174222+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-02-13T14:49:48.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:47 smithi062 bash[28859]: cluster 2024-02-13T14:49:45.785468+0000 mgr.y (mgr.14613) 260 : cluster 0 pgmap v250: 428 pgs: 32 unknown, 396 active+clean; 592 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:49:48.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:47 smithi062 bash[28859]: audit 2024-02-13T14:49:46.692669+0000 mon.a (mon.0) 1409 : audit 1 from='client.46595 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:48.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:47 smithi062 bash[28859]: audit 2024-02-13T14:49:46.945651+0000 mon.c (mon.2) 301 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:48.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:47 smithi062 bash[28859]: cluster 2024-02-13T14:49:47.174222+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-02-13T14:49:48.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:47 smithi111 bash[23388]: cluster 2024-02-13T14:49:45.785468+0000 mgr.y (mgr.14613) 260 : cluster 0 pgmap v250: 428 pgs: 32 unknown, 396 active+clean; 592 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:49:48.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:47 smithi111 bash[23388]: audit 2024-02-13T14:49:46.692669+0000 mon.a (mon.0) 1409 : audit 1 from='client.46595 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPPNS_smithi062-64512-20","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:48.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:47 smithi111 bash[23388]: audit 2024-02-13T14:49:46.945651+0000 mon.c (mon.2) 301 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:48.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:47 smithi111 bash[23388]: cluster 2024-02-13T14:49:47.174222+0000 mon.a (mon.0) 1410 : cluster 0 osdmap e161: 8 total, 8 up, 8 in 2024-02-13T14:49:49.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[21479]: audit 2024-02-13T14:49:47.294526+0000 mon.b (mon.1) 176 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:49.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[21479]: audit 2024-02-13T14:49:47.694975+0000 mon.a (mon.0) 1411 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:49.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[21479]: cluster 2024-02-13T14:49:47.703667+0000 mon.a (mon.0) 1412 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-02-13T14:49:49.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[21479]: audit 2024-02-13T14:49:47.708471+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.62:0/3923426829' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[21479]: audit 2024-02-13T14:49:47.709445+0000 mon.a (mon.0) 1413 : audit 1 from='client.46604 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[21479]: cluster 2024-02-13T14:49:47.786021+0000 mgr.y (mgr.14613) 261 : cluster 0 pgmap v254: 436 pgs: 40 unknown, 396 active+clean; 592 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 287 B/s wr, 1 op/s 2024-02-13T14:49:49.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[21479]: audit 2024-02-13T14:49:47.947252+0000 mon.c (mon.2) 303 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:49.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[28859]: audit 2024-02-13T14:49:47.294526+0000 mon.b (mon.1) 176 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:49.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[28859]: audit 2024-02-13T14:49:47.694975+0000 mon.a (mon.0) 1411 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:49.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[28859]: cluster 2024-02-13T14:49:47.703667+0000 mon.a (mon.0) 1412 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-02-13T14:49:49.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[28859]: audit 2024-02-13T14:49:47.708471+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.62:0/3923426829' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:49.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[28859]: audit 2024-02-13T14:49:47.709445+0000 mon.a (mon.0) 1413 : audit 1 from='client.46604 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:49.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[28859]: cluster 2024-02-13T14:49:47.786021+0000 mgr.y (mgr.14613) 261 : cluster 0 pgmap v254: 436 pgs: 40 unknown, 396 active+clean; 592 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 287 B/s wr, 1 op/s 2024-02-13T14:49:49.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:48 smithi062 bash[28859]: audit 2024-02-13T14:49:47.947252+0000 mon.c (mon.2) 303 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:49.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:48 smithi111 bash[23388]: audit 2024-02-13T14:49:47.294526+0000 mon.b (mon.1) 176 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:49:49.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:48 smithi111 bash[23388]: audit 2024-02-13T14:49:47.694975+0000 mon.a (mon.0) 1411 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosMiscECPP_smithi062-64655-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:48 smithi111 bash[23388]: cluster 2024-02-13T14:49:47.703667+0000 mon.a (mon.0) 1412 : cluster 0 osdmap e162: 8 total, 8 up, 8 in 2024-02-13T14:49:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:48 smithi111 bash[23388]: audit 2024-02-13T14:49:47.708471+0000 mon.c (mon.2) 302 : audit 1 from='client.? v1:172.21.15.62:0/3923426829' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:48 smithi111 bash[23388]: audit 2024-02-13T14:49:47.709445+0000 mon.a (mon.0) 1413 : audit 1 from='client.46604 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:48 smithi111 bash[23388]: cluster 2024-02-13T14:49:47.786021+0000 mgr.y (mgr.14613) 261 : cluster 0 pgmap v254: 436 pgs: 40 unknown, 396 active+clean; 592 KiB data, 518 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 287 B/s wr, 1 op/s 2024-02-13T14:49:49.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:48 smithi111 bash[23388]: audit 2024-02-13T14:49:47.947252+0000 mon.c (mon.2) 303 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:49.734 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: Running main() from gmock_main.cc 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [==========] Running 21 tests from 5 test suites. 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] Global test environment set-up. 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: seed 64736 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapListPP 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapListPP (3595 ms) 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapRemovePP 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapRemovePP (5597 ms) 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.RollbackPP 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.RollbackPP (6943 ms) 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapGetNamePP 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapGetNamePP (4670 ms) 2024-02-13T14:49:49.735 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsPP.SnapCreateRemovePP 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsPP.SnapCreateRemovePP (6496 ms) 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 5 tests from LibRadosSnapshotsPP (27301 ms total) 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapPP 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapPP (5330 ms) 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.RollbackPP 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.RollbackPP (6670 ms) 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.SnapOverlapPP (8576 ms) 2024-02-13T14:49:49.736 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.Bug11677 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.Bug11677 (5440 ms) 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.OrderSnap 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.OrderSnap (1186 ms) 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: ./src/test/librados/snapshots_cxx.cc:463: Skipped 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback (0 ms) 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: deleting snap 14 in pool LibRadosSnapshotsSelfManagedPP_smithi062-64736-7 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: waiting for snaps to purge 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedPP.ReusePurgedSnap (17961 ms) 2024-02-13T14:49:49.737 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 7 tests from LibRadosSnapshotsSelfManagedPP (45164 ms total) 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.NotConnected (16 ms) 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosPoolIsInSelfmanagedSnapsMode.FreshInstance (5022 ms) 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 2 tests from LibRadosPoolIsInSelfmanagedSnapsMode (5038 ms total) 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapListPP 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapListPP (3028 ms) 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.SnapRemovePP 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapRemovePP (1459 ms) 2024-02-13T14:49:49.738 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsECPP.RollbackPP 2024-02-13T14:49:49.739 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.RollbackPP (2031 ms) 2024-02-13T14:49:50.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[21479]: cluster 2024-02-13T14:49:48.697139+0000 mon.a (mon.0) 1414 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:50.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[21479]: audit 2024-02-13T14:49:48.699453+0000 mon.a (mon.0) 1415 : audit 1 from='client.46604 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:50.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[21479]: cluster 2024-02-13T14:49:48.708153+0000 mon.a (mon.0) 1416 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-02-13T14:49:50.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[21479]: audit 2024-02-13T14:49:48.711480+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.62:0/173963682' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:50.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[21479]: audit 2024-02-13T14:49:48.728195+0000 mon.a (mon.0) 1417 : audit 1 from='client.46610 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:50.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[21479]: audit 2024-02-13T14:49:48.948745+0000 mon.c (mon.2) 305 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:50.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[28859]: cluster 2024-02-13T14:49:48.697139+0000 mon.a (mon.0) 1414 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:50.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[28859]: audit 2024-02-13T14:49:48.699453+0000 mon.a (mon.0) 1415 : audit 1 from='client.46604 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:50.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[28859]: cluster 2024-02-13T14:49:48.708153+0000 mon.a (mon.0) 1416 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-02-13T14:49:50.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[28859]: audit 2024-02-13T14:49:48.711480+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.62:0/173963682' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:50.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[28859]: audit 2024-02-13T14:49:48.728195+0000 mon.a (mon.0) 1417 : audit 1 from='client.46610 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:50.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:49 smithi062 bash[28859]: audit 2024-02-13T14:49:48.948745+0000 mon.c (mon.2) 305 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:50.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:49 smithi111 bash[23388]: cluster 2024-02-13T14:49:48.697139+0000 mon.a (mon.0) 1414 : cluster 3 Health check update: 8 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:50.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:49 smithi111 bash[23388]: audit 2024-02-13T14:49:48.699453+0000 mon.a (mon.0) 1415 : audit 1 from='client.46604 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemove_smithi062-64504-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:50.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:49 smithi111 bash[23388]: cluster 2024-02-13T14:49:48.708153+0000 mon.a (mon.0) 1416 : cluster 0 osdmap e163: 8 total, 8 up, 8 in 2024-02-13T14:49:50.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:49 smithi111 bash[23388]: audit 2024-02-13T14:49:48.711480+0000 mon.c (mon.2) 304 : audit 1 from='client.? v1:172.21.15.62:0/173963682' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:50.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:49 smithi111 bash[23388]: audit 2024-02-13T14:49:48.728195+0000 mon.a (mon.0) 1417 : audit 1 from='client.46610 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:50.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:49 smithi111 bash[23388]: audit 2024-02-13T14:49:48.948745+0000 mon.c (mon.2) 305 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:50.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:49:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:49:51.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[28859]: audit 2024-02-13T14:49:49.702792+0000 mon.a (mon.0) 1418 : audit 1 from='client.46610 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:51.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[28859]: cluster 2024-02-13T14:49:49.712449+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-02-13T14:49:51.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[28859]: audit 2024-02-13T14:49:49.715895+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:51.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[28859]: audit 2024-02-13T14:49:49.736156+0000 mon.a (mon.0) 1420 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[28859]: cluster 2024-02-13T14:49:49.787225+0000 mgr.y (mgr.14613) 262 : cluster 0 pgmap v257: 428 pgs: 1 active+clean+snaptrim, 1 active, 13 creating+peering, 18 unknown, 395 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 864 B/s wr, 2 op/s 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[28859]: audit 2024-02-13T14:49:49.950480+0000 mon.c (mon.2) 307 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[28859]: audit 2024-02-13T14:49:50.188619+0000 mgr.y (mgr.14613) 263 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[21479]: audit 2024-02-13T14:49:49.702792+0000 mon.a (mon.0) 1418 : audit 1 from='client.46610 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[21479]: cluster 2024-02-13T14:49:49.712449+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[21479]: audit 2024-02-13T14:49:49.715895+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[21479]: audit 2024-02-13T14:49:49.736156+0000 mon.a (mon.0) 1420 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[21479]: cluster 2024-02-13T14:49:49.787225+0000 mgr.y (mgr.14613) 262 : cluster 0 pgmap v257: 428 pgs: 1 active+clean+snaptrim, 1 active, 13 creating+peering, 18 unknown, 395 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 864 B/s wr, 2 op/s 2024-02-13T14:49:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[21479]: audit 2024-02-13T14:49:49.950480+0000 mon.c (mon.2) 307 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:51.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:50 smithi062 bash[21479]: audit 2024-02-13T14:49:50.188619+0000 mgr.y (mgr.14613) 263 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:51.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:50 smithi111 bash[23388]: audit 2024-02-13T14:49:49.702792+0000 mon.a (mon.0) 1418 : audit 1 from='client.46610 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "SimpleStatPP_smithi062-64512-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:51.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:50 smithi111 bash[23388]: cluster 2024-02-13T14:49:49.712449+0000 mon.a (mon.0) 1419 : cluster 0 osdmap e164: 8 total, 8 up, 8 in 2024-02-13T14:49:51.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:50 smithi111 bash[23388]: audit 2024-02-13T14:49:49.715895+0000 mon.c (mon.2) 306 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:51.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:50 smithi111 bash[23388]: audit 2024-02-13T14:49:49.736156+0000 mon.a (mon.0) 1420 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:51.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:50 smithi111 bash[23388]: cluster 2024-02-13T14:49:49.787225+0000 mgr.y (mgr.14613) 262 : cluster 0 pgmap v257: 428 pgs: 1 active+clean+snaptrim, 1 active, 13 creating+peering, 18 unknown, 395 active+clean; 592 KiB data, 561 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 864 B/s wr, 2 op/s 2024-02-13T14:49:51.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:50 smithi111 bash[23388]: audit 2024-02-13T14:49:49.950480+0000 mon.c (mon.2) 307 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:51.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:50 smithi111 bash[23388]: audit 2024-02-13T14:49:50.188619+0000 mgr.y (mgr.14613) 263 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_ (68954 ms total) 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosTwoPoolsECPP.CopyFrom 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosTwoPoolsECPP.CopyFrom (141 ms) 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosTwoPoolsECPP (141 ms total) 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)0, Checksummer::xxhash32, ceph_le > 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Subset 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Subset (69 ms) 2024-02-13T14:49:51.754 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/0.Chunked 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/0.Chunked (3 ms) 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/0 (72 ms total) 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)1, Checksummer::xxhash64, ceph_le > 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Subset 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Subset (69 ms) 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/1.Chunked 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/1.Chunked (8 ms) 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/1 (77 ms total) 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2, where TypeParam = LibRadosChecksumParams<(rados_checksum_type_t)2, Checksummer::crc32c, ceph_le > 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Subset 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Subset (69 ms) 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosChecksum/2.Chunked 2024-02-13T14:49:51.755 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosChecksum/2.Chunked (21 ms) 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 2 tests from LibRadosChecksum/2 (90 ms total) 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ RUN ] LibRadosMiscECPP.CompareExtentRange 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ OK ] LibRadosMiscECPP.CompareExtentRange (1083 ms) 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] 1 test from LibRadosMiscECPP (1083 ms total) 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [----------] Global test environment tear-down 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [==========] 31 tests from 7 test suites ran. (113013 ms total) 2024-02-13T14:49:51.756 INFO:tasks.workunit.client.0.smithi062.stdout: api_misc_pp: [ PASSED ] 31 tests. 2024-02-13T14:49:52.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[21479]: audit 2024-02-13T14:49:50.716813+0000 mon.a (mon.0) 1421 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:52.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[21479]: cluster 2024-02-13T14:49:50.729357+0000 mon.a (mon.0) 1422 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[21479]: audit 2024-02-13T14:49:50.733859+0000 mon.c (mon.2) 308 : audit 1 from='client.? v1:172.21.15.62:0/1440099144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[21479]: audit 2024-02-13T14:49:50.734621+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[21479]: audit 2024-02-13T14:49:50.734678+0000 mon.a (mon.0) 1423 : audit 1 from='client.46613 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[21479]: audit 2024-02-13T14:49:50.736204+0000 mon.a (mon.0) 1424 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[21479]: audit 2024-02-13T14:49:50.952036+0000 mon.c (mon.2) 310 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[28859]: audit 2024-02-13T14:49:50.716813+0000 mon.a (mon.0) 1421 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[28859]: cluster 2024-02-13T14:49:50.729357+0000 mon.a (mon.0) 1422 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[28859]: audit 2024-02-13T14:49:50.733859+0000 mon.c (mon.2) 308 : audit 1 from='client.? v1:172.21.15.62:0/1440099144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[28859]: audit 2024-02-13T14:49:50.734621+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:52.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[28859]: audit 2024-02-13T14:49:50.734678+0000 mon.a (mon.0) 1423 : audit 1 from='client.46613 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[28859]: audit 2024-02-13T14:49:50.736204+0000 mon.a (mon.0) 1424 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:51 smithi062 bash[28859]: audit 2024-02-13T14:49:50.952036+0000 mon.c (mon.2) 310 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:52.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:51 smithi111 bash[23388]: audit 2024-02-13T14:49:50.716813+0000 mon.a (mon.0) 1421 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:52.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:51 smithi111 bash[23388]: cluster 2024-02-13T14:49:50.729357+0000 mon.a (mon.0) 1422 : cluster 0 osdmap e165: 8 total, 8 up, 8 in 2024-02-13T14:49:52.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:51 smithi111 bash[23388]: audit 2024-02-13T14:49:50.733859+0000 mon.c (mon.2) 308 : audit 1 from='client.? v1:172.21.15.62:0/1440099144' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:52.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:51 smithi111 bash[23388]: audit 2024-02-13T14:49:50.734621+0000 mon.c (mon.2) 309 : audit 1 from='client.? v1:172.21.15.62:0/18952239' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:52.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:51 smithi111 bash[23388]: audit 2024-02-13T14:49:50.734678+0000 mon.a (mon.0) 1423 : audit 1 from='client.46613 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:52.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:51 smithi111 bash[23388]: audit 2024-02-13T14:49:50.736204+0000 mon.a (mon.0) 1424 : audit 1 from='client.46598 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]: dispatch 2024-02-13T14:49:52.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:51 smithi111 bash[23388]: audit 2024-02-13T14:49:50.952036+0000 mon.c (mon.2) 310 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:53.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: audit 2024-02-13T14:49:51.722072+0000 mon.a (mon.0) 1425 : audit 1 from='client.46613 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:53.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: audit 2024-02-13T14:49:51.722256+0000 mon.a (mon.0) 1426 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:53.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: cluster 2024-02-13T14:49:51.732135+0000 mon.a (mon.0) 1427 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-02-13T14:49:53.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: audit 2024-02-13T14:49:51.735278+0000 mon.c (mon.2) 311 : audit 1 from='client.? v1:172.21.15.62:0/3038451504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:53.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: audit 2024-02-13T14:49:51.761135+0000 mon.a (mon.0) 1428 : audit 1 from='client.46619 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:53.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: cluster 2024-02-13T14:49:51.788168+0000 mgr.y (mgr.14613) 264 : cluster 0 pgmap v260: 460 pgs: 1 active+clean+snaptrim, 64 unknown, 395 active+clean; 592 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:49:53.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: audit 2024-02-13T14:49:51.953637+0000 mon.c (mon.2) 312 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:53.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: audit 2024-02-13T14:49:52.725505+0000 mon.a (mon.0) 1429 : audit 1 from='client.46619 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:53.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[21479]: cluster 2024-02-13T14:49:52.735064+0000 mon.a (mon.0) 1430 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-02-13T14:49:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: audit 2024-02-13T14:49:51.722072+0000 mon.a (mon.0) 1425 : audit 1 from='client.46613 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: audit 2024-02-13T14:49:51.722256+0000 mon.a (mon.0) 1426 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: cluster 2024-02-13T14:49:51.732135+0000 mon.a (mon.0) 1427 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-02-13T14:49:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: audit 2024-02-13T14:49:51.735278+0000 mon.c (mon.2) 311 : audit 1 from='client.? v1:172.21.15.62:0/3038451504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: audit 2024-02-13T14:49:51.761135+0000 mon.a (mon.0) 1428 : audit 1 from='client.46619 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: cluster 2024-02-13T14:49:51.788168+0000 mgr.y (mgr.14613) 264 : cluster 0 pgmap v260: 460 pgs: 1 active+clean+snaptrim, 64 unknown, 395 active+clean; 592 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:49:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: audit 2024-02-13T14:49:51.953637+0000 mon.c (mon.2) 312 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: audit 2024-02-13T14:49:52.725505+0000 mon.a (mon.0) 1429 : audit 1 from='client.46619 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:52 smithi062 bash[28859]: cluster 2024-02-13T14:49:52.735064+0000 mon.a (mon.0) 1430 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-02-13T14:49:53.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: audit 2024-02-13T14:49:51.722072+0000 mon.a (mon.0) 1425 : audit 1 from='client.46613 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClass_smithi062-64504-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:53.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: audit 2024-02-13T14:49:51.722256+0000 mon.a (mon.0) 1426 : audit 1 from='client.46598 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosMiscECPP_smithi062-64655-36"}]': finished 2024-02-13T14:49:53.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: cluster 2024-02-13T14:49:51.732135+0000 mon.a (mon.0) 1427 : cluster 0 osdmap e166: 8 total, 8 up, 8 in 2024-02-13T14:49:53.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: audit 2024-02-13T14:49:51.735278+0000 mon.c (mon.2) 311 : audit 1 from='client.? v1:172.21.15.62:0/3038451504' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:53.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: audit 2024-02-13T14:49:51.761135+0000 mon.a (mon.0) 1428 : audit 1 from='client.46619 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:53.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: cluster 2024-02-13T14:49:51.788168+0000 mgr.y (mgr.14613) 264 : cluster 0 pgmap v260: 460 pgs: 1 active+clean+snaptrim, 64 unknown, 395 active+clean; 592 KiB data, 584 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:49:53.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: audit 2024-02-13T14:49:51.953637+0000 mon.c (mon.2) 312 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:53.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: audit 2024-02-13T14:49:52.725505+0000 mon.a (mon.0) 1429 : audit 1 from='client.46619 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime_smithi062-64512-22","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:53.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:52 smithi111 bash[23388]: cluster 2024-02-13T14:49:52.735064+0000 mon.a (mon.0) 1430 : cluster 0 osdmap e167: 8 total, 8 up, 8 in 2024-02-13T14:49:54.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: audit 2024-02-13T14:49:52.740433+0000 mon.c (mon.2) 313 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: audit 2024-02-13T14:49:52.742021+0000 mon.a (mon.0) 1431 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: audit 2024-02-13T14:49:52.955229+0000 mon.c (mon.2) 314 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:54.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: audit 2024-02-13T14:49:53.729328+0000 mon.a (mon.0) 1432 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: cluster 2024-02-13T14:49:53.740885+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: audit 2024-02-13T14:49:53.741374+0000 mon.c (mon.2) 315 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: audit 2024-02-13T14:49:53.747879+0000 mon.a (mon.0) 1434 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: audit 2024-02-13T14:49:53.750590+0000 mon.c (mon.2) 316 : audit 1 from='client.? v1:172.21.15.62:0/1581816723' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[21479]: audit 2024-02-13T14:49:53.752037+0000 mon.a (mon.0) 1435 : audit 1 from='client.46625 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: audit 2024-02-13T14:49:52.740433+0000 mon.c (mon.2) 313 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: audit 2024-02-13T14:49:52.742021+0000 mon.a (mon.0) 1431 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: audit 2024-02-13T14:49:52.955229+0000 mon.c (mon.2) 314 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: audit 2024-02-13T14:49:53.729328+0000 mon.a (mon.0) 1432 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:54.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: cluster 2024-02-13T14:49:53.740885+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-02-13T14:49:54.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: audit 2024-02-13T14:49:53.741374+0000 mon.c (mon.2) 315 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: audit 2024-02-13T14:49:53.747879+0000 mon.a (mon.0) 1434 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: audit 2024-02-13T14:49:53.750590+0000 mon.c (mon.2) 316 : audit 1 from='client.? v1:172.21.15.62:0/1581816723' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:54.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:53 smithi062 bash[28859]: audit 2024-02-13T14:49:53.752037+0000 mon.a (mon.0) 1435 : audit 1 from='client.46625 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:54.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: audit 2024-02-13T14:49:52.740433+0000 mon.c (mon.2) 313 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: audit 2024-02-13T14:49:52.742021+0000 mon.a (mon.0) 1431 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: audit 2024-02-13T14:49:52.955229+0000 mon.c (mon.2) 314 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:54.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: audit 2024-02-13T14:49:53.729328+0000 mon.a (mon.0) 1432 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:54.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: cluster 2024-02-13T14:49:53.740885+0000 mon.a (mon.0) 1433 : cluster 0 osdmap e168: 8 total, 8 up, 8 in 2024-02-13T14:49:54.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: audit 2024-02-13T14:49:53.741374+0000 mon.c (mon.2) 315 : audit 1 from='client.? v1:172.21.15.62:0/769470366' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: audit 2024-02-13T14:49:53.747879+0000 mon.a (mon.0) 1434 : audit 1 from='client.46568 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]: dispatch 2024-02-13T14:49:54.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: audit 2024-02-13T14:49:53.750590+0000 mon.c (mon.2) 316 : audit 1 from='client.? v1:172.21.15.62:0/1581816723' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:54.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:53 smithi111 bash[23388]: audit 2024-02-13T14:49:53.752037+0000 mon.a (mon.0) 1435 : audit 1 from='client.46625 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:55.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:54 smithi062 bash[21479]: cluster 2024-02-13T14:49:53.788899+0000 mgr.y (mgr.14613) 265 : cluster 0 pgmap v263: 420 pgs: 32 unknown, 388 active+clean; 592 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:49:55.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:54 smithi062 bash[21479]: audit 2024-02-13T14:49:53.956775+0000 mon.c (mon.2) 317 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:55.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:54 smithi062 bash[28859]: cluster 2024-02-13T14:49:53.788899+0000 mgr.y (mgr.14613) 265 : cluster 0 pgmap v263: 420 pgs: 32 unknown, 388 active+clean; 592 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:49:55.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:54 smithi062 bash[28859]: audit 2024-02-13T14:49:53.956775+0000 mon.c (mon.2) 317 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:55.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:54 smithi111 bash[23388]: cluster 2024-02-13T14:49:53.788899+0000 mgr.y (mgr.14613) 265 : cluster 0 pgmap v263: 420 pgs: 32 unknown, 388 active+clean; 592 KiB data, 584 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:49:55.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:54 smithi111 bash[23388]: audit 2024-02-13T14:49:53.956775+0000 mon.c (mon.2) 317 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:56.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.735037+0000 mon.a (mon.0) 1436 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:56.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.735312+0000 mon.a (mon.0) 1437 : audit 1 from='client.46625 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: cluster 2024-02-13T14:49:54.748701+0000 mon.a (mon.0) 1438 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: cluster 2024-02-13T14:49:54.770963+0000 mon.a (mon.0) 1439 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.773700+0000 mon.a (mon.0) 1440 : audit 1 from='client.? v1:172.21.15.62:0/3689240368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi062-64512-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.801852+0000 mon.c (mon.2) 318 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.802746+0000 mon.a (mon.0) 1441 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.804255+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.804564+0000 mon.a (mon.0) 1442 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.805277+0000 mon.c (mon.2) 320 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.805615+0000 mon.a (mon.0) 1443 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:54.958468+0000 mon.c (mon.2) 321 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:55.738340+0000 mon.a (mon.0) 1444 : audit 1 from='client.? v1:172.21.15.62:0/3689240368' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi062-64512-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:56.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:55.738731+0000 mon.a (mon.0) 1445 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:56.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: cluster 2024-02-13T14:49:55.747712+0000 mon.a (mon.0) 1446 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-02-13T14:49:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.735037+0000 mon.a (mon.0) 1436 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.735312+0000 mon.a (mon.0) 1437 : audit 1 from='client.46625 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: cluster 2024-02-13T14:49:54.748701+0000 mon.a (mon.0) 1438 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-02-13T14:49:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: cluster 2024-02-13T14:49:54.770963+0000 mon.a (mon.0) 1439 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.773700+0000 mon.a (mon.0) 1440 : audit 1 from='client.? v1:172.21.15.62:0/3689240368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi062-64512-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.801852+0000 mon.c (mon.2) 318 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.802746+0000 mon.a (mon.0) 1441 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.804255+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.804564+0000 mon.a (mon.0) 1442 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.805277+0000 mon.c (mon.2) 320 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.805615+0000 mon.a (mon.0) 1443 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:54.958468+0000 mon.c (mon.2) 321 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:55.738340+0000 mon.a (mon.0) 1444 : audit 1 from='client.? v1:172.21.15.62:0/3689240368' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi062-64512-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:55.738731+0000 mon.a (mon.0) 1445 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: cluster 2024-02-13T14:49:55.747712+0000 mon.a (mon.0) 1446 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:55.753667+0000 mon.c (mon.2) 322 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[28859]: audit 2024-02-13T14:49:55.754521+0000 mon.a (mon.0) 1447 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:55.753667+0000 mon.c (mon.2) 322 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:55 smithi062 bash[21479]: audit 2024-02-13T14:49:55.754521+0000 mon.a (mon.0) 1447 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.735037+0000 mon.a (mon.0) 1436 : audit 1 from='client.46568 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsECPP_smithi062-64736-16"}]': finished 2024-02-13T14:49:56.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.735312+0000 mon.a (mon.0) 1437 : audit 1 from='client.46625 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWrite_smithi062-64504-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: cluster 2024-02-13T14:49:54.748701+0000 mon.a (mon.0) 1438 : cluster 0 osdmap e169: 8 total, 8 up, 8 in 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: cluster 2024-02-13T14:49:54.770963+0000 mon.a (mon.0) 1439 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.773700+0000 mon.a (mon.0) 1440 : audit 1 from='client.? v1:172.21.15.62:0/3689240368' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi062-64512-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.801852+0000 mon.c (mon.2) 318 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.802746+0000 mon.a (mon.0) 1441 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.804255+0000 mon.c (mon.2) 319 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.804564+0000 mon.a (mon.0) 1442 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.805277+0000 mon.c (mon.2) 320 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.805615+0000 mon.a (mon.0) 1443 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:56.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:54.958468+0000 mon.c (mon.2) 321 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:56.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:55.738340+0000 mon.a (mon.0) 1444 : audit 1 from='client.? v1:172.21.15.62:0/3689240368' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OperateMtime2_smithi062-64512-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:56.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:55.738731+0000 mon.a (mon.0) 1445 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:49:56.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: cluster 2024-02-13T14:49:55.747712+0000 mon.a (mon.0) 1446 : cluster 0 osdmap e170: 8 total, 8 up, 8 in 2024-02-13T14:49:56.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:55.753667+0000 mon.c (mon.2) 322 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:55 smithi111 bash[23388]: audit 2024-02-13T14:49:55.754521+0000 mon.a (mon.0) 1447 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:49:56.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:49:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:49:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:49:57.232 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: Running main() from gmock_main.cc 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [==========] Running 11 tests from 2 test suites. 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] Global test environment set-up. 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapList 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapList (25864 ms) 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapRemove 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapRemove (14111 ms) 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.Rollback 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.Rollback (6868 ms) 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapGetName 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapGetName (8495 ms) 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSnapshots.SnapCreateRemove 2024-02-13T14:49:57.233 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSnapshots.SnapCreateRemove (11181 ms) 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] 5 tests from NeoRadosSnapshots (66519 ms total) 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Snap 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Snap (6149 ms) 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Rollback 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Rollback (6565 ms) 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.SnapOverlap 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.SnapOverlap (8426 ms) 2024-02-13T14:49:57.234 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.Bug11677 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.Bug11677 (6038 ms) 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.OrderSnap 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.OrderSnap (4015 ms) 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ RUN ] NeoRadosSelfManagedSnaps.ReusePurgedSnap 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: Deleting snap 3 in pool ReusePurgedSnapsmithi062-65440-11. 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: Waiting for snaps to purge. 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ OK ] NeoRadosSelfManagedSnaps.ReusePurgedSnap (20473 ms) 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] 6 tests from NeoRadosSelfManagedSnaps (51667 ms total) 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [----------] Global test environment tear-down 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [==========] 11 tests from 2 test suites ran. (118186 ms total) 2024-02-13T14:49:57.235 INFO:tasks.workunit.client.0.smithi062.stdout: snapshots: [ PASSED ] 11 tests. 2024-02-13T14:49:57.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:57 smithi062 bash[21479]: cluster 2024-02-13T14:49:55.789944+0000 mgr.y (mgr.14613) 266 : cluster 0 pgmap v266: 420 pgs: 23 creating+peering, 9 unknown, 388 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:49:57.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:57 smithi062 bash[21479]: audit 2024-02-13T14:49:55.960004+0000 mon.c (mon.2) 323 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:57.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:57 smithi062 bash[28859]: cluster 2024-02-13T14:49:55.789944+0000 mgr.y (mgr.14613) 266 : cluster 0 pgmap v266: 420 pgs: 23 creating+peering, 9 unknown, 388 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:49:57.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:57 smithi062 bash[28859]: audit 2024-02-13T14:49:55.960004+0000 mon.c (mon.2) 323 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:57.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:57 smithi111 bash[23388]: cluster 2024-02-13T14:49:55.789944+0000 mgr.y (mgr.14613) 266 : cluster 0 pgmap v266: 420 pgs: 23 creating+peering, 9 unknown, 388 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:49:57.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:57 smithi111 bash[23388]: audit 2024-02-13T14:49:55.960004+0000 mon.c (mon.2) 323 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:58.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: audit 2024-02-13T14:49:56.961457+0000 mon.c (mon.2) 324 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:58.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: cluster 2024-02-13T14:49:57.225187+0000 mon.a (mon.0) 1448 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: audit 2024-02-13T14:49:57.226436+0000 mon.c (mon.2) 325 : audit 1 from='client.? v1:172.21.15.62:0/3270226057' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: audit 2024-02-13T14:49:57.235646+0000 mon.a (mon.0) 1449 : audit 1 from='client.46643 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: audit 2024-02-13T14:49:57.755274+0000 mon.a (mon.0) 1450 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: audit 2024-02-13T14:49:57.755517+0000 mon.a (mon.0) 1451 : audit 1 from='client.46643 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: cluster 2024-02-13T14:49:57.765358+0000 mon.a (mon.0) 1452 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: audit 2024-02-13T14:49:57.771825+0000 mon.c (mon.2) 326 : audit 1 from='client.? v1:172.21.15.62:0/2994346232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: audit 2024-02-13T14:49:57.776254+0000 mon.a (mon.0) 1453 : audit 1 from='client.46649 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[28859]: audit 2024-02-13T14:49:57.962939+0000 mon.c (mon.2) 327 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: audit 2024-02-13T14:49:56.961457+0000 mon.c (mon.2) 324 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: cluster 2024-02-13T14:49:57.225187+0000 mon.a (mon.0) 1448 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-02-13T14:49:58.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: audit 2024-02-13T14:49:57.226436+0000 mon.c (mon.2) 325 : audit 1 from='client.? v1:172.21.15.62:0/3270226057' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: audit 2024-02-13T14:49:57.235646+0000 mon.a (mon.0) 1449 : audit 1 from='client.46643 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: audit 2024-02-13T14:49:57.755274+0000 mon.a (mon.0) 1450 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:49:58.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: audit 2024-02-13T14:49:57.755517+0000 mon.a (mon.0) 1451 : audit 1 from='client.46643 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:58.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: cluster 2024-02-13T14:49:57.765358+0000 mon.a (mon.0) 1452 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-02-13T14:49:58.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: audit 2024-02-13T14:49:57.771825+0000 mon.c (mon.2) 326 : audit 1 from='client.? v1:172.21.15.62:0/2994346232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: audit 2024-02-13T14:49:57.776254+0000 mon.a (mon.0) 1453 : audit 1 from='client.46649 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:58 smithi062 bash[21479]: audit 2024-02-13T14:49:57.962939+0000 mon.c (mon.2) 327 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:58.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: audit 2024-02-13T14:49:56.961457+0000 mon.c (mon.2) 324 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:58.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: cluster 2024-02-13T14:49:57.225187+0000 mon.a (mon.0) 1448 : cluster 0 osdmap e171: 8 total, 8 up, 8 in 2024-02-13T14:49:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: audit 2024-02-13T14:49:57.226436+0000 mon.c (mon.2) 325 : audit 1 from='client.? v1:172.21.15.62:0/3270226057' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: audit 2024-02-13T14:49:57.235646+0000 mon.a (mon.0) 1449 : audit 1 from='client.46643 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: audit 2024-02-13T14:49:57.755274+0000 mon.a (mon.0) 1450 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:49:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: audit 2024-02-13T14:49:57.755517+0000 mon.a (mon.0) 1451 : audit 1 from='client.46643 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlock_smithi062-64504-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: cluster 2024-02-13T14:49:57.765358+0000 mon.a (mon.0) 1452 : cluster 0 osdmap e172: 8 total, 8 up, 8 in 2024-02-13T14:49:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: audit 2024-02-13T14:49:57.771825+0000 mon.c (mon.2) 326 : audit 1 from='client.? v1:172.21.15.62:0/2994346232' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: audit 2024-02-13T14:49:57.776254+0000 mon.a (mon.0) 1453 : audit 1 from='client.46649 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:49:58.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:58 smithi111 bash[23388]: audit 2024-02-13T14:49:57.962939+0000 mon.c (mon.2) 327 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:58.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: Running main() from gmock_main.cc 2024-02-13T14:49:58.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [==========] Running 42 tests from 2 test suites. 2024-02-13T14:49:58.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] Global test environment set-up. 2024-02-13T14:49:58.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] 26 tests from LibRadosAio 2024-02-13T14:49:58.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.TooBig 2024-02-13T14:49:58.771 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.TooBig (17658 ms) 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.SimpleWrite 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.SimpleWrite (15107 ms) 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.WaitForSafe 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.WaitForSafe (5152 ms) 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip (4421 ms) 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip2 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip2 (4902 ms) 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTrip3 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTrip3 (6106 ms) 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripAppend 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTripAppend (5703 ms) 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RemoveTest 2024-02-13T14:49:58.772 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RemoveTest (4538 ms) 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.XattrsRoundTrip 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.XattrsRoundTrip (5088 ms) 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RmXattr 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RmXattr (3387 ms) 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.XattrIter 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.XattrIter (3426 ms) 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.IsComplete 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.IsComplete (2112 ms) 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.IsSafe 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.IsSafe (3038 ms) 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.ReturnValue 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.ReturnValue (3426 ms) 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.Flush 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.Flush (3007 ms) 2024-02-13T14:49:58.773 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.FlushAsync 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.FlushAsync (2994 ms) 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteFull 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteFull (3017 ms) 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.RoundTripWriteSame 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.RoundTripWriteSame (3013 ms) 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStat 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.SimpleStat (3015 ms) 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.OperateMtime 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.OperateMtime (3022 ms) 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.Operate2Mtime 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.Operate2Mtime (3464 ms) 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.SimpleStatNS 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.SimpleStatNS (2940 ms) 2024-02-13T14:49:58.774 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.StatRemove 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.StatRemove (2539 ms) 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.ExecuteClass 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.ExecuteClass (3024 ms) 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.MultiWrite 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.MultiWrite (3016 ms) 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAio.AioUnlock 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAio.AioUnlock (3013 ms) 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] 26 tests from LibRadosAio (120129 ms total) 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: 2024-02-13T14:49:58.775 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] 16 tests from LibRadosAioEC 2024-02-13T14:49:59.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: cluster 2024-02-13T14:49:57.790608+0000 mgr.y (mgr.14613) 267 : cluster 0 pgmap v269: 428 pgs: 72 unknown, 356 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:49:59.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: audit 2024-02-13T14:49:58.759028+0000 mon.a (mon.0) 1454 : audit 1 from='client.46649 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: cluster 2024-02-13T14:49:58.767387+0000 mon.a (mon.0) 1455 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: audit 2024-02-13T14:49:58.821398+0000 mon.c (mon.2) 328 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: audit 2024-02-13T14:49:58.821894+0000 mon.a (mon.0) 1456 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: audit 2024-02-13T14:49:58.822876+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: audit 2024-02-13T14:49:58.823485+0000 mon.a (mon.0) 1457 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: audit 2024-02-13T14:49:58.824318+0000 mon.c (mon.2) 330 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: audit 2024-02-13T14:49:58.824667+0000 mon.a (mon.0) 1458 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[21479]: audit 2024-02-13T14:49:58.964519+0000 mon.c (mon.2) 331 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: cluster 2024-02-13T14:49:57.790608+0000 mgr.y (mgr.14613) 267 : cluster 0 pgmap v269: 428 pgs: 72 unknown, 356 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:49:59.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: audit 2024-02-13T14:49:58.759028+0000 mon.a (mon.0) 1454 : audit 1 from='client.46649 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: cluster 2024-02-13T14:49:58.767387+0000 mon.a (mon.0) 1455 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-02-13T14:49:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: audit 2024-02-13T14:49:58.821398+0000 mon.c (mon.2) 328 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: audit 2024-02-13T14:49:58.821894+0000 mon.a (mon.0) 1456 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: audit 2024-02-13T14:49:58.822876+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: audit 2024-02-13T14:49:58.823485+0000 mon.a (mon.0) 1457 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: audit 2024-02-13T14:49:58.824318+0000 mon.c (mon.2) 330 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: audit 2024-02-13T14:49:58.824667+0000 mon.a (mon.0) 1458 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:59.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:49:59 smithi062 bash[28859]: audit 2024-02-13T14:49:58.964519+0000 mon.c (mon.2) 331 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:49:59.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: cluster 2024-02-13T14:49:57.790608+0000 mgr.y (mgr.14613) 267 : cluster 0 pgmap v269: 428 pgs: 72 unknown, 356 active+clean; 592 KiB data, 572 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: audit 2024-02-13T14:49:58.759028+0000 mon.a (mon.0) 1454 : audit 1 from='client.46649 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "StatRemovePP_smithi062-64512-24","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: cluster 2024-02-13T14:49:58.767387+0000 mon.a (mon.0) 1455 : cluster 0 osdmap e173: 8 total, 8 up, 8 in 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: audit 2024-02-13T14:49:58.821398+0000 mon.c (mon.2) 328 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: audit 2024-02-13T14:49:58.821894+0000 mon.a (mon.0) 1456 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: audit 2024-02-13T14:49:58.822876+0000 mon.c (mon.2) 329 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: audit 2024-02-13T14:49:58.823485+0000 mon.a (mon.0) 1457 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: audit 2024-02-13T14:49:58.824318+0000 mon.c (mon.2) 330 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: audit 2024-02-13T14:49:58.824667+0000 mon.a (mon.0) 1458 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:49:59.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:49:59 smithi111 bash[23388]: audit 2024-02-13T14:49:58.964519+0000 mon.c (mon.2) 331 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:00.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:50:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:50:01.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:49:59.792903+0000 mgr.y (mgr.14613) 268 : cluster 0 pgmap v271: 396 pgs: 16 unknown, 380 active+clean; 592 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:01.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: audit 2024-02-13T14:49:59.794243+0000 mon.a (mon.0) 1459 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:49:59.802343+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: audit 2024-02-13T14:49:59.803956+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: audit 2024-02-13T14:49:59.809582+0000 mon.a (mon.0) 1461 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: audit 2024-02-13T14:49:59.966059+0000 mon.c (mon.2) 333 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: audit 2024-02-13T14:50:00.197862+0000 mgr.y (mgr.14613) 269 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287532+0000 mon.a (mon.0) 1462 : cluster 3 Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 6 pool(s) do not have an application enabled 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287611+0000 mon.a (mon.0) 1463 : cluster 3 [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287645+0000 mon.a (mon.0) 1464 : cluster 3 pool 'test-rados-api-smithi062-64695-13' with cache_mode writeback needs hit_set_type to be set but it is not 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287676+0000 mon.a (mon.0) 1465 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 6 pool(s) do not have an application enabled 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287700+0000 mon.a (mon.0) 1466 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287738+0000 mon.a (mon.0) 1467 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T14:50:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287768+0000 mon.a (mon.0) 1468 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287796+0000 mon.a (mon.0) 1469 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287826+0000 mon.a (mon.0) 1470 : cluster 3 application not enabled on pool 'LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21' 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287860+0000 mon.a (mon.0) 1471 : cluster 3 application not enabled on pool 'StatRemovePP_smithi062-64512-24' 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.287890+0000 mon.a (mon.0) 1472 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:49:59.792903+0000 mgr.y (mgr.14613) 268 : cluster 0 pgmap v271: 396 pgs: 16 unknown, 380 active+clean; 592 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: audit 2024-02-13T14:49:59.794243+0000 mon.a (mon.0) 1459 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:49:59.802343+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: audit 2024-02-13T14:49:59.803956+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: audit 2024-02-13T14:49:59.809582+0000 mon.a (mon.0) 1461 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: audit 2024-02-13T14:49:59.966059+0000 mon.c (mon.2) 333 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: audit 2024-02-13T14:50:00.197862+0000 mgr.y (mgr.14613) 269 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287532+0000 mon.a (mon.0) 1462 : cluster 3 Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 6 pool(s) do not have an application enabled 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287611+0000 mon.a (mon.0) 1463 : cluster 3 [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287645+0000 mon.a (mon.0) 1464 : cluster 3 pool 'test-rados-api-smithi062-64695-13' with cache_mode writeback needs hit_set_type to be set but it is not 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287676+0000 mon.a (mon.0) 1465 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 6 pool(s) do not have an application enabled 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287700+0000 mon.a (mon.0) 1466 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287738+0000 mon.a (mon.0) 1467 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287768+0000 mon.a (mon.0) 1468 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287796+0000 mon.a (mon.0) 1469 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287826+0000 mon.a (mon.0) 1470 : cluster 3 application not enabled on pool 'LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21' 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287860+0000 mon.a (mon.0) 1471 : cluster 3 application not enabled on pool 'StatRemovePP_smithi062-64512-24' 2024-02-13T14:50:01.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:01 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.287890+0000 mon.a (mon.0) 1472 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:49:59.792903+0000 mgr.y (mgr.14613) 268 : cluster 0 pgmap v271: 396 pgs: 16 unknown, 380 active+clean; 592 KiB data, 556 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: audit 2024-02-13T14:49:59.794243+0000 mon.a (mon.0) 1459 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWrite_smithi062-64504-27", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:49:59.802343+0000 mon.a (mon.0) 1460 : cluster 0 osdmap e174: 8 total, 8 up, 8 in 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: audit 2024-02-13T14:49:59.803956+0000 mon.c (mon.2) 332 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: audit 2024-02-13T14:49:59.809582+0000 mon.a (mon.0) 1461 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: audit 2024-02-13T14:49:59.966059+0000 mon.c (mon.2) 333 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: audit 2024-02-13T14:50:00.197862+0000 mgr.y (mgr.14613) 269 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287532+0000 mon.a (mon.0) 1462 : cluster 3 Health detail: HEALTH_WARN 1 cache pools are missing hit_sets; 6 pool(s) do not have an application enabled 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287611+0000 mon.a (mon.0) 1463 : cluster 3 [WRN] CACHE_POOL_NO_HIT_SET: 1 cache pools are missing hit_sets 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287645+0000 mon.a (mon.0) 1464 : cluster 3 pool 'test-rados-api-smithi062-64695-13' with cache_mode writeback needs hit_set_type to be set but it is not 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287676+0000 mon.a (mon.0) 1465 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 6 pool(s) do not have an application enabled 2024-02-13T14:50:01.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287700+0000 mon.a (mon.0) 1466 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T14:50:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287738+0000 mon.a (mon.0) 1467 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T14:50:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287768+0000 mon.a (mon.0) 1468 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T14:50:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287796+0000 mon.a (mon.0) 1469 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T14:50:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287826+0000 mon.a (mon.0) 1470 : cluster 3 application not enabled on pool 'LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21' 2024-02-13T14:50:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287860+0000 mon.a (mon.0) 1471 : cluster 3 application not enabled on pool 'StatRemovePP_smithi062-64512-24' 2024-02-13T14:50:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:01 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.287890+0000 mon.a (mon.0) 1472 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T14:50:02.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: cluster 2024-02-13T14:50:00.797399+0000 mon.a (mon.0) 1473 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:02.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: audit 2024-02-13T14:50:00.967345+0000 mon.c (mon.2) 334 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:02.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: cluster 2024-02-13T14:50:01.271854+0000 mon.a (mon.0) 1474 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: audit 2024-02-13T14:50:01.274136+0000 mon.c (mon.2) 335 : audit 1 from='client.? v1:172.21.15.62:0/3173711630' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: audit 2024-02-13T14:50:01.283239+0000 mon.a (mon.0) 1475 : audit 1 from='client.46661 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: audit 2024-02-13T14:50:01.802829+0000 mon.a (mon.0) 1476 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: audit 2024-02-13T14:50:01.803099+0000 mon.a (mon.0) 1477 : audit 1 from='client.46661 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: cluster 2024-02-13T14:50:01.811612+0000 mon.a (mon.0) 1478 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[28859]: audit 2024-02-13T14:50:01.968863+0000 mon.c (mon.2) 336 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: cluster 2024-02-13T14:50:00.797399+0000 mon.a (mon.0) 1473 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: audit 2024-02-13T14:50:00.967345+0000 mon.c (mon.2) 334 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: cluster 2024-02-13T14:50:01.271854+0000 mon.a (mon.0) 1474 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: audit 2024-02-13T14:50:01.274136+0000 mon.c (mon.2) 335 : audit 1 from='client.? v1:172.21.15.62:0/3173711630' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:02.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: audit 2024-02-13T14:50:01.283239+0000 mon.a (mon.0) 1475 : audit 1 from='client.46661 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: audit 2024-02-13T14:50:01.802829+0000 mon.a (mon.0) 1476 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: audit 2024-02-13T14:50:01.803099+0000 mon.a (mon.0) 1477 : audit 1 from='client.46661 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: cluster 2024-02-13T14:50:01.811612+0000 mon.a (mon.0) 1478 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-02-13T14:50:02.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:02 smithi062 bash[21479]: audit 2024-02-13T14:50:01.968863+0000 mon.c (mon.2) 336 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:02.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: cluster 2024-02-13T14:50:00.797399+0000 mon.a (mon.0) 1473 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:02.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: audit 2024-02-13T14:50:00.967345+0000 mon.c (mon.2) 334 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:02.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: cluster 2024-02-13T14:50:01.271854+0000 mon.a (mon.0) 1474 : cluster 0 osdmap e175: 8 total, 8 up, 8 in 2024-02-13T14:50:02.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: audit 2024-02-13T14:50:01.274136+0000 mon.c (mon.2) 335 : audit 1 from='client.? v1:172.21.15.62:0/3173711630' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:02.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: audit 2024-02-13T14:50:01.283239+0000 mon.a (mon.0) 1475 : audit 1 from='client.46661 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:02.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: audit 2024-02-13T14:50:01.802829+0000 mon.a (mon.0) 1476 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWrite_smithi062-64504-27", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:02.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: audit 2024-02-13T14:50:01.803099+0000 mon.a (mon.0) 1477 : audit 1 from='client.46661 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ExecuteClassPP_smithi062-64512-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:02.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: cluster 2024-02-13T14:50:01.811612+0000 mon.a (mon.0) 1478 : cluster 0 osdmap e176: 8 total, 8 up, 8 in 2024-02-13T14:50:02.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:02 smithi111 bash[23388]: audit 2024-02-13T14:50:01.968863+0000 mon.c (mon.2) 336 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:03.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:03 smithi111 bash[23388]: cluster 2024-02-13T14:50:01.793890+0000 mgr.y (mgr.14613) 270 : cluster 0 pgmap v274: 396 pgs: 32 unknown, 364 active+clean; 608 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-13T14:50:03.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:03 smithi111 bash[23388]: audit 2024-02-13T14:50:02.323719+0000 mon.b (mon.1) 177 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:03.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:03 smithi111 bash[23388]: cluster 2024-02-13T14:50:02.815280+0000 mon.a (mon.0) 1479 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-02-13T14:50:03.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:03 smithi111 bash[23388]: audit 2024-02-13T14:50:02.969872+0000 mon.c (mon.2) 337 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:03.809 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:03 smithi062 bash[28859]: cluster 2024-02-13T14:50:01.793890+0000 mgr.y (mgr.14613) 270 : cluster 0 pgmap v274: 396 pgs: 32 unknown, 364 active+clean; 608 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-13T14:50:03.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:03 smithi062 bash[28859]: audit 2024-02-13T14:50:02.323719+0000 mon.b (mon.1) 177 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:03.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:03 smithi062 bash[28859]: cluster 2024-02-13T14:50:02.815280+0000 mon.a (mon.0) 1479 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-02-13T14:50:03.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:03 smithi062 bash[28859]: audit 2024-02-13T14:50:02.969872+0000 mon.c (mon.2) 337 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:03 smithi062 bash[21479]: cluster 2024-02-13T14:50:01.793890+0000 mgr.y (mgr.14613) 270 : cluster 0 pgmap v274: 396 pgs: 32 unknown, 364 active+clean; 608 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-13T14:50:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:03 smithi062 bash[21479]: audit 2024-02-13T14:50:02.323719+0000 mon.b (mon.1) 177 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:03 smithi062 bash[21479]: cluster 2024-02-13T14:50:02.815280+0000 mon.a (mon.0) 1479 : cluster 0 osdmap e177: 8 total, 8 up, 8 in 2024-02-13T14:50:03.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:03 smithi062 bash[21479]: audit 2024-02-13T14:50:02.969872+0000 mon.c (mon.2) 337 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:05.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:04 smithi111 bash[23388]: cluster 2024-02-13T14:50:03.794891+0000 mgr.y (mgr.14613) 271 : cluster 0 pgmap v277: 372 pgs: 8 unknown, 364 active+clean; 608 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 0 op/s 2024-02-13T14:50:05.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:04 smithi111 bash[23388]: cluster 2024-02-13T14:50:03.819260+0000 mon.a (mon.0) 1480 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-02-13T14:50:05.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:04 smithi111 bash[23388]: audit 2024-02-13T14:50:03.824214+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:05.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:04 smithi111 bash[23388]: audit 2024-02-13T14:50:03.837009+0000 mon.a (mon.0) 1481 : audit 1 from='client.? v1:172.21.15.62:0/2725072120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi062-64512-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:05.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:04 smithi111 bash[23388]: audit 2024-02-13T14:50:03.842812+0000 mon.a (mon.0) 1482 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:05.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:04 smithi111 bash[23388]: audit 2024-02-13T14:50:03.971096+0000 mon.c (mon.2) 339 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:05.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[28859]: cluster 2024-02-13T14:50:03.794891+0000 mgr.y (mgr.14613) 271 : cluster 0 pgmap v277: 372 pgs: 8 unknown, 364 active+clean; 608 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 0 op/s 2024-02-13T14:50:05.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[28859]: cluster 2024-02-13T14:50:03.819260+0000 mon.a (mon.0) 1480 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-02-13T14:50:05.309 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[28859]: audit 2024-02-13T14:50:03.824214+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[28859]: audit 2024-02-13T14:50:03.837009+0000 mon.a (mon.0) 1481 : audit 1 from='client.? v1:172.21.15.62:0/2725072120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi062-64512-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[28859]: audit 2024-02-13T14:50:03.842812+0000 mon.a (mon.0) 1482 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[28859]: audit 2024-02-13T14:50:03.971096+0000 mon.c (mon.2) 339 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[21479]: cluster 2024-02-13T14:50:03.794891+0000 mgr.y (mgr.14613) 271 : cluster 0 pgmap v277: 372 pgs: 8 unknown, 364 active+clean; 608 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 4.0 KiB/s wr, 0 op/s 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[21479]: cluster 2024-02-13T14:50:03.819260+0000 mon.a (mon.0) 1480 : cluster 0 osdmap e178: 8 total, 8 up, 8 in 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[21479]: audit 2024-02-13T14:50:03.824214+0000 mon.c (mon.2) 338 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[21479]: audit 2024-02-13T14:50:03.837009+0000 mon.a (mon.0) 1481 : audit 1 from='client.? v1:172.21.15.62:0/2725072120' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "OmapPP_smithi062-64512-26","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[21479]: audit 2024-02-13T14:50:03.842812+0000 mon.a (mon.0) 1482 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:04 smithi062 bash[21479]: audit 2024-02-13T14:50:03.971096+0000 mon.c (mon.2) 339 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:06.224 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:04.812787+0000 mon.a (mon.0) 1483 : audit 1 from='client.? v1:172.21.15.62:0/2725072120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi062-64512-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:06.224 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:04.812967+0000 mon.a (mon.0) 1484 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:06.224 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: cluster 2024-02-13T14:50:04.821210+0000 mon.a (mon.0) 1485 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:04.822343+0000 mon.c (mon.2) 340 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:04.825374+0000 mon.a (mon.0) 1486 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:04.972417+0000 mon.c (mon.2) 341 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:05.056514+0000 mon.c (mon.2) 342 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:05.056865+0000 mon.a (mon.0) 1487 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:05.816366+0000 mon.a (mon.0) 1488 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:05.816568+0000 mon.a (mon.0) 1489 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: cluster 2024-02-13T14:50:05.823860+0000 mon.a (mon.0) 1490 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:05.830802+0000 mon.c (mon.2) 343 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:50:06.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[28859]: audit 2024-02-13T14:50:05.834078+0000 mon.a (mon.0) 1491 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:04.812787+0000 mon.a (mon.0) 1483 : audit 1 from='client.? v1:172.21.15.62:0/2725072120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi062-64512-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:04.812967+0000 mon.a (mon.0) 1484 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: cluster 2024-02-13T14:50:04.821210+0000 mon.a (mon.0) 1485 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:04.822343+0000 mon.c (mon.2) 340 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:04.825374+0000 mon.a (mon.0) 1486 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:04.972417+0000 mon.c (mon.2) 341 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:05.056514+0000 mon.c (mon.2) 342 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:05.056865+0000 mon.a (mon.0) 1487 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:05.816366+0000 mon.a (mon.0) 1488 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:05.816568+0000 mon.a (mon.0) 1489 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: cluster 2024-02-13T14:50:05.823860+0000 mon.a (mon.0) 1490 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-02-13T14:50:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:05.830802+0000 mon.c (mon.2) 343 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:50:06.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:05 smithi062 bash[21479]: audit 2024-02-13T14:50:05.834078+0000 mon.a (mon.0) 1491 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:50:06.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:04.812787+0000 mon.a (mon.0) 1483 : audit 1 from='client.? v1:172.21.15.62:0/2725072120' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "OmapPP_smithi062-64512-26","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:06.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:04.812967+0000 mon.a (mon.0) 1484 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: cluster 2024-02-13T14:50:04.821210+0000 mon.a (mon.0) 1485 : cluster 0 osdmap e179: 8 total, 8 up, 8 in 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:04.822343+0000 mon.c (mon.2) 340 : audit 1 from='client.? v1:172.21.15.62:0/569623079' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:04.825374+0000 mon.a (mon.0) 1486 : audit 1 from='client.46655 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]: dispatch 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:04.972417+0000 mon.c (mon.2) 341 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:05.056514+0000 mon.c (mon.2) 342 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:05.056865+0000 mon.a (mon.0) 1487 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:05.816366+0000 mon.a (mon.0) 1488 : audit 1 from='client.46655 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWrite_smithi062-64504-27"}]': finished 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:05.816568+0000 mon.a (mon.0) 1489 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: cluster 2024-02-13T14:50:05.823860+0000 mon.a (mon.0) 1490 : cluster 0 osdmap e180: 8 total, 8 up, 8 in 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:05.830802+0000 mon.c (mon.2) 343 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:50:06.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:05 smithi111 bash[23388]: audit 2024-02-13T14:50:05.834078+0000 mon.a (mon.0) 1491 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]: dispatch 2024-02-13T14:50:06.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:50:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:50:07.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: cluster 2024-02-13T14:50:05.797164+0000 mgr.y (mgr.14613) 272 : cluster 0 pgmap v280: 396 pgs: 8 active+clean+snaptrim, 4 creating+activating, 20 creating+peering, 25 active+clean+snaptrim_wait, 339 active+clean; 611 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-02-13T14:50:07.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: cluster 2024-02-13T14:50:05.836715+0000 mon.a (mon.0) 1492 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:05.870619+0000 mon.c (mon.2) 344 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:05.973566+0000 mon.c (mon.2) 345 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.316306+0000 mon.a (mon.0) 1493 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.317085+0000 mon.c (mon.2) 346 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.317481+0000 mon.a (mon.0) 1494 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.318226+0000 mon.c (mon.2) 347 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.318657+0000 mon.a (mon.0) 1495 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: cluster 2024-02-13T14:50:06.698902+0000 mon.a (mon.0) 1496 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.702409+0000 mon.a (mon.0) 1497 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]': finished 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.702707+0000 mon.a (mon.0) 1498 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: cluster 2024-02-13T14:50:06.712177+0000 mon.a (mon.0) 1499 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-02-13T14:50:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.715391+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: cluster 2024-02-13T14:50:05.797164+0000 mgr.y (mgr.14613) 272 : cluster 0 pgmap v280: 396 pgs: 8 active+clean+snaptrim, 4 creating+activating, 20 creating+peering, 25 active+clean+snaptrim_wait, 339 active+clean; 611 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: cluster 2024-02-13T14:50:05.836715+0000 mon.a (mon.0) 1492 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:05.870619+0000 mon.c (mon.2) 344 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:05.973566+0000 mon.c (mon.2) 345 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.316306+0000 mon.a (mon.0) 1493 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.317085+0000 mon.c (mon.2) 346 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.317481+0000 mon.a (mon.0) 1494 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.318226+0000 mon.c (mon.2) 347 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.318657+0000 mon.a (mon.0) 1495 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: cluster 2024-02-13T14:50:06.698902+0000 mon.a (mon.0) 1496 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.702409+0000 mon.a (mon.0) 1497 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]': finished 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.702707+0000 mon.a (mon.0) 1498 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: cluster 2024-02-13T14:50:06.712177+0000 mon.a (mon.0) 1499 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-02-13T14:50:07.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.715391+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.717293+0000 mon.a (mon.0) 1500 : audit 1 from='client.? v1:172.21.15.62:0/249884179' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi062-64512-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[21479]: audit 2024-02-13T14:50:06.718480+0000 mon.a (mon.0) 1501 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.717293+0000 mon.a (mon.0) 1500 : audit 1 from='client.? v1:172.21.15.62:0/249884179' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi062-64512-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:07.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:06 smithi062 bash[28859]: audit 2024-02-13T14:50:06.718480+0000 mon.a (mon.0) 1501 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: cluster 2024-02-13T14:50:05.797164+0000 mgr.y (mgr.14613) 272 : cluster 0 pgmap v280: 396 pgs: 8 active+clean+snaptrim, 4 creating+activating, 20 creating+peering, 25 active+clean+snaptrim_wait, 339 active+clean; 611 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 7.2 KiB/s rd, 8.0 KiB/s wr, 3 op/s 2024-02-13T14:50:07.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: cluster 2024-02-13T14:50:05.836715+0000 mon.a (mon.0) 1492 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:05.870619+0000 mon.c (mon.2) 344 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:05.973566+0000 mon.c (mon.2) 345 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.316306+0000 mon.a (mon.0) 1493 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.317085+0000 mon.c (mon.2) 346 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.317481+0000 mon.a (mon.0) 1494 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.318226+0000 mon.c (mon.2) 347 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.318657+0000 mon.a (mon.0) 1495 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: cluster 2024-02-13T14:50:06.698902+0000 mon.a (mon.0) 1496 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.702409+0000 mon.a (mon.0) 1497 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-13"}]': finished 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.702707+0000 mon.a (mon.0) 1498 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForComplete_smithi062-64504-28", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: cluster 2024-02-13T14:50:06.712177+0000 mon.a (mon.0) 1499 : cluster 0 osdmap e181: 8 total, 8 up, 8 in 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.715391+0000 mon.c (mon.2) 348 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.717293+0000 mon.a (mon.0) 1500 : audit 1 from='client.? v1:172.21.15.62:0/249884179' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi062-64512-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:07.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:06 smithi111 bash[23388]: audit 2024-02-13T14:50:06.718480+0000 mon.a (mon.0) 1501 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:08 smithi062 bash[28859]: audit 2024-02-13T14:50:06.975136+0000 mon.c (mon.2) 349 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:08 smithi062 bash[28859]: audit 2024-02-13T14:50:07.706413+0000 mon.a (mon.0) 1502 : audit 1 from='client.? v1:172.21.15.62:0/249884179' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi062-64512-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:08.559 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:08 smithi062 bash[28859]: cluster 2024-02-13T14:50:08.182233+0000 mon.a (mon.0) 1503 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-02-13T14:50:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:08 smithi062 bash[21479]: audit 2024-02-13T14:50:06.975136+0000 mon.c (mon.2) 349 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:08 smithi062 bash[21479]: audit 2024-02-13T14:50:07.706413+0000 mon.a (mon.0) 1502 : audit 1 from='client.? v1:172.21.15.62:0/249884179' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi062-64512-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:08.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:08 smithi062 bash[21479]: cluster 2024-02-13T14:50:08.182233+0000 mon.a (mon.0) 1503 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-02-13T14:50:08.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:08 smithi111 bash[23388]: audit 2024-02-13T14:50:06.975136+0000 mon.c (mon.2) 349 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:08.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:08 smithi111 bash[23388]: audit 2024-02-13T14:50:07.706413+0000 mon.a (mon.0) 1502 : audit 1 from='client.? v1:172.21.15.62:0/249884179' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiWritePP_smithi062-64512-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:08.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:08 smithi111 bash[23388]: cluster 2024-02-13T14:50:08.182233+0000 mon.a (mon.0) 1503 : cluster 0 osdmap e182: 8 total, 8 up, 8 in 2024-02-13T14:50:09.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[21479]: cluster 2024-02-13T14:50:07.798123+0000 mgr.y (mgr.14613) 273 : cluster 0 pgmap v284: 364 pgs: 4 active+clean+snaptrim, 32 unknown, 14 active+clean+snaptrim_wait, 314 active+clean; 610 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-02-13T14:50:09.559 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[21479]: audit 2024-02-13T14:50:07.976660+0000 mon.c (mon.2) 350 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[21479]: audit 2024-02-13T14:50:08.718334+0000 mon.a (mon.0) 1504 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[21479]: cluster 2024-02-13T14:50:08.726634+0000 mon.a (mon.0) 1505 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[21479]: audit 2024-02-13T14:50:08.730081+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[21479]: audit 2024-02-13T14:50:08.731698+0000 mon.a (mon.0) 1506 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[21479]: audit 2024-02-13T14:50:08.978115+0000 mon.c (mon.2) 352 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[28859]: cluster 2024-02-13T14:50:07.798123+0000 mgr.y (mgr.14613) 273 : cluster 0 pgmap v284: 364 pgs: 4 active+clean+snaptrim, 32 unknown, 14 active+clean+snaptrim_wait, 314 active+clean; 610 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[28859]: audit 2024-02-13T14:50:07.976660+0000 mon.c (mon.2) 350 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[28859]: audit 2024-02-13T14:50:08.718334+0000 mon.a (mon.0) 1504 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[28859]: cluster 2024-02-13T14:50:08.726634+0000 mon.a (mon.0) 1505 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[28859]: audit 2024-02-13T14:50:08.730081+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:09.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[28859]: audit 2024-02-13T14:50:08.731698+0000 mon.a (mon.0) 1506 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:09.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:09 smithi062 bash[28859]: audit 2024-02-13T14:50:08.978115+0000 mon.c (mon.2) 352 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:09.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:09 smithi111 bash[23388]: cluster 2024-02-13T14:50:07.798123+0000 mgr.y (mgr.14613) 273 : cluster 0 pgmap v284: 364 pgs: 4 active+clean+snaptrim, 32 unknown, 14 active+clean+snaptrim_wait, 314 active+clean; 610 KiB data, 583 MiB used, 715 GiB / 715 GiB avail; 8.0 KiB/s wr, 1 op/s 2024-02-13T14:50:09.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:09 smithi111 bash[23388]: audit 2024-02-13T14:50:07.976660+0000 mon.c (mon.2) 350 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:09.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:09 smithi111 bash[23388]: audit 2024-02-13T14:50:08.718334+0000 mon.a (mon.0) 1504 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForComplete_smithi062-64504-28", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:09.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:09 smithi111 bash[23388]: cluster 2024-02-13T14:50:08.726634+0000 mon.a (mon.0) 1505 : cluster 0 osdmap e183: 8 total, 8 up, 8 in 2024-02-13T14:50:09.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:09 smithi111 bash[23388]: audit 2024-02-13T14:50:08.730081+0000 mon.c (mon.2) 351 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:09.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:09 smithi111 bash[23388]: audit 2024-02-13T14:50:08.731698+0000 mon.a (mon.0) 1506 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:09.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:09 smithi111 bash[23388]: audit 2024-02-13T14:50:08.978115+0000 mon.c (mon.2) 352 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:10.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:50:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:50:11.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[21479]: audit 2024-02-13T14:50:09.724384+0000 mon.a (mon.0) 1507 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[21479]: cluster 2024-02-13T14:50:09.732686+0000 mon.a (mon.0) 1508 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-02-13T14:50:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[21479]: audit 2024-02-13T14:50:09.735257+0000 mon.c (mon.2) 353 : audit 1 from='client.? v1:172.21.15.62:0/3517707421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[21479]: audit 2024-02-13T14:50:09.737724+0000 mon.a (mon.0) 1509 : audit 1 from='client.46682 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[21479]: cluster 2024-02-13T14:50:09.799125+0000 mgr.y (mgr.14613) 274 : cluster 0 pgmap v287: 404 pgs: 22 creating+peering, 4 active+clean+snaptrim, 45 unknown, 14 active+clean+snaptrim_wait, 319 active+clean; 610 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 257 B/s wr, 0 op/s 2024-02-13T14:50:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[21479]: audit 2024-02-13T14:50:09.979856+0000 mon.c (mon.2) 354 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:11.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[21479]: audit 2024-02-13T14:50:10.209101+0000 mgr.y (mgr.14613) 275 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:11.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[28859]: audit 2024-02-13T14:50:09.724384+0000 mon.a (mon.0) 1507 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:11.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[28859]: cluster 2024-02-13T14:50:09.732686+0000 mon.a (mon.0) 1508 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-02-13T14:50:11.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[28859]: audit 2024-02-13T14:50:09.735257+0000 mon.c (mon.2) 353 : audit 1 from='client.? v1:172.21.15.62:0/3517707421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:11.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[28859]: audit 2024-02-13T14:50:09.737724+0000 mon.a (mon.0) 1509 : audit 1 from='client.46682 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:11.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[28859]: cluster 2024-02-13T14:50:09.799125+0000 mgr.y (mgr.14613) 274 : cluster 0 pgmap v287: 404 pgs: 22 creating+peering, 4 active+clean+snaptrim, 45 unknown, 14 active+clean+snaptrim_wait, 319 active+clean; 610 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 257 B/s wr, 0 op/s 2024-02-13T14:50:11.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[28859]: audit 2024-02-13T14:50:09.979856+0000 mon.c (mon.2) 354 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:11.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:10 smithi062 bash[28859]: audit 2024-02-13T14:50:10.209101+0000 mgr.y (mgr.14613) 275 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:11.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:10 smithi111 bash[23388]: audit 2024-02-13T14:50:09.724384+0000 mon.a (mon.0) 1507 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-15","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:11.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:10 smithi111 bash[23388]: cluster 2024-02-13T14:50:09.732686+0000 mon.a (mon.0) 1508 : cluster 0 osdmap e184: 8 total, 8 up, 8 in 2024-02-13T14:50:11.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:10 smithi111 bash[23388]: audit 2024-02-13T14:50:09.735257+0000 mon.c (mon.2) 353 : audit 1 from='client.? v1:172.21.15.62:0/3517707421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:11.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:10 smithi111 bash[23388]: audit 2024-02-13T14:50:09.737724+0000 mon.a (mon.0) 1509 : audit 1 from='client.46682 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:11.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:10 smithi111 bash[23388]: cluster 2024-02-13T14:50:09.799125+0000 mgr.y (mgr.14613) 274 : cluster 0 pgmap v287: 404 pgs: 22 creating+peering, 4 active+clean+snaptrim, 45 unknown, 14 active+clean+snaptrim_wait, 319 active+clean; 610 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 257 B/s wr, 0 op/s 2024-02-13T14:50:11.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:10 smithi111 bash[23388]: audit 2024-02-13T14:50:09.979856+0000 mon.c (mon.2) 354 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:11.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:10 smithi111 bash[23388]: audit 2024-02-13T14:50:10.209101+0000 mgr.y (mgr.14613) 275 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: audit 2024-02-13T14:50:10.734133+0000 mon.a (mon.0) 1510 : audit 1 from='client.46682 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: cluster 2024-02-13T14:50:10.744736+0000 mon.a (mon.0) 1511 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: audit 2024-02-13T14:50:10.748662+0000 mon.c (mon.2) 355 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: audit 2024-02-13T14:50:10.749179+0000 mon.c (mon.2) 356 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: audit 2024-02-13T14:50:10.752788+0000 mon.a (mon.0) 1512 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: audit 2024-02-13T14:50:10.756061+0000 mon.a (mon.0) 1513 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: audit 2024-02-13T14:50:10.804740+0000 mon.c (mon.2) 357 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: audit 2024-02-13T14:50:10.805264+0000 mon.a (mon.0) 1514 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: audit 2024-02-13T14:50:10.981917+0000 mon.c (mon.2) 358 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:12.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[28859]: cluster 2024-02-13T14:50:11.701327+0000 mon.a (mon.0) 1515 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: audit 2024-02-13T14:50:10.734133+0000 mon.a (mon.0) 1510 : audit 1 from='client.46682 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: cluster 2024-02-13T14:50:10.744736+0000 mon.a (mon.0) 1511 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: audit 2024-02-13T14:50:10.748662+0000 mon.c (mon.2) 355 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: audit 2024-02-13T14:50:10.749179+0000 mon.c (mon.2) 356 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: audit 2024-02-13T14:50:10.752788+0000 mon.a (mon.0) 1512 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: audit 2024-02-13T14:50:10.756061+0000 mon.a (mon.0) 1513 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: audit 2024-02-13T14:50:10.804740+0000 mon.c (mon.2) 357 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: audit 2024-02-13T14:50:10.805264+0000 mon.a (mon.0) 1514 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: audit 2024-02-13T14:50:10.981917+0000 mon.c (mon.2) 358 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:12.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:11 smithi062 bash[21479]: cluster 2024-02-13T14:50:11.701327+0000 mon.a (mon.0) 1515 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:12.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: audit 2024-02-13T14:50:10.734133+0000 mon.a (mon.0) 1510 : audit 1 from='client.46682 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "AioUnlockPP_smithi062-64512-28","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:12.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: cluster 2024-02-13T14:50:10.744736+0000 mon.a (mon.0) 1511 : cluster 0 osdmap e185: 8 total, 8 up, 8 in 2024-02-13T14:50:12.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: audit 2024-02-13T14:50:10.748662+0000 mon.c (mon.2) 355 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:12.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: audit 2024-02-13T14:50:10.749179+0000 mon.c (mon.2) 356 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:12.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: audit 2024-02-13T14:50:10.752788+0000 mon.a (mon.0) 1512 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: audit 2024-02-13T14:50:10.756061+0000 mon.a (mon.0) 1513 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: audit 2024-02-13T14:50:10.804740+0000 mon.c (mon.2) 357 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: audit 2024-02-13T14:50:10.805264+0000 mon.a (mon.0) 1514 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: audit 2024-02-13T14:50:10.981917+0000 mon.c (mon.2) 358 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:12.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:11 smithi111 bash[23388]: cluster 2024-02-13T14:50:11.701327+0000 mon.a (mon.0) 1515 : cluster 3 Health check update: 7 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:12.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleWritpp: [ RUN ] LibRadosSnapshotsECPP.SnapGetNamePP 2024-02-13T14:50:12.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsECPP.SnapGetNamePP (1997 ms) 2024-02-13T14:50:12.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 4 tests from LibRadosSnapshotsECPP (8515 ms total) 2024-02-13T14:50:12.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-13T14:50:12.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.SnapPP 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.SnapPP (4129 ms) 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.RollbackPP 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.RollbackPP (3930 ms) 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ RUN ] LibRadosSnapshotsSelfManagedECPP.Bug11677 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ OK ] LibRadosSnapshotsSelfManagedECPP.Bug11677 (3903 ms) 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] 3 tests from LibRadosSnapshotsSelfManagedECPP (11962 ms total) 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [----------] Global test environment tear-down 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [==========] 21 tests from 5 test suites ran. (134027 ms total) 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ PASSED ] 20 tests. 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ SKIPPED ] 1 test, listed below: 2024-02-13T14:50:12.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_snapshots_pp: [ SKIPPED ] LibRadosSnapshotsSelfManagedPP.WriteRollback 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.745332+0000 mon.a (mon.0) 1516 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.745568+0000 mon.a (mon.0) 1517 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.745703+0000 mon.a (mon.0) 1518 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: cluster 2024-02-13T14:50:11.753540+0000 mon.a (mon.0) 1519 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.755285+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.755966+0000 mon.c (mon.2) 360 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.757124+0000 mon.a (mon.0) 1520 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.757245+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.757525+0000 mon.a (mon.0) 1521 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.758638+0000 mon.a (mon.0) 1522 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:13.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: cluster 2024-02-13T14:50:11.799629+0000 mgr.y (mgr.14613) 276 : cluster 0 pgmap v290: 356 pgs: 17 creating+peering, 339 active+clean; 585 KiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[28859]: audit 2024-02-13T14:50:11.983500+0000 mon.c (mon.2) 362 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.745332+0000 mon.a (mon.0) 1516 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.745568+0000 mon.a (mon.0) 1517 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.745703+0000 mon.a (mon.0) 1518 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: cluster 2024-02-13T14:50:11.753540+0000 mon.a (mon.0) 1519 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.755285+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.755966+0000 mon.c (mon.2) 360 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.757124+0000 mon.a (mon.0) 1520 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.757245+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.757525+0000 mon.a (mon.0) 1521 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.758638+0000 mon.a (mon.0) 1522 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:13.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: cluster 2024-02-13T14:50:11.799629+0000 mgr.y (mgr.14613) 276 : cluster 0 pgmap v290: 356 pgs: 17 creating+peering, 339 active+clean; 585 KiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:13.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:12 smithi062 bash[21479]: audit 2024-02-13T14:50:11.983500+0000 mon.c (mon.2) 362 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:13.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.745332+0000 mon.a (mon.0) 1516 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:50:13.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.745568+0000 mon.a (mon.0) 1517 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.745703+0000 mon.a (mon.0) 1518 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: cluster 2024-02-13T14:50:11.753540+0000 mon.a (mon.0) 1519 : cluster 0 osdmap e186: 8 total, 8 up, 8 in 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.755285+0000 mon.c (mon.2) 359 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.755966+0000 mon.c (mon.2) 360 : audit 1 from='client.? v1:172.21.15.62:0/3855640087' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.757124+0000 mon.a (mon.0) 1520 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.757245+0000 mon.c (mon.2) 361 : audit 1 from='client.? v1:172.21.15.62:0/1496975331' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.757525+0000 mon.a (mon.0) 1521 : audit 1 from='client.46637 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]: dispatch 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.758638+0000 mon.a (mon.0) 1522 : audit 1 from='client.46676 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]: dispatch 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: cluster 2024-02-13T14:50:11.799629+0000 mgr.y (mgr.14613) 276 : cluster 0 pgmap v290: 356 pgs: 17 creating+peering, 339 active+clean; 585 KiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:13.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:12 smithi111 bash[23388]: audit 2024-02-13T14:50:11.983500+0000 mon.c (mon.2) 362 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.759169+0000 mon.a (mon.0) 1523 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]': finished 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.759445+0000 mon.a (mon.0) 1524 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.759683+0000 mon.a (mon.0) 1525 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: cluster 2024-02-13T14:50:12.770522+0000 mon.a (mon.0) 1526 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.772792+0000 mon.c (mon.2) 363 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]: dispatch 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.775102+0000 mon.a (mon.0) 1527 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]: dispatch 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.775957+0000 mon.a (mon.0) 1528 : audit 1 from='client.? v1:172.21.15.62:0/235645218' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi062-64512-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.812865+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.813228+0000 mon.a (mon.0) 1529 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.814408+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.814729+0000 mon.a (mon.0) 1530 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.815232+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.815536+0000 mon.a (mon.0) 1531 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[21479]: audit 2024-02-13T14:50:12.985099+0000 mon.c (mon.2) 367 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.759169+0000 mon.a (mon.0) 1523 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]': finished 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.759445+0000 mon.a (mon.0) 1524 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.759683+0000 mon.a (mon.0) 1525 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: cluster 2024-02-13T14:50:12.770522+0000 mon.a (mon.0) 1526 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.772792+0000 mon.c (mon.2) 363 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]: dispatch 2024-02-13T14:50:14.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.775102+0000 mon.a (mon.0) 1527 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]: dispatch 2024-02-13T14:50:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.775957+0000 mon.a (mon.0) 1528 : audit 1 from='client.? v1:172.21.15.62:0/235645218' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi062-64512-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.812865+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.813228+0000 mon.a (mon.0) 1529 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.814408+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.814729+0000 mon.a (mon.0) 1530 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.815232+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.815536+0000 mon.a (mon.0) 1531 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:13 smithi062 bash[28859]: audit 2024-02-13T14:50:12.985099+0000 mon.c (mon.2) 367 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:14.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.759169+0000 mon.a (mon.0) 1523 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-15"}]': finished 2024-02-13T14:50:14.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.759445+0000 mon.a (mon.0) 1524 : audit 1 from='client.46637 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosSnapshotsSelfManagedECPP_smithi062-64736-21"}]': finished 2024-02-13T14:50:14.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.759683+0000 mon.a (mon.0) 1525 : audit 1 from='client.46676 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForComplete_smithi062-64504-28"}]': finished 2024-02-13T14:50:14.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: cluster 2024-02-13T14:50:12.770522+0000 mon.a (mon.0) 1526 : cluster 0 osdmap e187: 8 total, 8 up, 8 in 2024-02-13T14:50:14.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.772792+0000 mon.c (mon.2) 363 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.775102+0000 mon.a (mon.0) 1527 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.775957+0000 mon.a (mon.0) 1528 : audit 1 from='client.? v1:172.21.15.62:0/235645218' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi062-64512-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.812865+0000 mon.c (mon.2) 364 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.813228+0000 mon.a (mon.0) 1529 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.814408+0000 mon.c (mon.2) 365 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.814729+0000 mon.a (mon.0) 1530 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.815232+0000 mon.c (mon.2) 366 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.815536+0000 mon.a (mon.0) 1531 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:14.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:13 smithi111 bash[23388]: audit 2024-02-13T14:50:12.985099+0000 mon.c (mon.2) 367 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:15.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: cluster 2024-02-13T14:50:13.760037+0000 mon.a (mon.0) 1532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: audit 2024-02-13T14:50:13.762539+0000 mon.a (mon.0) 1533 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]': finished 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: audit 2024-02-13T14:50:13.762782+0000 mon.a (mon.0) 1534 : audit 1 from='client.? v1:172.21.15.62:0/235645218' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi062-64512-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: audit 2024-02-13T14:50:13.762990+0000 mon.a (mon.0) 1535 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: cluster 2024-02-13T14:50:13.770979+0000 mon.a (mon.0) 1536 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: audit 2024-02-13T14:50:13.776189+0000 mon.c (mon.2) 368 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: audit 2024-02-13T14:50:13.799722+0000 mon.a (mon.0) 1537 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: cluster 2024-02-13T14:50:13.800654+0000 mgr.y (mgr.14613) 277 : cluster 0 pgmap v293: 388 pgs: 32 unknown, 17 creating+peering, 339 active+clean; 585 KiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[28859]: audit 2024-02-13T14:50:13.986804+0000 mon.c (mon.2) 369 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:15.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: cluster 2024-02-13T14:50:13.760037+0000 mon.a (mon.0) 1532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: audit 2024-02-13T14:50:13.762539+0000 mon.a (mon.0) 1533 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]': finished 2024-02-13T14:50:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: audit 2024-02-13T14:50:13.762782+0000 mon.a (mon.0) 1534 : audit 1 from='client.? v1:172.21.15.62:0/235645218' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi062-64512-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: audit 2024-02-13T14:50:13.762990+0000 mon.a (mon.0) 1535 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: cluster 2024-02-13T14:50:13.770979+0000 mon.a (mon.0) 1536 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-02-13T14:50:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: audit 2024-02-13T14:50:13.776189+0000 mon.c (mon.2) 368 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: audit 2024-02-13T14:50:13.799722+0000 mon.a (mon.0) 1537 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: cluster 2024-02-13T14:50:13.800654+0000 mgr.y (mgr.14613) 277 : cluster 0 pgmap v293: 388 pgs: 32 unknown, 17 creating+peering, 339 active+clean; 585 KiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:15.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:14 smithi062 bash[21479]: audit 2024-02-13T14:50:13.986804+0000 mon.c (mon.2) 369 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:15.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: cluster 2024-02-13T14:50:13.760037+0000 mon.a (mon.0) 1532 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:15.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: audit 2024-02-13T14:50:13.762539+0000 mon.a (mon.0) 1533 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-15", "mode": "writeback"}]': finished 2024-02-13T14:50:15.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: audit 2024-02-13T14:50:13.762782+0000 mon.a (mon.0) 1534 : audit 1 from='client.? v1:172.21.15.62:0/235645218' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripAppendPP_smithi062-64512-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:15.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: audit 2024-02-13T14:50:13.762990+0000 mon.a (mon.0) 1535 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip_smithi062-64504-29", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:15.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: cluster 2024-02-13T14:50:13.770979+0000 mon.a (mon.0) 1536 : cluster 0 osdmap e188: 8 total, 8 up, 8 in 2024-02-13T14:50:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: audit 2024-02-13T14:50:13.776189+0000 mon.c (mon.2) 368 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: audit 2024-02-13T14:50:13.799722+0000 mon.a (mon.0) 1537 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: cluster 2024-02-13T14:50:13.800654+0000 mgr.y (mgr.14613) 277 : cluster 0 pgmap v293: 388 pgs: 32 unknown, 17 creating+peering, 339 active+clean; 585 KiB data, 585 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:15.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:14 smithi111 bash[23388]: audit 2024-02-13T14:50:13.986804+0000 mon.c (mon.2) 369 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:15.265 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: Running main() from gmock_main.cc 2024-02-13T14:50:15.265 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [==========] Running 57 tests from 4 test suites. 2024-02-13T14:50:15.265 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] Global test environment set-up. 2024-02-13T14:50:15.265 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio 2024-02-13T14:50:15.265 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.TooBigPP 2024-02-13T14:50:15.265 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.TooBigPP (18164 ms) 2024-02-13T14:50:15.265 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolQuotaPP 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolQuotaPP (32314 ms) 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleWritePP 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleWritePP (8601 ms) 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.WaitForSafePP 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.WaitForSafePP (4498 ms) 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP (6094 ms) 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP2 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP2 (3431 ms) 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripPP3 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripPP3 (3408 ms) 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripSparseReadPP 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripSparseReadPP (2123 ms) 2024-02-13T14:50:15.266 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsCompletePP 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.IsCompletePP (3030 ms) 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.IsSafePP 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.IsSafePP (3869 ms) 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.ReturnValuePP 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.ReturnValuePP (2554 ms) 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushPP 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushPP (3012 ms) 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.FlushAsyncPP 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.FlushAsyncPP (2989 ms) 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP (3040 ms) 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteFullPP2 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteFullPP2 (3006 ms) 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP 2024-02-13T14:50:15.267 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP (3504 ms) 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripWriteSamePP2 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripWriteSamePP2 (2969 ms) 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPPNS 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPPNS (2464 ms) 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.SimpleStatPP 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.SimpleStatPP (3026 ms) 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime (3015 ms) 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.OperateMtime2 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.OperateMtime2 (3480 ms) 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.StatRemovePP 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.StatRemovePP (2577 ms) 2024-02-13T14:50:15.268 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.ExecuteClassPP 2024-02-13T14:50:15.269 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.ExecuteClassPP (3012 ms) 2024-02-13T14:50:15.269 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.OmapPP 2024-02-13T14:50:15.269 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.OmapPP (3016 ms) 2024-02-13T14:50:15.269 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiWritePP 2024-02-13T14:50:15.269 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiWritePP (2909 ms) 2024-02-13T14:50:15.269 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.AioUnlockPP 2024-02-13T14:50:15.269 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.AioUnlockPP (3013 ms) 2024-02-13T14:50:15.269 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripAppendPP 2024-02-13T14:50:16.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:15 smithi062 bash[21479]: audit 2024-02-13T14:50:14.988415+0000 mon.c (mon.2) 370 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:16.059 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:15 smithi062 bash[21479]: cluster 2024-02-13T14:50:15.265660+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-02-13T14:50:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:15 smithi062 bash[21479]: audit 2024-02-13T14:50:15.292110+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:16.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:15 smithi062 bash[21479]: audit 2024-02-13T14:50:15.733043+0000 mon.a (mon.0) 1539 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:15 smithi062 bash[28859]: audit 2024-02-13T14:50:14.988415+0000 mon.c (mon.2) 370 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:15 smithi062 bash[28859]: cluster 2024-02-13T14:50:15.265660+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-02-13T14:50:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:15 smithi062 bash[28859]: audit 2024-02-13T14:50:15.292110+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:16.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:15 smithi062 bash[28859]: audit 2024-02-13T14:50:15.733043+0000 mon.a (mon.0) 1539 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:16.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:15 smithi111 bash[23388]: audit 2024-02-13T14:50:14.988415+0000 mon.c (mon.2) 370 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:16.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:15 smithi111 bash[23388]: cluster 2024-02-13T14:50:15.265660+0000 mon.a (mon.0) 1538 : cluster 0 osdmap e189: 8 total, 8 up, 8 in 2024-02-13T14:50:16.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:15 smithi111 bash[23388]: audit 2024-02-13T14:50:15.292110+0000 mon.c (mon.2) 371 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:16.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:15 smithi111 bash[23388]: audit 2024-02-13T14:50:15.733043+0000 mon.a (mon.0) 1539 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:16.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:50:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:50:17.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: cluster 2024-02-13T14:50:15.802818+0000 mgr.y (mgr.14613) 278 : cluster 0 pgmap v295: 356 pgs: 356 active+clean; 585 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 252 B/s wr, 1 op/s 2024-02-13T14:50:17.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:15.807510+0000 mon.a (mon.0) 1540 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:17.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:15.807806+0000 mon.a (mon.0) 1541 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:17.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: cluster 2024-02-13T14:50:15.816112+0000 mon.a (mon.0) 1542 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-02-13T14:50:17.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:15.825930+0000 mon.c (mon.2) 372 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:15.827270+0000 mon.a (mon.0) 1543 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:15.827448+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.62:0/4244343139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:15.827939+0000 mon.a (mon.0) 1544 : audit 1 from='client.46700 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:15.990053+0000 mon.c (mon.2) 374 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: cluster 2024-02-13T14:50:16.702825+0000 mon.a (mon.0) 1545 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:17.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: cluster 2024-02-13T14:50:16.704311+0000 mon.a (mon.0) 1546 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:17.064 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:16.707165+0000 mon.a (mon.0) 1547 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]': finished 2024-02-13T14:50:17.065 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: audit 2024-02-13T14:50:16.707351+0000 mon.a (mon.0) 1548 : audit 1 from='client.46700 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:17.065 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[21479]: cluster 2024-02-13T14:50:16.716009+0000 mon.a (mon.0) 1549 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-02-13T14:50:17.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: cluster 2024-02-13T14:50:15.802818+0000 mgr.y (mgr.14613) 278 : cluster 0 pgmap v295: 356 pgs: 356 active+clean; 585 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 252 B/s wr, 1 op/s 2024-02-13T14:50:17.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:15.807510+0000 mon.a (mon.0) 1540 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:17.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:15.807806+0000 mon.a (mon.0) 1541 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:17.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: cluster 2024-02-13T14:50:15.816112+0000 mon.a (mon.0) 1542 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-02-13T14:50:17.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:15.825930+0000 mon.c (mon.2) 372 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:15.827270+0000 mon.a (mon.0) 1543 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:15.827448+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.62:0/4244343139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:15.827939+0000 mon.a (mon.0) 1544 : audit 1 from='client.46700 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:15.990053+0000 mon.c (mon.2) 374 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: cluster 2024-02-13T14:50:16.702825+0000 mon.a (mon.0) 1545 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: cluster 2024-02-13T14:50:16.704311+0000 mon.a (mon.0) 1546 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:16.707165+0000 mon.a (mon.0) 1547 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]': finished 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: audit 2024-02-13T14:50:16.707351+0000 mon.a (mon.0) 1548 : audit 1 from='client.46700 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:17.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:16 smithi062 bash[28859]: cluster 2024-02-13T14:50:16.716009+0000 mon.a (mon.0) 1549 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-02-13T14:50:17.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: cluster 2024-02-13T14:50:15.802818+0000 mgr.y (mgr.14613) 278 : cluster 0 pgmap v295: 356 pgs: 356 active+clean; 585 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 252 B/s wr, 1 op/s 2024-02-13T14:50:17.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:15.807510+0000 mon.a (mon.0) 1540 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip_smithi062-64504-29", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:17.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:15.807806+0000 mon.a (mon.0) 1541 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:17.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: cluster 2024-02-13T14:50:15.816112+0000 mon.a (mon.0) 1542 : cluster 0 osdmap e190: 8 total, 8 up, 8 in 2024-02-13T14:50:17.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:15.825930+0000 mon.c (mon.2) 372 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:17.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:15.827270+0000 mon.a (mon.0) 1543 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]: dispatch 2024-02-13T14:50:17.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:15.827448+0000 mon.c (mon.2) 373 : audit 1 from='client.? v1:172.21.15.62:0/4244343139' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:17.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:15.827939+0000 mon.a (mon.0) 1544 : audit 1 from='client.46700 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:17.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:15.990053+0000 mon.c (mon.2) 374 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:17.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: cluster 2024-02-13T14:50:16.702825+0000 mon.a (mon.0) 1545 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:17.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: cluster 2024-02-13T14:50:16.704311+0000 mon.a (mon.0) 1546 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:17.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:16.707165+0000 mon.a (mon.0) 1547 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-15"}]': finished 2024-02-13T14:50:17.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: audit 2024-02-13T14:50:16.707351+0000 mon.a (mon.0) 1548 : audit 1 from='client.46700 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RacingRemovePP_smithi062-64512-30","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:17.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:16 smithi111 bash[23388]: cluster 2024-02-13T14:50:16.716009+0000 mon.a (mon.0) 1549 : cluster 0 osdmap e191: 8 total, 8 up, 8 in 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:16.991996+0000 mon.c (mon.2) 375 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:16.993305+0000 mon.c (mon.2) 376 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:16.994124+0000 mon.a (mon.0) 1550 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:17.368485+0000 mon.a (mon.0) 1551 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:17.373390+0000 mon.b (mon.1) 178 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:17.710000+0000 mon.a (mon.0) 1552 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]': finished 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: cluster 2024-02-13T14:50:17.720158+0000 mon.a (mon.0) 1553 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:17.722091+0000 mon.c (mon.2) 377 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:17.723956+0000 mon.c (mon.2) 378 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:17.724601+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:17.726205+0000 mon.a (mon.0) 1554 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[21479]: audit 2024-02-13T14:50:17.727943+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:16.991996+0000 mon.c (mon.2) 375 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:16.993305+0000 mon.c (mon.2) 376 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:16.994124+0000 mon.a (mon.0) 1550 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:17.368485+0000 mon.a (mon.0) 1551 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:17.373390+0000 mon.b (mon.1) 178 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:17.710000+0000 mon.a (mon.0) 1552 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]': finished 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: cluster 2024-02-13T14:50:17.720158+0000 mon.a (mon.0) 1553 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-02-13T14:50:19.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:17.722091+0000 mon.c (mon.2) 377 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:17.723956+0000 mon.c (mon.2) 378 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:17.724601+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:17.726205+0000 mon.a (mon.0) 1554 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:18 smithi062 bash[28859]: audit 2024-02-13T14:50:17.727943+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:19.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:16.991996+0000 mon.c (mon.2) 375 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:16.993305+0000 mon.c (mon.2) 376 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:19.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:16.994124+0000 mon.a (mon.0) 1550 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:19.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:17.368485+0000 mon.a (mon.0) 1551 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:19.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:17.373390+0000 mon.b (mon.1) 178 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:19.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:17.710000+0000 mon.a (mon.0) 1552 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]': finished 2024-02-13T14:50:19.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: cluster 2024-02-13T14:50:17.720158+0000 mon.a (mon.0) 1553 : cluster 0 osdmap e192: 8 total, 8 up, 8 in 2024-02-13T14:50:19.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:17.722091+0000 mon.c (mon.2) 377 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:17.723956+0000 mon.c (mon.2) 378 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:19.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:17.724601+0000 mon.c (mon.2) 379 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:19.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:17.726205+0000 mon.a (mon.0) 1554 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:19.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:18 smithi111 bash[23388]: audit 2024-02-13T14:50:17.727943+0000 mon.c (mon.2) 380 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:20.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: cluster 2024-02-13T14:50:17.803355+0000 mgr.y (mgr.14613) 279 : cluster 0 pgmap v299: 324 pgs: 324 active+clean; 585 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:20.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:17.805109+0000 mon.b (mon.1) 179 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:20.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.199026+0000 mon.a (mon.0) 1555 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:20.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.663136+0000 mon.a (mon.0) 1556 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:20.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.718413+0000 mon.a (mon.0) 1557 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:20.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.718640+0000 mon.a (mon.0) 1558 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.718852+0000 mon.a (mon.0) 1559 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: cluster 2024-02-13T14:50:18.726704+0000 mon.a (mon.0) 1560 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.727317+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.727986+0000 mon.c (mon.2) 382 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.735306+0000 mon.a (mon.0) 1561 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.737805+0000 mon.c (mon.2) 383 : audit 1 from='client.? v1:172.21.15.62:0/3670706462' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.739268+0000 mon.a (mon.0) 1562 : audit 1 from='client.46706 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.741126+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[21479]: audit 2024-02-13T14:50:18.743223+0000 mon.a (mon.0) 1563 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: cluster 2024-02-13T14:50:17.803355+0000 mgr.y (mgr.14613) 279 : cluster 0 pgmap v299: 324 pgs: 324 active+clean; 585 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:17.805109+0000 mon.b (mon.1) 179 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.199026+0000 mon.a (mon.0) 1555 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.663136+0000 mon.a (mon.0) 1556 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.718413+0000 mon.a (mon.0) 1557 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.718640+0000 mon.a (mon.0) 1558 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.718852+0000 mon.a (mon.0) 1559 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: cluster 2024-02-13T14:50:18.726704+0000 mon.a (mon.0) 1560 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.727317+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.727986+0000 mon.c (mon.2) 382 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.735306+0000 mon.a (mon.0) 1561 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.737805+0000 mon.c (mon.2) 383 : audit 1 from='client.? v1:172.21.15.62:0/3670706462' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.739268+0000 mon.a (mon.0) 1562 : audit 1 from='client.46706 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.741126+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:19 smithi062 bash[28859]: audit 2024-02-13T14:50:18.743223+0000 mon.a (mon.0) 1563 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: cluster 2024-02-13T14:50:17.803355+0000 mgr.y (mgr.14613) 279 : cluster 0 pgmap v299: 324 pgs: 324 active+clean; 585 KiB data, 573 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:20.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:17.805109+0000 mon.b (mon.1) 179 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:20.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.199026+0000 mon.a (mon.0) 1555 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:20.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.663136+0000 mon.a (mon.0) 1556 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:20.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.718413+0000 mon.a (mon.0) 1557 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:20.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.718640+0000 mon.a (mon.0) 1558 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.718852+0000 mon.a (mon.0) 1559 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "31"}]': finished 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: cluster 2024-02-13T14:50:18.726704+0000 mon.a (mon.0) 1560 : cluster 0 osdmap e193: 8 total, 8 up, 8 in 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.727317+0000 mon.c (mon.2) 381 : audit 1 from='client.? v1:172.21.15.62:0/1924723925' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.727986+0000 mon.c (mon.2) 382 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.735306+0000 mon.a (mon.0) 1561 : audit 1 from='client.46694 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]: dispatch 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.737805+0000 mon.c (mon.2) 383 : audit 1 from='client.? v1:172.21.15.62:0/3670706462' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.739268+0000 mon.a (mon.0) 1562 : audit 1 from='client.46706 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.741126+0000 mon.c (mon.2) 384 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:19 smithi111 bash[23388]: audit 2024-02-13T14:50:18.743223+0000 mon.a (mon.0) 1563 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:20.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.724607+0000 mon.a (mon.0) 1564 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.724969+0000 mon.a (mon.0) 1565 : audit 1 from='client.46706 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.725242+0000 mon.a (mon.0) 1566 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: cluster 2024-02-13T14:50:19.735902+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.796997+0000 mon.c (mon.2) 385 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.797627+0000 mon.a (mon.0) 1568 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.799312+0000 mon.c (mon.2) 386 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.799656+0000 mon.a (mon.0) 1569 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.800333+0000 mon.c (mon.2) 387 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:21.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.800683+0000 mon.a (mon.0) 1570 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:21.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: cluster 2024-02-13T14:50:19.804347+0000 mgr.y (mgr.14613) 280 : cluster 0 pgmap v302: 388 pgs: 1 active, 5 creating+activating, 23 creating+peering, 1 peering, 34 unknown, 324 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T14:50:21.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.809654+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:21.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.810178+0000 mon.a (mon.0) 1571 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:21.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.855710+0000 mon.c (mon.2) 389 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:21.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.724607+0000 mon.a (mon.0) 1564 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:21.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.724969+0000 mon.a (mon.0) 1565 : audit 1 from='client.46706 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:21.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.725242+0000 mon.a (mon.0) 1566 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: cluster 2024-02-13T14:50:19.735902+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.796997+0000 mon.c (mon.2) 385 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.797627+0000 mon.a (mon.0) 1568 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.799312+0000 mon.c (mon.2) 386 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.799656+0000 mon.a (mon.0) 1569 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.800333+0000 mon.c (mon.2) 387 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.800683+0000 mon.a (mon.0) 1570 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: cluster 2024-02-13T14:50:19.804347+0000 mgr.y (mgr.14613) 280 : cluster 0 pgmap v302: 388 pgs: 1 active, 5 creating+activating, 23 creating+peering, 1 peering, 34 unknown, 324 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T14:50:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.809654+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:21.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.810178+0000 mon.a (mon.0) 1571 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:21.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.855710+0000 mon.c (mon.2) 389 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:21.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.856277+0000 mon.c (mon.2) 390 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:21.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:19.856572+0000 mon.a (mon.0) 1572 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:21.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[21479]: audit 2024-02-13T14:50:20.217595+0000 mgr.y (mgr.14613) 281 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:21.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.856277+0000 mon.c (mon.2) 390 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:21.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:19.856572+0000 mon.a (mon.0) 1572 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:21.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:20 smithi062 bash[28859]: audit 2024-02-13T14:50:20.217595+0000 mgr.y (mgr.14613) 281 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:21.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.724607+0000 mon.a (mon.0) 1564 : audit 1 from='client.46694 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip_smithi062-64504-29"}]': finished 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.724969+0000 mon.a (mon.0) 1565 : audit 1 from='client.46706 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP_smithi062-64512-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.725242+0000 mon.a (mon.0) 1566 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-17","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: cluster 2024-02-13T14:50:19.735902+0000 mon.a (mon.0) 1567 : cluster 0 osdmap e194: 8 total, 8 up, 8 in 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.796997+0000 mon.c (mon.2) 385 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.797627+0000 mon.a (mon.0) 1568 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.799312+0000 mon.c (mon.2) 386 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.799656+0000 mon.a (mon.0) 1569 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.800333+0000 mon.c (mon.2) 387 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.800683+0000 mon.a (mon.0) 1570 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: cluster 2024-02-13T14:50:19.804347+0000 mgr.y (mgr.14613) 280 : cluster 0 pgmap v302: 388 pgs: 1 active, 5 creating+activating, 23 creating+peering, 1 peering, 34 unknown, 324 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.809654+0000 mon.c (mon.2) 388 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:21.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.810178+0000 mon.a (mon.0) 1571 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:21.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.855710+0000 mon.c (mon.2) 389 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:21.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.856277+0000 mon.c (mon.2) 390 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:21.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:19.856572+0000 mon.a (mon.0) 1572 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]: dispatch 2024-02-13T14:50:21.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:20 smithi111 bash[23388]: audit 2024-02-13T14:50:20.217595+0000 mgr.y (mgr.14613) 281 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: audit 2024-02-13T14:50:20.733744+0000 mon.a (mon.0) 1573 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: audit 2024-02-13T14:50:20.733986+0000 mon.a (mon.0) 1574 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: audit 2024-02-13T14:50:20.734203+0000 mon.a (mon.0) 1575 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]': finished 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: cluster 2024-02-13T14:50:20.746569+0000 mon.a (mon.0) 1576 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: audit 2024-02-13T14:50:20.747480+0000 mon.c (mon.2) 391 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: audit 2024-02-13T14:50:20.749279+0000 mon.c (mon.2) 392 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: audit 2024-02-13T14:50:20.750349+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: audit 2024-02-13T14:50:20.753147+0000 mon.a (mon.0) 1577 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[21479]: audit 2024-02-13T14:50:20.753679+0000 mon.a (mon.0) 1578 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:22.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: audit 2024-02-13T14:50:20.733744+0000 mon.a (mon.0) 1573 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: audit 2024-02-13T14:50:20.733986+0000 mon.a (mon.0) 1574 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: audit 2024-02-13T14:50:20.734203+0000 mon.a (mon.0) 1575 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]': finished 2024-02-13T14:50:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: cluster 2024-02-13T14:50:20.746569+0000 mon.a (mon.0) 1576 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-02-13T14:50:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: audit 2024-02-13T14:50:20.747480+0000 mon.c (mon.2) 391 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: audit 2024-02-13T14:50:20.749279+0000 mon.c (mon.2) 392 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: audit 2024-02-13T14:50:20.750349+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: audit 2024-02-13T14:50:20.753147+0000 mon.a (mon.0) 1577 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:22 smithi062 bash[28859]: audit 2024-02-13T14:50:20.753679+0000 mon.a (mon.0) 1578 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:22.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: audit 2024-02-13T14:50:20.733744+0000 mon.a (mon.0) 1573 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTrip2_smithi062-64504-30", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:22.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: audit 2024-02-13T14:50:20.733986+0000 mon.a (mon.0) 1574 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:22.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: audit 2024-02-13T14:50:20.734203+0000 mon.a (mon.0) 1575 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pg_num","val":"11"}]': finished 2024-02-13T14:50:22.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: cluster 2024-02-13T14:50:20.746569+0000 mon.a (mon.0) 1576 : cluster 0 osdmap e195: 8 total, 8 up, 8 in 2024-02-13T14:50:22.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: audit 2024-02-13T14:50:20.747480+0000 mon.c (mon.2) 391 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:22.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: audit 2024-02-13T14:50:20.749279+0000 mon.c (mon.2) 392 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:22.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: audit 2024-02-13T14:50:20.750349+0000 mon.c (mon.2) 393 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:22.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: audit 2024-02-13T14:50:20.753147+0000 mon.a (mon.0) 1577 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:22.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:22 smithi111 bash[23388]: audit 2024-02-13T14:50:20.753679+0000 mon.a (mon.0) 1578 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:21.738200+0000 mon.a (mon.0) 1579 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]': finished 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:21.747703+0000 mon.c (mon.2) 394 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]: dispatch 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:21.749538+0000 mon.c (mon.2) 395 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: cluster 2024-02-13T14:50:21.805255+0000 mgr.y (mgr.14613) 282 : cluster 0 pgmap v305: 388 pgs: 32 unknown, 2 creating+activating, 10 creating+peering, 1 peering, 343 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: cluster 2024-02-13T14:50:22.191305+0000 mon.a (mon.0) 1580 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:22.193540+0000 mon.a (mon.0) 1581 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]: dispatch 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:22.205412+0000 mon.a (mon.0) 1582 : audit 1 from='client.? v1:172.21.15.62:0/1632586327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi062-64512-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: cluster 2024-02-13T14:50:22.738221+0000 mon.a (mon.0) 1583 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: cluster 2024-02-13T14:50:22.740032+0000 mon.a (mon.0) 1584 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:23.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:22.750411+0000 mon.a (mon.0) 1585 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:22.750681+0000 mon.a (mon.0) 1586 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]': finished 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:22.750883+0000 mon.a (mon.0) 1587 : audit 1 from='client.? v1:172.21.15.62:0/1632586327' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi062-64512-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: cluster 2024-02-13T14:50:22.758835+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:22.759260+0000 mon.c (mon.2) 396 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:22.893838+0000 mon.c (mon.2) 397 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[21479]: audit 2024-02-13T14:50:22.894385+0000 mon.a (mon.0) 1589 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:21.738200+0000 mon.a (mon.0) 1579 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]': finished 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:21.747703+0000 mon.c (mon.2) 394 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]: dispatch 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:21.749538+0000 mon.c (mon.2) 395 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: cluster 2024-02-13T14:50:21.805255+0000 mgr.y (mgr.14613) 282 : cluster 0 pgmap v305: 388 pgs: 32 unknown, 2 creating+activating, 10 creating+peering, 1 peering, 343 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T14:50:23.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: cluster 2024-02-13T14:50:22.191305+0000 mon.a (mon.0) 1580 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:22.193540+0000 mon.a (mon.0) 1581 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]: dispatch 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:22.205412+0000 mon.a (mon.0) 1582 : audit 1 from='client.? v1:172.21.15.62:0/1632586327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi062-64512-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: cluster 2024-02-13T14:50:22.738221+0000 mon.a (mon.0) 1583 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: cluster 2024-02-13T14:50:22.740032+0000 mon.a (mon.0) 1584 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:22.750411+0000 mon.a (mon.0) 1585 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:22.750681+0000 mon.a (mon.0) 1586 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]': finished 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:22.750883+0000 mon.a (mon.0) 1587 : audit 1 from='client.? v1:172.21.15.62:0/1632586327' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi062-64512-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: cluster 2024-02-13T14:50:22.758835+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:22.759260+0000 mon.c (mon.2) 396 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:22.893838+0000 mon.c (mon.2) 397 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:23 smithi062 bash[28859]: audit 2024-02-13T14:50:22.894385+0000 mon.a (mon.0) 1589 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:23.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:21.738200+0000 mon.a (mon.0) 1579 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-17"}]': finished 2024-02-13T14:50:23.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:21.747703+0000 mon.c (mon.2) 394 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]: dispatch 2024-02-13T14:50:23.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:21.749538+0000 mon.c (mon.2) 395 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: cluster 2024-02-13T14:50:21.805255+0000 mgr.y (mgr.14613) 282 : cluster 0 pgmap v305: 388 pgs: 32 unknown, 2 creating+activating, 10 creating+peering, 1 peering, 343 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: cluster 2024-02-13T14:50:22.191305+0000 mon.a (mon.0) 1580 : cluster 0 osdmap e196: 8 total, 8 up, 8 in 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:22.193540+0000 mon.a (mon.0) 1581 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]: dispatch 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:22.205412+0000 mon.a (mon.0) 1582 : audit 1 from='client.? v1:172.21.15.62:0/1632586327' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi062-64512-32","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: cluster 2024-02-13T14:50:22.738221+0000 mon.a (mon.0) 1583 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: cluster 2024-02-13T14:50:22.740032+0000 mon.a (mon.0) 1584 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:22.750411+0000 mon.a (mon.0) 1585 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTrip2_smithi062-64504-30", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:22.750681+0000 mon.a (mon.0) 1586 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-17", "mode": "writeback"}]': finished 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:22.750883+0000 mon.a (mon.0) 1587 : audit 1 from='client.? v1:172.21.15.62:0/1632586327' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripCmpExtPP2_smithi062-64512-32","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: cluster 2024-02-13T14:50:22.758835+0000 mon.a (mon.0) 1588 : cluster 0 osdmap e197: 8 total, 8 up, 8 in 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:22.759260+0000 mon.c (mon.2) 396 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:22.893838+0000 mon.c (mon.2) 397 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:23.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:23 smithi111 bash[23388]: audit 2024-02-13T14:50:22.894385+0000 mon.a (mon.0) 1589 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:25.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[21479]: audit 2024-02-13T14:50:23.753248+0000 mon.a (mon.0) 1590 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:25.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[21479]: cluster 2024-02-13T14:50:23.761664+0000 mon.a (mon.0) 1591 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-02-13T14:50:25.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[21479]: audit 2024-02-13T14:50:23.762354+0000 mon.c (mon.2) 398 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:25.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[21479]: audit 2024-02-13T14:50:23.762857+0000 mon.c (mon.2) 399 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:25.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[21479]: audit 2024-02-13T14:50:23.767102+0000 mon.a (mon.0) 1592 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:25.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[21479]: cluster 2024-02-13T14:50:23.806002+0000 mgr.y (mgr.14613) 283 : cluster 0 pgmap v308: 364 pgs: 8 unknown, 2 creating+activating, 10 creating+peering, 1 peering, 343 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:50:25.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[28859]: audit 2024-02-13T14:50:23.753248+0000 mon.a (mon.0) 1590 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:25.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[28859]: cluster 2024-02-13T14:50:23.761664+0000 mon.a (mon.0) 1591 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-02-13T14:50:25.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[28859]: audit 2024-02-13T14:50:23.762354+0000 mon.c (mon.2) 398 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:25.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[28859]: audit 2024-02-13T14:50:23.762857+0000 mon.c (mon.2) 399 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:25.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[28859]: audit 2024-02-13T14:50:23.767102+0000 mon.a (mon.0) 1592 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:25.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:24 smithi062 bash[28859]: cluster 2024-02-13T14:50:23.806002+0000 mgr.y (mgr.14613) 283 : cluster 0 pgmap v308: 364 pgs: 8 unknown, 2 creating+activating, 10 creating+peering, 1 peering, 343 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:50:25.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:24 smithi111 bash[23388]: audit 2024-02-13T14:50:23.753248+0000 mon.a (mon.0) 1590 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:25.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:24 smithi111 bash[23388]: cluster 2024-02-13T14:50:23.761664+0000 mon.a (mon.0) 1591 : cluster 0 osdmap e198: 8 total, 8 up, 8 in 2024-02-13T14:50:25.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:24 smithi111 bash[23388]: audit 2024-02-13T14:50:23.762354+0000 mon.c (mon.2) 398 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:25.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:24 smithi111 bash[23388]: audit 2024-02-13T14:50:23.762857+0000 mon.c (mon.2) 399 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:25.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:24 smithi111 bash[23388]: audit 2024-02-13T14:50:23.767102+0000 mon.a (mon.0) 1592 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]: dispatch 2024-02-13T14:50:25.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:24 smithi111 bash[23388]: cluster 2024-02-13T14:50:23.806002+0000 mgr.y (mgr.14613) 283 : cluster 0 pgmap v308: 364 pgs: 8 unknown, 2 creating+activating, 10 creating+peering, 1 peering, 343 active+clean; 585 KiB data, 582 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:50:26.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[28859]: cluster 2024-02-13T14:50:24.755574+0000 mon.a (mon.0) 1593 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:26.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[28859]: audit 2024-02-13T14:50:24.764849+0000 mon.c (mon.2) 400 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:26.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[28859]: audit 2024-02-13T14:50:24.766752+0000 mon.a (mon.0) 1594 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]': finished 2024-02-13T14:50:26.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[28859]: cluster 2024-02-13T14:50:24.776560+0000 mon.a (mon.0) 1595 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[28859]: audit 2024-02-13T14:50:24.779316+0000 mon.c (mon.2) 401 : audit 1 from='client.? v1:172.21.15.62:0/1688476483' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[28859]: audit 2024-02-13T14:50:24.783754+0000 mon.a (mon.0) 1596 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[28859]: audit 2024-02-13T14:50:24.784161+0000 mon.c (mon.2) 402 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[28859]: audit 2024-02-13T14:50:24.785898+0000 mon.a (mon.0) 1597 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[21479]: cluster 2024-02-13T14:50:24.755574+0000 mon.a (mon.0) 1593 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[21479]: audit 2024-02-13T14:50:24.764849+0000 mon.c (mon.2) 400 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[21479]: audit 2024-02-13T14:50:24.766752+0000 mon.a (mon.0) 1594 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]': finished 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[21479]: cluster 2024-02-13T14:50:24.776560+0000 mon.a (mon.0) 1595 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[21479]: audit 2024-02-13T14:50:24.779316+0000 mon.c (mon.2) 401 : audit 1 from='client.? v1:172.21.15.62:0/1688476483' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:26.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[21479]: audit 2024-02-13T14:50:24.783754+0000 mon.a (mon.0) 1596 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:26.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[21479]: audit 2024-02-13T14:50:24.784161+0000 mon.c (mon.2) 402 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:26.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:25 smithi062 bash[21479]: audit 2024-02-13T14:50:24.785898+0000 mon.a (mon.0) 1597 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:26.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:25 smithi111 bash[23388]: cluster 2024-02-13T14:50:24.755574+0000 mon.a (mon.0) 1593 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:26.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:25 smithi111 bash[23388]: audit 2024-02-13T14:50:24.764849+0000 mon.c (mon.2) 400 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:26.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:25 smithi111 bash[23388]: audit 2024-02-13T14:50:24.766752+0000 mon.a (mon.0) 1594 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-17"}]': finished 2024-02-13T14:50:26.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:25 smithi111 bash[23388]: cluster 2024-02-13T14:50:24.776560+0000 mon.a (mon.0) 1595 : cluster 0 osdmap e199: 8 total, 8 up, 8 in 2024-02-13T14:50:26.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:25 smithi111 bash[23388]: audit 2024-02-13T14:50:24.779316+0000 mon.c (mon.2) 401 : audit 1 from='client.? v1:172.21.15.62:0/1688476483' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:26.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:25 smithi111 bash[23388]: audit 2024-02-13T14:50:24.783754+0000 mon.a (mon.0) 1596 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:26.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:25 smithi111 bash[23388]: audit 2024-02-13T14:50:24.784161+0000 mon.c (mon.2) 402 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:26.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:25 smithi111 bash[23388]: audit 2024-02-13T14:50:24.785898+0000 mon.a (mon.0) 1597 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:26.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:50:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:50:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:25.766596+0000 mon.c (mon.2) 403 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:25.769783+0000 mon.a (mon.0) 1598 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:25.770011+0000 mon.a (mon.0) 1599 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:27.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: cluster 2024-02-13T14:50:25.779372+0000 mon.a (mon.0) 1600 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-02-13T14:50:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:25.780976+0000 mon.c (mon.2) 404 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:25.785207+0000 mon.a (mon.0) 1601 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: cluster 2024-02-13T14:50:25.806787+0000 mgr.y (mgr.14613) 284 : cluster 0 pgmap v311: 356 pgs: 11 unknown, 21 creating+peering, 324 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s; 31 B/s, 0 objects/s recovering 2024-02-13T14:50:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:25.808946+0000 mon.b (mon.1) 180 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.266913+0000 mon.a (mon.0) 1602 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279050+0000 mon.c (mon.2) 405 : audit 1 from='client.? v1:172.21.15.62:0/1688476483' entity='client.admin' cmd=[{ 2024-02-13T14:50:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279072+0000 mon.c (mon.2) 406 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279081+0000 mon.c (mon.2) 407 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279093+0000 mon.c (mon.2) 408 : audit 1 "var": "eio", 2024-02-13T14:50:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279103+0000 mon.c (mon.2) 409 : audit 1 "val": "true" 2024-02-13T14:50:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279113+0000 mon.c (mon.2) 410 : audit 1 }]: dispatch 2024-02-13T14:50:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279627+0000 mon.a (mon.0) 1603 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{ 2024-02-13T14:50:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279654+0000 mon.a (mon.0) 1604 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279668+0000 mon.a (mon.0) 1605 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279684+0000 mon.a (mon.0) 1606 : audit 1 "var": "eio", 2024-02-13T14:50:27.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279698+0000 mon.a (mon.0) 1607 : audit 1 "val": "true" 2024-02-13T14:50:27.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:25.766596+0000 mon.c (mon.2) 403 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:27.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:25.769783+0000 mon.a (mon.0) 1598 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:27.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:25.770011+0000 mon.a (mon.0) 1599 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:27.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: cluster 2024-02-13T14:50:25.779372+0000 mon.a (mon.0) 1600 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-02-13T14:50:27.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:25.780976+0000 mon.c (mon.2) 404 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:27.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:25.785207+0000 mon.a (mon.0) 1601 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:27.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: cluster 2024-02-13T14:50:25.806787+0000 mgr.y (mgr.14613) 284 : cluster 0 pgmap v311: 356 pgs: 11 unknown, 21 creating+peering, 324 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s; 31 B/s, 0 objects/s recovering 2024-02-13T14:50:27.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:25.808946+0000 mon.b (mon.1) 180 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:27.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.266913+0000 mon.a (mon.0) 1602 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:27.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279050+0000 mon.c (mon.2) 405 : audit 1 from='client.? v1:172.21.15.62:0/1688476483' entity='client.admin' cmd=[{ 2024-02-13T14:50:27.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279072+0000 mon.c (mon.2) 406 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279081+0000 mon.c (mon.2) 407 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.065 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279093+0000 mon.c (mon.2) 408 : audit 1 "var": "eio", 2024-02-13T14:50:27.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279103+0000 mon.c (mon.2) 409 : audit 1 "val": "true" 2024-02-13T14:50:27.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279113+0000 mon.c (mon.2) 410 : audit 1 }]: dispatch 2024-02-13T14:50:27.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279627+0000 mon.a (mon.0) 1603 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{ 2024-02-13T14:50:27.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279654+0000 mon.a (mon.0) 1604 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279668+0000 mon.a (mon.0) 1605 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.066 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279684+0000 mon.a (mon.0) 1606 : audit 1 "var": "eio", 2024-02-13T14:50:27.067 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279698+0000 mon.a (mon.0) 1607 : audit 1 "val": "true" 2024-02-13T14:50:27.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.279711+0000 mon.a (mon.0) 1608 : audit 1 }]: dispatch 2024-02-13T14:50:27.067 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.305269+0000 mon.b (mon.1) 181 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:50:27.068 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.714183+0000 mon.a (mon.0) 1609 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:27.068 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.714582+0000 mon.a (mon.0) 1610 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-13T14:50:27.068 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.714823+0000 mon.a (mon.0) 1611 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{ 2024-02-13T14:50:27.068 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.714880+0000 mon.a (mon.0) 1612 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.068 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.714929+0000 mon.a (mon.0) 1613 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.069 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.715005+0000 mon.a (mon.0) 1614 : audit 1 "var": "eio", 2024-02-13T14:50:27.069 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.715060+0000 mon.a (mon.0) 1615 : audit 1 "val": "true" 2024-02-13T14:50:27.069 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.715099+0000 mon.a (mon.0) 1616 : audit 1 }]': finished 2024-02-13T14:50:27.069 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: cluster 2024-02-13T14:50:26.726925+0000 mon.a (mon.0) 1617 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-02-13T14:50:27.069 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.735864+0000 mon.c (mon.2) 411 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:27.069 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.736529+0000 mon.a (mon.0) 1618 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:27.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.763131+0000 mon.c (mon.2) 412 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.763724+0000 mon.a (mon.0) 1619 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.764541+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.764845+0000 mon.a (mon.0) 1620 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.765306+0000 mon.c (mon.2) 414 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:27.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.765633+0000 mon.a (mon.0) 1621 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:27.070 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[21479]: audit 2024-02-13T14:50:26.767925+0000 mon.c (mon.2) 415 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:27.071 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.279711+0000 mon.a (mon.0) 1608 : audit 1 }]: dispatch 2024-02-13T14:50:27.071 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.305269+0000 mon.b (mon.1) 181 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:50:27.071 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.714183+0000 mon.a (mon.0) 1609 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:27.072 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.714582+0000 mon.a (mon.0) 1610 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-13T14:50:27.072 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.714823+0000 mon.a (mon.0) 1611 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{ 2024-02-13T14:50:27.072 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.714880+0000 mon.a (mon.0) 1612 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.072 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.714929+0000 mon.a (mon.0) 1613 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.072 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.715005+0000 mon.a (mon.0) 1614 : audit 1 "var": "eio", 2024-02-13T14:50:27.072 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.715060+0000 mon.a (mon.0) 1615 : audit 1 "val": "true" 2024-02-13T14:50:27.073 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.715099+0000 mon.a (mon.0) 1616 : audit 1 }]': finished 2024-02-13T14:50:27.073 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: cluster 2024-02-13T14:50:26.726925+0000 mon.a (mon.0) 1617 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-02-13T14:50:27.073 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.735864+0000 mon.c (mon.2) 411 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:27.073 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.736529+0000 mon.a (mon.0) 1618 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:27.073 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.763131+0000 mon.c (mon.2) 412 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.073 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.763724+0000 mon.a (mon.0) 1619 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.074 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.764541+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.074 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.764845+0000 mon.a (mon.0) 1620 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.074 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.765306+0000 mon.c (mon.2) 414 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:27.074 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.765633+0000 mon.a (mon.0) 1621 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:27.074 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:26 smithi062 bash[28859]: audit 2024-02-13T14:50:26.767925+0000 mon.c (mon.2) 415 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:27.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:25.766596+0000 mon.c (mon.2) 403 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:25.769783+0000 mon.a (mon.0) 1598 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "PoolEIOFlag_smithi062-64512-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:25.770011+0000 mon.a (mon.0) 1599 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: cluster 2024-02-13T14:50:25.779372+0000 mon.a (mon.0) 1600 : cluster 0 osdmap e200: 8 total, 8 up, 8 in 2024-02-13T14:50:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:25.780976+0000 mon.c (mon.2) 404 : audit 1 from='client.? v1:172.21.15.62:0/769251002' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:25.785207+0000 mon.a (mon.0) 1601 : audit 1 from='client.46712 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]: dispatch 2024-02-13T14:50:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: cluster 2024-02-13T14:50:25.806787+0000 mgr.y (mgr.14613) 284 : cluster 0 pgmap v311: 356 pgs: 11 unknown, 21 creating+peering, 324 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s; 31 B/s, 0 objects/s recovering 2024-02-13T14:50:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:25.808946+0000 mon.b (mon.1) 180 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:27.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.266913+0000 mon.a (mon.0) 1602 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]: dispatch 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279050+0000 mon.c (mon.2) 405 : audit 1 from='client.? v1:172.21.15.62:0/1688476483' entity='client.admin' cmd=[{ 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279072+0000 mon.c (mon.2) 406 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279081+0000 mon.c (mon.2) 407 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279093+0000 mon.c (mon.2) 408 : audit 1 "var": "eio", 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279103+0000 mon.c (mon.2) 409 : audit 1 "val": "true" 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279113+0000 mon.c (mon.2) 410 : audit 1 }]: dispatch 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279627+0000 mon.a (mon.0) 1603 : audit 1 from='client.46724 ' entity='client.admin' cmd=[{ 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279654+0000 mon.a (mon.0) 1604 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279668+0000 mon.a (mon.0) 1605 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279684+0000 mon.a (mon.0) 1606 : audit 1 "var": "eio", 2024-02-13T14:50:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279698+0000 mon.a (mon.0) 1607 : audit 1 "val": "true" 2024-02-13T14:50:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.279711+0000 mon.a (mon.0) 1608 : audit 1 }]: dispatch 2024-02-13T14:50:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.305269+0000 mon.b (mon.1) 181 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:50:27.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.714183+0000 mon.a (mon.0) 1609 : audit 1 from='client.46712 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTrip2_smithi062-64504-30"}]': finished 2024-02-13T14:50:27.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.714582+0000 mon.a (mon.0) 1610 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pg_num_actual", "val": "31"}]': finished 2024-02-13T14:50:27.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.714823+0000 mon.a (mon.0) 1611 : audit 1 from='client.46724 ' entity='client.admin' cmd='[{ 2024-02-13T14:50:27.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.714880+0000 mon.a (mon.0) 1612 : audit 1 "prefix": "osd pool set", 2024-02-13T14:50:27.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.714929+0000 mon.a (mon.0) 1613 : audit 1 "pool": "PoolEIOFlag_smithi062-64512-33", 2024-02-13T14:50:27.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.715005+0000 mon.a (mon.0) 1614 : audit 1 "var": "eio", 2024-02-13T14:50:27.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.715060+0000 mon.a (mon.0) 1615 : audit 1 "val": "true" 2024-02-13T14:50:27.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.715099+0000 mon.a (mon.0) 1616 : audit 1 }]': finished 2024-02-13T14:50:27.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: cluster 2024-02-13T14:50:26.726925+0000 mon.a (mon.0) 1617 : cluster 0 osdmap e201: 8 total, 8 up, 8 in 2024-02-13T14:50:27.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.735864+0000 mon.c (mon.2) 411 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:27.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.736529+0000 mon.a (mon.0) 1618 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:27.096 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.763131+0000 mon.c (mon.2) 412 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.763724+0000 mon.a (mon.0) 1619 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.764541+0000 mon.c (mon.2) 413 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.764845+0000 mon.a (mon.0) 1620 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.765306+0000 mon.c (mon.2) 414 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.765633+0000 mon.a (mon.0) 1621 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:27.097 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:26 smithi111 bash[23388]: audit 2024-02-13T14:50:26.767925+0000 mon.c (mon.2) 415 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:28.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.037035+0000 mon.b (mon.1) 182 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:50:28.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.039272+0000 mon.b (mon.1) 183 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.049071+0000 mon.a (mon.0) 1622 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.717405+0000 mon.a (mon.0) 1623 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.717669+0000 mon.a (mon.0) 1624 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: cluster 2024-02-13T14:50:27.725675+0000 mon.a (mon.0) 1625 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.726961+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.737981+0000 mon.a (mon.0) 1626 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.738566+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.740010+0000 mon.a (mon.0) 1627 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:28.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[28859]: audit 2024-02-13T14:50:27.770250+0000 mon.c (mon.2) 418 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.037035+0000 mon.b (mon.1) 182 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.039272+0000 mon.b (mon.1) 183 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.049071+0000 mon.a (mon.0) 1622 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.717405+0000 mon.a (mon.0) 1623 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.717669+0000 mon.a (mon.0) 1624 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: cluster 2024-02-13T14:50:27.725675+0000 mon.a (mon.0) 1625 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.726961+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.737981+0000 mon.a (mon.0) 1626 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.738566+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.740010+0000 mon.a (mon.0) 1627 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:28.565 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:28 smithi062 bash[21479]: audit 2024-02-13T14:50:27.770250+0000 mon.c (mon.2) 418 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:28.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.037035+0000 mon.b (mon.1) 182 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:50:28.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.039272+0000 mon.b (mon.1) 183 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.049071+0000 mon.a (mon.0) 1622 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.717405+0000 mon.a (mon.0) 1623 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-19","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.717669+0000 mon.a (mon.0) 1624 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppend_smithi062-64504-31", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: cluster 2024-02-13T14:50:27.725675+0000 mon.a (mon.0) 1625 : cluster 0 osdmap e202: 8 total, 8 up, 8 in 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.726961+0000 mon.c (mon.2) 416 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.737981+0000 mon.a (mon.0) 1626 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.738566+0000 mon.c (mon.2) 417 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.740010+0000 mon.a (mon.0) 1627 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:28.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:28 smithi111 bash[23388]: audit 2024-02-13T14:50:27.770250+0000 mon.c (mon.2) 418 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[21479]: cluster 2024-02-13T14:50:27.807377+0000 mgr.y (mgr.14613) 285 : cluster 0 pgmap v314: 356 pgs: 32 unknown, 324 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s; 31 B/s, 0 objects/s recovering 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[21479]: audit 2024-02-13T14:50:28.722030+0000 mon.a (mon.0) 1628 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[21479]: audit 2024-02-13T14:50:28.733763+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[21479]: audit 2024-02-13T14:50:28.771825+0000 mon.c (mon.2) 420 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[21479]: cluster 2024-02-13T14:50:29.197309+0000 mon.a (mon.0) 1629 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[21479]: audit 2024-02-13T14:50:29.198567+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.62:0/951860600' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[21479]: audit 2024-02-13T14:50:29.199973+0000 mon.a (mon.0) 1630 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[21479]: audit 2024-02-13T14:50:29.203658+0000 mon.a (mon.0) 1631 : audit 1 from='client.46736 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:29.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[28859]: cluster 2024-02-13T14:50:27.807377+0000 mgr.y (mgr.14613) 285 : cluster 0 pgmap v314: 356 pgs: 32 unknown, 324 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s; 31 B/s, 0 objects/s recovering 2024-02-13T14:50:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[28859]: audit 2024-02-13T14:50:28.722030+0000 mon.a (mon.0) 1628 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[28859]: audit 2024-02-13T14:50:28.733763+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[28859]: audit 2024-02-13T14:50:28.771825+0000 mon.c (mon.2) 420 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[28859]: cluster 2024-02-13T14:50:29.197309+0000 mon.a (mon.0) 1629 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-02-13T14:50:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[28859]: audit 2024-02-13T14:50:29.198567+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.62:0/951860600' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[28859]: audit 2024-02-13T14:50:29.199973+0000 mon.a (mon.0) 1630 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:29 smithi062 bash[28859]: audit 2024-02-13T14:50:29.203658+0000 mon.a (mon.0) 1631 : audit 1 from='client.46736 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:29.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:29 smithi111 bash[23388]: cluster 2024-02-13T14:50:27.807377+0000 mgr.y (mgr.14613) 285 : cluster 0 pgmap v314: 356 pgs: 32 unknown, 324 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.7 KiB/s wr, 6 op/s; 31 B/s, 0 objects/s recovering 2024-02-13T14:50:29.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:29 smithi111 bash[23388]: audit 2024-02-13T14:50:28.722030+0000 mon.a (mon.0) 1628 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:29.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:29 smithi111 bash[23388]: audit 2024-02-13T14:50:28.733763+0000 mon.c (mon.2) 419 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:29.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:29 smithi111 bash[23388]: audit 2024-02-13T14:50:28.771825+0000 mon.c (mon.2) 420 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:29.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:29 smithi111 bash[23388]: cluster 2024-02-13T14:50:29.197309+0000 mon.a (mon.0) 1629 : cluster 0 osdmap e203: 8 total, 8 up, 8 in 2024-02-13T14:50:29.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:29 smithi111 bash[23388]: audit 2024-02-13T14:50:29.198567+0000 mon.c (mon.2) 421 : audit 1 from='client.? v1:172.21.15.62:0/951860600' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:29.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:29 smithi111 bash[23388]: audit 2024-02-13T14:50:29.199973+0000 mon.a (mon.0) 1630 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:29.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:29 smithi111 bash[23388]: audit 2024-02-13T14:50:29.203658+0000 mon.a (mon.0) 1631 : audit 1 from='client.46736 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:30.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:50:30.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: audit 2024-02-13T14:50:29.725409+0000 mon.a (mon.0) 1632 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:30.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: audit 2024-02-13T14:50:29.725612+0000 mon.a (mon.0) 1633 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]': finished 2024-02-13T14:50:30.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: audit 2024-02-13T14:50:29.725809+0000 mon.a (mon.0) 1634 : audit 1 from='client.46736 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:30.742 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: cluster 2024-02-13T14:50:29.734324+0000 mon.a (mon.0) 1635 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-02-13T14:50:30.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: audit 2024-02-13T14:50:29.725409+0000 mon.a (mon.0) 1632 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:30.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: audit 2024-02-13T14:50:29.725612+0000 mon.a (mon.0) 1633 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]': finished 2024-02-13T14:50:30.742 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: audit 2024-02-13T14:50:29.725809+0000 mon.a (mon.0) 1634 : audit 1 from='client.46736 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:30.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: cluster 2024-02-13T14:50:29.734324+0000 mon.a (mon.0) 1635 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-02-13T14:50:30.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: audit 2024-02-13T14:50:29.747301+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]: dispatch 2024-02-13T14:50:30.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: audit 2024-02-13T14:50:29.748078+0000 mon.a (mon.0) 1636 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]: dispatch 2024-02-13T14:50:30.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: audit 2024-02-13T14:50:29.773521+0000 mon.c (mon.2) 423 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:30.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: cluster 2024-02-13T14:50:29.807878+0000 mgr.y (mgr.14613) 286 : cluster 0 pgmap v317: 395 pgs: 15 creating+peering, 1 peering, 45 unknown, 334 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:30.743 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[21479]: audit 2024-02-13T14:50:30.228932+0000 mgr.y (mgr.14613) 287 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:31.059 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: audit 2024-02-13T14:50:29.747301+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]: dispatch 2024-02-13T14:50:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: audit 2024-02-13T14:50:29.748078+0000 mon.a (mon.0) 1636 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]: dispatch 2024-02-13T14:50:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: audit 2024-02-13T14:50:29.773521+0000 mon.c (mon.2) 423 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: cluster 2024-02-13T14:50:29.807878+0000 mgr.y (mgr.14613) 286 : cluster 0 pgmap v317: 395 pgs: 15 creating+peering, 1 peering, 45 unknown, 334 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:31.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:30 smithi062 bash[28859]: audit 2024-02-13T14:50:30.228932+0000 mgr.y (mgr.14613) 287 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:31.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: audit 2024-02-13T14:50:29.725409+0000 mon.a (mon.0) 1632 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppend_smithi062-64504-31", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:31.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: audit 2024-02-13T14:50:29.725612+0000 mon.a (mon.0) 1633 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-19"}]': finished 2024-02-13T14:50:31.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: audit 2024-02-13T14:50:29.725809+0000 mon.a (mon.0) 1634 : audit 1 from='client.46736 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "MultiReads_smithi062-64512-34","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:31.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: cluster 2024-02-13T14:50:29.734324+0000 mon.a (mon.0) 1635 : cluster 0 osdmap e204: 8 total, 8 up, 8 in 2024-02-13T14:50:31.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: audit 2024-02-13T14:50:29.747301+0000 mon.c (mon.2) 422 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]: dispatch 2024-02-13T14:50:31.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: audit 2024-02-13T14:50:29.748078+0000 mon.a (mon.0) 1636 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]: dispatch 2024-02-13T14:50:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: audit 2024-02-13T14:50:29.773521+0000 mon.c (mon.2) 423 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: cluster 2024-02-13T14:50:29.807878+0000 mgr.y (mgr.14613) 286 : cluster 0 pgmap v317: 395 pgs: 15 creating+peering, 1 peering, 45 unknown, 334 active+clean; 585 KiB data, 571 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:31.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:30 smithi111 bash[23388]: audit 2024-02-13T14:50:30.228932+0000 mgr.y (mgr.14613) 287 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:32.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[21479]: cluster 2024-02-13T14:50:30.725433+0000 mon.a (mon.0) 1637 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:32.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[21479]: cluster 2024-02-13T14:50:30.726764+0000 mon.a (mon.0) 1638 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:32.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[21479]: audit 2024-02-13T14:50:30.735212+0000 mon.a (mon.0) 1639 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]': finished 2024-02-13T14:50:32.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[21479]: cluster 2024-02-13T14:50:30.745410+0000 mon.a (mon.0) 1640 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-02-13T14:50:32.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[21479]: audit 2024-02-13T14:50:30.776808+0000 mon.c (mon.2) 424 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:32.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[21479]: audit 2024-02-13T14:50:30.836528+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:32.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[21479]: audit 2024-02-13T14:50:31.250117+0000 mon.a (mon.0) 1641 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[28859]: cluster 2024-02-13T14:50:30.725433+0000 mon.a (mon.0) 1637 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[28859]: cluster 2024-02-13T14:50:30.726764+0000 mon.a (mon.0) 1638 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[28859]: audit 2024-02-13T14:50:30.735212+0000 mon.a (mon.0) 1639 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]': finished 2024-02-13T14:50:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[28859]: cluster 2024-02-13T14:50:30.745410+0000 mon.a (mon.0) 1640 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-02-13T14:50:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[28859]: audit 2024-02-13T14:50:30.776808+0000 mon.c (mon.2) 424 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[28859]: audit 2024-02-13T14:50:30.836528+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:31 smithi062 bash[28859]: audit 2024-02-13T14:50:31.250117+0000 mon.a (mon.0) 1641 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:32.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:31 smithi111 bash[23388]: cluster 2024-02-13T14:50:30.725433+0000 mon.a (mon.0) 1637 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:32.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:31 smithi111 bash[23388]: cluster 2024-02-13T14:50:30.726764+0000 mon.a (mon.0) 1638 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:32.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:31 smithi111 bash[23388]: audit 2024-02-13T14:50:30.735212+0000 mon.a (mon.0) 1639 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-19", "mode": "writeback"}]': finished 2024-02-13T14:50:32.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:31 smithi111 bash[23388]: cluster 2024-02-13T14:50:30.745410+0000 mon.a (mon.0) 1640 : cluster 0 osdmap e205: 8 total, 8 up, 8 in 2024-02-13T14:50:32.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:31 smithi111 bash[23388]: audit 2024-02-13T14:50:30.776808+0000 mon.c (mon.2) 424 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:32.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:31 smithi111 bash[23388]: audit 2024-02-13T14:50:30.836528+0000 mon.c (mon.2) 425 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:32.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:31 smithi111 bash[23388]: audit 2024-02-13T14:50:31.250117+0000 mon.a (mon.0) 1641 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:33.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:31.739095+0000 mon.a (mon.0) 1642 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:33.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: cluster 2024-02-13T14:50:31.749239+0000 mon.a (mon.0) 1643 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-02-13T14:50:33.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:31.755163+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:33.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:31.760974+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:33.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:31.761433+0000 mon.a (mon.0) 1644 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:31.761993+0000 mon.a (mon.0) 1645 : audit 1 from='client.? v1:172.21.15.62:0/876901910' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi062-64512-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:31.762428+0000 mon.a (mon.0) 1646 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:31.778167+0000 mon.c (mon.2) 428 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: cluster 2024-02-13T14:50:31.808800+0000 mgr.y (mgr.14613) 288 : cluster 0 pgmap v320: 387 pgs: 1 peering, 32 unknown, 354 active+clean; 585 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:32.416132+0000 mon.a (mon.0) 1647 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:32.420680+0000 mon.b (mon.1) 184 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: cluster 2024-02-13T14:50:32.739799+0000 mon.a (mon.0) 1648 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:32.743920+0000 mon.a (mon.0) 1649 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]': finished 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:32.744171+0000 mon.a (mon.0) 1650 : audit 1 from='client.? v1:172.21.15.62:0/876901910' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi062-64512-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: audit 2024-02-13T14:50:32.744298+0000 mon.a (mon.0) 1651 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[21479]: cluster 2024-02-13T14:50:32.753890+0000 mon.a (mon.0) 1652 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-02-13T14:50:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:31.739095+0000 mon.a (mon.0) 1642 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: cluster 2024-02-13T14:50:31.749239+0000 mon.a (mon.0) 1643 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:31.755163+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:31.760974+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:31.761433+0000 mon.a (mon.0) 1644 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:31.761993+0000 mon.a (mon.0) 1645 : audit 1 from='client.? v1:172.21.15.62:0/876901910' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi062-64512-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:31.762428+0000 mon.a (mon.0) 1646 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:31.778167+0000 mon.c (mon.2) 428 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: cluster 2024-02-13T14:50:31.808800+0000 mgr.y (mgr.14613) 288 : cluster 0 pgmap v320: 387 pgs: 1 peering, 32 unknown, 354 active+clean; 585 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:32.416132+0000 mon.a (mon.0) 1647 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:32.420680+0000 mon.b (mon.1) 184 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: cluster 2024-02-13T14:50:32.739799+0000 mon.a (mon.0) 1648 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:32.743920+0000 mon.a (mon.0) 1649 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]': finished 2024-02-13T14:50:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:32.744171+0000 mon.a (mon.0) 1650 : audit 1 from='client.? v1:172.21.15.62:0/876901910' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi062-64512-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:33.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: audit 2024-02-13T14:50:32.744298+0000 mon.a (mon.0) 1651 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:33.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:32 smithi062 bash[28859]: cluster 2024-02-13T14:50:32.753890+0000 mon.a (mon.0) 1652 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-02-13T14:50:33.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:31.739095+0000 mon.a (mon.0) 1642 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: cluster 2024-02-13T14:50:31.749239+0000 mon.a (mon.0) 1643 : cluster 0 osdmap e206: 8 total, 8 up, 8 in 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:31.755163+0000 mon.c (mon.2) 426 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:31.760974+0000 mon.c (mon.2) 427 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:31.761433+0000 mon.a (mon.0) 1644 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]: dispatch 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:31.761993+0000 mon.a (mon.0) 1645 : audit 1 from='client.? v1:172.21.15.62:0/876901910' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi062-64512-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:31.762428+0000 mon.a (mon.0) 1646 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:31.778167+0000 mon.c (mon.2) 428 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: cluster 2024-02-13T14:50:31.808800+0000 mgr.y (mgr.14613) 288 : cluster 0 pgmap v320: 387 pgs: 1 peering, 32 unknown, 354 active+clean; 585 KiB data, 579 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:32.416132+0000 mon.a (mon.0) 1647 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:32.420680+0000 mon.b (mon.1) 184 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: cluster 2024-02-13T14:50:32.739799+0000 mon.a (mon.0) 1648 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:32.743920+0000 mon.a (mon.0) 1649 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-19"}]': finished 2024-02-13T14:50:33.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:32.744171+0000 mon.a (mon.0) 1650 : audit 1 from='client.? v1:172.21.15.62:0/876901910' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "ReadIntoBufferlist_smithi062-64512-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: audit 2024-02-13T14:50:32.744298+0000 mon.a (mon.0) 1651 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:32 smithi111 bash[23388]: cluster 2024-02-13T14:50:32.753890+0000 mon.a (mon.0) 1652 : cluster 0 osdmap e207: 8 total, 8 up, 8 in 2024-02-13T14:50:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[21479]: audit 2024-02-13T14:50:32.762053+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[21479]: audit 2024-02-13T14:50:32.764935+0000 mon.a (mon.0) 1653 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[21479]: audit 2024-02-13T14:50:32.785448+0000 mon.c (mon.2) 430 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[21479]: audit 2024-02-13T14:50:33.747428+0000 mon.a (mon.0) 1654 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[21479]: cluster 2024-02-13T14:50:33.755069+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-02-13T14:50:34.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[21479]: audit 2024-02-13T14:50:33.786539+0000 mon.c (mon.2) 431 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:34.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[28859]: audit 2024-02-13T14:50:32.762053+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[28859]: audit 2024-02-13T14:50:32.764935+0000 mon.a (mon.0) 1653 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[28859]: audit 2024-02-13T14:50:32.785448+0000 mon.c (mon.2) 430 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[28859]: audit 2024-02-13T14:50:33.747428+0000 mon.a (mon.0) 1654 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[28859]: cluster 2024-02-13T14:50:33.755069+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-02-13T14:50:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:34 smithi062 bash[28859]: audit 2024-02-13T14:50:33.786539+0000 mon.c (mon.2) 431 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:34.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:34 smithi111 bash[23388]: audit 2024-02-13T14:50:32.762053+0000 mon.c (mon.2) 429 : audit 1 from='client.? v1:172.21.15.62:0/356982834' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:34.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:34 smithi111 bash[23388]: audit 2024-02-13T14:50:32.764935+0000 mon.a (mon.0) 1653 : audit 1 from='client.46730 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]: dispatch 2024-02-13T14:50:34.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:34 smithi111 bash[23388]: audit 2024-02-13T14:50:32.785448+0000 mon.c (mon.2) 430 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:34.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:34 smithi111 bash[23388]: audit 2024-02-13T14:50:33.747428+0000 mon.a (mon.0) 1654 : audit 1 from='client.46730 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppend_smithi062-64504-31"}]': finished 2024-02-13T14:50:34.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:34 smithi111 bash[23388]: cluster 2024-02-13T14:50:33.755069+0000 mon.a (mon.0) 1655 : cluster 0 osdmap e208: 8 total, 8 up, 8 in 2024-02-13T14:50:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:34 smithi111 bash[23388]: audit 2024-02-13T14:50:33.786539+0000 mon.c (mon.2) 431 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:35.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:33.799944+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: cluster 2024-02-13T14:50:33.809756+0000 mgr.y (mgr.14613) 289 : cluster 0 pgmap v323: 323 pgs: 1 peering, 322 active+clean; 585 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.232950+0000 mon.a (mon.0) 1656 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.234202+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.694231+0000 mon.a (mon.0) 1657 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.695434+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.696136+0000 mon.a (mon.0) 1658 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.760177+0000 mon.a (mon.0) 1659 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: cluster 2024-02-13T14:50:34.767627+0000 mon.a (mon.0) 1660 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.770711+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.771737+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.772769+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.62:0/2780126455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.783768+0000 mon.a (mon.0) 1661 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.784955+0000 mon.a (mon.0) 1662 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:33.799944+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: cluster 2024-02-13T14:50:33.809756+0000 mgr.y (mgr.14613) 289 : cluster 0 pgmap v323: 323 pgs: 1 peering, 322 active+clean; 585 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.232950+0000 mon.a (mon.0) 1656 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.234202+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.694231+0000 mon.a (mon.0) 1657 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.695434+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.696136+0000 mon.a (mon.0) 1658 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.760177+0000 mon.a (mon.0) 1659 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: cluster 2024-02-13T14:50:34.767627+0000 mon.a (mon.0) 1660 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.770711+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.771737+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.772769+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.62:0/2780126455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.783768+0000 mon.a (mon.0) 1661 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.784955+0000 mon.a (mon.0) 1662 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.786187+0000 mon.a (mon.0) 1663 : audit 1 from='client.46748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[28859]: audit 2024-02-13T14:50:34.792795+0000 mon.c (mon.2) 438 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:35.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.786187+0000 mon.a (mon.0) 1663 : audit 1 from='client.46748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:35 smithi062 bash[21479]: audit 2024-02-13T14:50:34.792795+0000 mon.c (mon.2) 438 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:35.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:33.799944+0000 mon.c (mon.2) 432 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: cluster 2024-02-13T14:50:33.809756+0000 mgr.y (mgr.14613) 289 : cluster 0 pgmap v323: 323 pgs: 1 peering, 322 active+clean; 585 KiB data, 579 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.232950+0000 mon.a (mon.0) 1656 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.234202+0000 mon.c (mon.2) 433 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.694231+0000 mon.a (mon.0) 1657 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.695434+0000 mon.c (mon.2) 434 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.696136+0000 mon.a (mon.0) 1658 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.760177+0000 mon.a (mon.0) 1659 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsComplete_smithi062-64504-32", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: cluster 2024-02-13T14:50:34.767627+0000 mon.a (mon.0) 1660 : cluster 0 osdmap e209: 8 total, 8 up, 8 in 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.770711+0000 mon.c (mon.2) 435 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.771737+0000 mon.c (mon.2) 436 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.772769+0000 mon.c (mon.2) 437 : audit 1 from='client.? v1:172.21.15.62:0/2780126455' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.783768+0000 mon.a (mon.0) 1661 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.784955+0000 mon.a (mon.0) 1662 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.786187+0000 mon.a (mon.0) 1663 : audit 1 from='client.46748 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:35 smithi111 bash[23388]: audit 2024-02-13T14:50:34.792795+0000 mon.c (mon.2) 438 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:36.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:50:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:50:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[28859]: audit 2024-02-13T14:50:35.764846+0000 mon.a (mon.0) 1664 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[28859]: audit 2024-02-13T14:50:35.765041+0000 mon.a (mon.0) 1665 : audit 1 from='client.46748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:37.060 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[28859]: audit 2024-02-13T14:50:35.795219+0000 mon.c (mon.2) 439 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[28859]: cluster 2024-02-13T14:50:35.810599+0000 mgr.y (mgr.14613) 290 : cluster 0 pgmap v326: 387 pgs: 35 creating+peering, 29 unknown, 323 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[28859]: audit 2024-02-13T14:50:35.814678+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[28859]: cluster 2024-02-13T14:50:36.249428+0000 mon.a (mon.0) 1666 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-02-13T14:50:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[28859]: audit 2024-02-13T14:50:36.256915+0000 mon.a (mon.0) 1667 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:37.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[28859]: cluster 2024-02-13T14:50:36.717945+0000 mon.a (mon.0) 1668 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21479]: audit 2024-02-13T14:50:35.764846+0000 mon.a (mon.0) 1664 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21479]: audit 2024-02-13T14:50:35.765041+0000 mon.a (mon.0) 1665 : audit 1 from='client.46748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21479]: audit 2024-02-13T14:50:35.795219+0000 mon.c (mon.2) 439 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21479]: cluster 2024-02-13T14:50:35.810599+0000 mgr.y (mgr.14613) 290 : cluster 0 pgmap v326: 387 pgs: 35 creating+peering, 29 unknown, 323 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21479]: audit 2024-02-13T14:50:35.814678+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21479]: cluster 2024-02-13T14:50:36.249428+0000 mon.a (mon.0) 1666 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-02-13T14:50:37.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21479]: audit 2024-02-13T14:50:36.256915+0000 mon.a (mon.0) 1667 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:37.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:36 smithi062 bash[21479]: cluster 2024-02-13T14:50:36.717945+0000 mon.a (mon.0) 1668 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:37.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:36 smithi111 bash[23388]: audit 2024-02-13T14:50:35.764846+0000 mon.a (mon.0) 1664 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-21","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:36 smithi111 bash[23388]: audit 2024-02-13T14:50:35.765041+0000 mon.a (mon.0) 1665 : audit 1 from='client.46748 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-36","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:36 smithi111 bash[23388]: audit 2024-02-13T14:50:35.795219+0000 mon.c (mon.2) 439 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:36 smithi111 bash[23388]: cluster 2024-02-13T14:50:35.810599+0000 mgr.y (mgr.14613) 290 : cluster 0 pgmap v326: 387 pgs: 35 creating+peering, 29 unknown, 323 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:36 smithi111 bash[23388]: audit 2024-02-13T14:50:35.814678+0000 mon.c (mon.2) 440 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:36 smithi111 bash[23388]: cluster 2024-02-13T14:50:36.249428+0000 mon.a (mon.0) 1666 : cluster 0 osdmap e210: 8 total, 8 up, 8 in 2024-02-13T14:50:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:36 smithi111 bash[23388]: audit 2024-02-13T14:50:36.256915+0000 mon.a (mon.0) 1667 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:37.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:36 smithi111 bash[23388]: cluster 2024-02-13T14:50:36.717945+0000 mon.a (mon.0) 1668 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[21479]: audit 2024-02-13T14:50:36.778247+0000 mon.a (mon.0) 1669 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[21479]: audit 2024-02-13T14:50:36.778548+0000 mon.a (mon.0) 1670 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[21479]: cluster 2024-02-13T14:50:36.787992+0000 mon.a (mon.0) 1671 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-02-13T14:50:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[21479]: audit 2024-02-13T14:50:36.790632+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[21479]: audit 2024-02-13T14:50:36.796795+0000 mon.c (mon.2) 442 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[21479]: audit 2024-02-13T14:50:36.799834+0000 mon.a (mon.0) 1672 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[21479]: audit 2024-02-13T14:50:36.800489+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.62:0/3084368917' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:38.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[21479]: audit 2024-02-13T14:50:36.802094+0000 mon.a (mon.0) 1673 : audit 1 from='client.46754 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[28859]: audit 2024-02-13T14:50:36.778247+0000 mon.a (mon.0) 1669 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[28859]: audit 2024-02-13T14:50:36.778548+0000 mon.a (mon.0) 1670 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[28859]: cluster 2024-02-13T14:50:36.787992+0000 mon.a (mon.0) 1671 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-02-13T14:50:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[28859]: audit 2024-02-13T14:50:36.790632+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[28859]: audit 2024-02-13T14:50:36.796795+0000 mon.c (mon.2) 442 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[28859]: audit 2024-02-13T14:50:36.799834+0000 mon.a (mon.0) 1672 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[28859]: audit 2024-02-13T14:50:36.800489+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.62:0/3084368917' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:38.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:37 smithi062 bash[28859]: audit 2024-02-13T14:50:36.802094+0000 mon.a (mon.0) 1673 : audit 1 from='client.46754 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:38.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:37 smithi111 bash[23388]: audit 2024-02-13T14:50:36.778247+0000 mon.a (mon.0) 1669 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsComplete_smithi062-64504-32", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:38.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:37 smithi111 bash[23388]: audit 2024-02-13T14:50:36.778548+0000 mon.a (mon.0) 1670 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:38.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:37 smithi111 bash[23388]: cluster 2024-02-13T14:50:36.787992+0000 mon.a (mon.0) 1671 : cluster 0 osdmap e211: 8 total, 8 up, 8 in 2024-02-13T14:50:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:37 smithi111 bash[23388]: audit 2024-02-13T14:50:36.790632+0000 mon.c (mon.2) 441 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:37 smithi111 bash[23388]: audit 2024-02-13T14:50:36.796795+0000 mon.c (mon.2) 442 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:37 smithi111 bash[23388]: audit 2024-02-13T14:50:36.799834+0000 mon.a (mon.0) 1672 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:37 smithi111 bash[23388]: audit 2024-02-13T14:50:36.800489+0000 mon.c (mon.2) 443 : audit 1 from='client.? v1:172.21.15.62:0/3084368917' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:38.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:37 smithi111 bash[23388]: audit 2024-02-13T14:50:36.802094+0000 mon.a (mon.0) 1673 : audit 1 from='client.46754 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:39.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:38 smithi111 bash[23388]: audit 2024-02-13T14:50:37.781621+0000 mon.a (mon.0) 1674 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]': finished 2024-02-13T14:50:39.091 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:38 smithi111 bash[23388]: audit 2024-02-13T14:50:37.781879+0000 mon.a (mon.0) 1675 : audit 1 from='client.46754 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:38 smithi111 bash[23388]: cluster 2024-02-13T14:50:37.790867+0000 mon.a (mon.0) 1676 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-02-13T14:50:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:38 smithi111 bash[23388]: audit 2024-02-13T14:50:37.796066+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]: dispatch 2024-02-13T14:50:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:38 smithi111 bash[23388]: audit 2024-02-13T14:50:37.798788+0000 mon.c (mon.2) 445 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:38 smithi111 bash[23388]: cluster 2024-02-13T14:50:37.813476+0000 mgr.y (mgr.14613) 291 : cluster 0 pgmap v329: 427 pgs: 35 creating+peering, 69 unknown, 323 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:39.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:38 smithi111 bash[23388]: audit 2024-02-13T14:50:37.826418+0000 mon.a (mon.0) 1677 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]: dispatch 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[21479]: audit 2024-02-13T14:50:37.781621+0000 mon.a (mon.0) 1674 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]': finished 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[21479]: audit 2024-02-13T14:50:37.781879+0000 mon.a (mon.0) 1675 : audit 1 from='client.46754 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[21479]: cluster 2024-02-13T14:50:37.790867+0000 mon.a (mon.0) 1676 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[21479]: audit 2024-02-13T14:50:37.796066+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]: dispatch 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[21479]: audit 2024-02-13T14:50:37.798788+0000 mon.c (mon.2) 445 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[21479]: cluster 2024-02-13T14:50:37.813476+0000 mgr.y (mgr.14613) 291 : cluster 0 pgmap v329: 427 pgs: 35 creating+peering, 69 unknown, 323 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[21479]: audit 2024-02-13T14:50:37.826418+0000 mon.a (mon.0) 1677 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]: dispatch 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[28859]: audit 2024-02-13T14:50:37.781621+0000 mon.a (mon.0) 1674 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-21"}]': finished 2024-02-13T14:50:39.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[28859]: audit 2024-02-13T14:50:37.781879+0000 mon.a (mon.0) 1675 : audit 1 from='client.46754 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:39.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[28859]: cluster 2024-02-13T14:50:37.790867+0000 mon.a (mon.0) 1676 : cluster 0 osdmap e212: 8 total, 8 up, 8 in 2024-02-13T14:50:39.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[28859]: audit 2024-02-13T14:50:37.796066+0000 mon.c (mon.2) 444 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]: dispatch 2024-02-13T14:50:39.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[28859]: audit 2024-02-13T14:50:37.798788+0000 mon.c (mon.2) 445 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:39.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[28859]: cluster 2024-02-13T14:50:37.813476+0000 mgr.y (mgr.14613) 291 : cluster 0 pgmap v329: 427 pgs: 35 creating+peering, 69 unknown, 323 active+clean; 585 KiB data, 568 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:39.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:38 smithi062 bash[28859]: audit 2024-02-13T14:50:37.826418+0000 mon.a (mon.0) 1677 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]: dispatch 2024-02-13T14:50:40.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: cluster 2024-02-13T14:50:38.799074+0000 mon.a (mon.0) 1678 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:40.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:38.800848+0000 mon.c (mon.2) 446 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:40.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:38.801891+0000 mon.a (mon.0) 1679 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]': finished 2024-02-13T14:50:40.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: cluster 2024-02-13T14:50:38.818398+0000 mon.a (mon.0) 1680 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-02-13T14:50:40.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:38.826518+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.62:0/1396508067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:40.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:38.827287+0000 mon.c (mon.2) 448 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:38.836971+0000 mon.a (mon.0) 1681 : audit 1 from='client.46760 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:40.239 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:38.837712+0000 mon.a (mon.0) 1682 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:38.946178+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:40.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:38.946883+0000 mon.a (mon.0) 1683 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:40.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:39.802415+0000 mon.c (mon.2) 450 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:40.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:39.805299+0000 mon.a (mon.0) 1684 : audit 1 from='client.46760 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:40.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:39.805637+0000 mon.a (mon.0) 1685 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:40.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:39.805875+0000 mon.a (mon.0) 1686 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:40.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: cluster 2024-02-13T14:50:39.816706+0000 mon.a (mon.0) 1687 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-02-13T14:50:40.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:39.817572+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:40.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:39.818274+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:39.827807+0000 mon.a (mon.0) 1688 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:40.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:39 smithi111 bash[23388]: audit 2024-02-13T14:50:39.832964+0000 mon.a (mon.0) 1689 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: cluster 2024-02-13T14:50:38.799074+0000 mon.a (mon.0) 1678 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:38.800848+0000 mon.c (mon.2) 446 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:38.801891+0000 mon.a (mon.0) 1679 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]': finished 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: cluster 2024-02-13T14:50:38.818398+0000 mon.a (mon.0) 1680 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:38.826518+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.62:0/1396508067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:38.827287+0000 mon.c (mon.2) 448 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:38.836971+0000 mon.a (mon.0) 1681 : audit 1 from='client.46760 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:38.837712+0000 mon.a (mon.0) 1682 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:38.946178+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:38.946883+0000 mon.a (mon.0) 1683 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:39.802415+0000 mon.c (mon.2) 450 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:40.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:39.805299+0000 mon.a (mon.0) 1684 : audit 1 from='client.46760 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:39.805637+0000 mon.a (mon.0) 1685 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:39.805875+0000 mon.a (mon.0) 1686 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: cluster 2024-02-13T14:50:39.816706+0000 mon.a (mon.0) 1687 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:39.817572+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: cluster 2024-02-13T14:50:38.799074+0000 mon.a (mon.0) 1678 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:38.800848+0000 mon.c (mon.2) 446 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:38.801891+0000 mon.a (mon.0) 1679 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-21", "mode": "writeback"}]': finished 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: cluster 2024-02-13T14:50:38.818398+0000 mon.a (mon.0) 1680 : cluster 0 osdmap e213: 8 total, 8 up, 8 in 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:38.826518+0000 mon.c (mon.2) 447 : audit 1 from='client.? v1:172.21.15.62:0/1396508067' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:40.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:38.827287+0000 mon.c (mon.2) 448 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:38.836971+0000 mon.a (mon.0) 1681 : audit 1 from='client.46760 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:38.837712+0000 mon.a (mon.0) 1682 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:38.946178+0000 mon.c (mon.2) 449 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:38.946883+0000 mon.a (mon.0) 1683 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:39.802415+0000 mon.c (mon.2) 450 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:39.805299+0000 mon.a (mon.0) 1684 : audit 1 from='client.46760 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrsRoundTripPP_smithi062-64512-38","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:39.805637+0000 mon.a (mon.0) 1685 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:39.805875+0000 mon.a (mon.0) 1686 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: cluster 2024-02-13T14:50:39.816706+0000 mon.a (mon.0) 1687 : cluster 0 osdmap e214: 8 total, 8 up, 8 in 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:39.817572+0000 mon.c (mon.2) 451 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:40.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:39.818274+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:39.827807+0000 mon.a (mon.0) 1688 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:40.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[21479]: audit 2024-02-13T14:50:39.832964+0000 mon.a (mon.0) 1689 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:39.818274+0000 mon.c (mon.2) 452 : audit 1 from='client.? v1:172.21.15.62:0/3332853027' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:39.827807+0000 mon.a (mon.0) 1688 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]: dispatch 2024-02-13T14:50:40.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:39 smithi062 bash[28859]: audit 2024-02-13T14:50:39.832964+0000 mon.a (mon.0) 1689 : audit 1 from='client.46745 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]: dispatch 2024-02-13T14:50:40.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:50:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:50:41.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[21479]: cluster 2024-02-13T14:50:39.815116+0000 mgr.y (mgr.14613) 292 : cluster 0 pgmap v332: 451 pgs: 48 creating+peering, 43 unknown, 360 active+clean; 586 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:50:41.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[21479]: audit 2024-02-13T14:50:40.239324+0000 mgr.y (mgr.14613) 293 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:41.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[21479]: audit 2024-02-13T14:50:40.804189+0000 mon.c (mon.2) 453 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:41.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[21479]: cluster 2024-02-13T14:50:40.806733+0000 mon.a (mon.0) 1690 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:41.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[21479]: audit 2024-02-13T14:50:40.809241+0000 mon.a (mon.0) 1691 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]': finished 2024-02-13T14:50:41.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[21479]: audit 2024-02-13T14:50:40.809416+0000 mon.a (mon.0) 1692 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:41.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[21479]: cluster 2024-02-13T14:50:40.816877+0000 mon.a (mon.0) 1693 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-02-13T14:50:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[28859]: cluster 2024-02-13T14:50:39.815116+0000 mgr.y (mgr.14613) 292 : cluster 0 pgmap v332: 451 pgs: 48 creating+peering, 43 unknown, 360 active+clean; 586 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:50:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[28859]: audit 2024-02-13T14:50:40.239324+0000 mgr.y (mgr.14613) 293 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[28859]: audit 2024-02-13T14:50:40.804189+0000 mon.c (mon.2) 453 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[28859]: cluster 2024-02-13T14:50:40.806733+0000 mon.a (mon.0) 1690 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[28859]: audit 2024-02-13T14:50:40.809241+0000 mon.a (mon.0) 1691 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]': finished 2024-02-13T14:50:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[28859]: audit 2024-02-13T14:50:40.809416+0000 mon.a (mon.0) 1692 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:40 smithi062 bash[28859]: cluster 2024-02-13T14:50:40.816877+0000 mon.a (mon.0) 1693 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-02-13T14:50:41.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:40 smithi111 bash[23388]: cluster 2024-02-13T14:50:39.815116+0000 mgr.y (mgr.14613) 292 : cluster 0 pgmap v332: 451 pgs: 48 creating+peering, 43 unknown, 360 active+clean; 586 KiB data, 552 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:50:41.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:40 smithi111 bash[23388]: audit 2024-02-13T14:50:40.239324+0000 mgr.y (mgr.14613) 293 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:41.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:40 smithi111 bash[23388]: audit 2024-02-13T14:50:40.804189+0000 mon.c (mon.2) 453 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:41.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:40 smithi111 bash[23388]: cluster 2024-02-13T14:50:40.806733+0000 mon.a (mon.0) 1690 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:40 smithi111 bash[23388]: audit 2024-02-13T14:50:40.809241+0000 mon.a (mon.0) 1691 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-21"}]': finished 2024-02-13T14:50:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:40 smithi111 bash[23388]: audit 2024-02-13T14:50:40.809416+0000 mon.a (mon.0) 1692 : audit 1 from='client.46745 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsComplete_smithi062-64504-32"}]': finished 2024-02-13T14:50:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:40 smithi111 bash[23388]: cluster 2024-02-13T14:50:40.816877+0000 mon.a (mon.0) 1693 : cluster 0 osdmap e215: 8 total, 8 up, 8 in 2024-02-13T14:50:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:40.863208+0000 mon.a (mon.0) 1694 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:40.864509+0000 mon.a (mon.0) 1695 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:40.864836+0000 mon.a (mon.0) 1696 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi062-64504-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:41.805768+0000 mon.c (mon.2) 454 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:41.818343+0000 mon.b (mon.1) 185 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-13T14:50:42.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:41.819962+0000 mon.a (mon.0) 1697 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-13T14:50:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:41.829909+0000 mon.a (mon.0) 1698 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi062-64504-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:41.830128+0000 mon.a (mon.0) 1699 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-02-13T14:50:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: cluster 2024-02-13T14:50:41.837669+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-02-13T14:50:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[28859]: audit 2024-02-13T14:50:41.839663+0000 mon.a (mon.0) 1701 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi062-64504-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:42.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:40.863208+0000 mon.a (mon.0) 1694 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:42.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:40.864509+0000 mon.a (mon.0) 1695 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:42.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:40.864836+0000 mon.a (mon.0) 1696 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi062-64504-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:42.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:41.805768+0000 mon.c (mon.2) 454 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:41.818343+0000 mon.b (mon.1) 185 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-13T14:50:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:41.819962+0000 mon.a (mon.0) 1697 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-13T14:50:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:41.829909+0000 mon.a (mon.0) 1698 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi062-64504-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:41.830128+0000 mon.a (mon.0) 1699 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-02-13T14:50:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: cluster 2024-02-13T14:50:41.837669+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-02-13T14:50:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:42 smithi062 bash[21479]: audit 2024-02-13T14:50:41.839663+0000 mon.a (mon.0) 1701 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi062-64504-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:42.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:40.863208+0000 mon.a (mon.0) 1694 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:42.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:40.864509+0000 mon.a (mon.0) 1695 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:40.864836+0000 mon.a (mon.0) 1696 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi062-64504-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:41.805768+0000 mon.c (mon.2) 454 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:41.818343+0000 mon.b (mon.1) 185 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-13T14:50:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:41.819962+0000 mon.a (mon.0) 1697 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]: dispatch 2024-02-13T14:50:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:41.829909+0000 mon.a (mon.0) 1698 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafe_smithi062-64504-33", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:41.830128+0000 mon.a (mon.0) 1699 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pool set", "pool": "LibRadosList_smithi062-64544-1", "var": "pgp_num_actual", "val": "30"}]': finished 2024-02-13T14:50:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: cluster 2024-02-13T14:50:41.837669+0000 mon.a (mon.0) 1700 : cluster 0 osdmap e216: 8 total, 8 up, 8 in 2024-02-13T14:50:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:42 smithi111 bash[23388]: audit 2024-02-13T14:50:41.839663+0000 mon.a (mon.0) 1701 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafe_smithi062-64504-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:43.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: cluster 2024-02-13T14:50:41.816142+0000 mgr.y (mgr.14613) 294 : cluster 0 pgmap v334: 419 pgs: 419 active+clean; 586 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 761 B/s wr, 4 op/s 2024-02-13T14:50:43.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: audit 2024-02-13T14:50:42.807359+0000 mon.c (mon.2) 455 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: audit 2024-02-13T14:50:42.808632+0000 mon.c (mon.2) 456 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: audit 2024-02-13T14:50:42.809909+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:43.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: audit 2024-02-13T14:50:42.810633+0000 mon.a (mon.0) 1702 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:43.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: audit 2024-02-13T14:50:42.834365+0000 mon.a (mon.0) 1703 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T14:50:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: audit 2024-02-13T14:50:42.845341+0000 mon.c (mon.2) 458 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: cluster 2024-02-13T14:50:43.312457+0000 mon.a (mon.0) 1704 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-02-13T14:50:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: audit 2024-02-13T14:50:43.313965+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:43 smithi111 bash[23388]: audit 2024-02-13T14:50:43.316572+0000 mon.a (mon.0) 1705 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: cluster 2024-02-13T14:50:41.816142+0000 mgr.y (mgr.14613) 294 : cluster 0 pgmap v334: 419 pgs: 419 active+clean; 586 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 761 B/s wr, 4 op/s 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: audit 2024-02-13T14:50:42.807359+0000 mon.c (mon.2) 455 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: audit 2024-02-13T14:50:42.808632+0000 mon.c (mon.2) 456 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: audit 2024-02-13T14:50:42.809909+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: audit 2024-02-13T14:50:42.810633+0000 mon.a (mon.0) 1702 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: audit 2024-02-13T14:50:42.834365+0000 mon.a (mon.0) 1703 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: audit 2024-02-13T14:50:42.845341+0000 mon.c (mon.2) 458 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: cluster 2024-02-13T14:50:43.312457+0000 mon.a (mon.0) 1704 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: audit 2024-02-13T14:50:43.313965+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:43.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[28859]: audit 2024-02-13T14:50:43.316572+0000 mon.a (mon.0) 1705 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: cluster 2024-02-13T14:50:41.816142+0000 mgr.y (mgr.14613) 294 : cluster 0 pgmap v334: 419 pgs: 419 active+clean; 586 KiB data, 553 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 761 B/s wr, 4 op/s 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: audit 2024-02-13T14:50:42.807359+0000 mon.c (mon.2) 455 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: audit 2024-02-13T14:50:42.808632+0000 mon.c (mon.2) 456 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: audit 2024-02-13T14:50:42.809909+0000 mon.c (mon.2) 457 : audit 1 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: audit 2024-02-13T14:50:42.810633+0000 mon.a (mon.0) 1702 : audit 1 from='client.24716 ' entity='client.admin' cmd=[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]: dispatch 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: audit 2024-02-13T14:50:42.834365+0000 mon.a (mon.0) 1703 : audit 1 from='client.24716 ' entity='client.admin' cmd='[{"prefix":"osd pool set","pool":"LibRadosList_smithi062-64544-1","var":"pgp_num","val":"11"}]': finished 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: audit 2024-02-13T14:50:42.845341+0000 mon.c (mon.2) 458 : audit 0 from='client.? v1:172.21.15.62:0/324448207' entity='client.admin' cmd=[{"prefix":"status","format":"json"}]: dispatch 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: cluster 2024-02-13T14:50:43.312457+0000 mon.a (mon.0) 1704 : cluster 0 osdmap e217: 8 total, 8 up, 8 in 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: audit 2024-02-13T14:50:43.313965+0000 mon.c (mon.2) 459 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:43 smithi062 bash[21479]: audit 2024-02-13T14:50:43.316572+0000 mon.a (mon.0) 1705 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:45.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: cluster 2024-02-13T14:50:43.817161+0000 mgr.y (mgr.14613) 295 : cluster 0 pgmap v337: 355 pgs: 32 unknown, 323 active+clean; 585 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:45.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.838817+0000 mon.a (mon.0) 1706 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi062-64504-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:45.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.839115+0000 mon.a (mon.0) 1707 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:45.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: cluster 2024-02-13T14:50:43.849727+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-02-13T14:50:45.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.855502+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.62:0/3928635963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.872315+0000 mon.a (mon.0) 1709 : audit 1 from='client.46772 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.912682+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.913143+0000 mon.a (mon.0) 1710 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.916389+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.916673+0000 mon.a (mon.0) 1711 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.917139+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: audit 2024-02-13T14:50:43.917531+0000 mon.a (mon.0) 1712 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[21479]: cluster 2024-02-13T14:50:44.323333+0000 mon.a (mon.0) 1713 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: cluster 2024-02-13T14:50:43.817161+0000 mgr.y (mgr.14613) 295 : cluster 0 pgmap v337: 355 pgs: 32 unknown, 323 active+clean; 585 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.838817+0000 mon.a (mon.0) 1706 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi062-64504-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.839115+0000 mon.a (mon.0) 1707 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:45.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: cluster 2024-02-13T14:50:43.849727+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.855502+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.62:0/3928635963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.872315+0000 mon.a (mon.0) 1709 : audit 1 from='client.46772 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.912682+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.913143+0000 mon.a (mon.0) 1710 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.916389+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.916673+0000 mon.a (mon.0) 1711 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.917139+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: audit 2024-02-13T14:50:43.917531+0000 mon.a (mon.0) 1712 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:44 smithi062 bash[28859]: cluster 2024-02-13T14:50:44.323333+0000 mon.a (mon.0) 1713 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:45.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: cluster 2024-02-13T14:50:43.817161+0000 mgr.y (mgr.14613) 295 : cluster 0 pgmap v337: 355 pgs: 32 unknown, 323 active+clean; 585 KiB data, 553 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.838817+0000 mon.a (mon.0) 1706 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafe_smithi062-64504-33", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.839115+0000 mon.a (mon.0) 1707 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-23","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: cluster 2024-02-13T14:50:43.849727+0000 mon.a (mon.0) 1708 : cluster 0 osdmap e218: 8 total, 8 up, 8 in 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.855502+0000 mon.c (mon.2) 460 : audit 1 from='client.? v1:172.21.15.62:0/3928635963' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.872315+0000 mon.a (mon.0) 1709 : audit 1 from='client.46772 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.912682+0000 mon.c (mon.2) 461 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.913143+0000 mon.a (mon.0) 1710 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.916389+0000 mon.c (mon.2) 462 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.916673+0000 mon.a (mon.0) 1711 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.917139+0000 mon.c (mon.2) 463 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: audit 2024-02-13T14:50:43.917531+0000 mon.a (mon.0) 1712 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:45.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:44 smithi111 bash[23388]: cluster 2024-02-13T14:50:44.323333+0000 mon.a (mon.0) 1713 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:46.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:50:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:50:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21479]: audit 2024-02-13T14:50:44.841796+0000 mon.a (mon.0) 1714 : audit 1 from='client.46772 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21479]: audit 2024-02-13T14:50:44.842019+0000 mon.a (mon.0) 1715 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21479]: cluster 2024-02-13T14:50:44.850520+0000 mon.a (mon.0) 1716 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-02-13T14:50:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21479]: audit 2024-02-13T14:50:44.851030+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21479]: audit 2024-02-13T14:50:44.870282+0000 mon.a (mon.0) 1717 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21479]: audit 2024-02-13T14:50:44.918872+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:46.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21479]: audit 2024-02-13T14:50:44.919131+0000 mon.a (mon.0) 1718 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[21479]: audit 2024-02-13T14:50:45.846629+0000 mon.a (mon.0) 1719 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[28859]: audit 2024-02-13T14:50:44.841796+0000 mon.a (mon.0) 1714 : audit 1 from='client.46772 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[28859]: audit 2024-02-13T14:50:44.842019+0000 mon.a (mon.0) 1715 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[28859]: cluster 2024-02-13T14:50:44.850520+0000 mon.a (mon.0) 1716 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[28859]: audit 2024-02-13T14:50:44.851030+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[28859]: audit 2024-02-13T14:50:44.870282+0000 mon.a (mon.0) 1717 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[28859]: audit 2024-02-13T14:50:44.918872+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[28859]: audit 2024-02-13T14:50:44.919131+0000 mon.a (mon.0) 1718 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:46 smithi062 bash[28859]: audit 2024-02-13T14:50:45.846629+0000 mon.a (mon.0) 1719 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:46 smithi111 bash[23388]: audit 2024-02-13T14:50:44.841796+0000 mon.a (mon.0) 1714 : audit 1 from='client.46772 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:46.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:46 smithi111 bash[23388]: audit 2024-02-13T14:50:44.842019+0000 mon.a (mon.0) 1715 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosListEC_smithi062-64544-2", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:46.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:46 smithi111 bash[23388]: cluster 2024-02-13T14:50:44.850520+0000 mon.a (mon.0) 1716 : cluster 0 osdmap e219: 8 total, 8 up, 8 in 2024-02-13T14:50:46.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:46 smithi111 bash[23388]: audit 2024-02-13T14:50:44.851030+0000 mon.c (mon.2) 464 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:46.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:46 smithi111 bash[23388]: audit 2024-02-13T14:50:44.870282+0000 mon.a (mon.0) 1717 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:46.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:46 smithi111 bash[23388]: audit 2024-02-13T14:50:44.918872+0000 mon.c (mon.2) 465 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:46.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:46 smithi111 bash[23388]: audit 2024-02-13T14:50:44.919131+0000 mon.a (mon.0) 1718 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:46.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:46 smithi111 bash[23388]: audit 2024-02-13T14:50:45.846629+0000 mon.a (mon.0) 1719 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:47.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: cluster 2024-02-13T14:50:45.819252+0000 mgr.y (mgr.14613) 296 : cluster 0 pgmap v340: 364 pgs: 8 creating+activating, 25 creating+peering, 331 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:50:47.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:45.857619+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:47.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: cluster 2024-02-13T14:50:46.320268+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-02-13T14:50:47.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.321303+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.62:0/2442628159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:47.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.322034+0000 mon.a (mon.0) 1721 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:47.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.322955+0000 mon.a (mon.0) 1722 : audit 1 from='client.46784 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:47.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.331744+0000 mon.a (mon.0) 1723 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.850255+0000 mon.a (mon.0) 1724 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.850476+0000 mon.a (mon.0) 1725 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]': finished 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.850717+0000 mon.a (mon.0) 1726 : audit 1 from='client.46784 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.850954+0000 mon.a (mon.0) 1727 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.864298+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]: dispatch 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: cluster 2024-02-13T14:50:46.864774+0000 mon.a (mon.0) 1728 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.869553+0000 mon.a (mon.0) 1729 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[21479]: audit 2024-02-13T14:50:46.872181+0000 mon.a (mon.0) 1730 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]: dispatch 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: cluster 2024-02-13T14:50:45.819252+0000 mgr.y (mgr.14613) 296 : cluster 0 pgmap v340: 364 pgs: 8 creating+activating, 25 creating+peering, 331 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:50:47.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:45.857619+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: cluster 2024-02-13T14:50:46.320268+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.321303+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.62:0/2442628159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.322034+0000 mon.a (mon.0) 1721 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.322955+0000 mon.a (mon.0) 1722 : audit 1 from='client.46784 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.331744+0000 mon.a (mon.0) 1723 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.850255+0000 mon.a (mon.0) 1724 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.850476+0000 mon.a (mon.0) 1725 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]': finished 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.850717+0000 mon.a (mon.0) 1726 : audit 1 from='client.46784 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.850954+0000 mon.a (mon.0) 1727 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.864298+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]: dispatch 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: cluster 2024-02-13T14:50:46.864774+0000 mon.a (mon.0) 1728 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.869553+0000 mon.a (mon.0) 1729 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:47 smithi062 bash[28859]: audit 2024-02-13T14:50:46.872181+0000 mon.a (mon.0) 1730 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]: dispatch 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: cluster 2024-02-13T14:50:45.819252+0000 mgr.y (mgr.14613) 296 : cluster 0 pgmap v340: 364 pgs: 8 creating+activating, 25 creating+peering, 331 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:45.857619+0000 mon.c (mon.2) 466 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: cluster 2024-02-13T14:50:46.320268+0000 mon.a (mon.0) 1720 : cluster 0 osdmap e220: 8 total, 8 up, 8 in 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.321303+0000 mon.c (mon.2) 467 : audit 1 from='client.? v1:172.21.15.62:0/2442628159' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.322034+0000 mon.a (mon.0) 1721 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.322955+0000 mon.a (mon.0) 1722 : audit 1 from='client.46784 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.331744+0000 mon.a (mon.0) 1723 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.850255+0000 mon.a (mon.0) 1724 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosListEC_smithi062-64544-2", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.850476+0000 mon.a (mon.0) 1725 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-23"}]': finished 2024-02-13T14:50:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.850717+0000 mon.a (mon.0) 1726 : audit 1 from='client.46784 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-40","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.850954+0000 mon.a (mon.0) 1727 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.864298+0000 mon.c (mon.2) 468 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]: dispatch 2024-02-13T14:50:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: cluster 2024-02-13T14:50:46.864774+0000 mon.a (mon.0) 1728 : cluster 0 osdmap e221: 8 total, 8 up, 8 in 2024-02-13T14:50:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.869553+0000 mon.a (mon.0) 1729 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]: dispatch 2024-02-13T14:50:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:47 smithi111 bash[23388]: audit 2024-02-13T14:50:46.872181+0000 mon.a (mon.0) 1730 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]: dispatch 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAi entry=0 expected=0 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:62a1935d:::14:head 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:62a1935d:::14:head expected=14:62a1935d:::14:head 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:62a1935d:::14:head -> 14 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=14 expected=14 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:5c6b0b28:::7:head 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:5c6b0b28:::7:head expected=14:5c6b0b28:::7:head 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:5c6b0b28:::7:head -> 7 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=7 expected=7 2024-02-13T14:50:47.970 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:52ea6a34:::10:head 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:52ea6a34:::10:head expected=14:52ea6a34:::10:head 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:52ea6a34:::10:head -> 10 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=10 expected=10 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:c4fdafeb:::6:head 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:c4fdafeb:::6:head expected=14:c4fdafeb:::6:head 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:c4fdafeb:::6:head -> 6 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=6 expected=6 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:bd63b0f1:::8:head 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:bd63b0f1:::8:head expected=14:bd63b0f1:::8:head 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:bd63b0f1:::8:head -> 8 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=8 expected=8 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:b29083e3:::5:head 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:b29083e3:::5:head expected=14:b29083e3:::5:head 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:b29083e3:::5:head -> 5 2024-02-13T14:50:47.971 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=5 expected=5 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:02547ec2:::1:head 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:02547ec2:::1:head expected=14:02547ec2:::1:head 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:02547ec2:::1:head -> 1 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=1 expected=1 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : seek to 14:566253c9:::13:head 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : cursor()=14:566253c9:::13:head expected=14:566253c9:::13:head 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: > 14:566253c9:::13:head -> 13 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: : entry=13 expected=13 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.ListObjectsCursor (230 ms) 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjects 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.EnumerateObjects (123150 ms) 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosList.EnumerateObjectsSplit 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 0/5 -> MIN 14:33333333::::head 2024-02-13T14:50:47.972 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 1/5 -> 14:33333333::::head 14:66666666::::head 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 2/5 -> 14:66666666::::head 14:99999999::::head 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 3/5 -> 14:99999999::::head 14:cccccccc::::head 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: split 4/5 -> 14:cccccccc::::head MAX 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosList.EnumerateObjectsSplit (23120 ms) 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 7 tests from LibRadosList (147203 ms total) 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 3 tests from LibRadosListEC 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosListEC.ListObjects 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosListEC.ListObjects (1061 ms) 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsNS 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo1,foo2,foo3 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo1 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo2 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo3 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo1,foo4,foo5 2024-02-13T14:50:47.973 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo4 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo5 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo1 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset foo6,foo7 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo7 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: foo6 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: myset :foo1,:foo2,:foo3,ns1:foo1,ns1:foo4,ns1:foo5,ns2:foo6,ns2:foo7 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo4 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo5 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns2:foo7 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns2:foo6 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: ns1:foo1 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo1 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo2 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: :foo3 2024-02-13T14:50:47.974 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsNS (46 ms) 2024-02-13T14:50:48.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.465340+0000 mon.a (mon.0) 1731 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:48.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.469551+0000 mon.b (mon.1) 186 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: cluster 2024-02-13T14:50:47.820251+0000 mgr.y (mgr.14613) 297 : cluster 0 pgmap v343: 396 pgs: 40 unknown, 6 creating+activating, 22 creating+peering, 328 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: cluster 2024-02-13T14:50:47.852850+0000 mon.a (mon.0) 1732 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.855729+0000 mon.a (mon.0) 1733 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.855977+0000 mon.a (mon.0) 1734 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]': finished 2024-02-13T14:50:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: cluster 2024-02-13T14:50:47.863943+0000 mon.a (mon.0) 1735 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-02-13T14:50:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.869323+0000 mon.a (mon.0) 1736 : audit 1 from='client.? v1:172.21.15.62:0/228935252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.904402+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.905133+0000 mon.a (mon.0) 1737 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.906215+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.906541+0000 mon.a (mon.0) 1738 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.907323+0000 mon.c (mon.2) 471 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[21479]: audit 2024-02-13T14:50:47.907918+0000 mon.a (mon.0) 1739 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.465340+0000 mon.a (mon.0) 1731 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.469551+0000 mon.b (mon.1) 186 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: cluster 2024-02-13T14:50:47.820251+0000 mgr.y (mgr.14613) 297 : cluster 0 pgmap v343: 396 pgs: 40 unknown, 6 creating+activating, 22 creating+peering, 328 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: cluster 2024-02-13T14:50:47.852850+0000 mon.a (mon.0) 1732 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.855729+0000 mon.a (mon.0) 1733 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:48.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.855977+0000 mon.a (mon.0) 1734 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]': finished 2024-02-13T14:50:48.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: cluster 2024-02-13T14:50:47.863943+0000 mon.a (mon.0) 1735 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-02-13T14:50:48.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.869323+0000 mon.a (mon.0) 1736 : audit 1 from='client.? v1:172.21.15.62:0/228935252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:48.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.904402+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.905133+0000 mon.a (mon.0) 1737 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.906215+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.906541+0000 mon.a (mon.0) 1738 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.907323+0000 mon.c (mon.2) 471 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:48.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:48 smithi062 bash[28859]: audit 2024-02-13T14:50:47.907918+0000 mon.a (mon.0) 1739 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.465340+0000 mon.a (mon.0) 1731 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:50:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.469551+0000 mon.b (mon.1) 186 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:50:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: cluster 2024-02-13T14:50:47.820251+0000 mgr.y (mgr.14613) 297 : cluster 0 pgmap v343: 396 pgs: 40 unknown, 6 creating+activating, 22 creating+peering, 328 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:50:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: cluster 2024-02-13T14:50:47.852850+0000 mon.a (mon.0) 1732 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.855729+0000 mon.a (mon.0) 1733 : audit 1 from='client.? v1:172.21.15.62:0/881152554' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafe_smithi062-64504-33"}]': finished 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.855977+0000 mon.a (mon.0) 1734 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-23", "mode": "writeback"}]': finished 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: cluster 2024-02-13T14:50:47.863943+0000 mon.a (mon.0) 1735 : cluster 0 osdmap e222: 8 total, 8 up, 8 in 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.869323+0000 mon.a (mon.0) 1736 : audit 1 from='client.? v1:172.21.15.62:0/228935252' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.904402+0000 mon.c (mon.2) 469 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.905133+0000 mon.a (mon.0) 1737 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.906215+0000 mon.c (mon.2) 470 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.906541+0000 mon.a (mon.0) 1738 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.907323+0000 mon.c (mon.2) 471 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:48 smithi111 bash[23388]: audit 2024-02-13T14:50:47.907918+0000 mon.a (mon.0) 1739 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:50.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: audit 2024-02-13T14:50:48.859760+0000 mon.a (mon.0) 1740 : audit 1 from='client.? v1:172.21.15.62:0/228935252' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:50.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: audit 2024-02-13T14:50:48.859945+0000 mon.a (mon.0) 1741 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:50.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: cluster 2024-02-13T14:50:48.869181+0000 mon.a (mon.0) 1742 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-02-13T14:50:50.240 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: audit 2024-02-13T14:50:48.885179+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:50.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: audit 2024-02-13T14:50:48.886160+0000 mon.c (mon.2) 473 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:50.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: audit 2024-02-13T14:50:48.889762+0000 mon.a (mon.0) 1743 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:50.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: audit 2024-02-13T14:50:48.899152+0000 mon.a (mon.0) 1744 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:50.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: audit 2024-02-13T14:50:48.948641+0000 mon.c (mon.2) 474 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:50.241 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:49 smithi111 bash[23388]: audit 2024-02-13T14:50:48.949064+0000 mon.a (mon.0) 1745 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: audit 2024-02-13T14:50:48.859760+0000 mon.a (mon.0) 1740 : audit 1 from='client.? v1:172.21.15.62:0/228935252' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: audit 2024-02-13T14:50:48.859945+0000 mon.a (mon.0) 1741 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: cluster 2024-02-13T14:50:48.869181+0000 mon.a (mon.0) 1742 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: audit 2024-02-13T14:50:48.885179+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: audit 2024-02-13T14:50:48.886160+0000 mon.c (mon.2) 473 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: audit 2024-02-13T14:50:48.889762+0000 mon.a (mon.0) 1743 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: audit 2024-02-13T14:50:48.899152+0000 mon.a (mon.0) 1744 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: audit 2024-02-13T14:50:48.948641+0000 mon.c (mon.2) 474 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:50.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[28859]: audit 2024-02-13T14:50:48.949064+0000 mon.a (mon.0) 1745 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: audit 2024-02-13T14:50:48.859760+0000 mon.a (mon.0) 1740 : audit 1 from='client.? v1:172.21.15.62:0/228935252' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: audit 2024-02-13T14:50:48.859945+0000 mon.a (mon.0) 1741 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValue_smithi062-64504-34", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: cluster 2024-02-13T14:50:48.869181+0000 mon.a (mon.0) 1742 : cluster 0 osdmap e223: 8 total, 8 up, 8 in 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: audit 2024-02-13T14:50:48.885179+0000 mon.c (mon.2) 472 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: audit 2024-02-13T14:50:48.886160+0000 mon.c (mon.2) 473 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: audit 2024-02-13T14:50:48.889762+0000 mon.a (mon.0) 1743 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: audit 2024-02-13T14:50:48.899152+0000 mon.a (mon.0) 1744 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: audit 2024-02-13T14:50:48.948641+0000 mon.c (mon.2) 474 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:50.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:49 smithi062 bash[21479]: audit 2024-02-13T14:50:48.949064+0000 mon.a (mon.0) 1745 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:50.592 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:50:51.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: cluster 2024-02-13T14:50:49.822321+0000 mgr.y (mgr.14613) 298 : cluster 0 pgmap v346: 420 pgs: 37 unknown, 6 creating+activating, 7 creating+peering, 370 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-13T14:50:51.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: cluster 2024-02-13T14:50:49.859762+0000 mon.a (mon.0) 1746 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:51.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:49.872713+0000 mon.a (mon.0) 1747 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:51.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:49.872956+0000 mon.a (mon.0) 1748 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:51.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:49.884362+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:51.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:49.884907+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:51.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:50.241586+0000 mgr.y (mgr.14613) 299 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: cluster 2024-02-13T14:50:50.344860+0000 mon.a (mon.0) 1749 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:50.347057+0000 mon.a (mon.0) 1750 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:50.347106+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.62:0/518638955' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:50.347699+0000 mon.a (mon.0) 1751 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[28859]: audit 2024-02-13T14:50:50.348803+0000 mon.a (mon.0) 1752 : audit 1 from='client.46802 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: cluster 2024-02-13T14:50:49.822321+0000 mgr.y (mgr.14613) 298 : cluster 0 pgmap v346: 420 pgs: 37 unknown, 6 creating+activating, 7 creating+peering, 370 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: cluster 2024-02-13T14:50:49.859762+0000 mon.a (mon.0) 1746 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:49.872713+0000 mon.a (mon.0) 1747 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:49.872956+0000 mon.a (mon.0) 1748 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:49.884362+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:49.884907+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:50.241586+0000 mgr.y (mgr.14613) 299 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:51.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: cluster 2024-02-13T14:50:50.344860+0000 mon.a (mon.0) 1749 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-02-13T14:50:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:50.347057+0000 mon.a (mon.0) 1750 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:50.347106+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.62:0/518638955' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:50.347699+0000 mon.a (mon.0) 1751 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:50 smithi062 bash[21479]: audit 2024-02-13T14:50:50.348803+0000 mon.a (mon.0) 1752 : audit 1 from='client.46802 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:51.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: cluster 2024-02-13T14:50:49.822321+0000 mgr.y (mgr.14613) 298 : cluster 0 pgmap v346: 420 pgs: 37 unknown, 6 creating+activating, 7 creating+peering, 370 active+clean; 584 KiB data, 557 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 255 B/s wr, 3 op/s 2024-02-13T14:50:51.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: cluster 2024-02-13T14:50:49.859762+0000 mon.a (mon.0) 1746 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:51.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:49.872713+0000 mon.a (mon.0) 1747 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:49.872956+0000 mon.a (mon.0) 1748 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:49.884362+0000 mon.c (mon.2) 475 : audit 1 from='client.? v1:172.21.15.62:0/1773304611' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:49.884907+0000 mon.c (mon.2) 476 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:50.241586+0000 mgr.y (mgr.14613) 299 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: cluster 2024-02-13T14:50:50.344860+0000 mon.a (mon.0) 1749 : cluster 0 osdmap e224: 8 total, 8 up, 8 in 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:50.347057+0000 mon.a (mon.0) 1750 : audit 1 from='client.46778 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]: dispatch 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:50.347106+0000 mon.c (mon.2) 477 : audit 1 from='client.? v1:172.21.15.62:0/518638955' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:50.347699+0000 mon.a (mon.0) 1751 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]: dispatch 2024-02-13T14:50:51.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:50 smithi111 bash[23388]: audit 2024-02-13T14:50:50.348803+0000 mon.a (mon.0) 1752 : audit 1 from='client.46802 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:52.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:52 smithi111 bash[23388]: cluster 2024-02-13T14:50:50.874880+0000 mon.a (mon.0) 1753 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:52.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:52 smithi111 bash[23388]: audit 2024-02-13T14:50:50.877743+0000 mon.a (mon.0) 1754 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:52.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:52 smithi111 bash[23388]: audit 2024-02-13T14:50:50.878019+0000 mon.a (mon.0) 1755 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:52.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:52 smithi111 bash[23388]: audit 2024-02-13T14:50:50.878238+0000 mon.a (mon.0) 1756 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]': finished 2024-02-13T14:50:52.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:52 smithi111 bash[23388]: audit 2024-02-13T14:50:50.878482+0000 mon.a (mon.0) 1757 : audit 1 from='client.46802 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:52.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:52 smithi111 bash[23388]: cluster 2024-02-13T14:50:50.890082+0000 mon.a (mon.0) 1758 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-02-13T14:50:52.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:52 smithi111 bash[23388]: cluster 2024-02-13T14:50:51.889702+0000 mon.a (mon.0) 1759 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-02-13T14:50:52.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:52 smithi111 bash[23388]: audit 2024-02-13T14:50:51.893632+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.62:0/437434842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[28859]: cluster 2024-02-13T14:50:50.874880+0000 mon.a (mon.0) 1753 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[28859]: audit 2024-02-13T14:50:50.877743+0000 mon.a (mon.0) 1754 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[28859]: audit 2024-02-13T14:50:50.878019+0000 mon.a (mon.0) 1755 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[28859]: audit 2024-02-13T14:50:50.878238+0000 mon.a (mon.0) 1756 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]': finished 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[28859]: audit 2024-02-13T14:50:50.878482+0000 mon.a (mon.0) 1757 : audit 1 from='client.46802 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[28859]: cluster 2024-02-13T14:50:50.890082+0000 mon.a (mon.0) 1758 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[28859]: cluster 2024-02-13T14:50:51.889702+0000 mon.a (mon.0) 1759 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[28859]: audit 2024-02-13T14:50:51.893632+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.62:0/437434842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[21479]: cluster 2024-02-13T14:50:50.874880+0000 mon.a (mon.0) 1753 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:50:52.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[21479]: audit 2024-02-13T14:50:50.877743+0000 mon.a (mon.0) 1754 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValue_smithi062-64504-34", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[21479]: audit 2024-02-13T14:50:50.878019+0000 mon.a (mon.0) 1755 : audit 1 from='client.46778 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosListEC_smithi062-64544-2"}]': finished 2024-02-13T14:50:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[21479]: audit 2024-02-13T14:50:50.878238+0000 mon.a (mon.0) 1756 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-23"}]': finished 2024-02-13T14:50:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[21479]: audit 2024-02-13T14:50:50.878482+0000 mon.a (mon.0) 1757 : audit 1 from='client.46802 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-42","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[21479]: cluster 2024-02-13T14:50:50.890082+0000 mon.a (mon.0) 1758 : cluster 0 osdmap e225: 8 total, 8 up, 8 in 2024-02-13T14:50:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[21479]: cluster 2024-02-13T14:50:51.889702+0000 mon.a (mon.0) 1759 : cluster 0 osdmap e226: 8 total, 8 up, 8 in 2024-02-13T14:50:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:52 smithi062 bash[21479]: audit 2024-02-13T14:50:51.893632+0000 mon.c (mon.2) 478 : audit 1 from='client.? v1:172.21.15.62:0/437434842' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: cluster 2024-02-13T14:50:51.823365+0000 mgr.y (mgr.14613) 300 : cluster 0 pgmap v349: 460 pgs: 12 creating+peering, 28 unknown, 420 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:51.894074+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.62:0/2037172204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.330517+0000 mon.a (mon.0) 1760 : audit 1 from='client.46808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.330981+0000 mon.a (mon.0) 1761 : audit 1 from='client.46814 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.886098+0000 mon.a (mon.0) 1762 : audit 1 from='client.46808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.886330+0000 mon.a (mon.0) 1763 : audit 1 from='client.46814 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: cluster 2024-02-13T14:50:52.897052+0000 mon.a (mon.0) 1764 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.901784+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.902277+0000 mon.c (mon.2) 481 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.903499+0000 mon.a (mon.0) 1765 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.904076+0000 mon.a (mon.0) 1766 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:53.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.986609+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.62:0/437434842' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T14:50:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:53 smithi111 bash[23388]: audit 2024-02-13T14:50:52.986974+0000 mon.a (mon.0) 1767 : audit 1 from='client.46808 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T14:50:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: cluster 2024-02-13T14:50:51.823365+0000 mgr.y (mgr.14613) 300 : cluster 0 pgmap v349: 460 pgs: 12 creating+peering, 28 unknown, 420 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-13T14:50:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:51.894074+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.62:0/2037172204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.330517+0000 mon.a (mon.0) 1760 : audit 1 from='client.46808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.330981+0000 mon.a (mon.0) 1761 : audit 1 from='client.46814 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.886098+0000 mon.a (mon.0) 1762 : audit 1 from='client.46808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.886330+0000 mon.a (mon.0) 1763 : audit 1 from='client.46814 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:53.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: cluster 2024-02-13T14:50:52.897052+0000 mon.a (mon.0) 1764 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.901784+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.902277+0000 mon.c (mon.2) 481 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.903499+0000 mon.a (mon.0) 1765 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.904076+0000 mon.a (mon.0) 1766 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.986609+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.62:0/437434842' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[21479]: audit 2024-02-13T14:50:52.986974+0000 mon.a (mon.0) 1767 : audit 1 from='client.46808 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: cluster 2024-02-13T14:50:51.823365+0000 mgr.y (mgr.14613) 300 : cluster 0 pgmap v349: 460 pgs: 12 creating+peering, 28 unknown, 420 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:51.894074+0000 mon.c (mon.2) 479 : audit 1 from='client.? v1:172.21.15.62:0/2037172204' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.330517+0000 mon.a (mon.0) 1760 : audit 1 from='client.46808 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.330981+0000 mon.a (mon.0) 1761 : audit 1 from='client.46814 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.886098+0000 mon.a (mon.0) 1762 : audit 1 from='client.46808 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64544-3","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.886330+0000 mon.a (mon.0) 1763 : audit 1 from='client.46814 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RmXattrPP_smithi062-64512-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: cluster 2024-02-13T14:50:52.897052+0000 mon.a (mon.0) 1764 : cluster 0 osdmap e227: 8 total, 8 up, 8 in 2024-02-13T14:50:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.901784+0000 mon.c (mon.2) 480 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.902277+0000 mon.c (mon.2) 481 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.903499+0000 mon.a (mon.0) 1765 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.904076+0000 mon.a (mon.0) 1766 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.986609+0000 mon.c (mon.2) 482 : audit 1 from='client.? v1:172.21.15.62:0/437434842' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T14:50:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:53 smithi062 bash[28859]: audit 2024-02-13T14:50:52.986974+0000 mon.a (mon.0) 1767 : audit 1 from='client.46808 ' entity='client.admin' cmd=[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]: dispatch 2024-02-13T14:50:53.911 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosListEC.ListObjectsStart 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 1 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 10 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 13 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 7 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 14 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 0 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 15 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 11 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 5 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 8 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 6 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 3 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 4 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 12 0 2024-02-13T14:50:53.912 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 9 0 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2 0 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: have 1 expect one of 0,1,10,11,12,13,14,15,2,3,4,5,6,7,8,9 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosListEC.ListObjectsStart (67 ms) 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 3 tests from LibRadosListEC (1174 ms total) 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 1 test from LibRadosListNP 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ RUN ] LibRadosListNP.ListObjectsError 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ OK ] LibRadosListNP.ListObjectsError (3013 ms) 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] 1 test from LibRadosListNP (3013 ms total) 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [----------] Global test environment tear-down 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [==========] 11 tests from 3 test suites ran. (175233 ms total) 2024-02-13T14:50:53.913 INFO:tasks.workunit.client.0.smithi062.stdout: api_list: [ PASSED ] 11 tests. 2024-02-13T14:50:55.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[21479]: cluster 2024-02-13T14:50:53.824438+0000 mgr.y (mgr.14613) 301 : cluster 0 pgmap v352: 516 pgs: 12 creating+peering, 116 unknown, 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1023 B/s wr, 0 op/s 2024-02-13T14:50:55.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[21479]: audit 2024-02-13T14:50:53.889467+0000 mon.a (mon.0) 1768 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:55.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[21479]: audit 2024-02-13T14:50:53.889614+0000 mon.a (mon.0) 1769 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:55.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[21479]: audit 2024-02-13T14:50:53.889767+0000 mon.a (mon.0) 1770 : audit 1 from='client.46808 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-13T14:50:55.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[21479]: cluster 2024-02-13T14:50:53.897356+0000 mon.a (mon.0) 1771 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-02-13T14:50:55.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[21479]: audit 2024-02-13T14:50:53.903564+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:55.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[21479]: audit 2024-02-13T14:50:53.905496+0000 mon.a (mon.0) 1772 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:55.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[28859]: cluster 2024-02-13T14:50:53.824438+0000 mgr.y (mgr.14613) 301 : cluster 0 pgmap v352: 516 pgs: 12 creating+peering, 116 unknown, 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1023 B/s wr, 0 op/s 2024-02-13T14:50:55.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[28859]: audit 2024-02-13T14:50:53.889467+0000 mon.a (mon.0) 1768 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:55.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[28859]: audit 2024-02-13T14:50:53.889614+0000 mon.a (mon.0) 1769 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:55.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[28859]: audit 2024-02-13T14:50:53.889767+0000 mon.a (mon.0) 1770 : audit 1 from='client.46808 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-13T14:50:55.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[28859]: cluster 2024-02-13T14:50:53.897356+0000 mon.a (mon.0) 1771 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-02-13T14:50:55.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[28859]: audit 2024-02-13T14:50:53.903564+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:55.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:54 smithi062 bash[28859]: audit 2024-02-13T14:50:53.905496+0000 mon.a (mon.0) 1772 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:55.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:54 smithi111 bash[23388]: cluster 2024-02-13T14:50:53.824438+0000 mgr.y (mgr.14613) 301 : cluster 0 pgmap v352: 516 pgs: 12 creating+peering, 116 unknown, 388 active+clean; 584 KiB data, 562 MiB used, 715 GiB / 715 GiB avail; 1023 B/s wr, 0 op/s 2024-02-13T14:50:55.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:54 smithi111 bash[23388]: audit 2024-02-13T14:50:53.889467+0000 mon.a (mon.0) 1768 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-25","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:50:55.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:54 smithi111 bash[23388]: audit 2024-02-13T14:50:53.889614+0000 mon.a (mon.0) 1769 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:55.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:54 smithi111 bash[23388]: audit 2024-02-13T14:50:53.889767+0000 mon.a (mon.0) 1770 : audit 1 from='client.46808 ' entity='client.admin' cmd='[{"prefix":"osd pool rm","pool": "test-rados-api-smithi062-64544-3","pool2":"test-rados-api-smithi062-64544-3","yes_i_really_really_mean_it_not_faking": true}]': finished 2024-02-13T14:50:55.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:54 smithi111 bash[23388]: cluster 2024-02-13T14:50:53.897356+0000 mon.a (mon.0) 1771 : cluster 0 osdmap e228: 8 total, 8 up, 8 in 2024-02-13T14:50:55.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:54 smithi111 bash[23388]: audit 2024-02-13T14:50:53.903564+0000 mon.c (mon.2) 483 : audit 1 from='client.? v1:172.21.15.62:0/2102866829' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:55.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:54 smithi111 bash[23388]: audit 2024-02-13T14:50:53.905496+0000 mon.a (mon.0) 1772 : audit 1 from='client.46796 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]: dispatch 2024-02-13T14:50:56.224 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:54.895381+0000 mon.a (mon.0) 1773 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:56.224 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: cluster 2024-02-13T14:50:54.904692+0000 mon.a (mon.0) 1774 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-02-13T14:50:56.224 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:54.948710+0000 mon.a (mon.0) 1775 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:54.949746+0000 mon.a (mon.0) 1776 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:54.950156+0000 mon.a (mon.0) 1777 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi062-64504-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:54.954150+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:54.954508+0000 mon.a (mon.0) 1778 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:55.897931+0000 mon.a (mon.0) 1779 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi062-64504-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:55.898220+0000 mon.a (mon.0) 1780 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: cluster 2024-02-13T14:50:55.905767+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:55.908205+0000 mon.a (mon.0) 1782 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi062-64504-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:55.908952+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[21479]: audit 2024-02-13T14:50:55.911199+0000 mon.a (mon.0) 1783 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:54.895381+0000 mon.a (mon.0) 1773 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: cluster 2024-02-13T14:50:54.904692+0000 mon.a (mon.0) 1774 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-02-13T14:50:56.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:54.948710+0000 mon.a (mon.0) 1775 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:54.949746+0000 mon.a (mon.0) 1776 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:54.950156+0000 mon.a (mon.0) 1777 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi062-64504-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:54.954150+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:54.954508+0000 mon.a (mon.0) 1778 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:55.897931+0000 mon.a (mon.0) 1779 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi062-64504-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:55.898220+0000 mon.a (mon.0) 1780 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: cluster 2024-02-13T14:50:55.905767+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:55.908205+0000 mon.a (mon.0) 1782 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi062-64504-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:55.908952+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:55 smithi062 bash[28859]: audit 2024-02-13T14:50:55.911199+0000 mon.a (mon.0) 1783 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:54.895381+0000 mon.a (mon.0) 1773 : audit 1 from='client.46796 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValue_smithi062-64504-34"}]': finished 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: cluster 2024-02-13T14:50:54.904692+0000 mon.a (mon.0) 1774 : cluster 0 osdmap e229: 8 total, 8 up, 8 in 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:54.948710+0000 mon.a (mon.0) 1775 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:54.949746+0000 mon.a (mon.0) 1776 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:54.950156+0000 mon.a (mon.0) 1777 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi062-64504-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:54.954150+0000 mon.c (mon.2) 484 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:54.954508+0000 mon.a (mon.0) 1778 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:55.897931+0000 mon.a (mon.0) 1779 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-Flush_smithi062-64504-35", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:55.898220+0000 mon.a (mon.0) 1780 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:50:56.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: cluster 2024-02-13T14:50:55.905767+0000 mon.a (mon.0) 1781 : cluster 0 osdmap e230: 8 total, 8 up, 8 in 2024-02-13T14:50:56.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:55.908205+0000 mon.a (mon.0) 1782 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "Flush_smithi062-64504-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:50:56.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:55.908952+0000 mon.c (mon.2) 485 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:56.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:55 smithi111 bash[23388]: audit 2024-02-13T14:50:55.911199+0000 mon.a (mon.0) 1783 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:56.559 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:50:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:50:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:50:57.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:57 smithi062 bash[21479]: cluster 2024-02-13T14:50:55.826529+0000 mgr.y (mgr.14613) 302 : cluster 0 pgmap v355: 420 pgs: 420 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:57.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:57 smithi062 bash[21479]: cluster 2024-02-13T14:50:55.921512+0000 mon.a (mon.0) 1784 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:57.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:57 smithi062 bash[21479]: audit 2024-02-13T14:50:56.867405+0000 mon.a (mon.0) 1785 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]': finished 2024-02-13T14:50:57.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:57 smithi062 bash[28859]: cluster 2024-02-13T14:50:55.826529+0000 mgr.y (mgr.14613) 302 : cluster 0 pgmap v355: 420 pgs: 420 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:57.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:57 smithi062 bash[28859]: cluster 2024-02-13T14:50:55.921512+0000 mon.a (mon.0) 1784 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:57.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:57 smithi062 bash[28859]: audit 2024-02-13T14:50:56.867405+0000 mon.a (mon.0) 1785 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]': finished 2024-02-13T14:50:57.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:57 smithi111 bash[23388]: cluster 2024-02-13T14:50:55.826529+0000 mgr.y (mgr.14613) 302 : cluster 0 pgmap v355: 420 pgs: 420 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:50:57.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:57 smithi111 bash[23388]: cluster 2024-02-13T14:50:55.921512+0000 mon.a (mon.0) 1784 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:50:57.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:57 smithi111 bash[23388]: audit 2024-02-13T14:50:56.867405+0000 mon.a (mon.0) 1785 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-25"}]': finished 2024-02-13T14:50:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[21479]: audit 2024-02-13T14:50:56.875551+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]: dispatch 2024-02-13T14:50:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[21479]: cluster 2024-02-13T14:50:57.341393+0000 mon.a (mon.0) 1786 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-02-13T14:50:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[21479]: audit 2024-02-13T14:50:57.343157+0000 mon.a (mon.0) 1787 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]: dispatch 2024-02-13T14:50:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[21479]: cluster 2024-02-13T14:50:57.867934+0000 mon.a (mon.0) 1788 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[21479]: audit 2024-02-13T14:50:57.870642+0000 mon.a (mon.0) 1789 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi062-64504-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi062-64504-35"}]': finished 2024-02-13T14:50:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[21479]: audit 2024-02-13T14:50:57.870913+0000 mon.a (mon.0) 1790 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]': finished 2024-02-13T14:50:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[21479]: cluster 2024-02-13T14:50:57.878369+0000 mon.a (mon.0) 1791 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-02-13T14:50:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[21479]: audit 2024-02-13T14:50:57.944525+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[28859]: audit 2024-02-13T14:50:56.875551+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]: dispatch 2024-02-13T14:50:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[28859]: cluster 2024-02-13T14:50:57.341393+0000 mon.a (mon.0) 1786 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-02-13T14:50:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[28859]: audit 2024-02-13T14:50:57.343157+0000 mon.a (mon.0) 1787 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]: dispatch 2024-02-13T14:50:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[28859]: cluster 2024-02-13T14:50:57.867934+0000 mon.a (mon.0) 1788 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[28859]: audit 2024-02-13T14:50:57.870642+0000 mon.a (mon.0) 1789 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi062-64504-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi062-64504-35"}]': finished 2024-02-13T14:50:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[28859]: audit 2024-02-13T14:50:57.870913+0000 mon.a (mon.0) 1790 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]': finished 2024-02-13T14:50:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[28859]: cluster 2024-02-13T14:50:57.878369+0000 mon.a (mon.0) 1791 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-02-13T14:50:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:58 smithi062 bash[28859]: audit 2024-02-13T14:50:57.944525+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:58.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:58 smithi111 bash[23388]: audit 2024-02-13T14:50:56.875551+0000 mon.c (mon.2) 486 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]: dispatch 2024-02-13T14:50:58.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:58 smithi111 bash[23388]: cluster 2024-02-13T14:50:57.341393+0000 mon.a (mon.0) 1786 : cluster 0 osdmap e231: 8 total, 8 up, 8 in 2024-02-13T14:50:58.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:58 smithi111 bash[23388]: audit 2024-02-13T14:50:57.343157+0000 mon.a (mon.0) 1787 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]: dispatch 2024-02-13T14:50:58.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:58 smithi111 bash[23388]: cluster 2024-02-13T14:50:57.867934+0000 mon.a (mon.0) 1788 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:50:58.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:58 smithi111 bash[23388]: audit 2024-02-13T14:50:57.870642+0000 mon.a (mon.0) 1789 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "Flush_smithi062-64504-35", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-Flush_smithi062-64504-35"}]': finished 2024-02-13T14:50:58.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:58 smithi111 bash[23388]: audit 2024-02-13T14:50:57.870913+0000 mon.a (mon.0) 1790 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-25", "mode": "writeback"}]': finished 2024-02-13T14:50:58.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:58 smithi111 bash[23388]: cluster 2024-02-13T14:50:57.878369+0000 mon.a (mon.0) 1791 : cluster 0 osdmap e232: 8 total, 8 up, 8 in 2024-02-13T14:50:58.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:58 smithi111 bash[23388]: audit 2024-02-13T14:50:57.944525+0000 mon.c (mon.2) 487 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:59.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[28859]: cluster 2024-02-13T14:50:57.827436+0000 mgr.y (mgr.14613) 303 : cluster 0 pgmap v358: 356 pgs: 356 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:59.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[28859]: audit 2024-02-13T14:50:58.377746+0000 mon.a (mon.0) 1792 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:59.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[28859]: audit 2024-02-13T14:50:58.874229+0000 mon.a (mon.0) 1793 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:59.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[28859]: cluster 2024-02-13T14:50:58.882853+0000 mon.a (mon.0) 1794 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-02-13T14:50:59.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[28859]: audit 2024-02-13T14:50:58.886104+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:59.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[28859]: audit 2024-02-13T14:50:58.886905+0000 mon.a (mon.0) 1795 : audit 1 from='client.? v1:172.21.15.62:0/2332480168' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi062-64512-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:59.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[28859]: audit 2024-02-13T14:50:58.887428+0000 mon.a (mon.0) 1796 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:59.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[21479]: cluster 2024-02-13T14:50:57.827436+0000 mgr.y (mgr.14613) 303 : cluster 0 pgmap v358: 356 pgs: 356 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[21479]: audit 2024-02-13T14:50:58.377746+0000 mon.a (mon.0) 1792 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[21479]: audit 2024-02-13T14:50:58.874229+0000 mon.a (mon.0) 1793 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[21479]: cluster 2024-02-13T14:50:58.882853+0000 mon.a (mon.0) 1794 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-02-13T14:50:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[21479]: audit 2024-02-13T14:50:58.886104+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[21479]: audit 2024-02-13T14:50:58.886905+0000 mon.a (mon.0) 1795 : audit 1 from='client.? v1:172.21.15.62:0/2332480168' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi062-64512-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:50:59 smithi062 bash[21479]: audit 2024-02-13T14:50:58.887428+0000 mon.a (mon.0) 1796 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:59.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:59 smithi111 bash[23388]: cluster 2024-02-13T14:50:57.827436+0000 mgr.y (mgr.14613) 303 : cluster 0 pgmap v358: 356 pgs: 356 active+clean; 584 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:50:59.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:59 smithi111 bash[23388]: audit 2024-02-13T14:50:58.377746+0000 mon.a (mon.0) 1792 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:50:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:59 smithi111 bash[23388]: audit 2024-02-13T14:50:58.874229+0000 mon.a (mon.0) 1793 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:50:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:59 smithi111 bash[23388]: cluster 2024-02-13T14:50:58.882853+0000 mon.a (mon.0) 1794 : cluster 0 osdmap e233: 8 total, 8 up, 8 in 2024-02-13T14:50:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:59 smithi111 bash[23388]: audit 2024-02-13T14:50:58.886104+0000 mon.c (mon.2) 488 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:50:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:59 smithi111 bash[23388]: audit 2024-02-13T14:50:58.886905+0000 mon.a (mon.0) 1795 : audit 1 from='client.? v1:172.21.15.62:0/2332480168' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi062-64512-44","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:50:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:50:59 smithi111 bash[23388]: audit 2024-02-13T14:50:58.887428+0000 mon.a (mon.0) 1796 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]: dispatch 2024-02-13T14:51:00.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:51:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:51:00.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:00 smithi111 bash[23388]: cluster 2024-02-13T14:50:59.829394+0000 mgr.y (mgr.14613) 304 : cluster 0 pgmap v361: 364 pgs: 14 creating+peering, 24 unknown, 326 active+clean; 583 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:00.591 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:00 smithi111 bash[23388]: cluster 2024-02-13T14:50:59.874975+0000 mon.a (mon.0) 1797 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:00.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:00 smithi111 bash[23388]: audit 2024-02-13T14:50:59.877584+0000 mon.a (mon.0) 1798 : audit 1 from='client.? v1:172.21.15.62:0/2332480168' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi062-64512-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:00.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:00 smithi111 bash[23388]: audit 2024-02-13T14:50:59.877771+0000 mon.a (mon.0) 1799 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]': finished 2024-02-13T14:51:00.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:00 smithi111 bash[23388]: cluster 2024-02-13T14:50:59.886957+0000 mon.a (mon.0) 1800 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-02-13T14:51:00.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:00 smithi111 bash[23388]: audit 2024-02-13T14:50:59.890338+0000 mon.a (mon.0) 1801 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:51:00.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:00 smithi111 bash[23388]: audit 2024-02-13T14:51:00.252967+0000 mgr.y (mgr.14613) 305 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[21479]: cluster 2024-02-13T14:50:59.829394+0000 mgr.y (mgr.14613) 304 : cluster 0 pgmap v361: 364 pgs: 14 creating+peering, 24 unknown, 326 active+clean; 583 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[21479]: cluster 2024-02-13T14:50:59.874975+0000 mon.a (mon.0) 1797 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[21479]: audit 2024-02-13T14:50:59.877584+0000 mon.a (mon.0) 1798 : audit 1 from='client.? v1:172.21.15.62:0/2332480168' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi062-64512-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[21479]: audit 2024-02-13T14:50:59.877771+0000 mon.a (mon.0) 1799 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]': finished 2024-02-13T14:51:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[21479]: cluster 2024-02-13T14:50:59.886957+0000 mon.a (mon.0) 1800 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-02-13T14:51:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[21479]: audit 2024-02-13T14:50:59.890338+0000 mon.a (mon.0) 1801 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:51:00.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[21479]: audit 2024-02-13T14:51:00.252967+0000 mgr.y (mgr.14613) 305 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[28859]: cluster 2024-02-13T14:50:59.829394+0000 mgr.y (mgr.14613) 304 : cluster 0 pgmap v361: 364 pgs: 14 creating+peering, 24 unknown, 326 active+clean; 583 KiB data, 567 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[28859]: cluster 2024-02-13T14:50:59.874975+0000 mon.a (mon.0) 1797 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[28859]: audit 2024-02-13T14:50:59.877584+0000 mon.a (mon.0) 1798 : audit 1 from='client.? v1:172.21.15.62:0/2332480168' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RemoveTestPP_smithi062-64512-44","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[28859]: audit 2024-02-13T14:50:59.877771+0000 mon.a (mon.0) 1799 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-25"}]': finished 2024-02-13T14:51:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[28859]: cluster 2024-02-13T14:50:59.886957+0000 mon.a (mon.0) 1800 : cluster 0 osdmap e234: 8 total, 8 up, 8 in 2024-02-13T14:51:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[28859]: audit 2024-02-13T14:50:59.890338+0000 mon.a (mon.0) 1801 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:51:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:00 smithi062 bash[28859]: audit 2024-02-13T14:51:00.252967+0000 mgr.y (mgr.14613) 305 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:01 smithi062 bash[21479]: audit 2024-02-13T14:51:00.881434+0000 mon.a (mon.0) 1802 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]': finished 2024-02-13T14:51:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:01 smithi062 bash[21479]: cluster 2024-02-13T14:51:00.890308+0000 mon.a (mon.0) 1803 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-02-13T14:51:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:01 smithi062 bash[21479]: audit 2024-02-13T14:51:00.891118+0000 mon.a (mon.0) 1804 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:51:02.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:01 smithi062 bash[21479]: cluster 2024-02-13T14:51:01.866412+0000 mon.a (mon.0) 1805 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:02.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:01 smithi062 bash[28859]: audit 2024-02-13T14:51:00.881434+0000 mon.a (mon.0) 1802 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]': finished 2024-02-13T14:51:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:01 smithi062 bash[28859]: cluster 2024-02-13T14:51:00.890308+0000 mon.a (mon.0) 1803 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-02-13T14:51:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:01 smithi062 bash[28859]: audit 2024-02-13T14:51:00.891118+0000 mon.a (mon.0) 1804 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:51:02.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:01 smithi062 bash[28859]: cluster 2024-02-13T14:51:01.866412+0000 mon.a (mon.0) 1805 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:02.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:01 smithi111 bash[23388]: audit 2024-02-13T14:51:00.881434+0000 mon.a (mon.0) 1802 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-Flush_smithi062-64504-35"}]': finished 2024-02-13T14:51:02.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:01 smithi111 bash[23388]: cluster 2024-02-13T14:51:00.890308+0000 mon.a (mon.0) 1803 : cluster 0 osdmap e235: 8 total, 8 up, 8 in 2024-02-13T14:51:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:01 smithi111 bash[23388]: audit 2024-02-13T14:51:00.891118+0000 mon.a (mon.0) 1804 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]: dispatch 2024-02-13T14:51:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:01 smithi111 bash[23388]: cluster 2024-02-13T14:51:01.866412+0000 mon.a (mon.0) 1805 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:03.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: cluster 2024-02-13T14:51:01.830280+0000 mgr.y (mgr.14613) 306 : cluster 0 pgmap v364: 292 pgs: 292 active+clean; 583 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:03.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.886542+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]': finished 2024-02-13T14:51:03.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: cluster 2024-02-13T14:51:01.897246+0000 mon.a (mon.0) 1807 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.900323+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.902085+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.62:0/917619098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.904104+0000 mon.a (mon.0) 1808 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.904866+0000 mon.a (mon.0) 1809 : audit 1 from='client.46832 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.946477+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.946836+0000 mon.a (mon.0) 1810 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.947962+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.948243+0000 mon.a (mon.0) 1811 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.948723+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:01.949030+0000 mon.a (mon.0) 1812 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:02.504526+0000 mon.b (mon.1) 187 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:02.890056+0000 mon.a (mon.0) 1813 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: cluster 2024-02-13T14:51:01.830280+0000 mgr.y (mgr.14613) 306 : cluster 0 pgmap v364: 292 pgs: 292 active+clean; 583 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.886542+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]': finished 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: cluster 2024-02-13T14:51:01.897246+0000 mon.a (mon.0) 1807 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.900323+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.902085+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.62:0/917619098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.904104+0000 mon.a (mon.0) 1808 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.904866+0000 mon.a (mon.0) 1809 : audit 1 from='client.46832 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.946477+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.946836+0000 mon.a (mon.0) 1810 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.947962+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.948243+0000 mon.a (mon.0) 1811 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.948723+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:01.949030+0000 mon.a (mon.0) 1812 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:02.504526+0000 mon.b (mon.1) 187 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:02.890056+0000 mon.a (mon.0) 1813 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:02.890306+0000 mon.a (mon.0) 1814 : audit 1 from='client.46832 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:02.890563+0000 mon.a (mon.0) 1815 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: cluster 2024-02-13T14:51:02.898511+0000 mon.a (mon.0) 1816 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:02.902270+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[21479]: audit 2024-02-13T14:51:02.904571+0000 mon.a (mon.0) 1817 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:02.890306+0000 mon.a (mon.0) 1814 : audit 1 from='client.46832 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:03.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:02.890563+0000 mon.a (mon.0) 1815 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:03.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: cluster 2024-02-13T14:51:02.898511+0000 mon.a (mon.0) 1816 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-02-13T14:51:03.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:02.902270+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:02 smithi062 bash[28859]: audit 2024-02-13T14:51:02.904571+0000 mon.a (mon.0) 1817 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: cluster 2024-02-13T14:51:01.830280+0000 mgr.y (mgr.14613) 306 : cluster 0 pgmap v364: 292 pgs: 292 active+clean; 583 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.886542+0000 mon.a (mon.0) 1806 : audit 1 from='client.? v1:172.21.15.62:0/2528219506' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"Flush_smithi062-64504-35"}]': finished 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: cluster 2024-02-13T14:51:01.897246+0000 mon.a (mon.0) 1807 : cluster 0 osdmap e236: 8 total, 8 up, 8 in 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.900323+0000 mon.c (mon.2) 489 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.902085+0000 mon.c (mon.2) 490 : audit 1 from='client.? v1:172.21.15.62:0/917619098' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.904104+0000 mon.a (mon.0) 1808 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.904866+0000 mon.a (mon.0) 1809 : audit 1 from='client.46832 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.946477+0000 mon.c (mon.2) 491 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.946836+0000 mon.a (mon.0) 1810 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.947962+0000 mon.c (mon.2) 492 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.948243+0000 mon.a (mon.0) 1811 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.948723+0000 mon.c (mon.2) 493 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:01.949030+0000 mon.a (mon.0) 1812 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:02.504526+0000 mon.b (mon.1) 187 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:02.890056+0000 mon.a (mon.0) 1813 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-27","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:02.890306+0000 mon.a (mon.0) 1814 : audit 1 from='client.46832 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "XattrListPP_smithi062-64512-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:02.890563+0000 mon.a (mon.0) 1815 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsync_smithi062-64504-36", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: cluster 2024-02-13T14:51:02.898511+0000 mon.a (mon.0) 1816 : cluster 0 osdmap e237: 8 total, 8 up, 8 in 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:02.902270+0000 mon.c (mon.2) 494 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:02 smithi111 bash[23388]: audit 2024-02-13T14:51:02.904571+0000 mon.a (mon.0) 1817 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: cluster 2024-02-13T14:51:03.831198+0000 mgr.y (mgr.14613) 307 : cluster 0 pgmap v367: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-02-13T14:51:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: cluster 2024-02-13T14:51:04.363281+0000 mon.a (mon.0) 1818 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-02-13T14:51:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: audit 2024-02-13T14:51:04.413779+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: audit 2024-02-13T14:51:04.414701+0000 mon.a (mon.0) 1819 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: audit 2024-02-13T14:51:04.421855+0000 mon.c (mon.2) 496 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: audit 2024-02-13T14:51:04.422152+0000 mon.a (mon.0) 1820 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: audit 2024-02-13T14:51:04.423149+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: audit 2024-02-13T14:51:04.423407+0000 mon.a (mon.0) 1821 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: audit 2024-02-13T14:51:04.423810+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[21479]: audit 2024-02-13T14:51:04.424064+0000 mon.a (mon.0) 1822 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: cluster 2024-02-13T14:51:03.831198+0000 mgr.y (mgr.14613) 307 : cluster 0 pgmap v367: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: cluster 2024-02-13T14:51:04.363281+0000 mon.a (mon.0) 1818 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: audit 2024-02-13T14:51:04.413779+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: audit 2024-02-13T14:51:04.414701+0000 mon.a (mon.0) 1819 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: audit 2024-02-13T14:51:04.421855+0000 mon.c (mon.2) 496 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: audit 2024-02-13T14:51:04.422152+0000 mon.a (mon.0) 1820 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: audit 2024-02-13T14:51:04.423149+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: audit 2024-02-13T14:51:04.423407+0000 mon.a (mon.0) 1821 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: audit 2024-02-13T14:51:04.423810+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:04 smithi062 bash[28859]: audit 2024-02-13T14:51:04.424064+0000 mon.a (mon.0) 1822 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:05.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: cluster 2024-02-13T14:51:03.831198+0000 mgr.y (mgr.14613) 307 : cluster 0 pgmap v367: 356 pgs: 64 unknown, 292 active+clean; 583 KiB data, 576 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 255 B/s wr, 0 op/s 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: cluster 2024-02-13T14:51:04.363281+0000 mon.a (mon.0) 1818 : cluster 0 osdmap e238: 8 total, 8 up, 8 in 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: audit 2024-02-13T14:51:04.413779+0000 mon.c (mon.2) 495 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: audit 2024-02-13T14:51:04.414701+0000 mon.a (mon.0) 1819 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: audit 2024-02-13T14:51:04.421855+0000 mon.c (mon.2) 496 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: audit 2024-02-13T14:51:04.422152+0000 mon.a (mon.0) 1820 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: audit 2024-02-13T14:51:04.423149+0000 mon.c (mon.2) 497 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: audit 2024-02-13T14:51:04.423407+0000 mon.a (mon.0) 1821 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: audit 2024-02-13T14:51:04.423810+0000 mon.c (mon.2) 498 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:04 smithi111 bash[23388]: audit 2024-02-13T14:51:04.424064+0000 mon.a (mon.0) 1822 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:06.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:51:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:51:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: audit 2024-02-13T14:51:04.897093+0000 mon.a (mon.0) 1823 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: audit 2024-02-13T14:51:04.897309+0000 mon.a (mon.0) 1824 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: audit 2024-02-13T14:51:04.897457+0000 mon.a (mon.0) 1825 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: cluster 2024-02-13T14:51:04.906724+0000 mon.a (mon.0) 1826 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-02-13T14:51:06.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: audit 2024-02-13T14:51:04.909380+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: audit 2024-02-13T14:51:04.910568+0000 mon.a (mon.0) 1827 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: audit 2024-02-13T14:51:04.911114+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: audit 2024-02-13T14:51:04.920861+0000 mon.a (mon.0) 1828 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[21479]: audit 2024-02-13T14:51:05.901026+0000 mon.a (mon.0) 1829 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]': finished 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: audit 2024-02-13T14:51:04.897093+0000 mon.a (mon.0) 1823 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: audit 2024-02-13T14:51:04.897309+0000 mon.a (mon.0) 1824 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: audit 2024-02-13T14:51:04.897457+0000 mon.a (mon.0) 1825 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: cluster 2024-02-13T14:51:04.906724+0000 mon.a (mon.0) 1826 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: audit 2024-02-13T14:51:04.909380+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: audit 2024-02-13T14:51:04.910568+0000 mon.a (mon.0) 1827 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: audit 2024-02-13T14:51:04.911114+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: audit 2024-02-13T14:51:04.920861+0000 mon.a (mon.0) 1828 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:06 smithi062 bash[28859]: audit 2024-02-13T14:51:05.901026+0000 mon.a (mon.0) 1829 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]': finished 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: audit 2024-02-13T14:51:04.897093+0000 mon.a (mon.0) 1823 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsync_smithi062-64504-36", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: audit 2024-02-13T14:51:04.897309+0000 mon.a (mon.0) 1824 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: audit 2024-02-13T14:51:04.897457+0000 mon.a (mon.0) 1825 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-46", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: cluster 2024-02-13T14:51:04.906724+0000 mon.a (mon.0) 1826 : cluster 0 osdmap e239: 8 total, 8 up, 8 in 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: audit 2024-02-13T14:51:04.909380+0000 mon.c (mon.2) 499 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: audit 2024-02-13T14:51:04.910568+0000 mon.a (mon.0) 1827 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: audit 2024-02-13T14:51:04.911114+0000 mon.c (mon.2) 500 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: audit 2024-02-13T14:51:04.920861+0000 mon.a (mon.0) 1828 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:06 smithi111 bash[23388]: audit 2024-02-13T14:51:05.901026+0000 mon.a (mon.0) 1829 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-27"}]': finished 2024-02-13T14:51:07.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: cluster 2024-02-13T14:51:05.832976+0000 mgr.y (mgr.14613) 308 : cluster 0 pgmap v370: 332 pgs: 2 creating+peering, 6 unknown, 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:51:07.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: audit 2024-02-13T14:51:05.910725+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]: dispatch 2024-02-13T14:51:07.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: cluster 2024-02-13T14:51:06.374253+0000 mon.a (mon.0) 1830 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-02-13T14:51:07.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: audit 2024-02-13T14:51:06.378415+0000 mon.a (mon.0) 1831 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]: dispatch 2024-02-13T14:51:07.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: cluster 2024-02-13T14:51:06.868174+0000 mon.a (mon.0) 1832 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:07.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: cluster 2024-02-13T14:51:06.901545+0000 mon.a (mon.0) 1833 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:07.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: audit 2024-02-13T14:51:06.903939+0000 mon.a (mon.0) 1834 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: audit 2024-02-13T14:51:06.904238+0000 mon.a (mon.0) 1835 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]': finished 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: cluster 2024-02-13T14:51:06.913691+0000 mon.a (mon.0) 1836 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: audit 2024-02-13T14:51:06.917177+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[21479]: audit 2024-02-13T14:51:06.918414+0000 mon.a (mon.0) 1837 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: cluster 2024-02-13T14:51:05.832976+0000 mgr.y (mgr.14613) 308 : cluster 0 pgmap v370: 332 pgs: 2 creating+peering, 6 unknown, 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: audit 2024-02-13T14:51:05.910725+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]: dispatch 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: cluster 2024-02-13T14:51:06.374253+0000 mon.a (mon.0) 1830 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: audit 2024-02-13T14:51:06.378415+0000 mon.a (mon.0) 1831 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]: dispatch 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: cluster 2024-02-13T14:51:06.868174+0000 mon.a (mon.0) 1832 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: cluster 2024-02-13T14:51:06.901545+0000 mon.a (mon.0) 1833 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: audit 2024-02-13T14:51:06.903939+0000 mon.a (mon.0) 1834 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: audit 2024-02-13T14:51:06.904238+0000 mon.a (mon.0) 1835 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]': finished 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: cluster 2024-02-13T14:51:06.913691+0000 mon.a (mon.0) 1836 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-02-13T14:51:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: audit 2024-02-13T14:51:06.917177+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:07 smithi062 bash[28859]: audit 2024-02-13T14:51:06.918414+0000 mon.a (mon.0) 1837 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:07.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: cluster 2024-02-13T14:51:05.832976+0000 mgr.y (mgr.14613) 308 : cluster 0 pgmap v370: 332 pgs: 2 creating+peering, 6 unknown, 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: audit 2024-02-13T14:51:05.910725+0000 mon.c (mon.2) 501 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]: dispatch 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: cluster 2024-02-13T14:51:06.374253+0000 mon.a (mon.0) 1830 : cluster 0 osdmap e240: 8 total, 8 up, 8 in 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: audit 2024-02-13T14:51:06.378415+0000 mon.a (mon.0) 1831 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]: dispatch 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: cluster 2024-02-13T14:51:06.868174+0000 mon.a (mon.0) 1832 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: cluster 2024-02-13T14:51:06.901545+0000 mon.a (mon.0) 1833 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: audit 2024-02-13T14:51:06.903939+0000 mon.a (mon.0) 1834 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-46", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: audit 2024-02-13T14:51:06.904238+0000 mon.a (mon.0) 1835 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-27", "mode": "writeback"}]': finished 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: cluster 2024-02-13T14:51:06.913691+0000 mon.a (mon.0) 1836 : cluster 0 osdmap e241: 8 total, 8 up, 8 in 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: audit 2024-02-13T14:51:06.917177+0000 mon.c (mon.2) 502 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:07 smithi111 bash[23388]: audit 2024-02-13T14:51:06.918414+0000 mon.a (mon.0) 1837 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:09.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[21479]: cluster 2024-02-13T14:51:07.834023+0000 mgr.y (mgr.14613) 309 : cluster 0 pgmap v373: 332 pgs: 8 unknown, 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:51:09.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[21479]: audit 2024-02-13T14:51:07.906740+0000 mon.a (mon.0) 1838 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:09.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[21479]: cluster 2024-02-13T14:51:07.914683+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-02-13T14:51:09.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[21479]: audit 2024-02-13T14:51:07.916080+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:09.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[21479]: audit 2024-02-13T14:51:07.918232+0000 mon.a (mon.0) 1840 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[21479]: audit 2024-02-13T14:51:07.998617+0000 mon.c (mon.2) 504 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[21479]: audit 2024-02-13T14:51:07.999204+0000 mon.a (mon.0) 1841 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[28859]: cluster 2024-02-13T14:51:07.834023+0000 mgr.y (mgr.14613) 309 : cluster 0 pgmap v373: 332 pgs: 8 unknown, 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[28859]: audit 2024-02-13T14:51:07.906740+0000 mon.a (mon.0) 1838 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[28859]: cluster 2024-02-13T14:51:07.914683+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[28859]: audit 2024-02-13T14:51:07.916080+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[28859]: audit 2024-02-13T14:51:07.918232+0000 mon.a (mon.0) 1840 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[28859]: audit 2024-02-13T14:51:07.998617+0000 mon.c (mon.2) 504 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:09.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:08 smithi062 bash[28859]: audit 2024-02-13T14:51:07.999204+0000 mon.a (mon.0) 1841 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:09.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:08 smithi111 bash[23388]: cluster 2024-02-13T14:51:07.834023+0000 mgr.y (mgr.14613) 309 : cluster 0 pgmap v373: 332 pgs: 8 unknown, 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T14:51:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:08 smithi111 bash[23388]: audit 2024-02-13T14:51:07.906740+0000 mon.a (mon.0) 1838 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:08 smithi111 bash[23388]: cluster 2024-02-13T14:51:07.914683+0000 mon.a (mon.0) 1839 : cluster 0 osdmap e242: 8 total, 8 up, 8 in 2024-02-13T14:51:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:08 smithi111 bash[23388]: audit 2024-02-13T14:51:07.916080+0000 mon.c (mon.2) 503 : audit 1 from='client.? v1:172.21.15.62:0/2862604383' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:08 smithi111 bash[23388]: audit 2024-02-13T14:51:07.918232+0000 mon.a (mon.0) 1840 : audit 1 from='client.46838 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]: dispatch 2024-02-13T14:51:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:08 smithi111 bash[23388]: audit 2024-02-13T14:51:07.998617+0000 mon.c (mon.2) 504 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:08 smithi111 bash[23388]: audit 2024-02-13T14:51:07.999204+0000 mon.a (mon.0) 1841 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:10.263 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.920317+0000 mon.a (mon.0) 1842 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.920524+0000 mon.a (mon.0) 1843 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: cluster 2024-02-13T14:51:08.927462+0000 mon.a (mon.0) 1844 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.928698+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.929688+0000 mon.a (mon.0) 1845 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.932372+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.933024+0000 mon.a (mon.0) 1846 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.974414+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.974814+0000 mon.a (mon.0) 1847 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.975982+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.976286+0000 mon.a (mon.0) 1848 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.976810+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:10.264 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:09 smithi111 bash[23388]: audit 2024-02-13T14:51:08.977133+0000 mon.a (mon.0) 1849 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:10.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.920317+0000 mon.a (mon.0) 1842 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:10.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.920524+0000 mon.a (mon.0) 1843 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: cluster 2024-02-13T14:51:08.927462+0000 mon.a (mon.0) 1844 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.928698+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.929688+0000 mon.a (mon.0) 1845 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.932372+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.933024+0000 mon.a (mon.0) 1846 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.974414+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.974814+0000 mon.a (mon.0) 1847 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.975982+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.976286+0000 mon.a (mon.0) 1848 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.976810+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[28859]: audit 2024-02-13T14:51:08.977133+0000 mon.a (mon.0) 1849 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:10.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.920317+0000 mon.a (mon.0) 1842 : audit 1 from='client.46838 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsync_smithi062-64504-36"}]': finished 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.920524+0000 mon.a (mon.0) 1843 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: cluster 2024-02-13T14:51:08.927462+0000 mon.a (mon.0) 1844 : cluster 0 osdmap e243: 8 total, 8 up, 8 in 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.928698+0000 mon.c (mon.2) 505 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.929688+0000 mon.a (mon.0) 1845 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.932372+0000 mon.c (mon.2) 506 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.933024+0000 mon.a (mon.0) 1846 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.974414+0000 mon.c (mon.2) 507 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.974814+0000 mon.a (mon.0) 1847 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.975982+0000 mon.c (mon.2) 508 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.976286+0000 mon.a (mon.0) 1848 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.976810+0000 mon.c (mon.2) 509 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:09 smithi062 bash[21479]: audit 2024-02-13T14:51:08.977133+0000 mon.a (mon.0) 1849 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:10.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:51:11.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: cluster 2024-02-13T14:51:09.836076+0000 mgr.y (mgr.14613) 310 : cluster 0 pgmap v376: 324 pgs: 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:11.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: cluster 2024-02-13T14:51:09.921270+0000 mon.a (mon.0) 1850 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:11.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: audit 2024-02-13T14:51:09.935156+0000 mon.a (mon.0) 1851 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]': finished 2024-02-13T14:51:11.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: audit 2024-02-13T14:51:09.935404+0000 mon.a (mon.0) 1852 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:11.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: audit 2024-02-13T14:51:09.935536+0000 mon.a (mon.0) 1853 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:11.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: cluster 2024-02-13T14:51:09.941962+0000 mon.a (mon.0) 1854 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: audit 2024-02-13T14:51:09.949571+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: audit 2024-02-13T14:51:09.950024+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: audit 2024-02-13T14:51:09.950718+0000 mon.a (mon.0) 1855 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: audit 2024-02-13T14:51:09.951685+0000 mon.a (mon.0) 1856 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[28859]: audit 2024-02-13T14:51:10.264296+0000 mgr.y (mgr.14613) 311 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: cluster 2024-02-13T14:51:09.836076+0000 mgr.y (mgr.14613) 310 : cluster 0 pgmap v376: 324 pgs: 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: cluster 2024-02-13T14:51:09.921270+0000 mon.a (mon.0) 1850 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: audit 2024-02-13T14:51:09.935156+0000 mon.a (mon.0) 1851 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]': finished 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: audit 2024-02-13T14:51:09.935404+0000 mon.a (mon.0) 1852 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: audit 2024-02-13T14:51:09.935536+0000 mon.a (mon.0) 1853 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: cluster 2024-02-13T14:51:09.941962+0000 mon.a (mon.0) 1854 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: audit 2024-02-13T14:51:09.949571+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: audit 2024-02-13T14:51:09.950024+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: audit 2024-02-13T14:51:09.950718+0000 mon.a (mon.0) 1855 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:11.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: audit 2024-02-13T14:51:09.951685+0000 mon.a (mon.0) 1856 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:11.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:10 smithi062 bash[21479]: audit 2024-02-13T14:51:10.264296+0000 mgr.y (mgr.14613) 311 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: cluster 2024-02-13T14:51:09.836076+0000 mgr.y (mgr.14613) 310 : cluster 0 pgmap v376: 324 pgs: 324 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: cluster 2024-02-13T14:51:09.921270+0000 mon.a (mon.0) 1850 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: audit 2024-02-13T14:51:09.935156+0000 mon.a (mon.0) 1851 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-27"}]': finished 2024-02-13T14:51:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: audit 2024-02-13T14:51:09.935404+0000 mon.a (mon.0) 1852 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: audit 2024-02-13T14:51:09.935536+0000 mon.a (mon.0) 1853 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: cluster 2024-02-13T14:51:09.941962+0000 mon.a (mon.0) 1854 : cluster 0 osdmap e244: 8 total, 8 up, 8 in 2024-02-13T14:51:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: audit 2024-02-13T14:51:09.949571+0000 mon.c (mon.2) 510 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:11.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: audit 2024-02-13T14:51:09.950024+0000 mon.c (mon.2) 511 : audit 1 from='client.? v1:172.21.15.62:0/4277288337' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:11.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: audit 2024-02-13T14:51:09.950718+0000 mon.a (mon.0) 1855 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:11.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: audit 2024-02-13T14:51:09.951685+0000 mon.a (mon.0) 1856 : audit 1 from='client.46844 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]: dispatch 2024-02-13T14:51:11.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:10 smithi111 bash[23388]: audit 2024-02-13T14:51:10.264296+0000 mgr.y (mgr.14613) 311 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: audit 2024-02-13T14:51:10.938989+0000 mon.a (mon.0) 1857 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: audit 2024-02-13T14:51:11.008372+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: cluster 2024-02-13T14:51:11.409510+0000 mon.a (mon.0) 1858 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-02-13T14:51:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: audit 2024-02-13T14:51:11.410962+0000 mon.a (mon.0) 1859 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: audit 2024-02-13T14:51:11.411989+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: audit 2024-02-13T14:51:11.868899+0000 mon.a (mon.0) 1860 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: audit 2024-02-13T14:51:11.870160+0000 mon.c (mon.2) 514 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: cluster 2024-02-13T14:51:11.871785+0000 mon.a (mon.0) 1861 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[21479]: audit 2024-02-13T14:51:11.874629+0000 mon.a (mon.0) 1862 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: audit 2024-02-13T14:51:10.938989+0000 mon.a (mon.0) 1857 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: audit 2024-02-13T14:51:11.008372+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: cluster 2024-02-13T14:51:11.409510+0000 mon.a (mon.0) 1858 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: audit 2024-02-13T14:51:11.410962+0000 mon.a (mon.0) 1859 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: audit 2024-02-13T14:51:11.411989+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: audit 2024-02-13T14:51:11.868899+0000 mon.a (mon.0) 1860 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: audit 2024-02-13T14:51:11.870160+0000 mon.c (mon.2) 514 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: cluster 2024-02-13T14:51:11.871785+0000 mon.a (mon.0) 1861 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:11 smithi062 bash[28859]: audit 2024-02-13T14:51:11.874629+0000 mon.a (mon.0) 1862 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:12.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: audit 2024-02-13T14:51:10.938989+0000 mon.a (mon.0) 1857 : audit 1 from='client.46844 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-46"}]': finished 2024-02-13T14:51:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: audit 2024-02-13T14:51:11.008372+0000 mon.c (mon.2) 512 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: cluster 2024-02-13T14:51:11.409510+0000 mon.a (mon.0) 1858 : cluster 0 osdmap e245: 8 total, 8 up, 8 in 2024-02-13T14:51:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: audit 2024-02-13T14:51:11.410962+0000 mon.a (mon.0) 1859 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: audit 2024-02-13T14:51:11.411989+0000 mon.c (mon.2) 513 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: audit 2024-02-13T14:51:11.868899+0000 mon.a (mon.0) 1860 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: audit 2024-02-13T14:51:11.870160+0000 mon.c (mon.2) 514 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: cluster 2024-02-13T14:51:11.871785+0000 mon.a (mon.0) 1861 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:11 smithi111 bash[23388]: audit 2024-02-13T14:51:11.874629+0000 mon.a (mon.0) 1862 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:13.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[21479]: cluster 2024-02-13T14:51:11.836890+0000 mgr.y (mgr.14613) 312 : cluster 0 pgmap v379: 292 pgs: 292 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:13.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[21479]: audit 2024-02-13T14:51:11.950824+0000 mon.a (mon.0) 1863 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:13.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[21479]: audit 2024-02-13T14:51:11.951051+0000 mon.a (mon.0) 1864 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:13.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[21479]: audit 2024-02-13T14:51:11.976150+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:13.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[21479]: cluster 2024-02-13T14:51:11.984240+0000 mon.a (mon.0) 1865 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[21479]: audit 2024-02-13T14:51:11.989236+0000 mon.a (mon.0) 1866 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[21479]: audit 2024-02-13T14:51:11.991924+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[21479]: audit 2024-02-13T14:51:11.992727+0000 mon.a (mon.0) 1867 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[28859]: cluster 2024-02-13T14:51:11.836890+0000 mgr.y (mgr.14613) 312 : cluster 0 pgmap v379: 292 pgs: 292 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[28859]: audit 2024-02-13T14:51:11.950824+0000 mon.a (mon.0) 1863 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[28859]: audit 2024-02-13T14:51:11.951051+0000 mon.a (mon.0) 1864 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[28859]: audit 2024-02-13T14:51:11.976150+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[28859]: cluster 2024-02-13T14:51:11.984240+0000 mon.a (mon.0) 1865 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[28859]: audit 2024-02-13T14:51:11.989236+0000 mon.a (mon.0) 1866 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:13.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[28859]: audit 2024-02-13T14:51:11.991924+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:13.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:13 smithi062 bash[28859]: audit 2024-02-13T14:51:11.992727+0000 mon.a (mon.0) 1867 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:13 smithi111 bash[23388]: cluster 2024-02-13T14:51:11.836890+0000 mgr.y (mgr.14613) 312 : cluster 0 pgmap v379: 292 pgs: 292 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:13 smithi111 bash[23388]: audit 2024-02-13T14:51:11.950824+0000 mon.a (mon.0) 1863 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFull_smithi062-64504-37", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:13 smithi111 bash[23388]: audit 2024-02-13T14:51:11.951051+0000 mon.a (mon.0) 1864 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleWritePP_smithi062-64512-47", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:13 smithi111 bash[23388]: audit 2024-02-13T14:51:11.976150+0000 mon.c (mon.2) 515 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:13 smithi111 bash[23388]: cluster 2024-02-13T14:51:11.984240+0000 mon.a (mon.0) 1865 : cluster 0 osdmap e246: 8 total, 8 up, 8 in 2024-02-13T14:51:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:13 smithi111 bash[23388]: audit 2024-02-13T14:51:11.989236+0000 mon.a (mon.0) 1866 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:13 smithi111 bash[23388]: audit 2024-02-13T14:51:11.991924+0000 mon.c (mon.2) 516 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:13.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:13 smithi111 bash[23388]: audit 2024-02-13T14:51:11.992727+0000 mon.a (mon.0) 1867 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[28859]: audit 2024-02-13T14:51:12.954964+0000 mon.a (mon.0) 1868 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[28859]: cluster 2024-02-13T14:51:13.429460+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-02-13T14:51:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[28859]: cluster 2024-02-13T14:51:13.837830+0000 mgr.y (mgr.14613) 313 : cluster 0 pgmap v382: 332 pgs: 40 unknown, 292 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-02-13T14:51:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[28859]: audit 2024-02-13T14:51:13.958147+0000 mon.a (mon.0) 1870 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:14.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[28859]: cluster 2024-02-13T14:51:13.967786+0000 mon.a (mon.0) 1871 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[28859]: audit 2024-02-13T14:51:13.973091+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[28859]: audit 2024-02-13T14:51:13.974360+0000 mon.a (mon.0) 1872 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[21479]: audit 2024-02-13T14:51:12.954964+0000 mon.a (mon.0) 1868 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[21479]: cluster 2024-02-13T14:51:13.429460+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[21479]: cluster 2024-02-13T14:51:13.837830+0000 mgr.y (mgr.14613) 313 : cluster 0 pgmap v382: 332 pgs: 40 unknown, 292 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[21479]: audit 2024-02-13T14:51:13.958147+0000 mon.a (mon.0) 1870 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[21479]: cluster 2024-02-13T14:51:13.967786+0000 mon.a (mon.0) 1871 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[21479]: audit 2024-02-13T14:51:13.973091+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:14 smithi062 bash[21479]: audit 2024-02-13T14:51:13.974360+0000 mon.a (mon.0) 1872 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:14 smithi111 bash[23388]: audit 2024-02-13T14:51:12.954964+0000 mon.a (mon.0) 1868 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-29","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:14 smithi111 bash[23388]: cluster 2024-02-13T14:51:13.429460+0000 mon.a (mon.0) 1869 : cluster 0 osdmap e247: 8 total, 8 up, 8 in 2024-02-13T14:51:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:14 smithi111 bash[23388]: cluster 2024-02-13T14:51:13.837830+0000 mgr.y (mgr.14613) 313 : cluster 0 pgmap v382: 332 pgs: 40 unknown, 292 active+clean; 584 KiB data, 589 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 op/s 2024-02-13T14:51:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:14 smithi111 bash[23388]: audit 2024-02-13T14:51:13.958147+0000 mon.a (mon.0) 1870 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleWritePP_smithi062-64512-47", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:14 smithi111 bash[23388]: cluster 2024-02-13T14:51:13.967786+0000 mon.a (mon.0) 1871 : cluster 0 osdmap e248: 8 total, 8 up, 8 in 2024-02-13T14:51:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:14 smithi111 bash[23388]: audit 2024-02-13T14:51:13.973091+0000 mon.c (mon.2) 517 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:14 smithi111 bash[23388]: audit 2024-02-13T14:51:13.974360+0000 mon.a (mon.0) 1872 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:16.224 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[28859]: audit 2024-02-13T14:51:14.961295+0000 mon.a (mon.0) 1873 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:16.224 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[28859]: cluster 2024-02-13T14:51:14.969661+0000 mon.a (mon.0) 1874 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[28859]: audit 2024-02-13T14:51:14.974892+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[28859]: audit 2024-02-13T14:51:14.976125+0000 mon.a (mon.0) 1875 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[28859]: audit 2024-02-13T14:51:15.013453+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[28859]: audit 2024-02-13T14:51:15.014269+0000 mon.a (mon.0) 1876 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[21479]: audit 2024-02-13T14:51:14.961295+0000 mon.a (mon.0) 1873 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[21479]: cluster 2024-02-13T14:51:14.969661+0000 mon.a (mon.0) 1874 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[21479]: audit 2024-02-13T14:51:14.974892+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[21479]: audit 2024-02-13T14:51:14.976125+0000 mon.a (mon.0) 1875 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[21479]: audit 2024-02-13T14:51:15.013453+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:16.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:15 smithi062 bash[21479]: audit 2024-02-13T14:51:15.014269+0000 mon.a (mon.0) 1876 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:16.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:15 smithi111 bash[23388]: audit 2024-02-13T14:51:14.961295+0000 mon.a (mon.0) 1873 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:15 smithi111 bash[23388]: cluster 2024-02-13T14:51:14.969661+0000 mon.a (mon.0) 1874 : cluster 0 osdmap e249: 8 total, 8 up, 8 in 2024-02-13T14:51:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:15 smithi111 bash[23388]: audit 2024-02-13T14:51:14.974892+0000 mon.c (mon.2) 518 : audit 1 from='client.? v1:172.21.15.62:0/3980135185' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:15 smithi111 bash[23388]: audit 2024-02-13T14:51:14.976125+0000 mon.a (mon.0) 1875 : audit 1 from='client.46850 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]: dispatch 2024-02-13T14:51:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:15 smithi111 bash[23388]: audit 2024-02-13T14:51:15.013453+0000 mon.c (mon.2) 519 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:16.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:15 smithi111 bash[23388]: audit 2024-02-13T14:51:15.014269+0000 mon.a (mon.0) 1876 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:16.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:51:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:51:17.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: cluster 2024-02-13T14:51:15.838828+0000 mgr.y (mgr.14613) 314 : cluster 0 pgmap v385: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:15.971337+0000 mon.a (mon.0) 1877 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:15.971581+0000 mon.a (mon.0) 1878 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: cluster 2024-02-13T14:51:15.980813+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:15.982635+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:15.984701+0000 mon.a (mon.0) 1880 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:15.990610+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:15.991315+0000 mon.a (mon.0) 1881 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.004800+0000 mon.c (mon.2) 522 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.005142+0000 mon.a (mon.0) 1882 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.006281+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.006619+0000 mon.a (mon.0) 1883 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.007148+0000 mon.c (mon.2) 524 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.007477+0000 mon.a (mon.0) 1884 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: cluster 2024-02-13T14:51:16.873964+0000 mon.a (mon.0) 1885 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: cluster 2024-02-13T14:51:15.838828+0000 mgr.y (mgr.14613) 314 : cluster 0 pgmap v385: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:15.971337+0000 mon.a (mon.0) 1877 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:15.971581+0000 mon.a (mon.0) 1878 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: cluster 2024-02-13T14:51:15.980813+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:15.982635+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:15.984701+0000 mon.a (mon.0) 1880 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:15.990610+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:15.991315+0000 mon.a (mon.0) 1881 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.004800+0000 mon.c (mon.2) 522 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.005142+0000 mon.a (mon.0) 1882 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.006281+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.006619+0000 mon.a (mon.0) 1883 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.007148+0000 mon.c (mon.2) 524 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:17.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.007477+0000 mon.a (mon.0) 1884 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:17.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: cluster 2024-02-13T14:51:16.873964+0000 mon.a (mon.0) 1885 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:17.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.877746+0000 mon.a (mon.0) 1886 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]': finished 2024-02-13T14:51:17.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.877958+0000 mon.a (mon.0) 1887 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:17.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.878170+0000 mon.a (mon.0) 1888 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: cluster 2024-02-13T14:51:16.886802+0000 mon.a (mon.0) 1889 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.888894+0000 mon.c (mon.2) 525 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]: dispatch 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.889680+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.890467+0000 mon.a (mon.0) 1890 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]: dispatch 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.890664+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.892495+0000 mon.a (mon.0) 1891 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[21479]: audit 2024-02-13T14:51:16.893986+0000 mon.a (mon.0) 1892 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.877746+0000 mon.a (mon.0) 1886 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]': finished 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.877958+0000 mon.a (mon.0) 1887 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.878170+0000 mon.a (mon.0) 1888 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: cluster 2024-02-13T14:51:16.886802+0000 mon.a (mon.0) 1889 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-02-13T14:51:17.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.888894+0000 mon.c (mon.2) 525 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]: dispatch 2024-02-13T14:51:17.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.889680+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.890467+0000 mon.a (mon.0) 1890 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]: dispatch 2024-02-13T14:51:17.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.890664+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.892495+0000 mon.a (mon.0) 1891 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:16 smithi062 bash[28859]: audit 2024-02-13T14:51:16.893986+0000 mon.a (mon.0) 1892 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: cluster 2024-02-13T14:51:15.838828+0000 mgr.y (mgr.14613) 314 : cluster 0 pgmap v385: 332 pgs: 8 creating+peering, 324 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1024 KiB/s wr, 1 op/s 2024-02-13T14:51:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:15.971337+0000 mon.a (mon.0) 1877 : audit 1 from='client.46850 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFull_smithi062-64504-37"}]': finished 2024-02-13T14:51:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:15.971581+0000 mon.a (mon.0) 1878 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: cluster 2024-02-13T14:51:15.980813+0000 mon.a (mon.0) 1879 : cluster 0 osdmap e250: 8 total, 8 up, 8 in 2024-02-13T14:51:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:15.982635+0000 mon.c (mon.2) 520 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:15.984701+0000 mon.a (mon.0) 1880 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:15.990610+0000 mon.c (mon.2) 521 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:15.991315+0000 mon.a (mon.0) 1881 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.004800+0000 mon.c (mon.2) 522 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.005142+0000 mon.a (mon.0) 1882 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.006281+0000 mon.c (mon.2) 523 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.006619+0000 mon.a (mon.0) 1883 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.007148+0000 mon.c (mon.2) 524 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.007477+0000 mon.a (mon.0) 1884 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: cluster 2024-02-13T14:51:16.873964+0000 mon.a (mon.0) 1885 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.877746+0000 mon.a (mon.0) 1886 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-29"}]': finished 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.877958+0000 mon.a (mon.0) 1887 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.878170+0000 mon.a (mon.0) 1888 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStat_smithi062-64504-38", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: cluster 2024-02-13T14:51:16.886802+0000 mon.a (mon.0) 1889 : cluster 0 osdmap e251: 8 total, 8 up, 8 in 2024-02-13T14:51:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.888894+0000 mon.c (mon.2) 525 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]: dispatch 2024-02-13T14:51:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.889680+0000 mon.c (mon.2) 526 : audit 1 from='client.? v1:172.21.15.62:0/3332034889' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.890467+0000 mon.a (mon.0) 1890 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]: dispatch 2024-02-13T14:51:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.890664+0000 mon.c (mon.2) 527 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.892495+0000 mon.a (mon.0) 1891 : audit 1 from='client.46856 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]: dispatch 2024-02-13T14:51:17.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:16 smithi111 bash[23388]: audit 2024-02-13T14:51:16.893986+0000 mon.a (mon.0) 1892 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:18.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:18 smithi062 bash[28859]: audit 2024-02-13T14:51:17.541758+0000 mon.b (mon.1) 188 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:18.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:18 smithi062 bash[28859]: cluster 2024-02-13T14:51:17.878833+0000 mon.a (mon.0) 1893 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:18.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:18 smithi062 bash[28859]: audit 2024-02-13T14:51:17.881256+0000 mon.a (mon.0) 1894 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]': finished 2024-02-13T14:51:18.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:18 smithi062 bash[21479]: audit 2024-02-13T14:51:17.541758+0000 mon.b (mon.1) 188 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:18.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:18 smithi062 bash[21479]: cluster 2024-02-13T14:51:17.878833+0000 mon.a (mon.0) 1893 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:18.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:18 smithi062 bash[21479]: audit 2024-02-13T14:51:17.881256+0000 mon.a (mon.0) 1894 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]': finished 2024-02-13T14:51:18.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:18 smithi111 bash[23388]: audit 2024-02-13T14:51:17.541758+0000 mon.b (mon.1) 188 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:18.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:18 smithi111 bash[23388]: cluster 2024-02-13T14:51:17.878833+0000 mon.a (mon.0) 1893 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:18.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:18 smithi111 bash[23388]: audit 2024-02-13T14:51:17.881256+0000 mon.a (mon.0) 1894 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-29", "mode": "writeback"}]': finished 2024-02-13T14:51:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: cluster 2024-02-13T14:51:17.839887+0000 mgr.y (mgr.14613) 315 : cluster 0 pgmap v388: 324 pgs: 324 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-02-13T14:51:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:17.881417+0000 mon.a (mon.0) 1895 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:17.949626+0000 mon.c (mon.2) 528 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: cluster 2024-02-13T14:51:18.383519+0000 mon.a (mon.0) 1896 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-02-13T14:51:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.387326+0000 mon.a (mon.0) 1897 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.389340+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.395424+0000 mon.a (mon.0) 1898 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.396186+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.406095+0000 mon.a (mon.0) 1899 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.890698+0000 mon.a (mon.0) 1900 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.890956+0000 mon.a (mon.0) 1901 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: cluster 2024-02-13T14:51:18.898567+0000 mon.a (mon.0) 1902 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.901977+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[21479]: audit 2024-02-13T14:51:18.903554+0000 mon.a (mon.0) 1903 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: cluster 2024-02-13T14:51:17.839887+0000 mgr.y (mgr.14613) 315 : cluster 0 pgmap v388: 324 pgs: 324 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:17.881417+0000 mon.a (mon.0) 1895 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:17.949626+0000 mon.c (mon.2) 528 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: cluster 2024-02-13T14:51:18.383519+0000 mon.a (mon.0) 1896 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.387326+0000 mon.a (mon.0) 1897 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.389340+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.395424+0000 mon.a (mon.0) 1898 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.396186+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.406095+0000 mon.a (mon.0) 1899 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.890698+0000 mon.a (mon.0) 1900 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.890956+0000 mon.a (mon.0) 1901 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: cluster 2024-02-13T14:51:18.898567+0000 mon.a (mon.0) 1902 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.901977+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:19 smithi062 bash[28859]: audit 2024-02-13T14:51:18.903554+0000 mon.a (mon.0) 1903 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: cluster 2024-02-13T14:51:17.839887+0000 mgr.y (mgr.14613) 315 : cluster 0 pgmap v388: 324 pgs: 324 active+clean; 4.6 MiB data, 602 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 KiB/s wr, 1 op/s 2024-02-13T14:51:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:17.881417+0000 mon.a (mon.0) 1895 : audit 1 from='client.46856 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleWritePP_smithi062-64512-47"}]': finished 2024-02-13T14:51:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:17.949626+0000 mon.c (mon.2) 528 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: cluster 2024-02-13T14:51:18.383519+0000 mon.a (mon.0) 1896 : cluster 0 osdmap e252: 8 total, 8 up, 8 in 2024-02-13T14:51:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.387326+0000 mon.a (mon.0) 1897 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.389340+0000 mon.c (mon.2) 529 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.395424+0000 mon.a (mon.0) 1898 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.396186+0000 mon.c (mon.2) 530 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.406095+0000 mon.a (mon.0) 1899 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.890698+0000 mon.a (mon.0) 1900 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStat_smithi062-64504-38", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.890956+0000 mon.a (mon.0) 1901 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-WaitForSafePP_smithi062-64512-48", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: cluster 2024-02-13T14:51:18.898567+0000 mon.a (mon.0) 1902 : cluster 0 osdmap e253: 8 total, 8 up, 8 in 2024-02-13T14:51:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.901977+0000 mon.c (mon.2) 531 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:19 smithi111 bash[23388]: audit 2024-02-13T14:51:18.903554+0000 mon.a (mon.0) 1903 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:20.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:51:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:51:21.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:20 smithi062 bash[21479]: cluster 2024-02-13T14:51:19.842066+0000 mgr.y (mgr.14613) 316 : cluster 0 pgmap v391: 332 pgs: 4 creating+peering, 4 unknown, 324 active+clean; 8.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 255 B/s wr, 26 op/s 2024-02-13T14:51:21.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:20 smithi062 bash[21479]: audit 2024-02-13T14:51:20.269309+0000 mgr.y (mgr.14613) 317 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:21.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:20 smithi062 bash[21479]: cluster 2024-02-13T14:51:20.363479+0000 mon.a (mon.0) 1904 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-02-13T14:51:21.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:20 smithi062 bash[28859]: cluster 2024-02-13T14:51:19.842066+0000 mgr.y (mgr.14613) 316 : cluster 0 pgmap v391: 332 pgs: 4 creating+peering, 4 unknown, 324 active+clean; 8.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 255 B/s wr, 26 op/s 2024-02-13T14:51:21.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:20 smithi062 bash[28859]: audit 2024-02-13T14:51:20.269309+0000 mgr.y (mgr.14613) 317 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:21.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:20 smithi062 bash[28859]: cluster 2024-02-13T14:51:20.363479+0000 mon.a (mon.0) 1904 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-02-13T14:51:21.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:20 smithi111 bash[23388]: cluster 2024-02-13T14:51:19.842066+0000 mgr.y (mgr.14613) 316 : cluster 0 pgmap v391: 332 pgs: 4 creating+peering, 4 unknown, 324 active+clean; 8.6 MiB data, 610 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 255 B/s wr, 26 op/s 2024-02-13T14:51:21.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:20 smithi111 bash[23388]: audit 2024-02-13T14:51:20.269309+0000 mgr.y (mgr.14613) 317 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:21.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:20 smithi111 bash[23388]: cluster 2024-02-13T14:51:20.363479+0000 mon.a (mon.0) 1904 : cluster 0 osdmap e254: 8 total, 8 up, 8 in 2024-02-13T14:51:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:20.897857+0000 mon.a (mon.0) 1905 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: cluster 2024-02-13T14:51:20.907623+0000 mon.a (mon.0) 1906 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-02-13T14:51:22.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:20.916829+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:20.928447+0000 mon.a (mon.0) 1907 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:21.008364+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:21.008974+0000 mon.a (mon.0) 1908 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:21.901024+0000 mon.a (mon.0) 1909 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:21.901233+0000 mon.a (mon.0) 1910 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: cluster 2024-02-13T14:51:21.909740+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:21.916004+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:21.916824+0000 mon.c (mon.2) 535 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:21.919433+0000 mon.a (mon.0) 1912 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[21479]: audit 2024-02-13T14:51:21.920154+0000 mon.a (mon.0) 1913 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:20.897857+0000 mon.a (mon.0) 1905 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: cluster 2024-02-13T14:51:20.907623+0000 mon.a (mon.0) 1906 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-02-13T14:51:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:20.916829+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:20.928447+0000 mon.a (mon.0) 1907 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:21.008364+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:21.008974+0000 mon.a (mon.0) 1908 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:21.901024+0000 mon.a (mon.0) 1909 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:21.901233+0000 mon.a (mon.0) 1910 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: cluster 2024-02-13T14:51:21.909740+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:21.916004+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:21.916824+0000 mon.c (mon.2) 535 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:21.919433+0000 mon.a (mon.0) 1912 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:22.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:21 smithi062 bash[28859]: audit 2024-02-13T14:51:21.920154+0000 mon.a (mon.0) 1913 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:20.897857+0000 mon.a (mon.0) 1905 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "WaitForSafePP_smithi062-64512-48", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: cluster 2024-02-13T14:51:20.907623+0000 mon.a (mon.0) 1906 : cluster 0 osdmap e255: 8 total, 8 up, 8 in 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:20.916829+0000 mon.c (mon.2) 532 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:20.928447+0000 mon.a (mon.0) 1907 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:21.008364+0000 mon.c (mon.2) 533 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:21.008974+0000 mon.a (mon.0) 1908 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:21.901024+0000 mon.a (mon.0) 1909 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:21.901233+0000 mon.a (mon.0) 1910 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: cluster 2024-02-13T14:51:21.909740+0000 mon.a (mon.0) 1911 : cluster 0 osdmap e256: 8 total, 8 up, 8 in 2024-02-13T14:51:22.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:21.916004+0000 mon.c (mon.2) 534 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:21.916824+0000 mon.c (mon.2) 535 : audit 1 from='client.? v1:172.21.15.62:0/108853910' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:21.919433+0000 mon.a (mon.0) 1912 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]: dispatch 2024-02-13T14:51:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:21 smithi111 bash[23388]: audit 2024-02-13T14:51:21.920154+0000 mon.a (mon.0) 1913 : audit 1 from='client.46862 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]: dispatch 2024-02-13T14:51:23.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[21479]: cluster 2024-02-13T14:51:21.843068+0000 mgr.y (mgr.14613) 318 : cluster 0 pgmap v394: 332 pgs: 8 unknown, 324 active+clean; 8.6 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 255 B/s wr, 26 op/s 2024-02-13T14:51:23.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[21479]: cluster 2024-02-13T14:51:22.902273+0000 mon.a (mon.0) 1914 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:23.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[21479]: audit 2024-02-13T14:51:22.904795+0000 mon.a (mon.0) 1915 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]': finished 2024-02-13T14:51:23.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[21479]: audit 2024-02-13T14:51:22.904975+0000 mon.a (mon.0) 1916 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:23.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[21479]: cluster 2024-02-13T14:51:22.912946+0000 mon.a (mon.0) 1917 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-02-13T14:51:23.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[21479]: audit 2024-02-13T14:51:22.918431+0000 mon.c (mon.2) 536 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[21479]: audit 2024-02-13T14:51:22.920149+0000 mon.a (mon.0) 1918 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[28859]: cluster 2024-02-13T14:51:21.843068+0000 mgr.y (mgr.14613) 318 : cluster 0 pgmap v394: 332 pgs: 8 unknown, 324 active+clean; 8.6 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 255 B/s wr, 26 op/s 2024-02-13T14:51:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[28859]: cluster 2024-02-13T14:51:22.902273+0000 mon.a (mon.0) 1914 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[28859]: audit 2024-02-13T14:51:22.904795+0000 mon.a (mon.0) 1915 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]': finished 2024-02-13T14:51:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[28859]: audit 2024-02-13T14:51:22.904975+0000 mon.a (mon.0) 1916 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[28859]: cluster 2024-02-13T14:51:22.912946+0000 mon.a (mon.0) 1917 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-02-13T14:51:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[28859]: audit 2024-02-13T14:51:22.918431+0000 mon.c (mon.2) 536 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:22 smithi062 bash[28859]: audit 2024-02-13T14:51:22.920149+0000 mon.a (mon.0) 1918 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:23.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:22 smithi111 bash[23388]: cluster 2024-02-13T14:51:21.843068+0000 mgr.y (mgr.14613) 318 : cluster 0 pgmap v394: 332 pgs: 8 unknown, 324 active+clean; 8.6 MiB data, 615 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 255 B/s wr, 26 op/s 2024-02-13T14:51:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:22 smithi111 bash[23388]: cluster 2024-02-13T14:51:22.902273+0000 mon.a (mon.0) 1914 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:22 smithi111 bash[23388]: audit 2024-02-13T14:51:22.904795+0000 mon.a (mon.0) 1915 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-29"}]': finished 2024-02-13T14:51:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:22 smithi111 bash[23388]: audit 2024-02-13T14:51:22.904975+0000 mon.a (mon.0) 1916 : audit 1 from='client.46862 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStat_smithi062-64504-38"}]': finished 2024-02-13T14:51:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:22 smithi111 bash[23388]: cluster 2024-02-13T14:51:22.912946+0000 mon.a (mon.0) 1917 : cluster 0 osdmap e257: 8 total, 8 up, 8 in 2024-02-13T14:51:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:22 smithi111 bash[23388]: audit 2024-02-13T14:51:22.918431+0000 mon.c (mon.2) 536 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:22 smithi111 bash[23388]: audit 2024-02-13T14:51:22.920149+0000 mon.a (mon.0) 1918 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:24.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: audit 2024-02-13T14:51:22.966863+0000 mon.a (mon.0) 1919 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: audit 2024-02-13T14:51:22.968384+0000 mon.a (mon.0) 1920 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: audit 2024-02-13T14:51:22.968788+0000 mon.a (mon.0) 1921 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi062-64504-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: audit 2024-02-13T14:51:23.907515+0000 mon.a (mon.0) 1922 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: audit 2024-02-13T14:51:23.907740+0000 mon.a (mon.0) 1923 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi062-64504-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: cluster 2024-02-13T14:51:23.914484+0000 mon.a (mon.0) 1924 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: audit 2024-02-13T14:51:23.918005+0000 mon.c (mon.2) 537 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: audit 2024-02-13T14:51:23.920883+0000 mon.a (mon.0) 1925 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi062-64504-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[21479]: audit 2024-02-13T14:51:23.923042+0000 mon.a (mon.0) 1926 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: audit 2024-02-13T14:51:22.966863+0000 mon.a (mon.0) 1919 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: audit 2024-02-13T14:51:22.968384+0000 mon.a (mon.0) 1920 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: audit 2024-02-13T14:51:22.968788+0000 mon.a (mon.0) 1921 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi062-64504-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: audit 2024-02-13T14:51:23.907515+0000 mon.a (mon.0) 1922 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: audit 2024-02-13T14:51:23.907740+0000 mon.a (mon.0) 1923 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi062-64504-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: cluster 2024-02-13T14:51:23.914484+0000 mon.a (mon.0) 1924 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-02-13T14:51:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: audit 2024-02-13T14:51:23.918005+0000 mon.c (mon.2) 537 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: audit 2024-02-13T14:51:23.920883+0000 mon.a (mon.0) 1925 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi062-64504-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:24 smithi062 bash[28859]: audit 2024-02-13T14:51:23.923042+0000 mon.a (mon.0) 1926 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: audit 2024-02-13T14:51:22.966863+0000 mon.a (mon.0) 1919 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: audit 2024-02-13T14:51:22.968384+0000 mon.a (mon.0) 1920 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: audit 2024-02-13T14:51:22.968788+0000 mon.a (mon.0) 1921 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi062-64504-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: audit 2024-02-13T14:51:23.907515+0000 mon.a (mon.0) 1922 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: audit 2024-02-13T14:51:23.907740+0000 mon.a (mon.0) 1923 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatNS_smithi062-64504-39", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: cluster 2024-02-13T14:51:23.914484+0000 mon.a (mon.0) 1924 : cluster 0 osdmap e258: 8 total, 8 up, 8 in 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: audit 2024-02-13T14:51:23.918005+0000 mon.c (mon.2) 537 : audit 1 from='client.? v1:172.21.15.62:0/3392024596' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: audit 2024-02-13T14:51:23.920883+0000 mon.a (mon.0) 1925 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi062-64504-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:24 smithi111 bash[23388]: audit 2024-02-13T14:51:23.923042+0000 mon.a (mon.0) 1926 : audit 1 from='client.46868 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]: dispatch 2024-02-13T14:51:25.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: cluster 2024-02-13T14:51:23.843992+0000 mgr.y (mgr.14613) 319 : cluster 0 pgmap v397: 324 pgs: 324 active+clean; 8.6 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: cluster 2024-02-13T14:51:24.381652+0000 mon.a (mon.0) 1927 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: audit 2024-02-13T14:51:24.911139+0000 mon.a (mon.0) 1928 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: audit 2024-02-13T14:51:24.952620+0000 mon.c (mon.2) 538 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: cluster 2024-02-13T14:51:25.377115+0000 mon.a (mon.0) 1929 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: audit 2024-02-13T14:51:25.378796+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: audit 2024-02-13T14:51:25.378971+0000 mon.a (mon.0) 1930 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: audit 2024-02-13T14:51:25.379876+0000 mon.a (mon.0) 1931 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: audit 2024-02-13T14:51:25.379926+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[21479]: audit 2024-02-13T14:51:25.381805+0000 mon.a (mon.0) 1932 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: cluster 2024-02-13T14:51:23.843992+0000 mgr.y (mgr.14613) 319 : cluster 0 pgmap v397: 324 pgs: 324 active+clean; 8.6 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: cluster 2024-02-13T14:51:24.381652+0000 mon.a (mon.0) 1927 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: audit 2024-02-13T14:51:24.911139+0000 mon.a (mon.0) 1928 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: audit 2024-02-13T14:51:24.952620+0000 mon.c (mon.2) 538 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: cluster 2024-02-13T14:51:25.377115+0000 mon.a (mon.0) 1929 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: audit 2024-02-13T14:51:25.378796+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: audit 2024-02-13T14:51:25.378971+0000 mon.a (mon.0) 1930 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: audit 2024-02-13T14:51:25.379876+0000 mon.a (mon.0) 1931 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: audit 2024-02-13T14:51:25.379926+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:25 smithi062 bash[28859]: audit 2024-02-13T14:51:25.381805+0000 mon.a (mon.0) 1932 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: cluster 2024-02-13T14:51:23.843992+0000 mgr.y (mgr.14613) 319 : cluster 0 pgmap v397: 324 pgs: 324 active+clean; 8.6 MiB data, 615 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: cluster 2024-02-13T14:51:24.381652+0000 mon.a (mon.0) 1927 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: audit 2024-02-13T14:51:24.911139+0000 mon.a (mon.0) 1928 : audit 1 from='client.46868 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"WaitForSafePP_smithi062-64512-48"}]': finished 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: audit 2024-02-13T14:51:24.952620+0000 mon.c (mon.2) 538 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: cluster 2024-02-13T14:51:25.377115+0000 mon.a (mon.0) 1929 : cluster 0 osdmap e259: 8 total, 8 up, 8 in 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: audit 2024-02-13T14:51:25.378796+0000 mon.c (mon.2) 539 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: audit 2024-02-13T14:51:25.378971+0000 mon.a (mon.0) 1930 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: audit 2024-02-13T14:51:25.379876+0000 mon.a (mon.0) 1931 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: audit 2024-02-13T14:51:25.379926+0000 mon.c (mon.2) 540 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:25 smithi111 bash[23388]: audit 2024-02-13T14:51:25.381805+0000 mon.a (mon.0) 1932 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:26.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:51:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:51:26.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.382904+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:26.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.384076+0000 mon.a (mon.0) 1933 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:26.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: cluster 2024-02-13T14:51:25.845750+0000 mgr.y (mgr.14613) 320 : cluster 0 pgmap v400: 324 pgs: 8 creating+peering, 24 unknown, 292 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.914476+0000 mon.a (mon.0) 1934 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi062-64504-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.914701+0000 mon.a (mon.0) 1935 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.914894+0000 mon.a (mon.0) 1936 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.924210+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: cluster 2024-02-13T14:51:25.924772+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.938535+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.940867+0000 mon.a (mon.0) 1938 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[21479]: audit 2024-02-13T14:51:25.941526+0000 mon.a (mon.0) 1939 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.382904+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:26.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.384076+0000 mon.a (mon.0) 1933 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: cluster 2024-02-13T14:51:25.845750+0000 mgr.y (mgr.14613) 320 : cluster 0 pgmap v400: 324 pgs: 8 creating+peering, 24 unknown, 292 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.914476+0000 mon.a (mon.0) 1934 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi062-64504-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.914701+0000 mon.a (mon.0) 1935 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.914894+0000 mon.a (mon.0) 1936 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.924210+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: cluster 2024-02-13T14:51:25.924772+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.938535+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.940867+0000 mon.a (mon.0) 1938 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:26 smithi062 bash[28859]: audit 2024-02-13T14:51:25.941526+0000 mon.a (mon.0) 1939 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:26.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.382904+0000 mon.c (mon.2) 541 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:26.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.384076+0000 mon.a (mon.0) 1933 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:26.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: cluster 2024-02-13T14:51:25.845750+0000 mgr.y (mgr.14613) 320 : cluster 0 pgmap v400: 324 pgs: 8 creating+peering, 24 unknown, 292 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:26.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.914476+0000 mon.a (mon.0) 1934 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatNS_smithi062-64504-39", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:26.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.914701+0000 mon.a (mon.0) 1935 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-31","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:26.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.914894+0000 mon.a (mon.0) 1936 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP_smithi062-64512-49", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.924210+0000 mon.c (mon.2) 542 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: cluster 2024-02-13T14:51:25.924772+0000 mon.a (mon.0) 1937 : cluster 0 osdmap e260: 8 total, 8 up, 8 in 2024-02-13T14:51:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.938535+0000 mon.c (mon.2) 543 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.940867+0000 mon.a (mon.0) 1938 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:26 smithi111 bash[23388]: audit 2024-02-13T14:51:25.941526+0000 mon.a (mon.0) 1939 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:28.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[21479]: audit 2024-02-13T14:51:26.882677+0000 mon.a (mon.0) 1940 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:28.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[21479]: audit 2024-02-13T14:51:26.900987+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:28.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[21479]: audit 2024-02-13T14:51:27.131298+0000 mon.b (mon.1) 189 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:51:28.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[21479]: cluster 2024-02-13T14:51:27.350135+0000 mon.a (mon.0) 1941 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-02-13T14:51:28.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[21479]: audit 2024-02-13T14:51:27.351149+0000 mon.a (mon.0) 1942 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[28859]: audit 2024-02-13T14:51:26.882677+0000 mon.a (mon.0) 1940 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[28859]: audit 2024-02-13T14:51:26.900987+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[28859]: audit 2024-02-13T14:51:27.131298+0000 mon.b (mon.1) 189 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:51:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[28859]: cluster 2024-02-13T14:51:27.350135+0000 mon.a (mon.0) 1941 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-02-13T14:51:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:27 smithi062 bash[28859]: audit 2024-02-13T14:51:27.351149+0000 mon.a (mon.0) 1942 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:28.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:27 smithi111 bash[23388]: audit 2024-02-13T14:51:26.882677+0000 mon.a (mon.0) 1940 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:28.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:27 smithi111 bash[23388]: audit 2024-02-13T14:51:26.900987+0000 mon.c (mon.2) 544 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:28.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:27 smithi111 bash[23388]: audit 2024-02-13T14:51:27.131298+0000 mon.b (mon.1) 189 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:51:28.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:27 smithi111 bash[23388]: cluster 2024-02-13T14:51:27.350135+0000 mon.a (mon.0) 1941 : cluster 0 osdmap e261: 8 total, 8 up, 8 in 2024-02-13T14:51:28.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:27 smithi111 bash[23388]: audit 2024-02-13T14:51:27.351149+0000 mon.a (mon.0) 1942 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:29.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: cluster 2024-02-13T14:51:27.846707+0000 mgr.y (mgr.14613) 321 : cluster 0 pgmap v403: 332 pgs: 8 creating+peering, 32 unknown, 292 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:29.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: audit 2024-02-13T14:51:27.900762+0000 mon.a (mon.0) 1943 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:29.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: audit 2024-02-13T14:51:27.900941+0000 mon.a (mon.0) 1944 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]': finished 2024-02-13T14:51:29.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: cluster 2024-02-13T14:51:27.911026+0000 mon.a (mon.0) 1945 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-02-13T14:51:29.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: audit 2024-02-13T14:51:27.914008+0000 mon.c (mon.2) 545 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]: dispatch 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: audit 2024-02-13T14:51:27.917981+0000 mon.a (mon.0) 1946 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]: dispatch 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: audit 2024-02-13T14:51:27.918423+0000 mon.a (mon.0) 1947 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: audit 2024-02-13T14:51:27.973971+0000 mon.b (mon.1) 190 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: audit 2024-02-13T14:51:27.975530+0000 mon.b (mon.1) 191 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[21479]: audit 2024-02-13T14:51:27.983413+0000 mon.a (mon.0) 1948 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: cluster 2024-02-13T14:51:27.846707+0000 mgr.y (mgr.14613) 321 : cluster 0 pgmap v403: 332 pgs: 8 creating+peering, 32 unknown, 292 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: audit 2024-02-13T14:51:27.900762+0000 mon.a (mon.0) 1943 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: audit 2024-02-13T14:51:27.900941+0000 mon.a (mon.0) 1944 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]': finished 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: cluster 2024-02-13T14:51:27.911026+0000 mon.a (mon.0) 1945 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: audit 2024-02-13T14:51:27.914008+0000 mon.c (mon.2) 545 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]: dispatch 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: audit 2024-02-13T14:51:27.917981+0000 mon.a (mon.0) 1946 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]: dispatch 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: audit 2024-02-13T14:51:27.918423+0000 mon.a (mon.0) 1947 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:29.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: audit 2024-02-13T14:51:27.973971+0000 mon.b (mon.1) 190 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:51:29.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: audit 2024-02-13T14:51:27.975530+0000 mon.b (mon.1) 191 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:51:29.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:28 smithi062 bash[28859]: audit 2024-02-13T14:51:27.983413+0000 mon.a (mon.0) 1948 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:51:29.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: cluster 2024-02-13T14:51:27.846707+0000 mgr.y (mgr.14613) 321 : cluster 0 pgmap v403: 332 pgs: 8 creating+peering, 32 unknown, 292 active+clean; 4.6 MiB data, 603 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: audit 2024-02-13T14:51:27.900762+0000 mon.a (mon.0) 1943 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP_smithi062-64512-49", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: audit 2024-02-13T14:51:27.900941+0000 mon.a (mon.0) 1944 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-31"}]': finished 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: cluster 2024-02-13T14:51:27.911026+0000 mon.a (mon.0) 1945 : cluster 0 osdmap e262: 8 total, 8 up, 8 in 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: audit 2024-02-13T14:51:27.914008+0000 mon.c (mon.2) 545 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]: dispatch 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: audit 2024-02-13T14:51:27.917981+0000 mon.a (mon.0) 1946 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]: dispatch 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: audit 2024-02-13T14:51:27.918423+0000 mon.a (mon.0) 1947 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: audit 2024-02-13T14:51:27.973971+0000 mon.b (mon.1) 190 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: audit 2024-02-13T14:51:27.975530+0000 mon.b (mon.1) 191 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:51:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:28 smithi111 bash[23388]: audit 2024-02-13T14:51:27.983413+0000 mon.a (mon.0) 1948 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:51:30.277 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: cluster 2024-02-13T14:51:28.901292+0000 mon.a (mon.0) 1949 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:28.903845+0000 mon.a (mon.0) 1950 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]': finished 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:28.904109+0000 mon.a (mon.0) 1951 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: cluster 2024-02-13T14:51:28.916566+0000 mon.a (mon.0) 1952 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:28.921748+0000 mon.a (mon.0) 1953 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:29.095507+0000 mon.c (mon.2) 546 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:29.096107+0000 mon.a (mon.0) 1954 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:29.907315+0000 mon.a (mon.0) 1955 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:29.907548+0000 mon.a (mon.0) 1956 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: cluster 2024-02-13T14:51:29.915454+0000 mon.a (mon.0) 1957 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:29.917181+0000 mon.c (mon.2) 547 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:29.919264+0000 mon.a (mon.0) 1958 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:29.919420+0000 mon.c (mon.2) 548 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:30.278 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:29 smithi111 bash[23388]: audit 2024-02-13T14:51:29.920888+0000 mon.a (mon.0) 1959 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: cluster 2024-02-13T14:51:28.901292+0000 mon.a (mon.0) 1949 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:28.903845+0000 mon.a (mon.0) 1950 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]': finished 2024-02-13T14:51:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:28.904109+0000 mon.a (mon.0) 1951 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: cluster 2024-02-13T14:51:28.916566+0000 mon.a (mon.0) 1952 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-02-13T14:51:30.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:28.921748+0000 mon.a (mon.0) 1953 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:29.095507+0000 mon.c (mon.2) 546 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:29.096107+0000 mon.a (mon.0) 1954 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:29.907315+0000 mon.a (mon.0) 1955 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:29.907548+0000 mon.a (mon.0) 1956 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: cluster 2024-02-13T14:51:29.915454+0000 mon.a (mon.0) 1957 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:29.917181+0000 mon.c (mon.2) 547 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:29.919264+0000 mon.a (mon.0) 1958 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:29.919420+0000 mon.c (mon.2) 548 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[21479]: audit 2024-02-13T14:51:29.920888+0000 mon.a (mon.0) 1959 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: cluster 2024-02-13T14:51:28.901292+0000 mon.a (mon.0) 1949 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:28.903845+0000 mon.a (mon.0) 1950 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-31", "mode": "writeback"}]': finished 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:28.904109+0000 mon.a (mon.0) 1951 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: cluster 2024-02-13T14:51:28.916566+0000 mon.a (mon.0) 1952 : cluster 0 osdmap e263: 8 total, 8 up, 8 in 2024-02-13T14:51:30.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:28.921748+0000 mon.a (mon.0) 1953 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]: dispatch 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:29.095507+0000 mon.c (mon.2) 546 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:29.096107+0000 mon.a (mon.0) 1954 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:29.907315+0000 mon.a (mon.0) 1955 : audit 1 from='client.? v1:172.21.15.62:0/3214359045' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatNS_smithi062-64504-39"}]': finished 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:29.907548+0000 mon.a (mon.0) 1956 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: cluster 2024-02-13T14:51:29.915454+0000 mon.a (mon.0) 1957 : cluster 0 osdmap e264: 8 total, 8 up, 8 in 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:29.917181+0000 mon.c (mon.2) 547 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:29.919264+0000 mon.a (mon.0) 1958 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]: dispatch 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:29.919420+0000 mon.c (mon.2) 548 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:29 smithi062 bash[28859]: audit 2024-02-13T14:51:29.920888+0000 mon.a (mon.0) 1959 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:30.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:51:31.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: cluster 2024-02-13T14:51:29.848619+0000 mgr.y (mgr.14613) 322 : cluster 0 pgmap v406: 332 pgs: 8 creating+peering, 11 unknown, 313 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:29.964801+0000 mon.c (mon.2) 549 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:29.965156+0000 mon.a (mon.0) 1960 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:29.966322+0000 mon.c (mon.2) 550 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:29.966648+0000 mon.a (mon.0) 1961 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:29.967212+0000 mon.c (mon.2) 551 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:29.967514+0000 mon.a (mon.0) 1962 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:30.278791+0000 mgr.y (mgr.14613) 323 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: cluster 2024-02-13T14:51:30.907695+0000 mon.a (mon.0) 1963 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:30.910133+0000 mon.a (mon.0) 1964 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]': finished 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:30.910313+0000 mon.a (mon.0) 1965 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:31.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:30.910548+0000 mon.a (mon.0) 1966 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: cluster 2024-02-13T14:51:30.920027+0000 mon.a (mon.0) 1967 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:30.924347+0000 mon.c (mon.2) 552 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:30.924790+0000 mon.c (mon.2) 553 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:30.925280+0000 mon.a (mon.0) 1968 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[21479]: audit 2024-02-13T14:51:30.925725+0000 mon.a (mon.0) 1969 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: cluster 2024-02-13T14:51:29.848619+0000 mgr.y (mgr.14613) 322 : cluster 0 pgmap v406: 332 pgs: 8 creating+peering, 11 unknown, 313 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:29.964801+0000 mon.c (mon.2) 549 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:29.965156+0000 mon.a (mon.0) 1960 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:29.966322+0000 mon.c (mon.2) 550 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:29.966648+0000 mon.a (mon.0) 1961 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:29.967212+0000 mon.c (mon.2) 551 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:29.967514+0000 mon.a (mon.0) 1962 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:30.278791+0000 mgr.y (mgr.14613) 323 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: cluster 2024-02-13T14:51:30.907695+0000 mon.a (mon.0) 1963 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:30.910133+0000 mon.a (mon.0) 1964 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]': finished 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:30.910313+0000 mon.a (mon.0) 1965 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:30.910548+0000 mon.a (mon.0) 1966 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: cluster 2024-02-13T14:51:30.920027+0000 mon.a (mon.0) 1967 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:30.924347+0000 mon.c (mon.2) 552 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:30.924790+0000 mon.c (mon.2) 553 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:30.925280+0000 mon.a (mon.0) 1968 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:31.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:30 smithi062 bash[28859]: audit 2024-02-13T14:51:30.925725+0000 mon.a (mon.0) 1969 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: cluster 2024-02-13T14:51:29.848619+0000 mgr.y (mgr.14613) 322 : cluster 0 pgmap v406: 332 pgs: 8 creating+peering, 11 unknown, 313 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:31.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:29.964801+0000 mon.c (mon.2) 549 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:29.965156+0000 mon.a (mon.0) 1960 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:29.966322+0000 mon.c (mon.2) 550 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:29.966648+0000 mon.a (mon.0) 1961 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:29.967212+0000 mon.c (mon.2) 551 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:31.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:29.967514+0000 mon.a (mon.0) 1962 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:30.278791+0000 mgr.y (mgr.14613) 323 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: cluster 2024-02-13T14:51:30.907695+0000 mon.a (mon.0) 1963 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:30.910133+0000 mon.a (mon.0) 1964 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-31"}]': finished 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:30.910313+0000 mon.a (mon.0) 1965 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:30.910548+0000 mon.a (mon.0) 1966 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemove_smithi062-64504-40", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: cluster 2024-02-13T14:51:30.920027+0000 mon.a (mon.0) 1967 : cluster 0 osdmap e265: 8 total, 8 up, 8 in 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:30.924347+0000 mon.c (mon.2) 552 : audit 1 from='client.? v1:172.21.15.62:0/26446454' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:30.924790+0000 mon.c (mon.2) 553 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:30.925280+0000 mon.a (mon.0) 1968 : audit 1 from='client.46880 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]: dispatch 2024-02-13T14:51:31.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:30 smithi111 bash[23388]: audit 2024-02-13T14:51:30.925725+0000 mon.a (mon.0) 1969 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:32.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:32 smithi062 bash[28859]: cluster 2024-02-13T14:51:31.881534+0000 mon.a (mon.0) 1970 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:32.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:32 smithi062 bash[28859]: audit 2024-02-13T14:51:31.913535+0000 mon.a (mon.0) 1971 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:32 smithi062 bash[21479]: cluster 2024-02-13T14:51:31.881534+0000 mon.a (mon.0) 1970 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:32.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:32 smithi062 bash[21479]: audit 2024-02-13T14:51:31.913535+0000 mon.a (mon.0) 1971 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:32.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:32 smithi111 bash[23388]: cluster 2024-02-13T14:51:31.881534+0000 mon.a (mon.0) 1970 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:32.841 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:32 smithi111 bash[23388]: audit 2024-02-13T14:51:31.913535+0000 mon.a (mon.0) 1971 : audit 1 from='client.46880 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP_smithi062-64512-49"}]': finished 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: cluster 2024-02-13T14:51:31.849520+0000 mgr.y (mgr.14613) 324 : cluster 0 pgmap v409: 324 pgs: 324 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:31.966321+0000 mon.c (mon.2) 554 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: cluster 2024-02-13T14:51:32.381277+0000 mon.a (mon.0) 1972 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.383741+0000 mon.a (mon.0) 1973 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.387234+0000 mon.c (mon.2) 555 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.577832+0000 mon.b (mon.1) 192 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.845724+0000 mon.a (mon.0) 1974 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.849445+0000 mon.c (mon.2) 556 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.850336+0000 mon.a (mon.0) 1975 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:33.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.944075+0000 mon.a (mon.0) 1976 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.944214+0000 mon.a (mon.0) 1977 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: cluster 2024-02-13T14:51:32.953702+0000 mon.a (mon.0) 1978 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.967842+0000 mon.c (mon.2) 557 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.968553+0000 mon.a (mon.0) 1979 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: cluster 2024-02-13T14:51:31.849520+0000 mgr.y (mgr.14613) 324 : cluster 0 pgmap v409: 324 pgs: 324 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:31.966321+0000 mon.c (mon.2) 554 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: cluster 2024-02-13T14:51:32.381277+0000 mon.a (mon.0) 1972 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.383741+0000 mon.a (mon.0) 1973 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.387234+0000 mon.c (mon.2) 555 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.577832+0000 mon.b (mon.1) 192 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.845724+0000 mon.a (mon.0) 1974 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.849445+0000 mon.c (mon.2) 556 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.850336+0000 mon.a (mon.0) 1975 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.944075+0000 mon.a (mon.0) 1976 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.944214+0000 mon.a (mon.0) 1977 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: cluster 2024-02-13T14:51:32.953702+0000 mon.a (mon.0) 1978 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.967842+0000 mon.c (mon.2) 557 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.968553+0000 mon.a (mon.0) 1979 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.969764+0000 mon.c (mon.2) 558 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[21479]: audit 2024-02-13T14:51:32.970494+0000 mon.a (mon.0) 1980 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.969764+0000 mon.c (mon.2) 558 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:33 smithi062 bash[28859]: audit 2024-02-13T14:51:32.970494+0000 mon.a (mon.0) 1980 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: cluster 2024-02-13T14:51:31.849520+0000 mgr.y (mgr.14613) 324 : cluster 0 pgmap v409: 324 pgs: 324 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:31.966321+0000 mon.c (mon.2) 554 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: cluster 2024-02-13T14:51:32.381277+0000 mon.a (mon.0) 1972 : cluster 0 osdmap e266: 8 total, 8 up, 8 in 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.383741+0000 mon.a (mon.0) 1973 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.387234+0000 mon.c (mon.2) 555 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.577832+0000 mon.b (mon.1) 192 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.845724+0000 mon.a (mon.0) 1974 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.849445+0000 mon.c (mon.2) 556 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:33.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.850336+0000 mon.a (mon.0) 1975 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.944075+0000 mon.a (mon.0) 1976 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemove_smithi062-64504-40", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.944214+0000 mon.a (mon.0) 1977 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripPP2_smithi062-64512-50", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: cluster 2024-02-13T14:51:32.953702+0000 mon.a (mon.0) 1978 : cluster 0 osdmap e267: 8 total, 8 up, 8 in 2024-02-13T14:51:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.967842+0000 mon.c (mon.2) 557 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.968553+0000 mon.a (mon.0) 1979 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.969764+0000 mon.c (mon.2) 558 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:33 smithi111 bash[23388]: audit 2024-02-13T14:51:32.970494+0000 mon.a (mon.0) 1980 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:35.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[28859]: cluster 2024-02-13T14:51:33.850481+0000 mgr.y (mgr.14613) 325 : cluster 0 pgmap v412: 332 pgs: 40 unknown, 292 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-02-13T14:51:35.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[28859]: audit 2024-02-13T14:51:33.948238+0000 mon.a (mon.0) 1981 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:35.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[28859]: audit 2024-02-13T14:51:33.959413+0000 mon.c (mon.2) 559 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:35.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[28859]: cluster 2024-02-13T14:51:34.421499+0000 mon.a (mon.0) 1982 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-02-13T14:51:35.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[28859]: audit 2024-02-13T14:51:34.424048+0000 mon.a (mon.0) 1983 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:35.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[21479]: cluster 2024-02-13T14:51:33.850481+0000 mgr.y (mgr.14613) 325 : cluster 0 pgmap v412: 332 pgs: 40 unknown, 292 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-02-13T14:51:35.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[21479]: audit 2024-02-13T14:51:33.948238+0000 mon.a (mon.0) 1981 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:35.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[21479]: audit 2024-02-13T14:51:33.959413+0000 mon.c (mon.2) 559 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:35.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[21479]: cluster 2024-02-13T14:51:34.421499+0000 mon.a (mon.0) 1982 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-02-13T14:51:35.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:34 smithi062 bash[21479]: audit 2024-02-13T14:51:34.424048+0000 mon.a (mon.0) 1983 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:35.341 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:34 smithi111 bash[23388]: cluster 2024-02-13T14:51:33.850481+0000 mgr.y (mgr.14613) 325 : cluster 0 pgmap v412: 332 pgs: 40 unknown, 292 active+clean; 4.6 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-02-13T14:51:35.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:34 smithi111 bash[23388]: audit 2024-02-13T14:51:33.948238+0000 mon.a (mon.0) 1981 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-33","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:35.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:34 smithi111 bash[23388]: audit 2024-02-13T14:51:33.959413+0000 mon.c (mon.2) 559 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:35.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:34 smithi111 bash[23388]: cluster 2024-02-13T14:51:34.421499+0000 mon.a (mon.0) 1982 : cluster 0 osdmap e268: 8 total, 8 up, 8 in 2024-02-13T14:51:35.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:34 smithi111 bash[23388]: audit 2024-02-13T14:51:34.424048+0000 mon.a (mon.0) 1983 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: audit 2024-02-13T14:51:34.950985+0000 mon.a (mon.0) 1984 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: audit 2024-02-13T14:51:34.951269+0000 mon.a (mon.0) 1985 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: cluster 2024-02-13T14:51:34.959762+0000 mon.a (mon.0) 1986 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: audit 2024-02-13T14:51:34.965317+0000 mon.c (mon.2) 560 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: audit 2024-02-13T14:51:34.966575+0000 mon.a (mon.0) 1987 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: audit 2024-02-13T14:51:34.969308+0000 mon.c (mon.2) 561 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: audit 2024-02-13T14:51:34.981173+0000 mon.a (mon.0) 1988 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: audit 2024-02-13T14:51:35.953630+0000 mon.a (mon.0) 1989 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]': finished 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: audit 2024-02-13T14:51:35.953836+0000 mon.a (mon.0) 1990 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[21479]: cluster 2024-02-13T14:51:35.961991+0000 mon.a (mon.0) 1991 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: audit 2024-02-13T14:51:34.950985+0000 mon.a (mon.0) 1984 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: audit 2024-02-13T14:51:34.951269+0000 mon.a (mon.0) 1985 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: cluster 2024-02-13T14:51:34.959762+0000 mon.a (mon.0) 1986 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: audit 2024-02-13T14:51:34.965317+0000 mon.c (mon.2) 560 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: audit 2024-02-13T14:51:34.966575+0000 mon.a (mon.0) 1987 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: audit 2024-02-13T14:51:34.969308+0000 mon.c (mon.2) 561 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: audit 2024-02-13T14:51:34.981173+0000 mon.a (mon.0) 1988 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: audit 2024-02-13T14:51:35.953630+0000 mon.a (mon.0) 1989 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]': finished 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: audit 2024-02-13T14:51:35.953836+0000 mon.a (mon.0) 1990 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:35 smithi062 bash[28859]: cluster 2024-02-13T14:51:35.961991+0000 mon.a (mon.0) 1991 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: audit 2024-02-13T14:51:34.950985+0000 mon.a (mon.0) 1984 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripPP2_smithi062-64512-50", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: audit 2024-02-13T14:51:34.951269+0000 mon.a (mon.0) 1985 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: cluster 2024-02-13T14:51:34.959762+0000 mon.a (mon.0) 1986 : cluster 0 osdmap e269: 8 total, 8 up, 8 in 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: audit 2024-02-13T14:51:34.965317+0000 mon.c (mon.2) 560 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: audit 2024-02-13T14:51:34.966575+0000 mon.a (mon.0) 1987 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: audit 2024-02-13T14:51:34.969308+0000 mon.c (mon.2) 561 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: audit 2024-02-13T14:51:34.981173+0000 mon.a (mon.0) 1988 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: audit 2024-02-13T14:51:35.953630+0000 mon.a (mon.0) 1989 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-33"}]': finished 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: audit 2024-02-13T14:51:35.953836+0000 mon.a (mon.0) 1990 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:36.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:35 smithi111 bash[23388]: cluster 2024-02-13T14:51:35.961991+0000 mon.a (mon.0) 1991 : cluster 0 osdmap e270: 8 total, 8 up, 8 in 2024-02-13T14:51:36.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:51:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:51:37.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: cluster 2024-02-13T14:51:35.851741+0000 mgr.y (mgr.14613) 326 : cluster 0 pgmap v415: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:51:37.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: audit 2024-02-13T14:51:35.970958+0000 mon.c (mon.2) 562 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]: dispatch 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: audit 2024-02-13T14:51:35.972042+0000 mon.a (mon.0) 1992 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]: dispatch 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: audit 2024-02-13T14:51:35.972482+0000 mon.c (mon.2) 563 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: audit 2024-02-13T14:51:35.985592+0000 mon.a (mon.0) 1993 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: cluster 2024-02-13T14:51:36.954840+0000 mon.a (mon.0) 1994 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: audit 2024-02-13T14:51:36.957060+0000 mon.a (mon.0) 1995 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]': finished 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: audit 2024-02-13T14:51:36.957233+0000 mon.a (mon.0) 1996 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: cluster 2024-02-13T14:51:36.965366+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: audit 2024-02-13T14:51:36.967480+0000 mon.c (mon.2) 564 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[21479]: audit 2024-02-13T14:51:36.969116+0000 mon.a (mon.0) 1998 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: cluster 2024-02-13T14:51:35.851741+0000 mgr.y (mgr.14613) 326 : cluster 0 pgmap v415: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:51:37.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: audit 2024-02-13T14:51:35.970958+0000 mon.c (mon.2) 562 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]: dispatch 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: audit 2024-02-13T14:51:35.972042+0000 mon.a (mon.0) 1992 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]: dispatch 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: audit 2024-02-13T14:51:35.972482+0000 mon.c (mon.2) 563 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: audit 2024-02-13T14:51:35.985592+0000 mon.a (mon.0) 1993 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: cluster 2024-02-13T14:51:36.954840+0000 mon.a (mon.0) 1994 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: audit 2024-02-13T14:51:36.957060+0000 mon.a (mon.0) 1995 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]': finished 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: audit 2024-02-13T14:51:36.957233+0000 mon.a (mon.0) 1996 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: cluster 2024-02-13T14:51:36.965366+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: audit 2024-02-13T14:51:36.967480+0000 mon.c (mon.2) 564 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:36 smithi062 bash[28859]: audit 2024-02-13T14:51:36.969116+0000 mon.a (mon.0) 1998 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:37.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: cluster 2024-02-13T14:51:35.851741+0000 mgr.y (mgr.14613) 326 : cluster 0 pgmap v415: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:51:37.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: audit 2024-02-13T14:51:35.970958+0000 mon.c (mon.2) 562 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]: dispatch 2024-02-13T14:51:37.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: audit 2024-02-13T14:51:35.972042+0000 mon.a (mon.0) 1992 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]: dispatch 2024-02-13T14:51:37.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: audit 2024-02-13T14:51:35.972482+0000 mon.c (mon.2) 563 : audit 1 from='client.? v1:172.21.15.62:0/1601555582' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:37.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: audit 2024-02-13T14:51:35.985592+0000 mon.a (mon.0) 1993 : audit 1 from='client.46886 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]: dispatch 2024-02-13T14:51:37.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: cluster 2024-02-13T14:51:36.954840+0000 mon.a (mon.0) 1994 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:37.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: audit 2024-02-13T14:51:36.957060+0000 mon.a (mon.0) 1995 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-33", "mode": "writeback"}]': finished 2024-02-13T14:51:37.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: audit 2024-02-13T14:51:36.957233+0000 mon.a (mon.0) 1996 : audit 1 from='client.46886 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemove_smithi062-64504-40"}]': finished 2024-02-13T14:51:37.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: cluster 2024-02-13T14:51:36.965366+0000 mon.a (mon.0) 1997 : cluster 0 osdmap e271: 8 total, 8 up, 8 in 2024-02-13T14:51:37.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: audit 2024-02-13T14:51:36.967480+0000 mon.c (mon.2) 564 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:37.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:36 smithi111 bash[23388]: audit 2024-02-13T14:51:36.969116+0000 mon.a (mon.0) 1998 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:38.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:36.996766+0000 mon.c (mon.2) 565 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:36.997160+0000 mon.a (mon.0) 1999 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:36.998407+0000 mon.c (mon.2) 566 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:36.998776+0000 mon.a (mon.0) 2000 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:36.999281+0000 mon.c (mon.2) 567 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:36.999641+0000 mon.a (mon.0) 2001 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.201455+0000 mon.c (mon.2) 568 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.202001+0000 mon.a (mon.0) 2002 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.959799+0000 mon.a (mon.0) 2003 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.960038+0000 mon.a (mon.0) 2004 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.960251+0000 mon.a (mon.0) 2005 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: cluster 2024-02-13T14:51:37.967580+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-02-13T14:51:38.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.970716+0000 mon.c (mon.2) 569 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.971481+0000 mon.c (mon.2) 570 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:36.996766+0000 mon.c (mon.2) 565 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:36.997160+0000 mon.a (mon.0) 1999 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:36.998407+0000 mon.c (mon.2) 566 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:36.998776+0000 mon.a (mon.0) 2000 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:36.999281+0000 mon.c (mon.2) 567 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:36.999641+0000 mon.a (mon.0) 2001 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.201455+0000 mon.c (mon.2) 568 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.202001+0000 mon.a (mon.0) 2002 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.959799+0000 mon.a (mon.0) 2003 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.960038+0000 mon.a (mon.0) 2004 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.960251+0000 mon.a (mon.0) 2005 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: cluster 2024-02-13T14:51:37.967580+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.970716+0000 mon.c (mon.2) 569 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.971481+0000 mon.c (mon.2) 570 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.972263+0000 mon.c (mon.2) 571 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.972525+0000 mon.a (mon.0) 2007 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.973080+0000 mon.a (mon.0) 2008 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[28859]: audit 2024-02-13T14:51:37.974120+0000 mon.a (mon.0) 2009 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:38.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.972263+0000 mon.c (mon.2) 571 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:38.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.972525+0000 mon.a (mon.0) 2007 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:38.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.973080+0000 mon.a (mon.0) 2008 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:37 smithi062 bash[21479]: audit 2024-02-13T14:51:37.974120+0000 mon.a (mon.0) 2009 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:36.996766+0000 mon.c (mon.2) 565 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:36.997160+0000 mon.a (mon.0) 1999 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:36.998407+0000 mon.c (mon.2) 566 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:36.998776+0000 mon.a (mon.0) 2000 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:36.999281+0000 mon.c (mon.2) 567 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:38.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:36.999641+0000 mon.a (mon.0) 2001 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.201455+0000 mon.c (mon.2) 568 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.202001+0000 mon.a (mon.0) 2002 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.959799+0000 mon.a (mon.0) 2003 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.960038+0000 mon.a (mon.0) 2004 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClass_smithi062-64504-41", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.960251+0000 mon.a (mon.0) 2005 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: cluster 2024-02-13T14:51:37.967580+0000 mon.a (mon.0) 2006 : cluster 0 osdmap e272: 8 total, 8 up, 8 in 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.970716+0000 mon.c (mon.2) 569 : audit 1 from='client.? v1:172.21.15.62:0/3416486166' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.971481+0000 mon.c (mon.2) 570 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.972263+0000 mon.c (mon.2) 571 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.972525+0000 mon.a (mon.0) 2007 : audit 1 from='client.46892 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]: dispatch 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.973080+0000 mon.a (mon.0) 2008 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:38.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:37 smithi111 bash[23388]: audit 2024-02-13T14:51:37.974120+0000 mon.a (mon.0) 2009 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]: dispatch 2024-02-13T14:51:40.280 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:39 smithi111 bash[23388]: cluster 2024-02-13T14:51:37.852664+0000 mgr.y (mgr.14613) 327 : cluster 0 pgmap v418: 324 pgs: 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:40.280 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:39 smithi111 bash[23388]: cluster 2024-02-13T14:51:37.979080+0000 mon.a (mon.0) 2010 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:40.280 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:39 smithi111 bash[23388]: cluster 2024-02-13T14:51:38.961096+0000 mon.a (mon.0) 2011 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:40.280 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:39 smithi111 bash[23388]: audit 2024-02-13T14:51:38.963483+0000 mon.a (mon.0) 2012 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:40.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:39 smithi062 bash[21479]: cluster 2024-02-13T14:51:37.852664+0000 mgr.y (mgr.14613) 327 : cluster 0 pgmap v418: 324 pgs: 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:40.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:39 smithi062 bash[21479]: cluster 2024-02-13T14:51:37.979080+0000 mon.a (mon.0) 2010 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:40.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:39 smithi062 bash[21479]: cluster 2024-02-13T14:51:38.961096+0000 mon.a (mon.0) 2011 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:40.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:39 smithi062 bash[21479]: audit 2024-02-13T14:51:38.963483+0000 mon.a (mon.0) 2012 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:40.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:39 smithi062 bash[28859]: cluster 2024-02-13T14:51:37.852664+0000 mgr.y (mgr.14613) 327 : cluster 0 pgmap v418: 324 pgs: 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:40.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:39 smithi062 bash[28859]: cluster 2024-02-13T14:51:37.979080+0000 mon.a (mon.0) 2010 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:40.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:39 smithi062 bash[28859]: cluster 2024-02-13T14:51:38.961096+0000 mon.a (mon.0) 2011 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:40.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:39 smithi062 bash[28859]: audit 2024-02-13T14:51:38.963483+0000 mon.a (mon.0) 2012 : audit 1 from='client.46892 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripPP2_smithi062-64512-50"}]': finished 2024-02-13T14:51:40.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:51:41.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[28859]: audit 2024-02-13T14:51:38.963772+0000 mon.a (mon.0) 2013 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]': finished 2024-02-13T14:51:41.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[28859]: cluster 2024-02-13T14:51:39.428878+0000 mon.a (mon.0) 2014 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-02-13T14:51:41.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[28859]: cluster 2024-02-13T14:51:39.854724+0000 mgr.y (mgr.14613) 328 : cluster 0 pgmap v421: 324 pgs: 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[28859]: audit 2024-02-13T14:51:39.967020+0000 mon.a (mon.0) 2015 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[28859]: cluster 2024-02-13T14:51:39.975108+0000 mon.a (mon.0) 2016 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[28859]: audit 2024-02-13T14:51:39.981764+0000 mon.c (mon.2) 572 : audit 1 from='client.? v1:172.21.15.62:0/818248785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[28859]: audit 2024-02-13T14:51:39.983529+0000 mon.a (mon.0) 2017 : audit 1 from='client.46904 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[28859]: audit 2024-02-13T14:51:40.281868+0000 mgr.y (mgr.14613) 329 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[21479]: audit 2024-02-13T14:51:38.963772+0000 mon.a (mon.0) 2013 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]': finished 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[21479]: cluster 2024-02-13T14:51:39.428878+0000 mon.a (mon.0) 2014 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[21479]: cluster 2024-02-13T14:51:39.854724+0000 mgr.y (mgr.14613) 328 : cluster 0 pgmap v421: 324 pgs: 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[21479]: audit 2024-02-13T14:51:39.967020+0000 mon.a (mon.0) 2015 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:41.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[21479]: cluster 2024-02-13T14:51:39.975108+0000 mon.a (mon.0) 2016 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-02-13T14:51:41.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[21479]: audit 2024-02-13T14:51:39.981764+0000 mon.c (mon.2) 572 : audit 1 from='client.? v1:172.21.15.62:0/818248785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:41.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[21479]: audit 2024-02-13T14:51:39.983529+0000 mon.a (mon.0) 2017 : audit 1 from='client.46904 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:41.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:40 smithi062 bash[21479]: audit 2024-02-13T14:51:40.281868+0000 mgr.y (mgr.14613) 329 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[23388]: audit 2024-02-13T14:51:38.963772+0000 mon.a (mon.0) 2013 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-33"}]': finished 2024-02-13T14:51:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[23388]: cluster 2024-02-13T14:51:39.428878+0000 mon.a (mon.0) 2014 : cluster 0 osdmap e273: 8 total, 8 up, 8 in 2024-02-13T14:51:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[23388]: cluster 2024-02-13T14:51:39.854724+0000 mgr.y (mgr.14613) 328 : cluster 0 pgmap v421: 324 pgs: 324 active+clean; 4.6 MiB data, 613 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T14:51:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[23388]: audit 2024-02-13T14:51:39.967020+0000 mon.a (mon.0) 2015 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClass_smithi062-64504-41", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[23388]: cluster 2024-02-13T14:51:39.975108+0000 mon.a (mon.0) 2016 : cluster 0 osdmap e274: 8 total, 8 up, 8 in 2024-02-13T14:51:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[23388]: audit 2024-02-13T14:51:39.981764+0000 mon.c (mon.2) 572 : audit 1 from='client.? v1:172.21.15.62:0/818248785' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[23388]: audit 2024-02-13T14:51:39.983529+0000 mon.a (mon.0) 2017 : audit 1 from='client.46904 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:41.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:40 smithi111 bash[23388]: audit 2024-02-13T14:51:40.281868+0000 mgr.y (mgr.14613) 329 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:41 smithi062 bash[21479]: audit 2024-02-13T14:51:40.971276+0000 mon.a (mon.0) 2018 : audit 1 from='client.46904 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:42.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:41 smithi062 bash[21479]: cluster 2024-02-13T14:51:40.979119+0000 mon.a (mon.0) 2019 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-02-13T14:51:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:41 smithi062 bash[21479]: audit 2024-02-13T14:51:40.983337+0000 mon.c (mon.2) 573 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:42.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:41 smithi062 bash[21479]: audit 2024-02-13T14:51:40.984256+0000 mon.a (mon.0) 2020 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:42.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:41 smithi062 bash[28859]: audit 2024-02-13T14:51:40.971276+0000 mon.a (mon.0) 2018 : audit 1 from='client.46904 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:42.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:41 smithi062 bash[28859]: cluster 2024-02-13T14:51:40.979119+0000 mon.a (mon.0) 2019 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-02-13T14:51:42.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:41 smithi062 bash[28859]: audit 2024-02-13T14:51:40.983337+0000 mon.c (mon.2) 573 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:42.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:41 smithi062 bash[28859]: audit 2024-02-13T14:51:40.984256+0000 mon.a (mon.0) 2020 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:41 smithi111 bash[23388]: audit 2024-02-13T14:51:40.971276+0000 mon.a (mon.0) 2018 : audit 1 from='client.46904 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripPP3_smithi062-64512-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:41 smithi111 bash[23388]: cluster 2024-02-13T14:51:40.979119+0000 mon.a (mon.0) 2019 : cluster 0 osdmap e275: 8 total, 8 up, 8 in 2024-02-13T14:51:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:41 smithi111 bash[23388]: audit 2024-02-13T14:51:40.983337+0000 mon.c (mon.2) 573 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:42.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:41 smithi111 bash[23388]: audit 2024-02-13T14:51:40.984256+0000 mon.a (mon.0) 2020 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: cluster 2024-02-13T14:51:41.855708+0000 mgr.y (mgr.14613) 330 : cluster 0 pgmap v424: 364 pgs: 5 creating+peering, 67 unknown, 292 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: audit 2024-02-13T14:51:41.980863+0000 mon.a (mon.0) 2021 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: cluster 2024-02-13T14:51:41.991377+0000 mon.a (mon.0) 2022 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: audit 2024-02-13T14:51:41.993285+0000 mon.c (mon.2) 574 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: audit 2024-02-13T14:51:41.995584+0000 mon.a (mon.0) 2023 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: audit 2024-02-13T14:51:41.997223+0000 mon.c (mon.2) 575 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: audit 2024-02-13T14:51:41.998267+0000 mon.a (mon.0) 2024 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: audit 2024-02-13T14:51:42.049489+0000 mon.a (mon.0) 2025 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: audit 2024-02-13T14:51:42.051325+0000 mon.a (mon.0) 2026 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:43.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[21479]: audit 2024-02-13T14:51:42.051701+0000 mon.a (mon.0) 2027 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: cluster 2024-02-13T14:51:41.855708+0000 mgr.y (mgr.14613) 330 : cluster 0 pgmap v424: 364 pgs: 5 creating+peering, 67 unknown, 292 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: audit 2024-02-13T14:51:41.980863+0000 mon.a (mon.0) 2021 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: cluster 2024-02-13T14:51:41.991377+0000 mon.a (mon.0) 2022 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: audit 2024-02-13T14:51:41.993285+0000 mon.c (mon.2) 574 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: audit 2024-02-13T14:51:41.995584+0000 mon.a (mon.0) 2023 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: audit 2024-02-13T14:51:41.997223+0000 mon.c (mon.2) 575 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: audit 2024-02-13T14:51:41.998267+0000 mon.a (mon.0) 2024 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: audit 2024-02-13T14:51:42.049489+0000 mon.a (mon.0) 2025 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: audit 2024-02-13T14:51:42.051325+0000 mon.a (mon.0) 2026 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:42 smithi062 bash[28859]: audit 2024-02-13T14:51:42.051701+0000 mon.a (mon.0) 2027 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: cluster 2024-02-13T14:51:41.855708+0000 mgr.y (mgr.14613) 330 : cluster 0 pgmap v424: 364 pgs: 5 creating+peering, 67 unknown, 292 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:51:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: audit 2024-02-13T14:51:41.980863+0000 mon.a (mon.0) 2021 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-35","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: cluster 2024-02-13T14:51:41.991377+0000 mon.a (mon.0) 2022 : cluster 0 osdmap e276: 8 total, 8 up, 8 in 2024-02-13T14:51:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: audit 2024-02-13T14:51:41.993285+0000 mon.c (mon.2) 574 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:43.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: audit 2024-02-13T14:51:41.995584+0000 mon.a (mon.0) 2023 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:43.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: audit 2024-02-13T14:51:41.997223+0000 mon.c (mon.2) 575 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:43.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: audit 2024-02-13T14:51:41.998267+0000 mon.a (mon.0) 2024 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:43.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: audit 2024-02-13T14:51:42.049489+0000 mon.a (mon.0) 2025 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:43.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: audit 2024-02-13T14:51:42.051325+0000 mon.a (mon.0) 2026 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:43.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:42 smithi111 bash[23388]: audit 2024-02-13T14:51:42.051701+0000 mon.a (mon.0) 2027 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:44.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: audit 2024-02-13T14:51:42.994021+0000 mon.a (mon.0) 2028 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:44.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: audit 2024-02-13T14:51:42.994206+0000 mon.a (mon.0) 2029 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:44.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: audit 2024-02-13T14:51:42.994418+0000 mon.a (mon.0) 2030 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: cluster 2024-02-13T14:51:43.002341+0000 mon.a (mon.0) 2031 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: audit 2024-02-13T14:51:43.004041+0000 mon.c (mon.2) 576 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: audit 2024-02-13T14:51:43.004483+0000 mon.a (mon.0) 2032 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi062-64512-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: audit 2024-02-13T14:51:43.007396+0000 mon.c (mon.2) 577 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: audit 2024-02-13T14:51:43.007676+0000 mon.a (mon.0) 2033 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[28859]: audit 2024-02-13T14:51:43.008090+0000 mon.a (mon.0) 2034 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: audit 2024-02-13T14:51:42.994021+0000 mon.a (mon.0) 2028 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: audit 2024-02-13T14:51:42.994206+0000 mon.a (mon.0) 2029 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: audit 2024-02-13T14:51:42.994418+0000 mon.a (mon.0) 2030 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: cluster 2024-02-13T14:51:43.002341+0000 mon.a (mon.0) 2031 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-02-13T14:51:44.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: audit 2024-02-13T14:51:43.004041+0000 mon.c (mon.2) 576 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: audit 2024-02-13T14:51:43.004483+0000 mon.a (mon.0) 2032 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi062-64512-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: audit 2024-02-13T14:51:43.007396+0000 mon.c (mon.2) 577 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: audit 2024-02-13T14:51:43.007676+0000 mon.a (mon.0) 2033 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:44 smithi062 bash[21479]: audit 2024-02-13T14:51:43.008090+0000 mon.a (mon.0) 2034 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: audit 2024-02-13T14:51:42.994021+0000 mon.a (mon.0) 2028 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: audit 2024-02-13T14:51:42.994206+0000 mon.a (mon.0) 2029 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: audit 2024-02-13T14:51:42.994418+0000 mon.a (mon.0) 2030 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: cluster 2024-02-13T14:51:43.002341+0000 mon.a (mon.0) 2031 : cluster 0 osdmap e277: 8 total, 8 up, 8 in 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: audit 2024-02-13T14:51:43.004041+0000 mon.c (mon.2) 576 : audit 1 from='client.? v1:172.21.15.62:0/3352687719' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: audit 2024-02-13T14:51:43.004483+0000 mon.a (mon.0) 2032 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi062-64512-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: audit 2024-02-13T14:51:43.007396+0000 mon.c (mon.2) 577 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: audit 2024-02-13T14:51:43.007676+0000 mon.a (mon.0) 2033 : audit 1 from='client.46898 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]: dispatch 2024-02-13T14:51:44.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:44 smithi111 bash[23388]: audit 2024-02-13T14:51:43.008090+0000 mon.a (mon.0) 2034 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:45.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: cluster 2024-02-13T14:51:43.856623+0000 mgr.y (mgr.14613) 331 : cluster 0 pgmap v427: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: cluster 2024-02-13T14:51:43.993973+0000 mon.a (mon.0) 2035 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.003938+0000 mon.a (mon.0) 2036 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.004186+0000 mon.a (mon.0) 2037 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.015109+0000 mon.c (mon.2) 578 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]: dispatch 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.041954+0000 mon.c (mon.2) 579 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: cluster 2024-02-13T14:51:44.472884+0000 mon.a (mon.0) 2038 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.475036+0000 mon.a (mon.0) 2039 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]: dispatch 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.475711+0000 mon.a (mon.0) 2040 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.476770+0000 mon.c (mon.2) 580 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.477408+0000 mon.a (mon.0) 2041 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.478269+0000 mon.c (mon.2) 581 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:45.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[21479]: audit 2024-02-13T14:51:44.478814+0000 mon.a (mon.0) 2042 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: cluster 2024-02-13T14:51:43.856623+0000 mgr.y (mgr.14613) 331 : cluster 0 pgmap v427: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: cluster 2024-02-13T14:51:43.993973+0000 mon.a (mon.0) 2035 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.003938+0000 mon.a (mon.0) 2036 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.004186+0000 mon.a (mon.0) 2037 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.015109+0000 mon.c (mon.2) 578 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]: dispatch 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.041954+0000 mon.c (mon.2) 579 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: cluster 2024-02-13T14:51:44.472884+0000 mon.a (mon.0) 2038 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.475036+0000 mon.a (mon.0) 2039 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]: dispatch 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.475711+0000 mon.a (mon.0) 2040 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.476770+0000 mon.c (mon.2) 580 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.477408+0000 mon.a (mon.0) 2041 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.478269+0000 mon.c (mon.2) 581 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:45.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:45 smithi062 bash[28859]: audit 2024-02-13T14:51:44.478814+0000 mon.a (mon.0) 2042 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: cluster 2024-02-13T14:51:43.856623+0000 mgr.y (mgr.14613) 331 : cluster 0 pgmap v427: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 614 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: cluster 2024-02-13T14:51:43.993973+0000 mon.a (mon.0) 2035 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.003938+0000 mon.a (mon.0) 2036 : audit 1 from='client.46898 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClass_smithi062-64504-41"}]': finished 2024-02-13T14:51:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.004186+0000 mon.a (mon.0) 2037 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.015109+0000 mon.c (mon.2) 578 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]: dispatch 2024-02-13T14:51:45.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.041954+0000 mon.c (mon.2) 579 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: cluster 2024-02-13T14:51:44.472884+0000 mon.a (mon.0) 2038 : cluster 0 osdmap e278: 8 total, 8 up, 8 in 2024-02-13T14:51:45.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.475036+0000 mon.a (mon.0) 2039 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]: dispatch 2024-02-13T14:51:45.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.475711+0000 mon.a (mon.0) 2040 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.476770+0000 mon.c (mon.2) 580 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.477408+0000 mon.a (mon.0) 2041 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:45.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.478269+0000 mon.c (mon.2) 581 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:45.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:45 smithi111 bash[23388]: audit 2024-02-13T14:51:44.478814+0000 mon.a (mon.0) 2042 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:46.310 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:51:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:51:46.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[21479]: cluster 2024-02-13T14:51:45.005707+0000 mon.a (mon.0) 2043 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:46.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[21479]: audit 2024-02-13T14:51:45.018158+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi062-64512-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:46.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[21479]: audit 2024-02-13T14:51:45.018369+0000 mon.a (mon.0) 2045 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]': finished 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[21479]: audit 2024-02-13T14:51:45.018620+0000 mon.a (mon.0) 2046 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[21479]: cluster 2024-02-13T14:51:45.025343+0000 mon.a (mon.0) 2047 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[21479]: audit 2024-02-13T14:51:45.028620+0000 mon.c (mon.2) 582 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[21479]: audit 2024-02-13T14:51:45.030299+0000 mon.a (mon.0) 2048 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[28859]: cluster 2024-02-13T14:51:45.005707+0000 mon.a (mon.0) 2043 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[28859]: audit 2024-02-13T14:51:45.018158+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi062-64512-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[28859]: audit 2024-02-13T14:51:45.018369+0000 mon.a (mon.0) 2045 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]': finished 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[28859]: audit 2024-02-13T14:51:45.018620+0000 mon.a (mon.0) 2046 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[28859]: cluster 2024-02-13T14:51:45.025343+0000 mon.a (mon.0) 2047 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-02-13T14:51:46.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[28859]: audit 2024-02-13T14:51:45.028620+0000 mon.c (mon.2) 582 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:46.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:46 smithi062 bash[28859]: audit 2024-02-13T14:51:45.030299+0000 mon.a (mon.0) 2048 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:46.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:46 smithi111 bash[23388]: cluster 2024-02-13T14:51:45.005707+0000 mon.a (mon.0) 2043 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:46.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:46 smithi111 bash[23388]: audit 2024-02-13T14:51:45.018158+0000 mon.a (mon.0) 2044 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripSparseReadPP_smithi062-64512-52", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:46.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:46 smithi111 bash[23388]: audit 2024-02-13T14:51:45.018369+0000 mon.a (mon.0) 2045 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-35", "mode": "writeback"}]': finished 2024-02-13T14:51:46.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:46 smithi111 bash[23388]: audit 2024-02-13T14:51:45.018620+0000 mon.a (mon.0) 2046 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWrite_smithi062-64504-42", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:46.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:46 smithi111 bash[23388]: cluster 2024-02-13T14:51:45.025343+0000 mon.a (mon.0) 2047 : cluster 0 osdmap e279: 8 total, 8 up, 8 in 2024-02-13T14:51:46.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:46 smithi111 bash[23388]: audit 2024-02-13T14:51:45.028620+0000 mon.c (mon.2) 582 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:46.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:46 smithi111 bash[23388]: audit 2024-02-13T14:51:45.030299+0000 mon.a (mon.0) 2048 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:47.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:47 smithi111 bash[23388]: cluster 2024-02-13T14:51:45.857546+0000 mgr.y (mgr.14613) 332 : cluster 0 pgmap v430: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:47.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:47 smithi111 bash[23388]: cluster 2024-02-13T14:51:46.503256+0000 mon.a (mon.0) 2049 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-02-13T14:51:47.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:47 smithi062 bash[21479]: cluster 2024-02-13T14:51:45.857546+0000 mgr.y (mgr.14613) 332 : cluster 0 pgmap v430: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:47.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:47 smithi062 bash[21479]: cluster 2024-02-13T14:51:46.503256+0000 mon.a (mon.0) 2049 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-02-13T14:51:47.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:47 smithi062 bash[28859]: cluster 2024-02-13T14:51:45.857546+0000 mgr.y (mgr.14613) 332 : cluster 0 pgmap v430: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:47.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:47 smithi062 bash[28859]: cluster 2024-02-13T14:51:46.503256+0000 mon.a (mon.0) 2049 : cluster 0 osdmap e280: 8 total, 8 up, 8 in 2024-02-13T14:51:48.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:47.035932+0000 mon.a (mon.0) 2050 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:48.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: cluster 2024-02-13T14:51:47.046416+0000 mon.a (mon.0) 2051 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-02-13T14:51:48.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:47.058052+0000 mon.a (mon.0) 2052 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:48.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:47.153044+0000 mon.c (mon.2) 583 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:48.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:47.153901+0000 mon.a (mon.0) 2053 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:48.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:47.900329+0000 mon.a (mon.0) 2054 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:51:48.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:47.904785+0000 mon.b (mon.1) 193 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:48.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:48.038572+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:48.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:48.038764+0000 mon.a (mon.0) 2056 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:48.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: cluster 2024-02-13T14:51:48.046940+0000 mon.a (mon.0) 2057 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-02-13T14:51:48.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:48 smithi111 bash[23388]: audit 2024-02-13T14:51:48.050997+0000 mon.a (mon.0) 2058 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:48.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:47.035932+0000 mon.a (mon.0) 2050 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:48.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: cluster 2024-02-13T14:51:47.046416+0000 mon.a (mon.0) 2051 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:47.058052+0000 mon.a (mon.0) 2052 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:47.153044+0000 mon.c (mon.2) 583 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:47.153901+0000 mon.a (mon.0) 2053 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:47.900329+0000 mon.a (mon.0) 2054 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:47.904785+0000 mon.b (mon.1) 193 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:48.038572+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:48.038764+0000 mon.a (mon.0) 2056 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: cluster 2024-02-13T14:51:48.046940+0000 mon.a (mon.0) 2057 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[21479]: audit 2024-02-13T14:51:48.050997+0000 mon.a (mon.0) 2058 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:47.035932+0000 mon.a (mon.0) 2050 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWrite_smithi062-64504-42", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: cluster 2024-02-13T14:51:47.046416+0000 mon.a (mon.0) 2051 : cluster 0 osdmap e281: 8 total, 8 up, 8 in 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:47.058052+0000 mon.a (mon.0) 2052 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:48.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:47.153044+0000 mon.c (mon.2) 583 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:47.153901+0000 mon.a (mon.0) 2053 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:47.900329+0000 mon.a (mon.0) 2054 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:51:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:47.904785+0000 mon.b (mon.1) 193 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:51:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:48.038572+0000 mon.a (mon.0) 2055 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:48.038764+0000 mon.a (mon.0) 2056 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: cluster 2024-02-13T14:51:48.046940+0000 mon.a (mon.0) 2057 : cluster 0 osdmap e282: 8 total, 8 up, 8 in 2024-02-13T14:51:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:48 smithi062 bash[28859]: audit 2024-02-13T14:51:48.050997+0000 mon.a (mon.0) 2058 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]: dispatch 2024-02-13T14:51:49.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:49 smithi111 bash[23388]: cluster 2024-02-13T14:51:47.858470+0000 mgr.y (mgr.14613) 333 : cluster 0 pgmap v433: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:49.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:49 smithi111 bash[23388]: audit 2024-02-13T14:51:48.081412+0000 mon.c (mon.2) 584 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:49.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:49 smithi111 bash[23388]: audit 2024-02-13T14:51:48.090714+0000 mon.a (mon.0) 2059 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:49.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:49 smithi111 bash[23388]: audit 2024-02-13T14:51:49.042033+0000 mon.a (mon.0) 2060 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:49.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:49 smithi111 bash[23388]: audit 2024-02-13T14:51:49.042328+0000 mon.a (mon.0) 2061 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:49.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:49 smithi111 bash[23388]: cluster 2024-02-13T14:51:49.051454+0000 mon.a (mon.0) 2062 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-02-13T14:51:49.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:49 smithi111 bash[23388]: audit 2024-02-13T14:51:49.057002+0000 mon.c (mon.2) 585 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:49.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:49 smithi111 bash[23388]: audit 2024-02-13T14:51:49.058051+0000 mon.a (mon.0) 2063 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:49.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[21479]: cluster 2024-02-13T14:51:47.858470+0000 mgr.y (mgr.14613) 333 : cluster 0 pgmap v433: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:49.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[21479]: audit 2024-02-13T14:51:48.081412+0000 mon.c (mon.2) 584 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:49.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[21479]: audit 2024-02-13T14:51:48.090714+0000 mon.a (mon.0) 2059 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[21479]: audit 2024-02-13T14:51:49.042033+0000 mon.a (mon.0) 2060 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[21479]: audit 2024-02-13T14:51:49.042328+0000 mon.a (mon.0) 2061 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[21479]: cluster 2024-02-13T14:51:49.051454+0000 mon.a (mon.0) 2062 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[21479]: audit 2024-02-13T14:51:49.057002+0000 mon.c (mon.2) 585 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[21479]: audit 2024-02-13T14:51:49.058051+0000 mon.a (mon.0) 2063 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[28859]: cluster 2024-02-13T14:51:47.858470+0000 mgr.y (mgr.14613) 333 : cluster 0 pgmap v433: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[28859]: audit 2024-02-13T14:51:48.081412+0000 mon.c (mon.2) 584 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[28859]: audit 2024-02-13T14:51:48.090714+0000 mon.a (mon.0) 2059 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[28859]: audit 2024-02-13T14:51:49.042033+0000 mon.a (mon.0) 2060 : audit 1 from='client.? v1:172.21.15.62:0/710986995' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripSparseReadPP_smithi062-64512-52"}]': finished 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[28859]: audit 2024-02-13T14:51:49.042328+0000 mon.a (mon.0) 2061 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[28859]: cluster 2024-02-13T14:51:49.051454+0000 mon.a (mon.0) 2062 : cluster 0 osdmap e283: 8 total, 8 up, 8 in 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[28859]: audit 2024-02-13T14:51:49.057002+0000 mon.c (mon.2) 585 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:49.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:49 smithi062 bash[28859]: audit 2024-02-13T14:51:49.058051+0000 mon.a (mon.0) 2063 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:50.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: audit 2024-02-13T14:51:49.100543+0000 mon.a (mon.0) 2064 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: audit 2024-02-13T14:51:49.102052+0000 mon.a (mon.0) 2065 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: audit 2024-02-13T14:51:49.102504+0000 mon.a (mon.0) 2066 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: audit 2024-02-13T14:51:50.046419+0000 mon.a (mon.0) 2067 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: audit 2024-02-13T14:51:50.046654+0000 mon.a (mon.0) 2068 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: cluster 2024-02-13T14:51:50.055337+0000 mon.a (mon.0) 2069 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-02-13T14:51:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: audit 2024-02-13T14:51:50.057523+0000 mon.a (mon.0) 2070 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi062-64512-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: audit 2024-02-13T14:51:50.059797+0000 mon.c (mon.2) 586 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:50.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[21479]: audit 2024-02-13T14:51:50.065183+0000 mon.a (mon.0) 2071 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: audit 2024-02-13T14:51:49.100543+0000 mon.a (mon.0) 2064 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: audit 2024-02-13T14:51:49.102052+0000 mon.a (mon.0) 2065 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: audit 2024-02-13T14:51:49.102504+0000 mon.a (mon.0) 2066 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: audit 2024-02-13T14:51:50.046419+0000 mon.a (mon.0) 2067 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: audit 2024-02-13T14:51:50.046654+0000 mon.a (mon.0) 2068 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: cluster 2024-02-13T14:51:50.055337+0000 mon.a (mon.0) 2069 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: audit 2024-02-13T14:51:50.057523+0000 mon.a (mon.0) 2070 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi062-64512-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: audit 2024-02-13T14:51:50.059797+0000 mon.c (mon.2) 586 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:50 smithi062 bash[28859]: audit 2024-02-13T14:51:50.065183+0000 mon.a (mon.0) 2071 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:50.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:51:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: audit 2024-02-13T14:51:49.100543+0000 mon.a (mon.0) 2064 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: audit 2024-02-13T14:51:49.102052+0000 mon.a (mon.0) 2065 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: audit 2024-02-13T14:51:49.102504+0000 mon.a (mon.0) 2066 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: audit 2024-02-13T14:51:50.046419+0000 mon.a (mon.0) 2067 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: audit 2024-02-13T14:51:50.046654+0000 mon.a (mon.0) 2068 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: cluster 2024-02-13T14:51:50.055337+0000 mon.a (mon.0) 2069 : cluster 0 osdmap e284: 8 total, 8 up, 8 in 2024-02-13T14:51:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: audit 2024-02-13T14:51:50.057523+0000 mon.a (mon.0) 2070 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi062-64512-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:50.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: audit 2024-02-13T14:51:50.059797+0000 mon.c (mon.2) 586 : audit 1 from='client.? v1:172.21.15.62:0/761867223' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:50.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:50 smithi111 bash[23388]: audit 2024-02-13T14:51:50.065183+0000 mon.a (mon.0) 2071 : audit 1 from='client.46916 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]: dispatch 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout:e 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleWrite (7064 ms) 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.WaitForComplete 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.WaitForComplete (6944 ms) 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip (6965 ms) 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTrip2 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTrip2 (6989 ms) 2024-02-13T14:51:51.069 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripAppend 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripAppend (7027 ms) 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.IsComplete 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.IsComplete (7066 ms) 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.IsSafe 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.IsSafe (7043 ms) 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.ReturnValue 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.ReturnValue (7052 ms) 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.Flush 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.Flush (6985 ms) 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.FlushAsync 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.FlushAsync (7025 ms) 2024-02-13T14:51:51.070 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.RoundTripWriteFull 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.RoundTripWriteFull (7053 ms) 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStat 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStat (6936 ms) 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.SimpleStatNS 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.SimpleStatNS (7001 ms) 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.StatRemove 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.StatRemove (7048 ms) 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.ExecuteClass 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.ExecuteClass (7047 ms) 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ RUN ] LibRadosAioEC.MultiWrite 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ OK ] LibRadosAioEC.MultiWrite (7047 ms) 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] 16 tests from LibRadosAioEC (112294 ms total) 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: 2024-02-13T14:51:51.071 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [----------] Global test environment tear-down 2024-02-13T14:51:51.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [==========] 42 tests from 2 test suites ran. (232424 ms total) 2024-02-13T14:51:51.072 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio: [ PASSED ] 42 tests. 2024-02-13T14:51:51.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[21479]: cluster 2024-02-13T14:51:49.859789+0000 mgr.y (mgr.14613) 334 : cluster 0 pgmap v436: 324 pgs: 324 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:51:51.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[21479]: cluster 2024-02-13T14:51:50.084084+0000 mon.a (mon.0) 2072 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:51.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[21479]: audit 2024-02-13T14:51:50.138886+0000 mon.c (mon.2) 587 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:51.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[21479]: audit 2024-02-13T14:51:50.139467+0000 mon.a (mon.0) 2073 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[21479]: audit 2024-02-13T14:51:50.293152+0000 mgr.y (mgr.14613) 335 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[21479]: audit 2024-02-13T14:51:51.050230+0000 mon.a (mon.0) 2074 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[21479]: audit 2024-02-13T14:51:51.050493+0000 mon.a (mon.0) 2075 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[28859]: cluster 2024-02-13T14:51:49.859789+0000 mgr.y (mgr.14613) 334 : cluster 0 pgmap v436: 324 pgs: 324 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[28859]: cluster 2024-02-13T14:51:50.084084+0000 mon.a (mon.0) 2072 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[28859]: audit 2024-02-13T14:51:50.138886+0000 mon.c (mon.2) 587 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[28859]: audit 2024-02-13T14:51:50.139467+0000 mon.a (mon.0) 2073 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[28859]: audit 2024-02-13T14:51:50.293152+0000 mgr.y (mgr.14613) 335 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[28859]: audit 2024-02-13T14:51:51.050230+0000 mon.a (mon.0) 2074 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:51.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:51 smithi062 bash[28859]: audit 2024-02-13T14:51:51.050493+0000 mon.a (mon.0) 2075 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:51.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:51 smithi111 bash[23388]: cluster 2024-02-13T14:51:49.859789+0000 mgr.y (mgr.14613) 334 : cluster 0 pgmap v436: 324 pgs: 324 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:51:51.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:51 smithi111 bash[23388]: cluster 2024-02-13T14:51:50.084084+0000 mon.a (mon.0) 2072 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:51.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:51 smithi111 bash[23388]: audit 2024-02-13T14:51:50.138886+0000 mon.c (mon.2) 587 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:51.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:51 smithi111 bash[23388]: audit 2024-02-13T14:51:50.139467+0000 mon.a (mon.0) 2073 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:51.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:51 smithi111 bash[23388]: audit 2024-02-13T14:51:50.293152+0000 mgr.y (mgr.14613) 335 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:51:51.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:51 smithi111 bash[23388]: audit 2024-02-13T14:51:51.050230+0000 mon.a (mon.0) 2074 : audit 1 from='client.46916 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWrite_smithi062-64504-42"}]': finished 2024-02-13T14:51:51.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:51 smithi111 bash[23388]: audit 2024-02-13T14:51:51.050493+0000 mon.a (mon.0) 2075 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:52.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[21479]: audit 2024-02-13T14:51:51.060341+0000 mon.c (mon.2) 588 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:52.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[21479]: cluster 2024-02-13T14:51:51.516646+0000 mon.a (mon.0) 2076 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[21479]: audit 2024-02-13T14:51:51.518554+0000 mon.a (mon.0) 2077 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[21479]: cluster 2024-02-13T14:51:51.860629+0000 mgr.y (mgr.14613) 336 : cluster 0 pgmap v439: 324 pgs: 324 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[21479]: cluster 2024-02-13T14:51:52.050916+0000 mon.a (mon.0) 2078 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[21479]: audit 2024-02-13T14:51:52.053541+0000 mon.a (mon.0) 2079 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi062-64512-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[21479]: audit 2024-02-13T14:51:52.053767+0000 mon.a (mon.0) 2080 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[21479]: cluster 2024-02-13T14:51:52.061787+0000 mon.a (mon.0) 2081 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[28859]: audit 2024-02-13T14:51:51.060341+0000 mon.c (mon.2) 588 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[28859]: cluster 2024-02-13T14:51:51.516646+0000 mon.a (mon.0) 2076 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[28859]: audit 2024-02-13T14:51:51.518554+0000 mon.a (mon.0) 2077 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[28859]: cluster 2024-02-13T14:51:51.860629+0000 mgr.y (mgr.14613) 336 : cluster 0 pgmap v439: 324 pgs: 324 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[28859]: cluster 2024-02-13T14:51:52.050916+0000 mon.a (mon.0) 2078 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:52.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[28859]: audit 2024-02-13T14:51:52.053541+0000 mon.a (mon.0) 2079 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi062-64512-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[28859]: audit 2024-02-13T14:51:52.053767+0000 mon.a (mon.0) 2080 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:52 smithi062 bash[28859]: cluster 2024-02-13T14:51:52.061787+0000 mon.a (mon.0) 2081 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-02-13T14:51:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:52 smithi111 bash[23388]: audit 2024-02-13T14:51:51.060341+0000 mon.c (mon.2) 588 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:52 smithi111 bash[23388]: cluster 2024-02-13T14:51:51.516646+0000 mon.a (mon.0) 2076 : cluster 0 osdmap e285: 8 total, 8 up, 8 in 2024-02-13T14:51:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:52 smithi111 bash[23388]: audit 2024-02-13T14:51:51.518554+0000 mon.a (mon.0) 2077 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]: dispatch 2024-02-13T14:51:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:52 smithi111 bash[23388]: cluster 2024-02-13T14:51:51.860629+0000 mgr.y (mgr.14613) 336 : cluster 0 pgmap v439: 324 pgs: 324 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:51:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:52 smithi111 bash[23388]: cluster 2024-02-13T14:51:52.050916+0000 mon.a (mon.0) 2078 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:51:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:52 smithi111 bash[23388]: audit 2024-02-13T14:51:52.053541+0000 mon.a (mon.0) 2079 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripAppendPP_smithi062-64512-53", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:52 smithi111 bash[23388]: audit 2024-02-13T14:51:52.053767+0000 mon.a (mon.0) 2080 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-35"}]': finished 2024-02-13T14:51:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:52 smithi111 bash[23388]: cluster 2024-02-13T14:51:52.061787+0000 mon.a (mon.0) 2081 : cluster 0 osdmap e286: 8 total, 8 up, 8 in 2024-02-13T14:51:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:54 smithi111 bash[23388]: cluster 2024-02-13T14:51:53.063651+0000 mon.a (mon.0) 2082 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-02-13T14:51:54.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:54 smithi062 bash[28859]: cluster 2024-02-13T14:51:53.063651+0000 mon.a (mon.0) 2082 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-02-13T14:51:54.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:54 smithi062 bash[21479]: cluster 2024-02-13T14:51:53.063651+0000 mon.a (mon.0) 2082 : cluster 0 osdmap e287: 8 total, 8 up, 8 in 2024-02-13T14:51:55.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: cluster 2024-02-13T14:51:53.861524+0000 mgr.y (mgr.14613) 337 : cluster 0 pgmap v442: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: cluster 2024-02-13T14:51:54.074030+0000 mon.a (mon.0) 2083 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: audit 2024-02-13T14:51:54.079326+0000 mon.c (mon.2) 589 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: audit 2024-02-13T14:51:54.084017+0000 mon.a (mon.0) 2084 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: audit 2024-02-13T14:51:54.087321+0000 mon.a (mon.0) 2085 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: audit 2024-02-13T14:51:55.063877+0000 mon.a (mon.0) 2086 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: audit 2024-02-13T14:51:55.064070+0000 mon.a (mon.0) 2087 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: cluster 2024-02-13T14:51:55.074342+0000 mon.a (mon.0) 2088 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: audit 2024-02-13T14:51:55.077252+0000 mon.a (mon.0) 2089 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: audit 2024-02-13T14:51:55.081594+0000 mon.c (mon.2) 590 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[21479]: audit 2024-02-13T14:51:55.082722+0000 mon.a (mon.0) 2090 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:55.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: cluster 2024-02-13T14:51:53.861524+0000 mgr.y (mgr.14613) 337 : cluster 0 pgmap v442: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: cluster 2024-02-13T14:51:54.074030+0000 mon.a (mon.0) 2083 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: audit 2024-02-13T14:51:54.079326+0000 mon.c (mon.2) 589 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: audit 2024-02-13T14:51:54.084017+0000 mon.a (mon.0) 2084 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: audit 2024-02-13T14:51:54.087321+0000 mon.a (mon.0) 2085 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: audit 2024-02-13T14:51:55.063877+0000 mon.a (mon.0) 2086 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: audit 2024-02-13T14:51:55.064070+0000 mon.a (mon.0) 2087 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: cluster 2024-02-13T14:51:55.074342+0000 mon.a (mon.0) 2088 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: audit 2024-02-13T14:51:55.077252+0000 mon.a (mon.0) 2089 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: audit 2024-02-13T14:51:55.081594+0000 mon.c (mon.2) 590 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:55 smithi062 bash[28859]: audit 2024-02-13T14:51:55.082722+0000 mon.a (mon.0) 2090 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:55.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: cluster 2024-02-13T14:51:53.861524+0000 mgr.y (mgr.14613) 337 : cluster 0 pgmap v442: 300 pgs: 8 unknown, 292 active+clean; 4.6 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:51:55.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: cluster 2024-02-13T14:51:54.074030+0000 mon.a (mon.0) 2083 : cluster 0 osdmap e288: 8 total, 8 up, 8 in 2024-02-13T14:51:55.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: audit 2024-02-13T14:51:54.079326+0000 mon.c (mon.2) 589 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:55.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: audit 2024-02-13T14:51:54.084017+0000 mon.a (mon.0) 2084 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: audit 2024-02-13T14:51:54.087321+0000 mon.a (mon.0) 2085 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:51:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: audit 2024-02-13T14:51:55.063877+0000 mon.a (mon.0) 2086 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: audit 2024-02-13T14:51:55.064070+0000 mon.a (mon.0) 2087 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-37","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:51:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: cluster 2024-02-13T14:51:55.074342+0000 mon.a (mon.0) 2088 : cluster 0 osdmap e289: 8 total, 8 up, 8 in 2024-02-13T14:51:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: audit 2024-02-13T14:51:55.077252+0000 mon.a (mon.0) 2089 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]: dispatch 2024-02-13T14:51:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: audit 2024-02-13T14:51:55.081594+0000 mon.c (mon.2) 590 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:55 smithi111 bash[23388]: audit 2024-02-13T14:51:55.082722+0000 mon.a (mon.0) 2090 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:51:56.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:51:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:51:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: cluster 2024-02-13T14:51:55.862488+0000 mgr.y (mgr.14613) 338 : cluster 0 pgmap v445: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.067497+0000 mon.a (mon.0) 2091 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.067712+0000 mon.a (mon.0) 2092 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: cluster 2024-02-13T14:51:56.075103+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.081160+0000 mon.c (mon.2) 591 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.083143+0000 mon.a (mon.0) 2094 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: cluster 2024-02-13T14:51:56.096622+0000 mon.a (mon.0) 2095 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.124016+0000 mon.c (mon.2) 592 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.124492+0000 mon.a (mon.0) 2096 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.125748+0000 mon.c (mon.2) 593 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.126078+0000 mon.a (mon.0) 2097 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.126616+0000 mon.c (mon.2) 594 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.126933+0000 mon.a (mon.0) 2098 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.895137+0000 mon.a (mon.0) 2099 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]': finished 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.895348+0000 mon.a (mon.0) 2100 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: cluster 2024-02-13T14:51:56.902678+0000 mon.a (mon.0) 2101 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.903881+0000 mon.c (mon.2) 595 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]: dispatch 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.904510+0000 mon.c (mon.2) 596 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.904634+0000 mon.a (mon.0) 2102 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]: dispatch 2024-02-13T14:51:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:57 smithi111 bash[23388]: audit 2024-02-13T14:51:56.905779+0000 mon.a (mon.0) 2103 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: cluster 2024-02-13T14:51:55.862488+0000 mgr.y (mgr.14613) 338 : cluster 0 pgmap v445: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.067497+0000 mon.a (mon.0) 2091 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.067712+0000 mon.a (mon.0) 2092 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: cluster 2024-02-13T14:51:56.075103+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.081160+0000 mon.c (mon.2) 591 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.083143+0000 mon.a (mon.0) 2094 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: cluster 2024-02-13T14:51:56.096622+0000 mon.a (mon.0) 2095 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.124016+0000 mon.c (mon.2) 592 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.124492+0000 mon.a (mon.0) 2096 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.125748+0000 mon.c (mon.2) 593 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.126078+0000 mon.a (mon.0) 2097 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.126616+0000 mon.c (mon.2) 594 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:57.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.126933+0000 mon.a (mon.0) 2098 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.895137+0000 mon.a (mon.0) 2099 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]': finished 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: cluster 2024-02-13T14:51:55.862488+0000 mgr.y (mgr.14613) 338 : cluster 0 pgmap v445: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.067497+0000 mon.a (mon.0) 2091 : audit 1 from='client.? v1:172.21.15.62:0/2114291284' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripAppendPP_smithi062-64512-53"}]': finished 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.067712+0000 mon.a (mon.0) 2092 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: cluster 2024-02-13T14:51:56.075103+0000 mon.a (mon.0) 2093 : cluster 0 osdmap e290: 8 total, 8 up, 8 in 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.081160+0000 mon.c (mon.2) 591 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.083143+0000 mon.a (mon.0) 2094 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: cluster 2024-02-13T14:51:56.096622+0000 mon.a (mon.0) 2095 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.124016+0000 mon.c (mon.2) 592 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.124492+0000 mon.a (mon.0) 2096 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.125748+0000 mon.c (mon.2) 593 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.126078+0000 mon.a (mon.0) 2097 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.126616+0000 mon.c (mon.2) 594 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.126933+0000 mon.a (mon.0) 2098 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.895137+0000 mon.a (mon.0) 2099 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-37"}]': finished 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.895348+0000 mon.a (mon.0) 2100 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: cluster 2024-02-13T14:51:56.902678+0000 mon.a (mon.0) 2101 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.903881+0000 mon.c (mon.2) 595 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]: dispatch 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.904510+0000 mon.c (mon.2) 596 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.904634+0000 mon.a (mon.0) 2102 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]: dispatch 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[21479]: audit 2024-02-13T14:51:56.905779+0000 mon.a (mon.0) 2103 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.895348+0000 mon.a (mon.0) 2100 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsCompletePP_smithi062-64512-54", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:51:57.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: cluster 2024-02-13T14:51:56.902678+0000 mon.a (mon.0) 2101 : cluster 0 osdmap e291: 8 total, 8 up, 8 in 2024-02-13T14:51:57.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.903881+0000 mon.c (mon.2) 595 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]: dispatch 2024-02-13T14:51:57.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.904510+0000 mon.c (mon.2) 596 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:57.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.904634+0000 mon.a (mon.0) 2102 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]: dispatch 2024-02-13T14:51:57.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:57 smithi062 bash[28859]: audit 2024-02-13T14:51:56.905779+0000 mon.a (mon.0) 2103 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:51:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:58 smithi062 bash[21479]: cluster 2024-02-13T14:51:57.896204+0000 mon.a (mon.0) 2104 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:58.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:58 smithi062 bash[21479]: audit 2024-02-13T14:51:57.898753+0000 mon.a (mon.0) 2105 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]': finished 2024-02-13T14:51:58.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:58 smithi062 bash[28859]: cluster 2024-02-13T14:51:57.896204+0000 mon.a (mon.0) 2104 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:58 smithi062 bash[28859]: audit 2024-02-13T14:51:57.898753+0000 mon.a (mon.0) 2105 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]': finished 2024-02-13T14:51:58.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:58 smithi111 bash[23388]: cluster 2024-02-13T14:51:57.896204+0000 mon.a (mon.0) 2104 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:51:58.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:58 smithi111 bash[23388]: audit 2024-02-13T14:51:57.898753+0000 mon.a (mon.0) 2105 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-37", "mode": "writeback"}]': finished 2024-02-13T14:51:59.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: cluster 2024-02-13T14:51:57.863377+0000 mgr.y (mgr.14613) 339 : cluster 0 pgmap v448: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: cluster 2024-02-13T14:51:58.365760+0000 mon.a (mon.0) 2106 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: audit 2024-02-13T14:51:58.407374+0000 mon.c (mon.2) 597 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: audit 2024-02-13T14:51:58.408015+0000 mon.a (mon.0) 2107 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: audit 2024-02-13T14:51:58.901667+0000 mon.a (mon.0) 2108 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: audit 2024-02-13T14:51:58.901895+0000 mon.a (mon.0) 2109 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: cluster 2024-02-13T14:51:58.909887+0000 mon.a (mon.0) 2110 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: audit 2024-02-13T14:51:58.910941+0000 mon.c (mon.2) 598 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[21479]: audit 2024-02-13T14:51:58.913303+0000 mon.a (mon.0) 2111 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: cluster 2024-02-13T14:51:57.863377+0000 mgr.y (mgr.14613) 339 : cluster 0 pgmap v448: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: cluster 2024-02-13T14:51:58.365760+0000 mon.a (mon.0) 2106 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-02-13T14:51:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: audit 2024-02-13T14:51:58.407374+0000 mon.c (mon.2) 597 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: audit 2024-02-13T14:51:58.408015+0000 mon.a (mon.0) 2107 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: audit 2024-02-13T14:51:58.901667+0000 mon.a (mon.0) 2108 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:51:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: audit 2024-02-13T14:51:58.901895+0000 mon.a (mon.0) 2109 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: cluster 2024-02-13T14:51:58.909887+0000 mon.a (mon.0) 2110 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-02-13T14:51:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: audit 2024-02-13T14:51:58.910941+0000 mon.c (mon.2) 598 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:51:59 smithi062 bash[28859]: audit 2024-02-13T14:51:58.913303+0000 mon.a (mon.0) 2111 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: cluster 2024-02-13T14:51:57.863377+0000 mgr.y (mgr.14613) 339 : cluster 0 pgmap v448: 324 pgs: 32 creating+peering, 292 active+clean; 4.6 MiB data, 620 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:51:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: cluster 2024-02-13T14:51:58.365760+0000 mon.a (mon.0) 2106 : cluster 0 osdmap e292: 8 total, 8 up, 8 in 2024-02-13T14:51:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: audit 2024-02-13T14:51:58.407374+0000 mon.c (mon.2) 597 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: audit 2024-02-13T14:51:58.408015+0000 mon.a (mon.0) 2107 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:51:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: audit 2024-02-13T14:51:58.901667+0000 mon.a (mon.0) 2108 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsCompletePP_smithi062-64512-54", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:51:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: audit 2024-02-13T14:51:58.901895+0000 mon.a (mon.0) 2109 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:51:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: cluster 2024-02-13T14:51:58.909887+0000 mon.a (mon.0) 2110 : cluster 0 osdmap e293: 8 total, 8 up, 8 in 2024-02-13T14:51:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: audit 2024-02-13T14:51:58.910941+0000 mon.c (mon.2) 598 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:51:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:51:59 smithi111 bash[23388]: audit 2024-02-13T14:51:58.913303+0000 mon.a (mon.0) 2111 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]: dispatch 2024-02-13T14:52:00.592 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:52:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:52:00.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:00 smithi111 bash[23388]: cluster 2024-02-13T14:51:59.865415+0000 mgr.y (mgr.14613) 340 : cluster 0 pgmap v451: 332 pgs: 4 unknown, 16 creating+peering, 312 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T14:52:00.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:00 smithi111 bash[23388]: cluster 2024-02-13T14:51:59.902032+0000 mon.a (mon.0) 2112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:00.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:00 smithi111 bash[23388]: audit 2024-02-13T14:51:59.907650+0000 mon.a (mon.0) 2113 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]': finished 2024-02-13T14:52:00.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:00 smithi111 bash[23388]: cluster 2024-02-13T14:51:59.916399+0000 mon.a (mon.0) 2114 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-02-13T14:52:00.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:00 smithi111 bash[23388]: audit 2024-02-13T14:52:00.304569+0000 mgr.y (mgr.14613) 341 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[28859]: cluster 2024-02-13T14:51:59.865415+0000 mgr.y (mgr.14613) 340 : cluster 0 pgmap v451: 332 pgs: 4 unknown, 16 creating+peering, 312 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T14:52:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[28859]: cluster 2024-02-13T14:51:59.902032+0000 mon.a (mon.0) 2112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[28859]: audit 2024-02-13T14:51:59.907650+0000 mon.a (mon.0) 2113 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]': finished 2024-02-13T14:52:00.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[28859]: cluster 2024-02-13T14:51:59.916399+0000 mon.a (mon.0) 2114 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-02-13T14:52:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[28859]: audit 2024-02-13T14:52:00.304569+0000 mgr.y (mgr.14613) 341 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[21479]: cluster 2024-02-13T14:51:59.865415+0000 mgr.y (mgr.14613) 340 : cluster 0 pgmap v451: 332 pgs: 4 unknown, 16 creating+peering, 312 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T14:52:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[21479]: cluster 2024-02-13T14:51:59.902032+0000 mon.a (mon.0) 2112 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[21479]: audit 2024-02-13T14:51:59.907650+0000 mon.a (mon.0) 2113 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-37"}]': finished 2024-02-13T14:52:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[21479]: cluster 2024-02-13T14:51:59.916399+0000 mon.a (mon.0) 2114 : cluster 0 osdmap e294: 8 total, 8 up, 8 in 2024-02-13T14:52:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:00 smithi062 bash[21479]: audit 2024-02-13T14:52:00.304569+0000 mgr.y (mgr.14613) 341 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:02.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:01 smithi062 bash[28859]: cluster 2024-02-13T14:52:00.917585+0000 mon.a (mon.0) 2115 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-02-13T14:52:02.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:01 smithi062 bash[28859]: audit 2024-02-13T14:52:00.920295+0000 mon.c (mon.2) 599 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:02.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:01 smithi062 bash[28859]: audit 2024-02-13T14:52:01.384282+0000 mon.a (mon.0) 2116 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:02.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:01 smithi062 bash[28859]: cluster 2024-02-13T14:52:01.894241+0000 mon.a (mon.0) 2117 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:02.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:01 smithi062 bash[21479]: cluster 2024-02-13T14:52:00.917585+0000 mon.a (mon.0) 2115 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-02-13T14:52:02.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:01 smithi062 bash[21479]: audit 2024-02-13T14:52:00.920295+0000 mon.c (mon.2) 599 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:02.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:01 smithi062 bash[21479]: audit 2024-02-13T14:52:01.384282+0000 mon.a (mon.0) 2116 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:02.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:01 smithi062 bash[21479]: cluster 2024-02-13T14:52:01.894241+0000 mon.a (mon.0) 2117 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:01 smithi111 bash[23388]: cluster 2024-02-13T14:52:00.917585+0000 mon.a (mon.0) 2115 : cluster 0 osdmap e295: 8 total, 8 up, 8 in 2024-02-13T14:52:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:01 smithi111 bash[23388]: audit 2024-02-13T14:52:00.920295+0000 mon.c (mon.2) 599 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:01 smithi111 bash[23388]: audit 2024-02-13T14:52:01.384282+0000 mon.a (mon.0) 2116 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:02.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:01 smithi111 bash[23388]: cluster 2024-02-13T14:52:01.894241+0000 mon.a (mon.0) 2117 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:03.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[21479]: cluster 2024-02-13T14:52:01.866287+0000 mgr.y (mgr.14613) 342 : cluster 0 pgmap v454: 292 pgs: 292 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[21479]: audit 2024-02-13T14:52:01.927721+0000 mon.a (mon.0) 2118 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[21479]: cluster 2024-02-13T14:52:01.945022+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[21479]: audit 2024-02-13T14:52:01.945599+0000 mon.c (mon.2) 600 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[21479]: audit 2024-02-13T14:52:01.945933+0000 mon.c (mon.2) 601 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[21479]: audit 2024-02-13T14:52:01.952054+0000 mon.a (mon.0) 2120 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[21479]: audit 2024-02-13T14:52:01.953843+0000 mon.a (mon.0) 2121 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[28859]: cluster 2024-02-13T14:52:01.866287+0000 mgr.y (mgr.14613) 342 : cluster 0 pgmap v454: 292 pgs: 292 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[28859]: audit 2024-02-13T14:52:01.927721+0000 mon.a (mon.0) 2118 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[28859]: cluster 2024-02-13T14:52:01.945022+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[28859]: audit 2024-02-13T14:52:01.945599+0000 mon.c (mon.2) 600 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[28859]: audit 2024-02-13T14:52:01.945933+0000 mon.c (mon.2) 601 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:03.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[28859]: audit 2024-02-13T14:52:01.952054+0000 mon.a (mon.0) 2120 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:02 smithi062 bash[28859]: audit 2024-02-13T14:52:01.953843+0000 mon.a (mon.0) 2121 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:02 smithi111 bash[23388]: cluster 2024-02-13T14:52:01.866287+0000 mgr.y (mgr.14613) 342 : cluster 0 pgmap v454: 292 pgs: 292 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:52:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:02 smithi111 bash[23388]: audit 2024-02-13T14:52:01.927721+0000 mon.a (mon.0) 2118 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:52:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:02 smithi111 bash[23388]: cluster 2024-02-13T14:52:01.945022+0000 mon.a (mon.0) 2119 : cluster 0 osdmap e296: 8 total, 8 up, 8 in 2024-02-13T14:52:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:02 smithi111 bash[23388]: audit 2024-02-13T14:52:01.945599+0000 mon.c (mon.2) 600 : audit 1 from='client.? v1:172.21.15.62:0/1142644058' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:03.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:02 smithi111 bash[23388]: audit 2024-02-13T14:52:01.945933+0000 mon.c (mon.2) 601 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:02 smithi111 bash[23388]: audit 2024-02-13T14:52:01.952054+0000 mon.a (mon.0) 2120 : audit 1 from='client.46928 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]: dispatch 2024-02-13T14:52:03.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:02 smithi111 bash[23388]: audit 2024-02-13T14:52:01.953843+0000 mon.a (mon.0) 2121 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:04.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:02.931492+0000 mon.a (mon.0) 2122 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:52:04.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:02.931749+0000 mon.a (mon.0) 2123 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:04.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: cluster 2024-02-13T14:52:02.943778+0000 mon.a (mon.0) 2124 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-02-13T14:52:04.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:02.952427+0000 mon.c (mon.2) 602 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:04.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:02.958592+0000 mon.a (mon.0) 2125 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:04.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:02.988448+0000 mon.a (mon.0) 2126 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:02.994710+0000 mon.b (mon.1) 194 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:03.003630+0000 mon.a (mon.0) 2127 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:03.006579+0000 mon.a (mon.0) 2128 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:03.009630+0000 mon.a (mon.0) 2129 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi062-64512-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:03.934314+0000 mon.a (mon.0) 2130 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:03.934652+0000 mon.a (mon.0) 2131 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi062-64512-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: cluster 2024-02-13T14:52:03.941980+0000 mon.a (mon.0) 2132 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:03.943660+0000 mon.a (mon.0) 2133 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi062-64512-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:03.947075+0000 mon.c (mon.2) 603 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[21479]: audit 2024-02-13T14:52:03.947826+0000 mon.a (mon.0) 2134 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:04.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:02.931492+0000 mon.a (mon.0) 2122 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:02.931749+0000 mon.a (mon.0) 2123 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: cluster 2024-02-13T14:52:02.943778+0000 mon.a (mon.0) 2124 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:02.952427+0000 mon.c (mon.2) 602 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:02.958592+0000 mon.a (mon.0) 2125 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:02.988448+0000 mon.a (mon.0) 2126 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:02.994710+0000 mon.b (mon.1) 194 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:03.003630+0000 mon.a (mon.0) 2127 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:03.006579+0000 mon.a (mon.0) 2128 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:03.009630+0000 mon.a (mon.0) 2129 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi062-64512-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:03.934314+0000 mon.a (mon.0) 2130 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:03.934652+0000 mon.a (mon.0) 2131 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi062-64512-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: cluster 2024-02-13T14:52:03.941980+0000 mon.a (mon.0) 2132 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:03.943660+0000 mon.a (mon.0) 2133 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi062-64512-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:03.947075+0000 mon.c (mon.2) 603 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:04.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:03 smithi062 bash[28859]: audit 2024-02-13T14:52:03.947826+0000 mon.a (mon.0) 2134 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:04.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:02.931492+0000 mon.a (mon.0) 2122 : audit 1 from='client.46928 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsCompletePP_smithi062-64512-54"}]': finished 2024-02-13T14:52:04.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:02.931749+0000 mon.a (mon.0) 2123 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-39","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: cluster 2024-02-13T14:52:02.943778+0000 mon.a (mon.0) 2124 : cluster 0 osdmap e297: 8 total, 8 up, 8 in 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:02.952427+0000 mon.c (mon.2) 602 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:02.958592+0000 mon.a (mon.0) 2125 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:02.988448+0000 mon.a (mon.0) 2126 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:02.994710+0000 mon.b (mon.1) 194 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:03.003630+0000 mon.a (mon.0) 2127 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:03.006579+0000 mon.a (mon.0) 2128 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:03.009630+0000 mon.a (mon.0) 2129 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi062-64512-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:03.934314+0000 mon.a (mon.0) 2130 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:03.934652+0000 mon.a (mon.0) 2131 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-IsSafePP_smithi062-64512-55", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: cluster 2024-02-13T14:52:03.941980+0000 mon.a (mon.0) 2132 : cluster 0 osdmap e298: 8 total, 8 up, 8 in 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:03.943660+0000 mon.a (mon.0) 2133 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "IsSafePP_smithi062-64512-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:03.947075+0000 mon.c (mon.2) 603 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:03 smithi111 bash[23388]: audit 2024-02-13T14:52:03.947826+0000 mon.a (mon.0) 2134 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:05.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:05 smithi062 bash[21479]: cluster 2024-02-13T14:52:03.867183+0000 mgr.y (mgr.14613) 343 : cluster 0 pgmap v457: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:06.335 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:05 smithi062 bash[21479]: audit 2024-02-13T14:52:04.937534+0000 mon.a (mon.0) 2135 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]': finished 2024-02-13T14:52:06.336 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:05 smithi062 bash[28859]: cluster 2024-02-13T14:52:03.867183+0000 mgr.y (mgr.14613) 343 : cluster 0 pgmap v457: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:06.336 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:05 smithi062 bash[28859]: audit 2024-02-13T14:52:04.937534+0000 mon.a (mon.0) 2135 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]': finished 2024-02-13T14:52:06.336 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:05 smithi111 bash[23388]: cluster 2024-02-13T14:52:03.867183+0000 mgr.y (mgr.14613) 343 : cluster 0 pgmap v457: 324 pgs: 32 unknown, 292 active+clean; 4.6 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:06.337 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:05 smithi111 bash[23388]: audit 2024-02-13T14:52:04.937534+0000 mon.a (mon.0) 2135 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-39"}]': finished 2024-02-13T14:52:06.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:52:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:52:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: audit 2024-02-13T14:52:04.948053+0000 mon.c (mon.2) 604 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]: dispatch 2024-02-13T14:52:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: cluster 2024-02-13T14:52:05.404691+0000 mon.a (mon.0) 2136 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-02-13T14:52:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: audit 2024-02-13T14:52:05.406928+0000 mon.a (mon.0) 2137 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]: dispatch 2024-02-13T14:52:06.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: cluster 2024-02-13T14:52:05.869007+0000 mgr.y (mgr.14613) 344 : cluster 0 pgmap v460: 324 pgs: 324 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: cluster 2024-02-13T14:52:05.938119+0000 mon.a (mon.0) 2138 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: audit 2024-02-13T14:52:05.940864+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi062-64512-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: audit 2024-02-13T14:52:05.941176+0000 mon.a (mon.0) 2140 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]': finished 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: cluster 2024-02-13T14:52:05.948777+0000 mon.a (mon.0) 2141 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: audit 2024-02-13T14:52:06.146684+0000 mon.c (mon.2) 605 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[28859]: audit 2024-02-13T14:52:06.147202+0000 mon.a (mon.0) 2142 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: audit 2024-02-13T14:52:04.948053+0000 mon.c (mon.2) 604 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]: dispatch 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: cluster 2024-02-13T14:52:05.404691+0000 mon.a (mon.0) 2136 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: audit 2024-02-13T14:52:05.406928+0000 mon.a (mon.0) 2137 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]: dispatch 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: cluster 2024-02-13T14:52:05.869007+0000 mgr.y (mgr.14613) 344 : cluster 0 pgmap v460: 324 pgs: 324 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: cluster 2024-02-13T14:52:05.938119+0000 mon.a (mon.0) 2138 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: audit 2024-02-13T14:52:05.940864+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi062-64512-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: audit 2024-02-13T14:52:05.941176+0000 mon.a (mon.0) 2140 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]': finished 2024-02-13T14:52:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: cluster 2024-02-13T14:52:05.948777+0000 mon.a (mon.0) 2141 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-02-13T14:52:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: audit 2024-02-13T14:52:06.146684+0000 mon.c (mon.2) 605 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:06 smithi062 bash[21479]: audit 2024-02-13T14:52:06.147202+0000 mon.a (mon.0) 2142 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: audit 2024-02-13T14:52:04.948053+0000 mon.c (mon.2) 604 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]: dispatch 2024-02-13T14:52:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: cluster 2024-02-13T14:52:05.404691+0000 mon.a (mon.0) 2136 : cluster 0 osdmap e299: 8 total, 8 up, 8 in 2024-02-13T14:52:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: audit 2024-02-13T14:52:05.406928+0000 mon.a (mon.0) 2137 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]: dispatch 2024-02-13T14:52:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: cluster 2024-02-13T14:52:05.869007+0000 mgr.y (mgr.14613) 344 : cluster 0 pgmap v460: 324 pgs: 324 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: cluster 2024-02-13T14:52:05.938119+0000 mon.a (mon.0) 2138 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:52:06.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: audit 2024-02-13T14:52:05.940864+0000 mon.a (mon.0) 2139 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "IsSafePP_smithi062-64512-55", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:06.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: audit 2024-02-13T14:52:05.941176+0000 mon.a (mon.0) 2140 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-39", "mode": "writeback"}]': finished 2024-02-13T14:52:06.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: cluster 2024-02-13T14:52:05.948777+0000 mon.a (mon.0) 2141 : cluster 0 osdmap e300: 8 total, 8 up, 8 in 2024-02-13T14:52:06.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: audit 2024-02-13T14:52:06.146684+0000 mon.c (mon.2) 605 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:06.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:06 smithi111 bash[23388]: audit 2024-02-13T14:52:06.147202+0000 mon.a (mon.0) 2142 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:07.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[21479]: cluster 2024-02-13T14:52:06.901815+0000 mon.a (mon.0) 2143 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[21479]: audit 2024-02-13T14:52:06.943124+0000 mon.a (mon.0) 2144 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[21479]: audit 2024-02-13T14:52:06.950250+0000 mon.c (mon.2) 606 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[21479]: cluster 2024-02-13T14:52:06.950884+0000 mon.a (mon.0) 2145 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[21479]: audit 2024-02-13T14:52:06.953135+0000 mon.a (mon.0) 2146 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[28859]: cluster 2024-02-13T14:52:06.901815+0000 mon.a (mon.0) 2143 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[28859]: audit 2024-02-13T14:52:06.943124+0000 mon.a (mon.0) 2144 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[28859]: audit 2024-02-13T14:52:06.950250+0000 mon.c (mon.2) 606 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[28859]: cluster 2024-02-13T14:52:06.950884+0000 mon.a (mon.0) 2145 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-02-13T14:52:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:07 smithi062 bash[28859]: audit 2024-02-13T14:52:06.953135+0000 mon.a (mon.0) 2146 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:07 smithi111 bash[23388]: cluster 2024-02-13T14:52:06.901815+0000 mon.a (mon.0) 2143 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:07 smithi111 bash[23388]: audit 2024-02-13T14:52:06.943124+0000 mon.a (mon.0) 2144 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:52:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:07 smithi111 bash[23388]: audit 2024-02-13T14:52:06.950250+0000 mon.c (mon.2) 606 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:07 smithi111 bash[23388]: cluster 2024-02-13T14:52:06.950884+0000 mon.a (mon.0) 2145 : cluster 0 osdmap e301: 8 total, 8 up, 8 in 2024-02-13T14:52:07.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:07 smithi111 bash[23388]: audit 2024-02-13T14:52:06.953135+0000 mon.a (mon.0) 2146 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]: dispatch 2024-02-13T14:52:08.810 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[21479]: cluster 2024-02-13T14:52:07.869998+0000 mgr.y (mgr.14613) 345 : cluster 0 pgmap v463: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[21479]: cluster 2024-02-13T14:52:07.943360+0000 mon.a (mon.0) 2147 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[21479]: audit 2024-02-13T14:52:07.945779+0000 mon.a (mon.0) 2148 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]': finished 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[21479]: cluster 2024-02-13T14:52:07.953070+0000 mon.a (mon.0) 2149 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[21479]: audit 2024-02-13T14:52:07.960472+0000 mon.a (mon.0) 2150 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[28859]: cluster 2024-02-13T14:52:07.869998+0000 mgr.y (mgr.14613) 345 : cluster 0 pgmap v463: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[28859]: cluster 2024-02-13T14:52:07.943360+0000 mon.a (mon.0) 2147 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[28859]: audit 2024-02-13T14:52:07.945779+0000 mon.a (mon.0) 2148 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]': finished 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[28859]: cluster 2024-02-13T14:52:07.953070+0000 mon.a (mon.0) 2149 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-02-13T14:52:08.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:08 smithi062 bash[28859]: audit 2024-02-13T14:52:07.960472+0000 mon.a (mon.0) 2150 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:08.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:08 smithi111 bash[23388]: cluster 2024-02-13T14:52:07.869998+0000 mgr.y (mgr.14613) 345 : cluster 0 pgmap v463: 332 pgs: 8 unknown, 324 active+clean; 4.6 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:08.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:08 smithi111 bash[23388]: cluster 2024-02-13T14:52:07.943360+0000 mon.a (mon.0) 2147 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:08.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:08 smithi111 bash[23388]: audit 2024-02-13T14:52:07.945779+0000 mon.a (mon.0) 2148 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-39"}]': finished 2024-02-13T14:52:08.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:08 smithi111 bash[23388]: cluster 2024-02-13T14:52:07.953070+0000 mon.a (mon.0) 2149 : cluster 0 osdmap e302: 8 total, 8 up, 8 in 2024-02-13T14:52:08.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:08 smithi111 bash[23388]: audit 2024-02-13T14:52:07.960472+0000 mon.a (mon.0) 2150 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:08.962 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [==========] Running 77 tests from 4 test suites. 2024-02-13T14:52:08.962 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] Global test environment set-up. 2024-02-13T14:52:08.962 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP 2024-02-13T14:52:08.962 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: seed 64695 2024-02-13T14:52:08.962 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.Dirty 2024-02-13T14:52:08.962 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierPP.Dirty (419 ms) 2024-02-13T14:52:08.962 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.FlushWriteRaces 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierPP.FlushWriteRaces (25916 ms) 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierPP.HitSetNone 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierPP.HitSetNone (36 ms) 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 3 tests from LibRadosTierPP (26371 ms total) 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Overlay 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Overlay (10677 ms) 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Promote 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Promote (11993 ms) 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnap 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnap (10608 ms) 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapScrub 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: my_snaps [3] 2024-02-13T14:52:08.963 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: my_snaps [4,3] 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: my_snaps [5,4,3] 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: my_snaps [6,5,4,3] 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting some heads 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting from clones for snap 6 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting from clones for snap 5 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting from clones for snap 4 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: promoting from clones for snap 3 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: waiting for scrubs... 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: done waiting 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapScrub (47881 ms) 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteSnapTrimRace 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteSnapTrimRace (9540 ms) 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Whiteout 2024-02-13T14:52:08.964 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Whiteout (8059 ms) 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.WhiteoutDeleteCreate (7975 ms) 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Evict 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Evict (8084 ms) 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap (10052 ms) 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnap2 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnap2 (9005 ms) 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ListSnap 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ListSnap (10512 ms) 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.EvictSnapRollbackReadRace (12510 ms) 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlush 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlush (8462 ms) 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.Flush 2024-02-13T14:52:08.965 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.Flush (7600 ms) 2024-02-13T14:52:08.966 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushSnap 2024-02-13T14:52:08.966 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushSnap (13083 ms) 2024-02-13T14:52:08.966 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.FlushTryFlushRaces 2024-02-13T14:52:08.966 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.FlushTryFlushRaces (7854 ms) 2024-02-13T14:52:08.966 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TryFlushReadRace 2024-02-13T14:52:08.966 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TryFlushReadRace (8045 ms) 2024-02-13T14:52:10.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:09 smithi062 bash[21479]: audit 2024-02-13T14:52:08.948502+0000 mon.a (mon.0) 2151 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:10.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:09 smithi062 bash[21479]: cluster 2024-02-13T14:52:08.955448+0000 mon.a (mon.0) 2152 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-02-13T14:52:10.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:09 smithi062 bash[21479]: audit 2024-02-13T14:52:08.958950+0000 mon.a (mon.0) 2153 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:09 smithi062 bash[28859]: audit 2024-02-13T14:52:08.948502+0000 mon.a (mon.0) 2151 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:09 smithi062 bash[28859]: cluster 2024-02-13T14:52:08.955448+0000 mon.a (mon.0) 2152 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-02-13T14:52:10.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:09 smithi062 bash[28859]: audit 2024-02-13T14:52:08.958950+0000 mon.a (mon.0) 2153 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:10.315 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:09 smithi111 bash[23388]: audit 2024-02-13T14:52:08.948502+0000 mon.a (mon.0) 2151 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:10.315 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:09 smithi111 bash[23388]: cluster 2024-02-13T14:52:08.955448+0000 mon.a (mon.0) 2152 : cluster 0 osdmap e303: 8 total, 8 up, 8 in 2024-02-13T14:52:10.315 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:09 smithi111 bash[23388]: audit 2024-02-13T14:52:08.958950+0000 mon.a (mon.0) 2153 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]: dispatch 2024-02-13T14:52:10.592 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:52:11.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: cluster 2024-02-13T14:52:09.871854+0000 mgr.y (mgr.14613) 346 : cluster 0 pgmap v466: 292 pgs: 292 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: audit 2024-02-13T14:52:09.962138+0000 mon.a (mon.0) 2154 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: cluster 2024-02-13T14:52:09.972587+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: audit 2024-02-13T14:52:09.979375+0000 mon.c (mon.2) 607 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: audit 2024-02-13T14:52:09.980899+0000 mon.a (mon.0) 2156 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: audit 2024-02-13T14:52:10.016125+0000 mon.a (mon.0) 2157 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: audit 2024-02-13T14:52:10.017550+0000 mon.a (mon.0) 2158 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: audit 2024-02-13T14:52:10.017937+0000 mon.a (mon.0) 2159 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi062-64512-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[21479]: audit 2024-02-13T14:52:10.315954+0000 mgr.y (mgr.14613) 347 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:11.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: cluster 2024-02-13T14:52:09.871854+0000 mgr.y (mgr.14613) 346 : cluster 0 pgmap v466: 292 pgs: 292 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T14:52:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: audit 2024-02-13T14:52:09.962138+0000 mon.a (mon.0) 2154 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: cluster 2024-02-13T14:52:09.972587+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-02-13T14:52:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: audit 2024-02-13T14:52:09.979375+0000 mon.c (mon.2) 607 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: audit 2024-02-13T14:52:09.980899+0000 mon.a (mon.0) 2156 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: audit 2024-02-13T14:52:10.016125+0000 mon.a (mon.0) 2157 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: audit 2024-02-13T14:52:10.017550+0000 mon.a (mon.0) 2158 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: audit 2024-02-13T14:52:10.017937+0000 mon.a (mon.0) 2159 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi062-64512-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:10 smithi062 bash[28859]: audit 2024-02-13T14:52:10.315954+0000 mgr.y (mgr.14613) 347 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: cluster 2024-02-13T14:52:09.871854+0000 mgr.y (mgr.14613) 346 : cluster 0 pgmap v466: 292 pgs: 292 active+clean; 8.4 MiB data, 637 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T14:52:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: audit 2024-02-13T14:52:09.962138+0000 mon.a (mon.0) 2154 : audit 1 from='client.? v1:172.21.15.62:0/3956198996' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"IsSafePP_smithi062-64512-55"}]': finished 2024-02-13T14:52:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: cluster 2024-02-13T14:52:09.972587+0000 mon.a (mon.0) 2155 : cluster 0 osdmap e304: 8 total, 8 up, 8 in 2024-02-13T14:52:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: audit 2024-02-13T14:52:09.979375+0000 mon.c (mon.2) 607 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: audit 2024-02-13T14:52:09.980899+0000 mon.a (mon.0) 2156 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:11.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: audit 2024-02-13T14:52:10.016125+0000 mon.a (mon.0) 2157 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:11.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: audit 2024-02-13T14:52:10.017550+0000 mon.a (mon.0) 2158 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:11.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: audit 2024-02-13T14:52:10.017937+0000 mon.a (mon.0) 2159 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi062-64512-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:11.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:10 smithi111 bash[23388]: audit 2024-02-13T14:52:10.315954+0000 mgr.y (mgr.14613) 347 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:12.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[21479]: audit 2024-02-13T14:52:10.973404+0000 mon.a (mon.0) 2160 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[21479]: audit 2024-02-13T14:52:10.973626+0000 mon.a (mon.0) 2161 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi062-64512-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[21479]: cluster 2024-02-13T14:52:10.981687+0000 mon.a (mon.0) 2162 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-02-13T14:52:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[21479]: audit 2024-02-13T14:52:10.983791+0000 mon.a (mon.0) 2163 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi062-64512-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[21479]: audit 2024-02-13T14:52:10.986709+0000 mon.c (mon.2) 608 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[21479]: audit 2024-02-13T14:52:10.989520+0000 mon.a (mon.0) 2164 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[28859]: audit 2024-02-13T14:52:10.973404+0000 mon.a (mon.0) 2160 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[28859]: audit 2024-02-13T14:52:10.973626+0000 mon.a (mon.0) 2161 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi062-64512-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[28859]: cluster 2024-02-13T14:52:10.981687+0000 mon.a (mon.0) 2162 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-02-13T14:52:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[28859]: audit 2024-02-13T14:52:10.983791+0000 mon.a (mon.0) 2163 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi062-64512-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[28859]: audit 2024-02-13T14:52:10.986709+0000 mon.c (mon.2) 608 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:11 smithi062 bash[28859]: audit 2024-02-13T14:52:10.989520+0000 mon.a (mon.0) 2164 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:11 smithi111 bash[23388]: audit 2024-02-13T14:52:10.973404+0000 mon.a (mon.0) 2160 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-41","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:11 smithi111 bash[23388]: audit 2024-02-13T14:52:10.973626+0000 mon.a (mon.0) 2161 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ReturnValuePP_smithi062-64512-56", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:11 smithi111 bash[23388]: cluster 2024-02-13T14:52:10.981687+0000 mon.a (mon.0) 2162 : cluster 0 osdmap e305: 8 total, 8 up, 8 in 2024-02-13T14:52:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:11 smithi111 bash[23388]: audit 2024-02-13T14:52:10.983791+0000 mon.a (mon.0) 2163 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi062-64512-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:12.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:11 smithi111 bash[23388]: audit 2024-02-13T14:52:10.986709+0000 mon.c (mon.2) 608 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:12.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:11 smithi111 bash[23388]: audit 2024-02-13T14:52:10.989520+0000 mon.a (mon.0) 2164 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:13.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[21479]: cluster 2024-02-13T14:52:11.872764+0000 mgr.y (mgr.14613) 348 : cluster 0 pgmap v469: 324 pgs: 6 creating+peering, 26 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T14:52:13.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[21479]: audit 2024-02-13T14:52:11.984835+0000 mon.a (mon.0) 2165 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:13.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[21479]: audit 2024-02-13T14:52:12.001825+0000 mon.c (mon.2) 609 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:13.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[21479]: cluster 2024-02-13T14:52:12.453158+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-02-13T14:52:13.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[21479]: audit 2024-02-13T14:52:12.454397+0000 mon.a (mon.0) 2167 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[28859]: cluster 2024-02-13T14:52:11.872764+0000 mgr.y (mgr.14613) 348 : cluster 0 pgmap v469: 324 pgs: 6 creating+peering, 26 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T14:52:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[28859]: audit 2024-02-13T14:52:11.984835+0000 mon.a (mon.0) 2165 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[28859]: audit 2024-02-13T14:52:12.001825+0000 mon.c (mon.2) 609 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[28859]: cluster 2024-02-13T14:52:12.453158+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-02-13T14:52:13.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:13 smithi062 bash[28859]: audit 2024-02-13T14:52:12.454397+0000 mon.a (mon.0) 2167 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:13 smithi111 bash[23388]: cluster 2024-02-13T14:52:11.872764+0000 mgr.y (mgr.14613) 348 : cluster 0 pgmap v469: 324 pgs: 6 creating+peering, 26 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T14:52:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:13 smithi111 bash[23388]: audit 2024-02-13T14:52:11.984835+0000 mon.a (mon.0) 2165 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:13 smithi111 bash[23388]: audit 2024-02-13T14:52:12.001825+0000 mon.c (mon.2) 609 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:13 smithi111 bash[23388]: cluster 2024-02-13T14:52:12.453158+0000 mon.a (mon.0) 2166 : cluster 0 osdmap e306: 8 total, 8 up, 8 in 2024-02-13T14:52:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:13 smithi111 bash[23388]: audit 2024-02-13T14:52:12.454397+0000 mon.a (mon.0) 2167 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:14.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: audit 2024-02-13T14:52:12.988138+0000 mon.a (mon.0) 2168 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi062-64512-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: audit 2024-02-13T14:52:12.988351+0000 mon.a (mon.0) 2169 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: audit 2024-02-13T14:52:12.998947+0000 mon.c (mon.2) 610 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: cluster 2024-02-13T14:52:12.999060+0000 mon.a (mon.0) 2170 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: audit 2024-02-13T14:52:13.003513+0000 mon.a (mon.0) 2171 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: audit 2024-02-13T14:52:13.991169+0000 mon.a (mon.0) 2172 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: cluster 2024-02-13T14:52:13.998765+0000 mon.a (mon.0) 2173 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: audit 2024-02-13T14:52:14.000932+0000 mon.c (mon.2) 611 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[21479]: audit 2024-02-13T14:52:14.003228+0000 mon.a (mon.0) 2174 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: audit 2024-02-13T14:52:12.988138+0000 mon.a (mon.0) 2168 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi062-64512-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: audit 2024-02-13T14:52:12.988351+0000 mon.a (mon.0) 2169 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:52:14.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: audit 2024-02-13T14:52:12.998947+0000 mon.c (mon.2) 610 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:14.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: cluster 2024-02-13T14:52:12.999060+0000 mon.a (mon.0) 2170 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-02-13T14:52:14.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: audit 2024-02-13T14:52:13.003513+0000 mon.a (mon.0) 2171 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:14.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: audit 2024-02-13T14:52:13.991169+0000 mon.a (mon.0) 2172 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:14.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: cluster 2024-02-13T14:52:13.998765+0000 mon.a (mon.0) 2173 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-02-13T14:52:14.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: audit 2024-02-13T14:52:14.000932+0000 mon.c (mon.2) 611 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:52:14.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:14 smithi062 bash[28859]: audit 2024-02-13T14:52:14.003228+0000 mon.a (mon.0) 2174 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:52:14.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: audit 2024-02-13T14:52:12.988138+0000 mon.a (mon.0) 2168 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ReturnValuePP_smithi062-64512-56", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: audit 2024-02-13T14:52:12.988351+0000 mon.a (mon.0) 2169 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:52:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: audit 2024-02-13T14:52:12.998947+0000 mon.c (mon.2) 610 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: cluster 2024-02-13T14:52:12.999060+0000 mon.a (mon.0) 2170 : cluster 0 osdmap e307: 8 total, 8 up, 8 in 2024-02-13T14:52:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: audit 2024-02-13T14:52:13.003513+0000 mon.a (mon.0) 2171 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: audit 2024-02-13T14:52:13.991169+0000 mon.a (mon.0) 2172 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: cluster 2024-02-13T14:52:13.998765+0000 mon.a (mon.0) 2173 : cluster 0 osdmap e308: 8 total, 8 up, 8 in 2024-02-13T14:52:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: audit 2024-02-13T14:52:14.000932+0000 mon.c (mon.2) 611 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:52:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:14 smithi111 bash[23388]: audit 2024-02-13T14:52:14.003228+0000 mon.a (mon.0) 2174 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:52:15.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[21479]: cluster 2024-02-13T14:52:13.873830+0000 mgr.y (mgr.14613) 349 : cluster 0 pgmap v472: 332 pgs: 6 creating+peering, 34 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:15.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[21479]: cluster 2024-02-13T14:52:14.017002+0000 mon.a (mon.0) 2175 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:15.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[21479]: audit 2024-02-13T14:52:14.993746+0000 mon.a (mon.0) 2176 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:52:15.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[21479]: cluster 2024-02-13T14:52:15.001166+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-02-13T14:52:15.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[21479]: audit 2024-02-13T14:52:15.005405+0000 mon.a (mon.0) 2178 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:15.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[28859]: cluster 2024-02-13T14:52:13.873830+0000 mgr.y (mgr.14613) 349 : cluster 0 pgmap v472: 332 pgs: 6 creating+peering, 34 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:15.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[28859]: cluster 2024-02-13T14:52:14.017002+0000 mon.a (mon.0) 2175 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:15.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[28859]: audit 2024-02-13T14:52:14.993746+0000 mon.a (mon.0) 2176 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:52:15.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[28859]: cluster 2024-02-13T14:52:15.001166+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-02-13T14:52:15.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:15 smithi062 bash[28859]: audit 2024-02-13T14:52:15.005405+0000 mon.a (mon.0) 2178 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:15.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:15 smithi111 bash[23388]: cluster 2024-02-13T14:52:13.873830+0000 mgr.y (mgr.14613) 349 : cluster 0 pgmap v472: 332 pgs: 6 creating+peering, 34 unknown, 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:15.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:15 smithi111 bash[23388]: cluster 2024-02-13T14:52:14.017002+0000 mon.a (mon.0) 2175 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:15.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:15 smithi111 bash[23388]: audit 2024-02-13T14:52:14.993746+0000 mon.a (mon.0) 2176 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-41","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:52:15.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:15 smithi111 bash[23388]: cluster 2024-02-13T14:52:15.001166+0000 mon.a (mon.0) 2177 : cluster 0 osdmap e309: 8 total, 8 up, 8 in 2024-02-13T14:52:15.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:15 smithi111 bash[23388]: audit 2024-02-13T14:52:15.005405+0000 mon.a (mon.0) 2178 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:16.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:52:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:52:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[21479]: cluster 2024-02-13T14:52:15.875202+0000 mgr.y (mgr.14613) 350 : cluster 0 pgmap v475: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[21479]: audit 2024-02-13T14:52:15.996405+0000 mon.a (mon.0) 2179 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[21479]: cluster 2024-02-13T14:52:16.004111+0000 mon.a (mon.0) 2180 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[21479]: audit 2024-02-13T14:52:16.005312+0000 mon.a (mon.0) 2181 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[21479]: audit 2024-02-13T14:52:16.094409+0000 mon.c (mon.2) 612 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[21479]: audit 2024-02-13T14:52:16.095155+0000 mon.a (mon.0) 2182 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[21479]: audit 2024-02-13T14:52:16.096405+0000 mon.c (mon.2) 613 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]: dispatch 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[21479]: audit 2024-02-13T14:52:16.097054+0000 mon.a (mon.0) 2183 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]: dispatch 2024-02-13T14:52:17.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[28859]: cluster 2024-02-13T14:52:15.875202+0000 mgr.y (mgr.14613) 350 : cluster 0 pgmap v475: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[28859]: audit 2024-02-13T14:52:15.996405+0000 mon.a (mon.0) 2179 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[28859]: cluster 2024-02-13T14:52:16.004111+0000 mon.a (mon.0) 2180 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-02-13T14:52:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[28859]: audit 2024-02-13T14:52:16.005312+0000 mon.a (mon.0) 2181 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[28859]: audit 2024-02-13T14:52:16.094409+0000 mon.c (mon.2) 612 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[28859]: audit 2024-02-13T14:52:16.095155+0000 mon.a (mon.0) 2182 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[28859]: audit 2024-02-13T14:52:16.096405+0000 mon.c (mon.2) 613 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]: dispatch 2024-02-13T14:52:17.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:17 smithi062 bash[28859]: audit 2024-02-13T14:52:16.097054+0000 mon.a (mon.0) 2183 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]: dispatch 2024-02-13T14:52:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:17 smithi111 bash[23388]: cluster 2024-02-13T14:52:15.875202+0000 mgr.y (mgr.14613) 350 : cluster 0 pgmap v475: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:17 smithi111 bash[23388]: audit 2024-02-13T14:52:15.996405+0000 mon.a (mon.0) 2179 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:17 smithi111 bash[23388]: cluster 2024-02-13T14:52:16.004111+0000 mon.a (mon.0) 2180 : cluster 0 osdmap e310: 8 total, 8 up, 8 in 2024-02-13T14:52:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:17 smithi111 bash[23388]: audit 2024-02-13T14:52:16.005312+0000 mon.a (mon.0) 2181 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]: dispatch 2024-02-13T14:52:17.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:17 smithi111 bash[23388]: audit 2024-02-13T14:52:16.094409+0000 mon.c (mon.2) 612 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:17 smithi111 bash[23388]: audit 2024-02-13T14:52:16.095155+0000 mon.a (mon.0) 2182 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:17 smithi111 bash[23388]: audit 2024-02-13T14:52:16.096405+0000 mon.c (mon.2) 613 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]: dispatch 2024-02-13T14:52:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:17 smithi111 bash[23388]: audit 2024-02-13T14:52:16.097054+0000 mon.a (mon.0) 2183 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]: dispatch 2024-02-13T14:52:18.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: audit 2024-02-13T14:52:16.999879+0000 mon.a (mon.0) 2184 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: audit 2024-02-13T14:52:17.000035+0000 mon.a (mon.0) 2185 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]': finished 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: cluster 2024-02-13T14:52:17.007951+0000 mon.a (mon.0) 2186 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: audit 2024-02-13T14:52:17.044666+0000 mon.c (mon.2) 614 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: audit 2024-02-13T14:52:17.046587+0000 mon.a (mon.0) 2187 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: audit 2024-02-13T14:52:17.047140+0000 mon.c (mon.2) 615 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: audit 2024-02-13T14:52:17.047430+0000 mon.a (mon.0) 2188 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: audit 2024-02-13T14:52:17.047976+0000 mon.c (mon.2) 616 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[21479]: audit 2024-02-13T14:52:17.048323+0000 mon.a (mon.0) 2189 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:18.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: audit 2024-02-13T14:52:16.999879+0000 mon.a (mon.0) 2184 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: audit 2024-02-13T14:52:17.000035+0000 mon.a (mon.0) 2185 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]': finished 2024-02-13T14:52:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: cluster 2024-02-13T14:52:17.007951+0000 mon.a (mon.0) 2186 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-02-13T14:52:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: audit 2024-02-13T14:52:17.044666+0000 mon.c (mon.2) 614 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: audit 2024-02-13T14:52:17.046587+0000 mon.a (mon.0) 2187 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: audit 2024-02-13T14:52:17.047140+0000 mon.c (mon.2) 615 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: audit 2024-02-13T14:52:17.047430+0000 mon.a (mon.0) 2188 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: audit 2024-02-13T14:52:17.047976+0000 mon.c (mon.2) 616 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:18 smithi062 bash[28859]: audit 2024-02-13T14:52:17.048323+0000 mon.a (mon.0) 2189 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:18.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: audit 2024-02-13T14:52:16.999879+0000 mon.a (mon.0) 2184 : audit 1 from='client.? v1:172.21.15.62:0/2700833385' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ReturnValuePP_smithi062-64512-56"}]': finished 2024-02-13T14:52:18.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: audit 2024-02-13T14:52:17.000035+0000 mon.a (mon.0) 2185 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-41"}]': finished 2024-02-13T14:52:18.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: cluster 2024-02-13T14:52:17.007951+0000 mon.a (mon.0) 2186 : cluster 0 osdmap e311: 8 total, 8 up, 8 in 2024-02-13T14:52:18.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: audit 2024-02-13T14:52:17.044666+0000 mon.c (mon.2) 614 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: audit 2024-02-13T14:52:17.046587+0000 mon.a (mon.0) 2187 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: audit 2024-02-13T14:52:17.047140+0000 mon.c (mon.2) 615 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: audit 2024-02-13T14:52:17.047430+0000 mon.a (mon.0) 2188 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:18.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: audit 2024-02-13T14:52:17.047976+0000 mon.c (mon.2) 616 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:18.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:18 smithi111 bash[23388]: audit 2024-02-13T14:52:17.048323+0000 mon.a (mon.0) 2189 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[28859]: cluster 2024-02-13T14:52:17.876269+0000 mgr.y (mgr.14613) 351 : cluster 0 pgmap v478: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[28859]: audit 2024-02-13T14:52:18.019679+0000 mon.a (mon.0) 2190 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[28859]: audit 2024-02-13T14:52:18.020477+0000 mon.b (mon.1) 195 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[28859]: cluster 2024-02-13T14:52:18.027348+0000 mon.a (mon.0) 2191 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[28859]: audit 2024-02-13T14:52:18.029743+0000 mon.c (mon.2) 617 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[28859]: audit 2024-02-13T14:52:18.031600+0000 mon.a (mon.0) 2192 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[28859]: cluster 2024-02-13T14:52:19.495413+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[21479]: cluster 2024-02-13T14:52:17.876269+0000 mgr.y (mgr.14613) 351 : cluster 0 pgmap v478: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[21479]: audit 2024-02-13T14:52:18.019679+0000 mon.a (mon.0) 2190 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[21479]: audit 2024-02-13T14:52:18.020477+0000 mon.b (mon.1) 195 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[21479]: cluster 2024-02-13T14:52:18.027348+0000 mon.a (mon.0) 2191 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-02-13T14:52:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[21479]: audit 2024-02-13T14:52:18.029743+0000 mon.c (mon.2) 617 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[21479]: audit 2024-02-13T14:52:18.031600+0000 mon.a (mon.0) 2192 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:19 smithi062 bash[21479]: cluster 2024-02-13T14:52:19.495413+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-02-13T14:52:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:19 smithi111 bash[23388]: cluster 2024-02-13T14:52:17.876269+0000 mgr.y (mgr.14613) 351 : cluster 0 pgmap v478: 324 pgs: 324 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:19 smithi111 bash[23388]: audit 2024-02-13T14:52:18.019679+0000 mon.a (mon.0) 2190 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushPP_smithi062-64512-57", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:19 smithi111 bash[23388]: audit 2024-02-13T14:52:18.020477+0000 mon.b (mon.1) 195 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:19 smithi111 bash[23388]: cluster 2024-02-13T14:52:18.027348+0000 mon.a (mon.0) 2191 : cluster 0 osdmap e312: 8 total, 8 up, 8 in 2024-02-13T14:52:19.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:19 smithi111 bash[23388]: audit 2024-02-13T14:52:18.029743+0000 mon.c (mon.2) 617 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:19 smithi111 bash[23388]: audit 2024-02-13T14:52:18.031600+0000 mon.a (mon.0) 2192 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:19 smithi111 bash[23388]: cluster 2024-02-13T14:52:19.495413+0000 mon.a (mon.0) 2193 : cluster 0 osdmap e313: 8 total, 8 up, 8 in 2024-02-13T14:52:20.592 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:52:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: audit 2024-02-13T14:52:19.497166+0000 mon.c (mon.2) 618 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:20.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: audit 2024-02-13T14:52:19.499864+0000 mon.a (mon.0) 2194 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: cluster 2024-02-13T14:52:19.878238+0000 mgr.y (mgr.14613) 352 : cluster 0 pgmap v481: 324 pgs: 15 creating+peering, 17 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: audit 2024-02-13T14:52:20.026831+0000 mon.a (mon.0) 2195 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: audit 2024-02-13T14:52:20.026966+0000 mon.a (mon.0) 2196 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: cluster 2024-02-13T14:52:20.031985+0000 mon.a (mon.0) 2197 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-02-13T14:52:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: audit 2024-02-13T14:52:20.052049+0000 mon.c (mon.2) 619 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi062-64695-6","var": "pg_num","format": "json"}]: dispatch 2024-02-13T14:52:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: audit 2024-02-13T14:52:20.058327+0000 mon.c (mon.2) 620 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: audit 2024-02-13T14:52:20.059364+0000 mon.a (mon.0) 2198 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:20 smithi111 bash[23388]: audit 2024-02-13T14:52:20.322973+0000 mgr.y (mgr.14613) 353 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: audit 2024-02-13T14:52:19.497166+0000 mon.c (mon.2) 618 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: audit 2024-02-13T14:52:19.499864+0000 mon.a (mon.0) 2194 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: cluster 2024-02-13T14:52:19.878238+0000 mgr.y (mgr.14613) 352 : cluster 0 pgmap v481: 324 pgs: 15 creating+peering, 17 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: audit 2024-02-13T14:52:20.026831+0000 mon.a (mon.0) 2195 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: audit 2024-02-13T14:52:20.026966+0000 mon.a (mon.0) 2196 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: cluster 2024-02-13T14:52:20.031985+0000 mon.a (mon.0) 2197 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: audit 2024-02-13T14:52:20.052049+0000 mon.c (mon.2) 619 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi062-64695-6","var": "pg_num","format": "json"}]: dispatch 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: audit 2024-02-13T14:52:20.058327+0000 mon.c (mon.2) 620 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: audit 2024-02-13T14:52:20.059364+0000 mon.a (mon.0) 2198 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:20.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[28859]: audit 2024-02-13T14:52:20.322973+0000 mgr.y (mgr.14613) 353 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: audit 2024-02-13T14:52:19.497166+0000 mon.c (mon.2) 618 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: audit 2024-02-13T14:52:19.499864+0000 mon.a (mon.0) 2194 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: cluster 2024-02-13T14:52:19.878238+0000 mgr.y (mgr.14613) 352 : cluster 0 pgmap v481: 324 pgs: 15 creating+peering, 17 unknown, 292 active+clean; 8.4 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: audit 2024-02-13T14:52:20.026831+0000 mon.a (mon.0) 2195 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushPP_smithi062-64512-57", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: audit 2024-02-13T14:52:20.026966+0000 mon.a (mon.0) 2196 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-43","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: cluster 2024-02-13T14:52:20.031985+0000 mon.a (mon.0) 2197 : cluster 0 osdmap e314: 8 total, 8 up, 8 in 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: audit 2024-02-13T14:52:20.052049+0000 mon.c (mon.2) 619 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi062-64695-6","var": "pg_num","format": "json"}]: dispatch 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: audit 2024-02-13T14:52:20.058327+0000 mon.c (mon.2) 620 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: audit 2024-02-13T14:52:20.059364+0000 mon.a (mon.0) 2198 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:20 smithi062 bash[21479]: audit 2024-02-13T14:52:20.322973+0000 mgr.y (mgr.14613) 353 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:21.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[28859]: cluster 2024-02-13T14:52:20.501771+0000 mon.a (mon.0) 2199 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[28859]: audit 2024-02-13T14:52:21.029738+0000 mon.a (mon.0) 2200 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[28859]: cluster 2024-02-13T14:52:21.037433+0000 mon.a (mon.0) 2201 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[28859]: audit 2024-02-13T14:52:21.041100+0000 mon.c (mon.2) 621 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[28859]: audit 2024-02-13T14:52:21.042107+0000 mon.a (mon.0) 2202 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[21479]: cluster 2024-02-13T14:52:20.501771+0000 mon.a (mon.0) 2199 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[21479]: audit 2024-02-13T14:52:21.029738+0000 mon.a (mon.0) 2200 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[21479]: cluster 2024-02-13T14:52:21.037433+0000 mon.a (mon.0) 2201 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[21479]: audit 2024-02-13T14:52:21.041100+0000 mon.c (mon.2) 621 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T14:52:21.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:21 smithi062 bash[21479]: audit 2024-02-13T14:52:21.042107+0000 mon.a (mon.0) 2202 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T14:52:21.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:21 smithi111 bash[23388]: cluster 2024-02-13T14:52:20.501771+0000 mon.a (mon.0) 2199 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:21.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:21 smithi111 bash[23388]: audit 2024-02-13T14:52:21.029738+0000 mon.a (mon.0) 2200 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:21.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:21 smithi111 bash[23388]: cluster 2024-02-13T14:52:21.037433+0000 mon.a (mon.0) 2201 : cluster 0 osdmap e315: 8 total, 8 up, 8 in 2024-02-13T14:52:21.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:21 smithi111 bash[23388]: audit 2024-02-13T14:52:21.041100+0000 mon.c (mon.2) 621 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T14:52:21.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:21 smithi111 bash[23388]: audit 2024-02-13T14:52:21.042107+0000 mon.a (mon.0) 2202 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]: dispatch 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[21479]: cluster 2024-02-13T14:52:21.879320+0000 mgr.y (mgr.14613) 354 : cluster 0 pgmap v484: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[21479]: audit 2024-02-13T14:52:22.031682+0000 mon.a (mon.0) 2203 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]': finished 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[21479]: cluster 2024-02-13T14:52:22.035644+0000 mon.a (mon.0) 2204 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[21479]: audit 2024-02-13T14:52:22.048927+0000 mon.c (mon.2) 622 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[21479]: audit 2024-02-13T14:52:22.049825+0000 mon.a (mon.0) 2205 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[21479]: audit 2024-02-13T14:52:22.051933+0000 mon.c (mon.2) 623 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[21479]: audit 2024-02-13T14:52:22.053539+0000 mon.a (mon.0) 2206 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[28859]: cluster 2024-02-13T14:52:21.879320+0000 mgr.y (mgr.14613) 354 : cluster 0 pgmap v484: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:23.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[28859]: audit 2024-02-13T14:52:22.031682+0000 mon.a (mon.0) 2203 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]': finished 2024-02-13T14:52:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[28859]: cluster 2024-02-13T14:52:22.035644+0000 mon.a (mon.0) 2204 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-02-13T14:52:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[28859]: audit 2024-02-13T14:52:22.048927+0000 mon.c (mon.2) 622 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[28859]: audit 2024-02-13T14:52:22.049825+0000 mon.a (mon.0) 2205 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[28859]: audit 2024-02-13T14:52:22.051933+0000 mon.c (mon.2) 623 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:23 smithi062 bash[28859]: audit 2024-02-13T14:52:22.053539+0000 mon.a (mon.0) 2206 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:23 smithi111 bash[23388]: cluster 2024-02-13T14:52:21.879320+0000 mgr.y (mgr.14613) 354 : cluster 0 pgmap v484: 332 pgs: 8 unknown, 32 creating+peering, 292 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:23 smithi111 bash[23388]: audit 2024-02-13T14:52:22.031682+0000 mon.a (mon.0) 2203 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_count","val": "8"}]': finished 2024-02-13T14:52:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:23 smithi111 bash[23388]: cluster 2024-02-13T14:52:22.035644+0000 mon.a (mon.0) 2204 : cluster 0 osdmap e316: 8 total, 8 up, 8 in 2024-02-13T14:52:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:23 smithi111 bash[23388]: audit 2024-02-13T14:52:22.048927+0000 mon.c (mon.2) 622 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:23 smithi111 bash[23388]: audit 2024-02-13T14:52:22.049825+0000 mon.a (mon.0) 2205 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:23 smithi111 bash[23388]: audit 2024-02-13T14:52:22.051933+0000 mon.c (mon.2) 623 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:23 smithi111 bash[23388]: audit 2024-02-13T14:52:22.053539+0000 mon.a (mon.0) 2206 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:24.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[21479]: audit 2024-02-13T14:52:23.045879+0000 mon.a (mon.0) 2207 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:24.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[21479]: audit 2024-02-13T14:52:23.046220+0000 mon.a (mon.0) 2208 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:24.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[21479]: cluster 2024-02-13T14:52:23.055317+0000 mon.a (mon.0) 2209 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[21479]: audit 2024-02-13T14:52:23.058371+0000 mon.c (mon.2) 624 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[21479]: audit 2024-02-13T14:52:23.059289+0000 mon.a (mon.0) 2210 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[21479]: audit 2024-02-13T14:52:23.061602+0000 mon.c (mon.2) 625 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[21479]: audit 2024-02-13T14:52:23.062427+0000 mon.a (mon.0) 2211 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[28859]: audit 2024-02-13T14:52:23.045879+0000 mon.a (mon.0) 2207 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[28859]: audit 2024-02-13T14:52:23.046220+0000 mon.a (mon.0) 2208 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[28859]: cluster 2024-02-13T14:52:23.055317+0000 mon.a (mon.0) 2209 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[28859]: audit 2024-02-13T14:52:23.058371+0000 mon.c (mon.2) 624 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[28859]: audit 2024-02-13T14:52:23.059289+0000 mon.a (mon.0) 2210 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[28859]: audit 2024-02-13T14:52:23.061602+0000 mon.c (mon.2) 625 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:24.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:24 smithi062 bash[28859]: audit 2024-02-13T14:52:23.062427+0000 mon.a (mon.0) 2211 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:24.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:24 smithi111 bash[23388]: audit 2024-02-13T14:52:23.045879+0000 mon.a (mon.0) 2207 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:24.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:24 smithi111 bash[23388]: audit 2024-02-13T14:52:23.046220+0000 mon.a (mon.0) 2208 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:24.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:24 smithi111 bash[23388]: cluster 2024-02-13T14:52:23.055317+0000 mon.a (mon.0) 2209 : cluster 0 osdmap e317: 8 total, 8 up, 8 in 2024-02-13T14:52:24.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:24 smithi111 bash[23388]: audit 2024-02-13T14:52:23.058371+0000 mon.c (mon.2) 624 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T14:52:24.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:24 smithi111 bash[23388]: audit 2024-02-13T14:52:23.059289+0000 mon.a (mon.0) 2210 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]: dispatch 2024-02-13T14:52:24.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:24 smithi111 bash[23388]: audit 2024-02-13T14:52:23.061602+0000 mon.c (mon.2) 625 : audit 1 from='client.? v1:172.21.15.62:0/3982782603' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:24.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:24 smithi111 bash[23388]: audit 2024-02-13T14:52:23.062427+0000 mon.a (mon.0) 2211 : audit 1 from='client.46943 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]: dispatch 2024-02-13T14:52:24.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetRead 2024-02-13T14:52:24.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: hmm, no HitSet yet 2024-02-13T14:52:24.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: ok, hit_set contains 255:602f83fe:::foo:head 2024-02-13T14:52:24.607 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetRead (9066 ms) 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetWrite 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg_num = 32 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 0 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 1 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 2 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 3 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 4 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 5 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 6 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 7 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 8 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 9 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 10 ls 1707835945,0 2024-02-13T14:52:24.608 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 11 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 12 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 13 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 14 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 15 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 16 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 17 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 18 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 19 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 20 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 21 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 22 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 23 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 24 ls 1707835945,0 2024-02-13T14:52:24.609 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 25 ls 1707835945,0 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 26 ls 1707835945,0 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 27 ls 1707835945,0 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 28 ls 1707835945,0 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 29 ls 1707835945,0 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 30 ls 1707835945,0 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg 31 ls 1707835945,0 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: pg_num = 32 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:6cac518f:::0:head 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:02547ec2:::1:head 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f905c69b:::2:head 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:cfc208b3:::3:head 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d83876eb:::4:head 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b29083e3:::5:head 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c4fdafeb:::6:head 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:5c6b0b28:::7:head 2024-02-13T14:52:24.610 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:bd63b0f1:::8:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:e960b815:::9:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:52ea6a34:::10:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:89d3ae78:::11:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:de5d7c5f:::12:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:566253c9:::13:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:62a1935d:::14:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:863748b0:::15:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:3958e169:::16:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:4d4dabf9:::17:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:8391935d:::18:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:28883081:::19:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:69259c59:::20:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:4bdb80b7:::21:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a11c5d71:::22:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:271af37b:::23:head 2024-02-13T14:52:24.611 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:95b121be:::24:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:58d1031b:::25:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:0a050783:::26:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c709704c:::27:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:cbe56eaf:::28:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:86b4b162:::29:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:70d89383:::30:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:dd450c7c:::31:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:6d5729b1:::32:head 2024-02-13T14:52:24.612 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c388f3fb:::33:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:56cfea31:::34:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:9dbc1bf7:::35:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:40b74ccd:::36:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:4d5aaf42:::37:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:920f362c:::38:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:6cc53222:::39:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:9cad833f:::40:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:1ea84d41:::41:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c4480ef6:::42:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a694361e:::43:head 2024-02-13T14:52:24.613 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d1bd33e9:::44:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:ddc2cd5d:::45:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:2b782207:::46:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:7b187fca:::47:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:90ecdf6f:::48:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a5ed95fe:::49:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:ea0eaa55:::50:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f33ef17b:::51:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a0d1b2f6:::52:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:60c5229e:::53:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:edcbc575:::54:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:102cf253:::55:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:efb7fb0b:::56:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:50d0a326:::57:head 2024-02-13T14:52:24.614 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d4dc5daf:::58:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:3a130462:::59:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:ec87ed71:::60:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d5bc9454:::61:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:3ddfe313:::62:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:7c2816b9:::63:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:47e00e4d:::64:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c6410c18:::65:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b48ed237:::66:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:cd63ad31:::67:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b179e92b:::68:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:0d9f741a:::69:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:6d3352ae:::70:head 2024-02-13T14:52:24.615 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c6d5c19e:::71:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:bc4729c3:::72:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:77e930b9:::73:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:0abeecfd:::74:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b7c37e15:::75:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b6378398:::76:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:02bd68de:::77:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:cc795d2d:::78:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:630d4fea:::79:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:e0d29ef5:::80:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:fd6f13d2:::81:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:606461d5:::82:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:eadbdc43:::83:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:8761d0bb:::84:head 2024-02-13T14:52:24.616 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:9ef0186f:::85:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:e0d41294:::86:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:961de695:::87:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:1423148f:::88:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:633a8fa2:::89:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a8653809:::90:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:3dac8b33:::91:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:35aad435:::92:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f6dcc343:::93:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:dbbdad87:::94:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:1cb48ce0:::95:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:03cd461c:::96:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:17a4ea99:::97:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:9993c9a7:::98:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:6394211c:::99:head 2024-02-13T14:52:24.617 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:94c7ae57:::100:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:6fdee5bb:::101:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:9a477fd1:::102:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:eb850916:::103:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:affc56b9:::104:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b42dc814:::105:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f319f8f0:::106:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:9a40b9de:::107:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:8b524f28:::108:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:e3de589f:::109:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:90f90a5b:::110:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a7b4f1d7:::111:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:af51766e:::112:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b6f90bd1:::113:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:e0261208:::114:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c9569ef7:::115:head 2024-02-13T14:52:24.618 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:61bebe50:::116:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:fe93412b:::117:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d3d38bee:::118:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:3100ba0c:::119:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d0560ada:::120:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f0ea8b35:::121:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:766f231a:::122:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a07a2582:::123:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:bd7c6b3a:::124:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:fb2ddaff:::125:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:4408e1fe:::126:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:ee1df7a7:::127:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c3002909:::128:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:4f48ffa9:::129:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:edf38733:::130:head 2024-02-13T14:52:24.619 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c08425c0:::131:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:5f902d98:::132:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:41ea2c93:::133:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:813cee13:::134:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:0131818d:::135:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:26ba5a85:::136:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:381b8a5a:::137:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:28797e47:::138:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:bfca7f22:::139:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:36807075:::140:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:80b03975:::141:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:5c15709b:::142:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f39ea15e:::143:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:ea992956:::144:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:48887b1c:::145:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:9f24a9dd:::146:head 2024-02-13T14:52:24.620 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:987f100b:::147:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d2dd3581:::148:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:7fed1808:::149:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c80b70e9:::150:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:85ed90f9:::151:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:36428b24:::152:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d044c34a:::153:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:7c18bf58:::154:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d1c21232:::155:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a7a3c575:::156:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:87da0633:::157:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d5ac3822:::158:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:3f20522d:::159:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:6ca26563:::160:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:532ce135:::161:head 2024-02-13T14:52:24.621 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:c78863e6:::162:head 2024-02-13T14:52:25.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: cluster 2024-02-13T14:52:23.880266+0000 mgr.y (mgr.14613) 355 : cluster 0 pgmap v487: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.055729+0000 mon.a (mon.0) 2212 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.055970+0000 mon.a (mon.0) 2213 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: cluster 2024-02-13T14:52:24.067224+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.105747+0000 mon.a (mon.0) 2215 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.107257+0000 mon.a (mon.0) 2216 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.107590+0000 mon.a (mon.0) 2217 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi062-64512-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.608989+0000 mon.c (mon.2) 626 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi062-64695-43","var": "pg_num","format": "json"}]: dispatch 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.919361+0000 mon.c (mon.2) 627 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.919975+0000 mon.a (mon.0) 2218 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.920885+0000 mon.c (mon.2) 628 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]: dispatch 2024-02-13T14:52:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:25 smithi111 bash[23388]: audit 2024-02-13T14:52:24.921451+0000 mon.a (mon.0) 2219 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]: dispatch 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: cluster 2024-02-13T14:52:23.880266+0000 mgr.y (mgr.14613) 355 : cluster 0 pgmap v487: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.055729+0000 mon.a (mon.0) 2212 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.055970+0000 mon.a (mon.0) 2213 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: cluster 2024-02-13T14:52:24.067224+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.105747+0000 mon.a (mon.0) 2215 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.107257+0000 mon.a (mon.0) 2216 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.107590+0000 mon.a (mon.0) 2217 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi062-64512-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.608989+0000 mon.c (mon.2) 626 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi062-64695-43","var": "pg_num","format": "json"}]: dispatch 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.919361+0000 mon.c (mon.2) 627 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.919975+0000 mon.a (mon.0) 2218 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.920885+0000 mon.c (mon.2) 628 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]: dispatch 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[28859]: audit 2024-02-13T14:52:24.921451+0000 mon.a (mon.0) 2219 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]: dispatch 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: cluster 2024-02-13T14:52:23.880266+0000 mgr.y (mgr.14613) 355 : cluster 0 pgmap v487: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 655 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.055729+0000 mon.a (mon.0) 2212 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-43","var": "hit_set_type","val": "explicit_hash"}]': finished 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.055970+0000 mon.a (mon.0) 2213 : audit 1 from='client.46943 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushPP_smithi062-64512-57"}]': finished 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: cluster 2024-02-13T14:52:24.067224+0000 mon.a (mon.0) 2214 : cluster 0 osdmap e318: 8 total, 8 up, 8 in 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.105747+0000 mon.a (mon.0) 2215 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.107257+0000 mon.a (mon.0) 2216 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.107590+0000 mon.a (mon.0) 2217 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi062-64512-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.608989+0000 mon.c (mon.2) 626 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool get","pool":"test-rados-api-smithi062-64695-43","var": "pg_num","format": "json"}]: dispatch 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.919361+0000 mon.c (mon.2) 627 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.919975+0000 mon.a (mon.0) 2218 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:25.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.920885+0000 mon.c (mon.2) 628 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]: dispatch 2024-02-13T14:52:25.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:25 smithi062 bash[21479]: audit 2024-02-13T14:52:24.921451+0000 mon.a (mon.0) 2219 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]: dispatch 2024-02-13T14:52:26.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:52:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:52:27.310 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[21479]: audit 2024-02-13T14:52:25.058395+0000 mon.a (mon.0) 2220 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi062-64512-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:27.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[21479]: audit 2024-02-13T14:52:25.058612+0000 mon.a (mon.0) 2221 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]': finished 2024-02-13T14:52:27.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[21479]: cluster 2024-02-13T14:52:25.066308+0000 mon.a (mon.0) 2222 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-02-13T14:52:27.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[21479]: audit 2024-02-13T14:52:25.070225+0000 mon.a (mon.0) 2223 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi062-64512-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:27.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[28859]: audit 2024-02-13T14:52:25.058395+0000 mon.a (mon.0) 2220 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi062-64512-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:27.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[28859]: audit 2024-02-13T14:52:25.058612+0000 mon.a (mon.0) 2221 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]': finished 2024-02-13T14:52:27.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[28859]: cluster 2024-02-13T14:52:25.066308+0000 mon.a (mon.0) 2222 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-02-13T14:52:27.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:26 smithi062 bash[28859]: audit 2024-02-13T14:52:25.070225+0000 mon.a (mon.0) 2223 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi062-64512-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:27.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:26 smithi111 bash[23388]: audit 2024-02-13T14:52:25.058395+0000 mon.a (mon.0) 2220 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-FlushAsyncPP_smithi062-64512-58", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:27.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:26 smithi111 bash[23388]: audit 2024-02-13T14:52:25.058612+0000 mon.a (mon.0) 2221 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-43"}]': finished 2024-02-13T14:52:27.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:26 smithi111 bash[23388]: cluster 2024-02-13T14:52:25.066308+0000 mon.a (mon.0) 2222 : cluster 0 osdmap e319: 8 total, 8 up, 8 in 2024-02-13T14:52:27.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:26 smithi111 bash[23388]: audit 2024-02-13T14:52:25.070225+0000 mon.a (mon.0) 2223 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi062-64512-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:28.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[28859]: cluster 2024-02-13T14:52:25.881183+0000 mgr.y (mgr.14613) 356 : cluster 0 pgmap v490: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 KiB/s wr, 51 op/s 2024-02-13T14:52:28.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[28859]: cluster 2024-02-13T14:52:26.536695+0000 mon.a (mon.0) 2224 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-02-13T14:52:28.310 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[28859]: cluster 2024-02-13T14:52:26.989927+0000 mon.a (mon.0) 2225 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[28859]: audit 2024-02-13T14:52:27.066151+0000 mon.a (mon.0) 2226 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi062-64512-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[28859]: cluster 2024-02-13T14:52:27.074500+0000 mon.a (mon.0) 2227 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[28859]: audit 2024-02-13T14:52:27.077179+0000 mon.c (mon.2) 629 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[28859]: audit 2024-02-13T14:52:27.078269+0000 mon.a (mon.0) 2228 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[21479]: cluster 2024-02-13T14:52:25.881183+0000 mgr.y (mgr.14613) 356 : cluster 0 pgmap v490: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 KiB/s wr, 51 op/s 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[21479]: cluster 2024-02-13T14:52:26.536695+0000 mon.a (mon.0) 2224 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[21479]: cluster 2024-02-13T14:52:26.989927+0000 mon.a (mon.0) 2225 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[21479]: audit 2024-02-13T14:52:27.066151+0000 mon.a (mon.0) 2226 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi062-64512-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[21479]: cluster 2024-02-13T14:52:27.074500+0000 mon.a (mon.0) 2227 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[21479]: audit 2024-02-13T14:52:27.077179+0000 mon.c (mon.2) 629 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:28.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:27 smithi062 bash[21479]: audit 2024-02-13T14:52:27.078269+0000 mon.a (mon.0) 2228 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:28.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:27 smithi111 bash[23388]: cluster 2024-02-13T14:52:25.881183+0000 mgr.y (mgr.14613) 356 : cluster 0 pgmap v490: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 50 KiB/s wr, 51 op/s 2024-02-13T14:52:28.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:27 smithi111 bash[23388]: cluster 2024-02-13T14:52:26.536695+0000 mon.a (mon.0) 2224 : cluster 0 osdmap e320: 8 total, 8 up, 8 in 2024-02-13T14:52:28.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:27 smithi111 bash[23388]: cluster 2024-02-13T14:52:26.989927+0000 mon.a (mon.0) 2225 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:28.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:27 smithi111 bash[23388]: audit 2024-02-13T14:52:27.066151+0000 mon.a (mon.0) 2226 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "FlushAsyncPP_smithi062-64512-58", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:28.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:27 smithi111 bash[23388]: cluster 2024-02-13T14:52:27.074500+0000 mon.a (mon.0) 2227 : cluster 0 osdmap e321: 8 total, 8 up, 8 in 2024-02-13T14:52:28.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:27 smithi111 bash[23388]: audit 2024-02-13T14:52:27.077179+0000 mon.c (mon.2) 629 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:28.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:27 smithi111 bash[23388]: audit 2024-02-13T14:52:27.078269+0000 mon.a (mon.0) 2228 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: cluster 2024-02-13T14:52:27.882121+0000 mgr.y (mgr.14613) 357 : cluster 0 pgmap v493: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:29.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: audit 2024-02-13T14:52:28.074651+0000 mon.b (mon.1) 196 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:52:29.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: audit 2024-02-13T14:52:28.075587+0000 mon.a (mon.0) 2229 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:29.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: cluster 2024-02-13T14:52:28.083176+0000 mon.a (mon.0) 2230 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-02-13T14:52:29.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: audit 2024-02-13T14:52:28.095506+0000 mon.c (mon.2) 630 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:29.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: audit 2024-02-13T14:52:28.097404+0000 mon.a (mon.0) 2231 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:29.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: audit 2024-02-13T14:52:28.876011+0000 mon.b (mon.1) 197 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:52:29.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: audit 2024-02-13T14:52:28.878225+0000 mon.b (mon.1) 198 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:52:29.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:29 smithi111 bash[23388]: audit 2024-02-13T14:52:28.888428+0000 mon.a (mon.0) 2232 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: cluster 2024-02-13T14:52:27.882121+0000 mgr.y (mgr.14613) 357 : cluster 0 pgmap v493: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: audit 2024-02-13T14:52:28.074651+0000 mon.b (mon.1) 196 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: audit 2024-02-13T14:52:28.075587+0000 mon.a (mon.0) 2229 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: cluster 2024-02-13T14:52:28.083176+0000 mon.a (mon.0) 2230 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: audit 2024-02-13T14:52:28.095506+0000 mon.c (mon.2) 630 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: audit 2024-02-13T14:52:28.097404+0000 mon.a (mon.0) 2231 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: audit 2024-02-13T14:52:28.876011+0000 mon.b (mon.1) 197 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: audit 2024-02-13T14:52:28.878225+0000 mon.b (mon.1) 198 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:52:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[28859]: audit 2024-02-13T14:52:28.888428+0000 mon.a (mon.0) 2232 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: cluster 2024-02-13T14:52:27.882121+0000 mgr.y (mgr.14613) 357 : cluster 0 pgmap v493: 332 pgs: 40 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: audit 2024-02-13T14:52:28.074651+0000 mon.b (mon.1) 196 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: audit 2024-02-13T14:52:28.075587+0000 mon.a (mon.0) 2229 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-45","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: cluster 2024-02-13T14:52:28.083176+0000 mon.a (mon.0) 2230 : cluster 0 osdmap e322: 8 total, 8 up, 8 in 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: audit 2024-02-13T14:52:28.095506+0000 mon.c (mon.2) 630 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: audit 2024-02-13T14:52:28.097404+0000 mon.a (mon.0) 2231 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: audit 2024-02-13T14:52:28.876011+0000 mon.b (mon.1) 197 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: audit 2024-02-13T14:52:28.878225+0000 mon.b (mon.1) 198 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:52:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:29 smithi062 bash[21479]: audit 2024-02-13T14:52:28.888428+0000 mon.a (mon.0) 2232 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[21479]: audit 2024-02-13T14:52:29.085112+0000 mon.a (mon.0) 2233 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[21479]: cluster 2024-02-13T14:52:29.092659+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[21479]: audit 2024-02-13T14:52:29.094898+0000 mon.c (mon.2) 631 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[21479]: audit 2024-02-13T14:52:29.095540+0000 mon.a (mon.0) 2235 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[21479]: audit 2024-02-13T14:52:29.097736+0000 mon.a (mon.0) 2236 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[28859]: audit 2024-02-13T14:52:29.085112+0000 mon.a (mon.0) 2233 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[28859]: cluster 2024-02-13T14:52:29.092659+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[28859]: audit 2024-02-13T14:52:29.094898+0000 mon.c (mon.2) 631 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[28859]: audit 2024-02-13T14:52:29.095540+0000 mon.a (mon.0) 2235 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:30 smithi062 bash[28859]: audit 2024-02-13T14:52:29.097736+0000 mon.a (mon.0) 2236 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T14:52:30.592 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:52:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:52:30.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:30 smithi111 bash[23388]: audit 2024-02-13T14:52:29.085112+0000 mon.a (mon.0) 2233 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:30.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:30 smithi111 bash[23388]: cluster 2024-02-13T14:52:29.092659+0000 mon.a (mon.0) 2234 : cluster 0 osdmap e323: 8 total, 8 up, 8 in 2024-02-13T14:52:30.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:30 smithi111 bash[23388]: audit 2024-02-13T14:52:29.094898+0000 mon.c (mon.2) 631 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T14:52:30.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:30 smithi111 bash[23388]: audit 2024-02-13T14:52:29.095540+0000 mon.a (mon.0) 2235 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:30.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:30 smithi111 bash[23388]: audit 2024-02-13T14:52:29.097736+0000 mon.a (mon.0) 2236 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T14:52:31.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: cluster 2024-02-13T14:52:29.884169+0000 mgr.y (mgr.14613) 358 : cluster 0 pgmap v496: 324 pgs: 16 unknown, 308 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:31.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:30.087952+0000 mon.a (mon.0) 2237 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:31.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:30.088189+0000 mon.a (mon.0) 2238 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]': finished 2024-02-13T14:52:31.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: cluster 2024-02-13T14:52:30.094186+0000 mon.a (mon.0) 2239 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:30.100390+0000 mon.c (mon.2) 632 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:30.102946+0000 mon.a (mon.0) 2240 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:30.114541+0000 mon.a (mon.0) 2241 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:30.332648+0000 mgr.y (mgr.14613) 359 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:31.091454+0000 mon.a (mon.0) 2242 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:31.091642+0000 mon.a (mon.0) 2243 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]': finished 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: cluster 2024-02-13T14:52:31.097676+0000 mon.a (mon.0) 2244 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[21479]: audit 2024-02-13T14:52:31.101257+0000 mon.c (mon.2) 633 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: cluster 2024-02-13T14:52:29.884169+0000 mgr.y (mgr.14613) 358 : cluster 0 pgmap v496: 324 pgs: 16 unknown, 308 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:30.087952+0000 mon.a (mon.0) 2237 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:30.088189+0000 mon.a (mon.0) 2238 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]': finished 2024-02-13T14:52:31.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: cluster 2024-02-13T14:52:30.094186+0000 mon.a (mon.0) 2239 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-02-13T14:52:31.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:30.100390+0000 mon.c (mon.2) 632 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T14:52:31.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:30.102946+0000 mon.a (mon.0) 2240 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:31.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:30.114541+0000 mon.a (mon.0) 2241 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T14:52:31.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:30.332648+0000 mgr.y (mgr.14613) 359 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:31.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:31.091454+0000 mon.a (mon.0) 2242 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:31.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:31.091642+0000 mon.a (mon.0) 2243 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]': finished 2024-02-13T14:52:31.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: cluster 2024-02-13T14:52:31.097676+0000 mon.a (mon.0) 2244 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-02-13T14:52:31.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:31 smithi062 bash[28859]: audit 2024-02-13T14:52:31.101257+0000 mon.c (mon.2) 633 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:31.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: cluster 2024-02-13T14:52:29.884169+0000 mgr.y (mgr.14613) 358 : cluster 0 pgmap v496: 324 pgs: 16 unknown, 308 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:31.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:30.087952+0000 mon.a (mon.0) 2237 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:31.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:30.088189+0000 mon.a (mon.0) 2238 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_count","val": "3"}]': finished 2024-02-13T14:52:31.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: cluster 2024-02-13T14:52:30.094186+0000 mon.a (mon.0) 2239 : cluster 0 osdmap e324: 8 total, 8 up, 8 in 2024-02-13T14:52:31.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:30.100390+0000 mon.c (mon.2) 632 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T14:52:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:30.102946+0000 mon.a (mon.0) 2240 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]: dispatch 2024-02-13T14:52:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:30.114541+0000 mon.a (mon.0) 2241 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T14:52:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:30.332648+0000 mgr.y (mgr.14613) 359 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:31.091454+0000 mon.a (mon.0) 2242 : audit 1 from='client.? v1:172.21.15.62:0/2277348557' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"FlushAsyncPP_smithi062-64512-58"}]': finished 2024-02-13T14:52:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:31.091642+0000 mon.a (mon.0) 2243 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_period","val": "3"}]': finished 2024-02-13T14:52:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: cluster 2024-02-13T14:52:31.097676+0000 mon.a (mon.0) 2244 : cluster 0 osdmap e325: 8 total, 8 up, 8 in 2024-02-13T14:52:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:31 smithi111 bash[23388]: audit 2024-02-13T14:52:31.101257+0000 mon.c (mon.2) 633 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[21479]: audit 2024-02-13T14:52:31.103756+0000 mon.a (mon.0) 2245 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[21479]: audit 2024-02-13T14:52:31.136682+0000 mon.c (mon.2) 634 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[21479]: audit 2024-02-13T14:52:31.137073+0000 mon.a (mon.0) 2246 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[21479]: audit 2024-02-13T14:52:31.138146+0000 mon.c (mon.2) 635 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[21479]: audit 2024-02-13T14:52:31.138461+0000 mon.a (mon.0) 2247 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[21479]: audit 2024-02-13T14:52:31.138995+0000 mon.c (mon.2) 636 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[21479]: audit 2024-02-13T14:52:31.139302+0000 mon.a (mon.0) 2248 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[28859]: audit 2024-02-13T14:52:31.103756+0000 mon.a (mon.0) 2245 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[28859]: audit 2024-02-13T14:52:31.136682+0000 mon.c (mon.2) 634 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[28859]: audit 2024-02-13T14:52:31.137073+0000 mon.a (mon.0) 2246 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[28859]: audit 2024-02-13T14:52:31.138146+0000 mon.c (mon.2) 635 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[28859]: audit 2024-02-13T14:52:31.138461+0000 mon.a (mon.0) 2247 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[28859]: audit 2024-02-13T14:52:31.138995+0000 mon.c (mon.2) 636 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:32 smithi062 bash[28859]: audit 2024-02-13T14:52:31.139302+0000 mon.a (mon.0) 2248 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:32.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:32 smithi111 bash[23388]: audit 2024-02-13T14:52:31.103756+0000 mon.a (mon.0) 2245 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:32.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:32 smithi111 bash[23388]: audit 2024-02-13T14:52:31.136682+0000 mon.c (mon.2) 634 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:32 smithi111 bash[23388]: audit 2024-02-13T14:52:31.137073+0000 mon.a (mon.0) 2246 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:32 smithi111 bash[23388]: audit 2024-02-13T14:52:31.138146+0000 mon.c (mon.2) 635 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:32 smithi111 bash[23388]: audit 2024-02-13T14:52:31.138461+0000 mon.a (mon.0) 2247 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:32.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:32 smithi111 bash[23388]: audit 2024-02-13T14:52:31.138995+0000 mon.c (mon.2) 636 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:32 smithi111 bash[23388]: audit 2024-02-13T14:52:31.139302+0000 mon.a (mon.0) 2248 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:34.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: cluster 2024-02-13T14:52:31.885240+0000 mgr.y (mgr.14613) 360 : cluster 0 pgmap v499: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: audit 2024-02-13T14:52:32.123757+0000 mon.a (mon.0) 2249 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: audit 2024-02-13T14:52:32.123920+0000 mon.a (mon.0) 2250 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: cluster 2024-02-13T14:52:32.134264+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: audit 2024-02-13T14:52:32.134459+0000 mon.c (mon.2) 637 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: audit 2024-02-13T14:52:32.134653+0000 mon.c (mon.2) 638 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: audit 2024-02-13T14:52:32.137644+0000 mon.a (mon.0) 2252 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: audit 2024-02-13T14:52:32.137920+0000 mon.a (mon.0) 2253 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: audit 2024-02-13T14:52:33.071811+0000 mon.b (mon.1) 199 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[21479]: audit 2024-02-13T14:52:33.127228+0000 mon.a (mon.0) 2254 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T14:52:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: cluster 2024-02-13T14:52:31.885240+0000 mgr.y (mgr.14613) 360 : cluster 0 pgmap v499: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: audit 2024-02-13T14:52:32.123757+0000 mon.a (mon.0) 2249 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: audit 2024-02-13T14:52:32.123920+0000 mon.a (mon.0) 2250 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: cluster 2024-02-13T14:52:32.134264+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: audit 2024-02-13T14:52:32.134459+0000 mon.c (mon.2) 637 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: audit 2024-02-13T14:52:32.134653+0000 mon.c (mon.2) 638 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: audit 2024-02-13T14:52:32.137644+0000 mon.a (mon.0) 2252 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: audit 2024-02-13T14:52:32.137920+0000 mon.a (mon.0) 2253 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: audit 2024-02-13T14:52:33.071811+0000 mon.b (mon.1) 199 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:34.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:33 smithi062 bash[28859]: audit 2024-02-13T14:52:33.127228+0000 mon.a (mon.0) 2254 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T14:52:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: cluster 2024-02-13T14:52:31.885240+0000 mgr.y (mgr.14613) 360 : cluster 0 pgmap v499: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: audit 2024-02-13T14:52:32.123757+0000 mon.a (mon.0) 2249 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:52:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: audit 2024-02-13T14:52:32.123920+0000 mon.a (mon.0) 2250 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:34.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: cluster 2024-02-13T14:52:32.134264+0000 mon.a (mon.0) 2251 : cluster 0 osdmap e326: 8 total, 8 up, 8 in 2024-02-13T14:52:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: audit 2024-02-13T14:52:32.134459+0000 mon.c (mon.2) 637 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T14:52:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: audit 2024-02-13T14:52:32.134653+0000 mon.c (mon.2) 638 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: audit 2024-02-13T14:52:32.137644+0000 mon.a (mon.0) 2252 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T14:52:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: audit 2024-02-13T14:52:32.137920+0000 mon.a (mon.0) 2253 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: audit 2024-02-13T14:52:33.071811+0000 mon.b (mon.1) 199 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:33 smithi111 bash[23388]: audit 2024-02-13T14:52:33.127228+0000 mon.a (mon.0) 2254 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-45","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T14:52:35.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:34 smithi062 bash[21479]: cluster 2024-02-13T14:52:33.592729+0000 mon.a (mon.0) 2255 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-02-13T14:52:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:34 smithi062 bash[21479]: cluster 2024-02-13T14:52:33.886244+0000 mgr.y (mgr.14613) 361 : cluster 0 pgmap v502: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:34 smithi062 bash[21479]: audit 2024-02-13T14:52:34.130048+0000 mon.a (mon.0) 2256 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:35.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:34 smithi062 bash[21479]: cluster 2024-02-13T14:52:34.137921+0000 mon.a (mon.0) 2257 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-02-13T14:52:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:34 smithi062 bash[28859]: cluster 2024-02-13T14:52:33.592729+0000 mon.a (mon.0) 2255 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-02-13T14:52:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:34 smithi062 bash[28859]: cluster 2024-02-13T14:52:33.886244+0000 mgr.y (mgr.14613) 361 : cluster 0 pgmap v502: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:34 smithi062 bash[28859]: audit 2024-02-13T14:52:34.130048+0000 mon.a (mon.0) 2256 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:35.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:34 smithi062 bash[28859]: cluster 2024-02-13T14:52:34.137921+0000 mon.a (mon.0) 2257 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-02-13T14:52:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:34 smithi111 bash[23388]: cluster 2024-02-13T14:52:33.592729+0000 mon.a (mon.0) 2255 : cluster 0 osdmap e327: 8 total, 8 up, 8 in 2024-02-13T14:52:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:34 smithi111 bash[23388]: cluster 2024-02-13T14:52:33.886244+0000 mgr.y (mgr.14613) 361 : cluster 0 pgmap v502: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:34 smithi111 bash[23388]: audit 2024-02-13T14:52:34.130048+0000 mon.a (mon.0) 2256 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "RoundTripWriteFullPP_smithi062-64512-59", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:35.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:34 smithi111 bash[23388]: cluster 2024-02-13T14:52:34.137921+0000 mon.a (mon.0) 2257 : cluster 0 osdmap e328: 8 total, 8 up, 8 in 2024-02-13T14:52:36.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:36 smithi062 bash[28859]: cluster 2024-02-13T14:52:35.140194+0000 mon.a (mon.0) 2258 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-02-13T14:52:36.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:36 smithi062 bash[21479]: cluster 2024-02-13T14:52:35.140194+0000 mon.a (mon.0) 2258 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-02-13T14:52:36.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:52:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:52:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:52:36.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:36 smithi111 bash[23388]: cluster 2024-02-13T14:52:35.140194+0000 mon.a (mon.0) 2258 : cluster 0 osdmap e329: 8 total, 8 up, 8 in 2024-02-13T14:52:37.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[28859]: cluster 2024-02-13T14:52:35.887222+0000 mgr.y (mgr.14613) 362 : cluster 0 pgmap v505: 332 pgs: 8 creating+peering, 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:52:37.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[28859]: cluster 2024-02-13T14:52:36.132597+0000 mon.a (mon.0) 2259 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:37.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[28859]: cluster 2024-02-13T14:52:36.153962+0000 mon.a (mon.0) 2260 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-02-13T14:52:37.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[28859]: audit 2024-02-13T14:52:36.156682+0000 mon.c (mon.2) 639 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:37.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[28859]: audit 2024-02-13T14:52:36.159395+0000 mon.a (mon.0) 2261 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:37.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[21479]: cluster 2024-02-13T14:52:35.887222+0000 mgr.y (mgr.14613) 362 : cluster 0 pgmap v505: 332 pgs: 8 creating+peering, 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:52:37.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[21479]: cluster 2024-02-13T14:52:36.132597+0000 mon.a (mon.0) 2259 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:37.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[21479]: cluster 2024-02-13T14:52:36.153962+0000 mon.a (mon.0) 2260 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-02-13T14:52:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[21479]: audit 2024-02-13T14:52:36.156682+0000 mon.c (mon.2) 639 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:37 smithi062 bash[21479]: audit 2024-02-13T14:52:36.159395+0000 mon.a (mon.0) 2261 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:37.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:37 smithi111 bash[23388]: cluster 2024-02-13T14:52:35.887222+0000 mgr.y (mgr.14613) 362 : cluster 0 pgmap v505: 332 pgs: 8 creating+peering, 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:52:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:37 smithi111 bash[23388]: cluster 2024-02-13T14:52:36.132597+0000 mon.a (mon.0) 2259 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:37 smithi111 bash[23388]: cluster 2024-02-13T14:52:36.153962+0000 mon.a (mon.0) 2260 : cluster 0 osdmap e330: 8 total, 8 up, 8 in 2024-02-13T14:52:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:37 smithi111 bash[23388]: audit 2024-02-13T14:52:36.156682+0000 mon.c (mon.2) 639 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:37 smithi111 bash[23388]: audit 2024-02-13T14:52:36.159395+0000 mon.a (mon.0) 2261 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:38.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:38 smithi062 bash[21479]: audit 2024-02-13T14:52:37.144641+0000 mon.a (mon.0) 2262 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:38.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:38 smithi062 bash[21479]: cluster 2024-02-13T14:52:37.152750+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-02-13T14:52:38.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:38 smithi062 bash[21479]: audit 2024-02-13T14:52:37.157648+0000 mon.c (mon.2) 640 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:38.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:38 smithi062 bash[21479]: audit 2024-02-13T14:52:37.171180+0000 mon.a (mon.0) 2264 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:38.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:38 smithi062 bash[28859]: audit 2024-02-13T14:52:37.144641+0000 mon.a (mon.0) 2262 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:38.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:38 smithi062 bash[28859]: cluster 2024-02-13T14:52:37.152750+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-02-13T14:52:38.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:38 smithi062 bash[28859]: audit 2024-02-13T14:52:37.157648+0000 mon.c (mon.2) 640 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:38.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:38 smithi062 bash[28859]: audit 2024-02-13T14:52:37.171180+0000 mon.a (mon.0) 2264 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:38.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:38 smithi111 bash[23388]: audit 2024-02-13T14:52:37.144641+0000 mon.a (mon.0) 2262 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:38.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:38 smithi111 bash[23388]: cluster 2024-02-13T14:52:37.152750+0000 mon.a (mon.0) 2263 : cluster 0 osdmap e331: 8 total, 8 up, 8 in 2024-02-13T14:52:38.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:38 smithi111 bash[23388]: audit 2024-02-13T14:52:37.157648+0000 mon.c (mon.2) 640 : audit 1 from='client.? v1:172.21.15.62:0/322839688' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:38.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:38 smithi111 bash[23388]: audit 2024-02-13T14:52:37.171180+0000 mon.a (mon.0) 2264 : audit 1 from='client.46955 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]: dispatch 2024-02-13T14:52:39.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:39 smithi062 bash[21479]: cluster 2024-02-13T14:52:37.888275+0000 mgr.y (mgr.14613) 363 : cluster 0 pgmap v508: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:52:39.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:39 smithi062 bash[21479]: audit 2024-02-13T14:52:38.170989+0000 mon.a (mon.0) 2265 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:39.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:39 smithi062 bash[21479]: cluster 2024-02-13T14:52:38.180342+0000 mon.a (mon.0) 2266 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-02-13T14:52:39.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:39 smithi062 bash[28859]: cluster 2024-02-13T14:52:37.888275+0000 mgr.y (mgr.14613) 363 : cluster 0 pgmap v508: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:52:39.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:39 smithi062 bash[28859]: audit 2024-02-13T14:52:38.170989+0000 mon.a (mon.0) 2265 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:39.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:39 smithi062 bash[28859]: cluster 2024-02-13T14:52:38.180342+0000 mon.a (mon.0) 2266 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-02-13T14:52:39.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:39 smithi111 bash[23388]: cluster 2024-02-13T14:52:37.888275+0000 mgr.y (mgr.14613) 363 : cluster 0 pgmap v508: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:52:39.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:39 smithi111 bash[23388]: audit 2024-02-13T14:52:38.170989+0000 mon.a (mon.0) 2265 : audit 1 from='client.46955 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"RoundTripWriteFullPP_smithi062-64512-59"}]': finished 2024-02-13T14:52:39.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:39 smithi111 bash[23388]: cluster 2024-02-13T14:52:38.180342+0000 mon.a (mon.0) 2266 : cluster 0 osdmap e332: 8 total, 8 up, 8 in 2024-02-13T14:52:40.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[21479]: cluster 2024-02-13T14:52:39.189168+0000 mon.a (mon.0) 2267 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[21479]: audit 2024-02-13T14:52:39.196720+0000 mon.c (mon.2) 641 : audit 1 from='client.? v1:172.21.15.62:0/1898097222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[21479]: audit 2024-02-13T14:52:39.211394+0000 mon.a (mon.0) 2268 : audit 1 from='client.46961 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[21479]: audit 2024-02-13T14:52:40.181092+0000 mon.a (mon.0) 2269 : audit 1 from='client.46961 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[21479]: cluster 2024-02-13T14:52:40.189600+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[28859]: cluster 2024-02-13T14:52:39.189168+0000 mon.a (mon.0) 2267 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[28859]: audit 2024-02-13T14:52:39.196720+0000 mon.c (mon.2) 641 : audit 1 from='client.? v1:172.21.15.62:0/1898097222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[28859]: audit 2024-02-13T14:52:39.211394+0000 mon.a (mon.0) 2268 : audit 1 from='client.46961 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[28859]: audit 2024-02-13T14:52:40.181092+0000 mon.a (mon.0) 2269 : audit 1 from='client.46961 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:40.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:40 smithi062 bash[28859]: cluster 2024-02-13T14:52:40.189600+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-02-13T14:52:40.592 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:52:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:52:40.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:40 smithi111 bash[23388]: cluster 2024-02-13T14:52:39.189168+0000 mon.a (mon.0) 2267 : cluster 0 osdmap e333: 8 total, 8 up, 8 in 2024-02-13T14:52:40.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:40 smithi111 bash[23388]: audit 2024-02-13T14:52:39.196720+0000 mon.c (mon.2) 641 : audit 1 from='client.? v1:172.21.15.62:0/1898097222' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:40.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:40 smithi111 bash[23388]: audit 2024-02-13T14:52:39.211394+0000 mon.a (mon.0) 2268 : audit 1 from='client.46961 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:40.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:40 smithi111 bash[23388]: audit 2024-02-13T14:52:40.181092+0000 mon.a (mon.0) 2269 : audit 1 from='client.46961 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "RoundTripWriteFullPP2_smithi062-64512-60","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:40.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:40 smithi111 bash[23388]: cluster 2024-02-13T14:52:40.189600+0000 mon.a (mon.0) 2270 : cluster 0 osdmap e334: 8 total, 8 up, 8 in 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:7462ddf6:o.RoundTripAppendPP (3510 ms) 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RacingRemovePP 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RacingRemovePP (2460 ms) 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP (3025 ms) 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.RoundTripCmpExtPP2 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.RoundTripCmpExtPP2 (3015 ms) 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.PoolEIOFlag 2024-02-13T14:52:41.235 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: setting pool EIO 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: max_success 93, min_failed 94 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.PoolEIOFlag (3973 ms) 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAio.MultiReads 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAio.MultiReads (3012 ms) 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 32 tests from LibRadosAio (152113 ms total) 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.ReadIntoBufferlist 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioPP.ReadIntoBufferlist (3007 ms) 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.XattrsRoundTripPP 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioPP.XattrsRoundTripPP (9555 ms) 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RmXattrPP 2024-02-13T14:52:41.236 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RmXattrPP (14573 ms) 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioPP.RemoveTestPP 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioPP.RemoveTestPP (3012 ms) 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 4 tests from LibRadosAioPP (30147 ms total) 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosIoPP.XattrListPP 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosIoPP.XattrListPP (3465 ms) 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 1 test from LibRadosIoPP (3465 ms total) 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleWritePP 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleWritePP (13532 ms) 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.WaitForSafePP 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.WaitForSafePP (7033 ms) 2024-02-13T14:52:41.237 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP (6996 ms) 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP2 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP2 (7050 ms) 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripPP3 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripPP3 (3021 ms) 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripSparseReadPP 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripSparseReadPP (7061 ms) 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripAppendPP 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripAppendPP (7028 ms) 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsCompletePP 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsCompletePP (6868 ms) 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.IsSafePP 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.IsSafePP (7028 ms) 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ReturnValuePP 2024-02-13T14:52:41.238 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ReturnValuePP (7032 ms) 2024-02-13T14:52:41.239 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushPP 2024-02-13T14:52:41.239 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushPP (7065 ms) 2024-02-13T14:52:41.239 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.FlushAsyncPP 2024-02-13T14:52:41.239 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.FlushAsyncPP (7024 ms) 2024-02-13T14:52:41.239 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP 2024-02-13T14:52:41.239 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP (7083 ms) 2024-02-13T14:52:41.239 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.RoundTripWriteFullPP2 2024-02-13T14:52:41.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:41 smithi062 bash[28859]: cluster 2024-02-13T14:52:39.890347+0000 mgr.y (mgr.14613) 364 : cluster 0 pgmap v511: 356 pgs: 10 creating+peering, 22 unknown, 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:52:41.560 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:41 smithi062 bash[28859]: audit 2024-02-13T14:52:40.341638+0000 mgr.y (mgr.14613) 365 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:41.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:41 smithi062 bash[21479]: cluster 2024-02-13T14:52:39.890347+0000 mgr.y (mgr.14613) 364 : cluster 0 pgmap v511: 356 pgs: 10 creating+peering, 22 unknown, 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:52:41.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:41 smithi062 bash[21479]: audit 2024-02-13T14:52:40.341638+0000 mgr.y (mgr.14613) 365 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:41.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:41 smithi111 bash[23388]: cluster 2024-02-13T14:52:39.890347+0000 mgr.y (mgr.14613) 364 : cluster 0 pgmap v511: 356 pgs: 10 creating+peering, 22 unknown, 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:52:41.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:41 smithi111 bash[23388]: audit 2024-02-13T14:52:40.341638+0000 mgr.y (mgr.14613) 365 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[28859]: cluster 2024-02-13T14:52:41.223491+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-02-13T14:52:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[28859]: audit 2024-02-13T14:52:41.262255+0000 mon.c (mon.2) 642 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[28859]: audit 2024-02-13T14:52:41.262614+0000 mon.a (mon.0) 2272 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[28859]: audit 2024-02-13T14:52:41.263788+0000 mon.c (mon.2) 643 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[28859]: audit 2024-02-13T14:52:41.264077+0000 mon.a (mon.0) 2273 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[28859]: audit 2024-02-13T14:52:41.264565+0000 mon.c (mon.2) 644 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[28859]: audit 2024-02-13T14:52:41.264844+0000 mon.a (mon.0) 2274 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[21479]: cluster 2024-02-13T14:52:41.223491+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-02-13T14:52:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[21479]: audit 2024-02-13T14:52:41.262255+0000 mon.c (mon.2) 642 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[21479]: audit 2024-02-13T14:52:41.262614+0000 mon.a (mon.0) 2272 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[21479]: audit 2024-02-13T14:52:41.263788+0000 mon.c (mon.2) 643 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[21479]: audit 2024-02-13T14:52:41.264077+0000 mon.a (mon.0) 2273 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[21479]: audit 2024-02-13T14:52:41.264565+0000 mon.c (mon.2) 644 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:42 smithi062 bash[21479]: audit 2024-02-13T14:52:41.264844+0000 mon.a (mon.0) 2274 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:42 smithi111 bash[23388]: cluster 2024-02-13T14:52:41.223491+0000 mon.a (mon.0) 2271 : cluster 0 osdmap e335: 8 total, 8 up, 8 in 2024-02-13T14:52:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:42 smithi111 bash[23388]: audit 2024-02-13T14:52:41.262255+0000 mon.c (mon.2) 642 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:42 smithi111 bash[23388]: audit 2024-02-13T14:52:41.262614+0000 mon.a (mon.0) 2272 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:42 smithi111 bash[23388]: audit 2024-02-13T14:52:41.263788+0000 mon.c (mon.2) 643 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:42 smithi111 bash[23388]: audit 2024-02-13T14:52:41.264077+0000 mon.a (mon.0) 2273 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:42 smithi111 bash[23388]: audit 2024-02-13T14:52:41.264565+0000 mon.c (mon.2) 644 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:42 smithi111 bash[23388]: audit 2024-02-13T14:52:41.264844+0000 mon.a (mon.0) 2274 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[21479]: cluster 2024-02-13T14:52:41.891372+0000 mgr.y (mgr.14613) 366 : cluster 0 pgmap v514: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[21479]: cluster 2024-02-13T14:52:42.237092+0000 mon.a (mon.0) 2275 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[21479]: audit 2024-02-13T14:52:42.247001+0000 mon.a (mon.0) 2276 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[21479]: cluster 2024-02-13T14:52:42.254521+0000 mon.a (mon.0) 2277 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[21479]: audit 2024-02-13T14:52:42.261086+0000 mon.c (mon.2) 645 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[21479]: audit 2024-02-13T14:52:42.262127+0000 mon.a (mon.0) 2278 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[28859]: cluster 2024-02-13T14:52:41.891372+0000 mgr.y (mgr.14613) 366 : cluster 0 pgmap v514: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[28859]: cluster 2024-02-13T14:52:42.237092+0000 mon.a (mon.0) 2275 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[28859]: audit 2024-02-13T14:52:42.247001+0000 mon.a (mon.0) 2276 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:43.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[28859]: cluster 2024-02-13T14:52:42.254521+0000 mon.a (mon.0) 2277 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-02-13T14:52:43.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[28859]: audit 2024-02-13T14:52:42.261086+0000 mon.c (mon.2) 645 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:43.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:43 smithi062 bash[28859]: audit 2024-02-13T14:52:42.262127+0000 mon.a (mon.0) 2278 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:43 smithi111 bash[23388]: cluster 2024-02-13T14:52:41.891372+0000 mgr.y (mgr.14613) 366 : cluster 0 pgmap v514: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 2 op/s 2024-02-13T14:52:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:43 smithi111 bash[23388]: cluster 2024-02-13T14:52:42.237092+0000 mon.a (mon.0) 2275 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:43 smithi111 bash[23388]: audit 2024-02-13T14:52:42.247001+0000 mon.a (mon.0) 2276 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPP_smithi062-64512-61", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:43 smithi111 bash[23388]: cluster 2024-02-13T14:52:42.254521+0000 mon.a (mon.0) 2277 : cluster 0 osdmap e336: 8 total, 8 up, 8 in 2024-02-13T14:52:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:43 smithi111 bash[23388]: audit 2024-02-13T14:52:42.261086+0000 mon.c (mon.2) 645 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:43 smithi111 bash[23388]: audit 2024-02-13T14:52:42.262127+0000 mon.a (mon.0) 2278 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:44.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:44 smithi062 bash[21479]: cluster 2024-02-13T14:52:43.712976+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-02-13T14:52:44.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:44 smithi062 bash[28859]: cluster 2024-02-13T14:52:43.712976+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-02-13T14:52:44.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:44 smithi111 bash[23388]: cluster 2024-02-13T14:52:43.712976+0000 mon.a (mon.0) 2279 : cluster 0 osdmap e337: 8 total, 8 up, 8 in 2024-02-13T14:52:45.560 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:45 smithi062 bash[21479]: cluster 2024-02-13T14:52:43.892301+0000 mgr.y (mgr.14613) 367 : cluster 0 pgmap v517: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:45.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:45 smithi062 bash[21479]: audit 2024-02-13T14:52:44.253939+0000 mon.a (mon.0) 2280 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:45.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:45 smithi062 bash[21479]: cluster 2024-02-13T14:52:44.264647+0000 mon.a (mon.0) 2281 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-02-13T14:52:45.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:45 smithi062 bash[21479]: cluster 2024-02-13T14:52:45.264308+0000 mon.a (mon.0) 2282 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-02-13T14:52:45.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:45 smithi062 bash[28859]: cluster 2024-02-13T14:52:43.892301+0000 mgr.y (mgr.14613) 367 : cluster 0 pgmap v517: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:45.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:45 smithi062 bash[28859]: audit 2024-02-13T14:52:44.253939+0000 mon.a (mon.0) 2280 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:45.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:45 smithi062 bash[28859]: cluster 2024-02-13T14:52:44.264647+0000 mon.a (mon.0) 2281 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-02-13T14:52:45.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:45 smithi062 bash[28859]: cluster 2024-02-13T14:52:45.264308+0000 mon.a (mon.0) 2282 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-02-13T14:52:45.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:45 smithi111 bash[23388]: cluster 2024-02-13T14:52:43.892301+0000 mgr.y (mgr.14613) 367 : cluster 0 pgmap v517: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:52:45.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:45 smithi111 bash[23388]: audit 2024-02-13T14:52:44.253939+0000 mon.a (mon.0) 2280 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPP_smithi062-64512-61", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:45.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:45 smithi111 bash[23388]: cluster 2024-02-13T14:52:44.264647+0000 mon.a (mon.0) 2281 : cluster 0 osdmap e338: 8 total, 8 up, 8 in 2024-02-13T14:52:45.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:45 smithi111 bash[23388]: cluster 2024-02-13T14:52:45.264308+0000 mon.a (mon.0) 2282 : cluster 0 osdmap e339: 8 total, 8 up, 8 in 2024-02-13T14:52:46.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:52:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:52:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[28859]: audit 2024-02-13T14:52:45.327924+0000 mon.c (mon.2) 646 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[28859]: audit 2024-02-13T14:52:45.328483+0000 mon.a (mon.0) 2283 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[28859]: audit 2024-02-13T14:52:45.329514+0000 mon.c (mon.2) 647 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]: dispatch 2024-02-13T14:52:46.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[28859]: audit 2024-02-13T14:52:45.330003+0000 mon.a (mon.0) 2284 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]: dispatch 2024-02-13T14:52:46.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[21479]: audit 2024-02-13T14:52:45.327924+0000 mon.c (mon.2) 646 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:46.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[21479]: audit 2024-02-13T14:52:45.328483+0000 mon.a (mon.0) 2283 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:46.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[21479]: audit 2024-02-13T14:52:45.329514+0000 mon.c (mon.2) 647 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]: dispatch 2024-02-13T14:52:46.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:46 smithi062 bash[21479]: audit 2024-02-13T14:52:45.330003+0000 mon.a (mon.0) 2284 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]: dispatch 2024-02-13T14:52:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:46 smithi111 bash[23388]: audit 2024-02-13T14:52:45.327924+0000 mon.c (mon.2) 646 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:46 smithi111 bash[23388]: audit 2024-02-13T14:52:45.328483+0000 mon.a (mon.0) 2283 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:46 smithi111 bash[23388]: audit 2024-02-13T14:52:45.329514+0000 mon.c (mon.2) 647 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]: dispatch 2024-02-13T14:52:46.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:46 smithi111 bash[23388]: audit 2024-02-13T14:52:45.330003+0000 mon.a (mon.0) 2284 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]: dispatch 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[21479]: cluster 2024-02-13T14:52:45.893237+0000 mgr.y (mgr.14613) 368 : cluster 0 pgmap v520: 332 pgs: 8 creating+peering, 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[21479]: audit 2024-02-13T14:52:46.294380+0000 mon.a (mon.0) 2285 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]': finished 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[21479]: cluster 2024-02-13T14:52:46.305759+0000 mon.a (mon.0) 2286 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[21479]: audit 2024-02-13T14:52:46.309586+0000 mon.c (mon.2) 648 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[21479]: audit 2024-02-13T14:52:46.311582+0000 mon.a (mon.0) 2287 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[28859]: cluster 2024-02-13T14:52:45.893237+0000 mgr.y (mgr.14613) 368 : cluster 0 pgmap v520: 332 pgs: 8 creating+peering, 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[28859]: audit 2024-02-13T14:52:46.294380+0000 mon.a (mon.0) 2285 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]': finished 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[28859]: cluster 2024-02-13T14:52:46.305759+0000 mon.a (mon.0) 2286 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[28859]: audit 2024-02-13T14:52:46.309586+0000 mon.c (mon.2) 648 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:47.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:47 smithi062 bash[28859]: audit 2024-02-13T14:52:46.311582+0000 mon.a (mon.0) 2287 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:47.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:47 smithi111 bash[23388]: cluster 2024-02-13T14:52:45.893237+0000 mgr.y (mgr.14613) 368 : cluster 0 pgmap v520: 332 pgs: 8 creating+peering, 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:52:47.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:47 smithi111 bash[23388]: audit 2024-02-13T14:52:46.294380+0000 mon.a (mon.0) 2285 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-45"}]': finished 2024-02-13T14:52:47.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:47 smithi111 bash[23388]: cluster 2024-02-13T14:52:46.305759+0000 mon.a (mon.0) 2286 : cluster 0 osdmap e340: 8 total, 8 up, 8 in 2024-02-13T14:52:47.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:47 smithi111 bash[23388]: audit 2024-02-13T14:52:46.309586+0000 mon.c (mon.2) 648 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:47.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:47 smithi111 bash[23388]: audit 2024-02-13T14:52:46.311582+0000 mon.a (mon.0) 2287 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:48.810 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[28859]: audit 2024-02-13T14:52:47.297071+0000 mon.a (mon.0) 2288 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[28859]: cluster 2024-02-13T14:52:47.304942+0000 mon.a (mon.0) 2289 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[28859]: audit 2024-02-13T14:52:47.307795+0000 mon.c (mon.2) 649 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[28859]: audit 2024-02-13T14:52:47.308630+0000 mon.a (mon.0) 2290 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[28859]: audit 2024-02-13T14:52:48.110169+0000 mon.b (mon.1) 200 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[28859]: audit 2024-02-13T14:52:48.303719+0000 mon.a (mon.0) 2291 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[28859]: cluster 2024-02-13T14:52:48.314670+0000 mon.a (mon.0) 2292 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[21479]: audit 2024-02-13T14:52:47.297071+0000 mon.a (mon.0) 2288 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[21479]: cluster 2024-02-13T14:52:47.304942+0000 mon.a (mon.0) 2289 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[21479]: audit 2024-02-13T14:52:47.307795+0000 mon.c (mon.2) 649 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[21479]: audit 2024-02-13T14:52:47.308630+0000 mon.a (mon.0) 2290 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[21479]: audit 2024-02-13T14:52:48.110169+0000 mon.b (mon.1) 200 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[21479]: audit 2024-02-13T14:52:48.303719+0000 mon.a (mon.0) 2291 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:48 smithi062 bash[21479]: cluster 2024-02-13T14:52:48.314670+0000 mon.a (mon.0) 2292 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-02-13T14:52:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:48 smithi111 bash[23388]: audit 2024-02-13T14:52:47.297071+0000 mon.a (mon.0) 2288 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:48 smithi111 bash[23388]: cluster 2024-02-13T14:52:47.304942+0000 mon.a (mon.0) 2289 : cluster 0 osdmap e341: 8 total, 8 up, 8 in 2024-02-13T14:52:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:48 smithi111 bash[23388]: audit 2024-02-13T14:52:47.307795+0000 mon.c (mon.2) 649 : audit 1 from='client.? v1:172.21.15.62:0/1915936859' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:48 smithi111 bash[23388]: audit 2024-02-13T14:52:47.308630+0000 mon.a (mon.0) 2290 : audit 1 from='client.46967 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]: dispatch 2024-02-13T14:52:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:48 smithi111 bash[23388]: audit 2024-02-13T14:52:48.110169+0000 mon.b (mon.1) 200 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:52:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:48 smithi111 bash[23388]: audit 2024-02-13T14:52:48.303719+0000 mon.a (mon.0) 2291 : audit 1 from='client.46967 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPP_smithi062-64512-61"}]': finished 2024-02-13T14:52:48.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:48 smithi111 bash[23388]: cluster 2024-02-13T14:52:48.314670+0000 mon.a (mon.0) 2292 : cluster 0 osdmap e342: 8 total, 8 up, 8 in 2024-02-13T14:52:49.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: cluster 2024-02-13T14:52:47.894255+0000 mgr.y (mgr.14613) 369 : cluster 0 pgmap v523: 292 pgs: 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:49.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: cluster 2024-02-13T14:52:48.317605+0000 mon.a (mon.0) 2293 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:49.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:48.341023+0000 mon.c (mon.2) 650 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:49.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:48.356007+0000 mon.a (mon.0) 2294 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:49.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:48.365155+0000 mon.c (mon.2) 651 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:48.365486+0000 mon.a (mon.0) 2295 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:48.366224+0000 mon.c (mon.2) 652 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:48.366577+0000 mon.a (mon.0) 2296 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:48.367052+0000 mon.c (mon.2) 653 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:48.367408+0000 mon.a (mon.0) 2297 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:49.308216+0000 mon.a (mon.0) 2298 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:49.308423+0000 mon.a (mon.0) 2299 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: cluster 2024-02-13T14:52:49.319971+0000 mon.a (mon.0) 2300 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:49.320037+0000 mon.c (mon.2) 654 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[28859]: audit 2024-02-13T14:52:49.327253+0000 mon.a (mon.0) 2301 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: cluster 2024-02-13T14:52:47.894255+0000 mgr.y (mgr.14613) 369 : cluster 0 pgmap v523: 292 pgs: 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: cluster 2024-02-13T14:52:48.317605+0000 mon.a (mon.0) 2293 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:48.341023+0000 mon.c (mon.2) 650 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:48.356007+0000 mon.a (mon.0) 2294 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:48.365155+0000 mon.c (mon.2) 651 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:48.365486+0000 mon.a (mon.0) 2295 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:48.366224+0000 mon.c (mon.2) 652 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:48.366577+0000 mon.a (mon.0) 2296 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:48.367052+0000 mon.c (mon.2) 653 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:48.367408+0000 mon.a (mon.0) 2297 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:49.308216+0000 mon.a (mon.0) 2298 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:49.308423+0000 mon.a (mon.0) 2299 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: cluster 2024-02-13T14:52:49.319971+0000 mon.a (mon.0) 2300 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:49.320037+0000 mon.c (mon.2) 654 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:49 smithi062 bash[21479]: audit 2024-02-13T14:52:49.327253+0000 mon.a (mon.0) 2301 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: cluster 2024-02-13T14:52:47.894255+0000 mgr.y (mgr.14613) 369 : cluster 0 pgmap v523: 292 pgs: 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: cluster 2024-02-13T14:52:48.317605+0000 mon.a (mon.0) 2293 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:48.341023+0000 mon.c (mon.2) 650 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:48.356007+0000 mon.a (mon.0) 2294 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:48.365155+0000 mon.c (mon.2) 651 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:48.365486+0000 mon.a (mon.0) 2295 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:48.366224+0000 mon.c (mon.2) 652 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:48.366577+0000 mon.a (mon.0) 2296 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:48.367052+0000 mon.c (mon.2) 653 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:48.367408+0000 mon.a (mon.0) 2297 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:49.308216+0000 mon.a (mon.0) 2298 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-47","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:49.308423+0000 mon.a (mon.0) 2299 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: cluster 2024-02-13T14:52:49.319971+0000 mon.a (mon.0) 2300 : cluster 0 osdmap e343: 8 total, 8 up, 8 in 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:49.320037+0000 mon.c (mon.2) 654 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:49 smithi111 bash[23388]: audit 2024-02-13T14:52:49.327253+0000 mon.a (mon.0) 2301 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:50.793 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:52:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:52:51.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:50 smithi062 bash[21479]: audit 2024-02-13T14:52:49.408674+0000 mon.c (mon.2) 655 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:51.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:50 smithi062 bash[21479]: audit 2024-02-13T14:52:49.409217+0000 mon.a (mon.0) 2302 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:51.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:50 smithi062 bash[21479]: audit 2024-02-13T14:52:50.311821+0000 mon.a (mon.0) 2303 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:51.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:50 smithi062 bash[28859]: audit 2024-02-13T14:52:49.408674+0000 mon.c (mon.2) 655 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:51.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:50 smithi062 bash[28859]: audit 2024-02-13T14:52:49.409217+0000 mon.a (mon.0) 2302 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:51.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:50 smithi062 bash[28859]: audit 2024-02-13T14:52:50.311821+0000 mon.a (mon.0) 2303 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:51.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:50 smithi111 bash[23388]: audit 2024-02-13T14:52:49.408674+0000 mon.c (mon.2) 655 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:51.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:50 smithi111 bash[23388]: audit 2024-02-13T14:52:49.409217+0000 mon.a (mon.0) 2302 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:52:51.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:50 smithi111 bash[23388]: audit 2024-02-13T14:52:50.311821+0000 mon.a (mon.0) 2303 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: cluster 2024-02-13T14:52:49.896197+0000 mgr.y (mgr.14613) 370 : cluster 0 pgmap v526: 324 pgs: 17 unknown, 307 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: audit 2024-02-13T14:52:50.323036+0000 mon.c (mon.2) 656 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: audit 2024-02-13T14:52:50.349602+0000 mgr.y (mgr.14613) 371 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: cluster 2024-02-13T14:52:50.779259+0000 mon.a (mon.0) 2304 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: audit 2024-02-13T14:52:50.781461+0000 mon.a (mon.0) 2305 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: audit 2024-02-13T14:52:51.315224+0000 mon.a (mon.0) 2306 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: audit 2024-02-13T14:52:51.315465+0000 mon.a (mon.0) 2307 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]': finished 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: audit 2024-02-13T14:52:51.324730+0000 mon.c (mon.2) 657 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]: dispatch 2024-02-13T14:52:52.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: cluster 2024-02-13T14:52:51.326242+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[28859]: audit 2024-02-13T14:52:51.328545+0000 mon.a (mon.0) 2309 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]: dispatch 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: cluster 2024-02-13T14:52:49.896197+0000 mgr.y (mgr.14613) 370 : cluster 0 pgmap v526: 324 pgs: 17 unknown, 307 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: audit 2024-02-13T14:52:50.323036+0000 mon.c (mon.2) 656 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: audit 2024-02-13T14:52:50.349602+0000 mgr.y (mgr.14613) 371 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: cluster 2024-02-13T14:52:50.779259+0000 mon.a (mon.0) 2304 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: audit 2024-02-13T14:52:50.781461+0000 mon.a (mon.0) 2305 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: audit 2024-02-13T14:52:51.315224+0000 mon.a (mon.0) 2306 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: audit 2024-02-13T14:52:51.315465+0000 mon.a (mon.0) 2307 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]': finished 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: audit 2024-02-13T14:52:51.324730+0000 mon.c (mon.2) 657 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]: dispatch 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: cluster 2024-02-13T14:52:51.326242+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-02-13T14:52:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:51 smithi062 bash[21479]: audit 2024-02-13T14:52:51.328545+0000 mon.a (mon.0) 2309 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]: dispatch 2024-02-13T14:52:52.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: cluster 2024-02-13T14:52:49.896197+0000 mgr.y (mgr.14613) 370 : cluster 0 pgmap v526: 324 pgs: 17 unknown, 307 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:52.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: audit 2024-02-13T14:52:50.323036+0000 mon.c (mon.2) 656 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:52:52.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: audit 2024-02-13T14:52:50.349602+0000 mgr.y (mgr.14613) 371 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:52:52.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: cluster 2024-02-13T14:52:50.779259+0000 mon.a (mon.0) 2304 : cluster 0 osdmap e344: 8 total, 8 up, 8 in 2024-02-13T14:52:52.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: audit 2024-02-13T14:52:50.781461+0000 mon.a (mon.0) 2305 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:52:52.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: audit 2024-02-13T14:52:51.315224+0000 mon.a (mon.0) 2306 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "SimpleStatPPNS_smithi062-64512-62", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:52.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: audit 2024-02-13T14:52:51.315465+0000 mon.a (mon.0) 2307 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-47"}]': finished 2024-02-13T14:52:52.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: audit 2024-02-13T14:52:51.324730+0000 mon.c (mon.2) 657 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]: dispatch 2024-02-13T14:52:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: cluster 2024-02-13T14:52:51.326242+0000 mon.a (mon.0) 2308 : cluster 0 osdmap e345: 8 total, 8 up, 8 in 2024-02-13T14:52:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:51 smithi111 bash[23388]: audit 2024-02-13T14:52:51.328545+0000 mon.a (mon.0) 2309 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]: dispatch 2024-02-13T14:52:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[28859]: cluster 2024-02-13T14:52:51.897124+0000 mgr.y (mgr.14613) 372 : cluster 0 pgmap v529: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T14:52:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[28859]: cluster 2024-02-13T14:52:52.315577+0000 mon.a (mon.0) 2310 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:52:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[28859]: audit 2024-02-13T14:52:52.318070+0000 mon.a (mon.0) 2311 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]': finished 2024-02-13T14:52:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[28859]: cluster 2024-02-13T14:52:52.325978+0000 mon.a (mon.0) 2312 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-02-13T14:52:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[28859]: audit 2024-02-13T14:52:52.331229+0000 mon.c (mon.2) 658 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:53.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[28859]: audit 2024-02-13T14:52:52.332335+0000 mon.a (mon.0) 2313 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:53.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[21479]: cluster 2024-02-13T14:52:51.897124+0000 mgr.y (mgr.14613) 372 : cluster 0 pgmap v529: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T14:52:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[21479]: cluster 2024-02-13T14:52:52.315577+0000 mon.a (mon.0) 2310 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:52:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[21479]: audit 2024-02-13T14:52:52.318070+0000 mon.a (mon.0) 2311 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]': finished 2024-02-13T14:52:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[21479]: cluster 2024-02-13T14:52:52.325978+0000 mon.a (mon.0) 2312 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-02-13T14:52:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[21479]: audit 2024-02-13T14:52:52.331229+0000 mon.c (mon.2) 658 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:52 smithi062 bash[21479]: audit 2024-02-13T14:52:52.332335+0000 mon.a (mon.0) 2313 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:53.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:52 smithi111 bash[23388]: cluster 2024-02-13T14:52:51.897124+0000 mgr.y (mgr.14613) 372 : cluster 0 pgmap v529: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T14:52:53.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:52 smithi111 bash[23388]: cluster 2024-02-13T14:52:52.315577+0000 mon.a (mon.0) 2310 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:52:53.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:52 smithi111 bash[23388]: audit 2024-02-13T14:52:52.318070+0000 mon.a (mon.0) 2311 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-47", "mode": "writeback"}]': finished 2024-02-13T14:52:53.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:52 smithi111 bash[23388]: cluster 2024-02-13T14:52:52.325978+0000 mon.a (mon.0) 2312 : cluster 0 osdmap e346: 8 total, 8 up, 8 in 2024-02-13T14:52:53.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:52 smithi111 bash[23388]: audit 2024-02-13T14:52:52.331229+0000 mon.c (mon.2) 658 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:53.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:52 smithi111 bash[23388]: audit 2024-02-13T14:52:52.332335+0000 mon.a (mon.0) 2313 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:52:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:54 smithi111 bash[23388]: audit 2024-02-13T14:52:53.320891+0000 mon.a (mon.0) 2314 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:52:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:54 smithi111 bash[23388]: cluster 2024-02-13T14:52:53.328810+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-02-13T14:52:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:54 smithi111 bash[23388]: audit 2024-02-13T14:52:53.332395+0000 mon.c (mon.2) 659 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:54 smithi111 bash[23388]: audit 2024-02-13T14:52:53.334340+0000 mon.a (mon.0) 2316 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:54 smithi111 bash[23388]: audit 2024-02-13T14:52:53.334488+0000 mon.c (mon.2) 660 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:54 smithi111 bash[23388]: audit 2024-02-13T14:52:53.336469+0000 mon.a (mon.0) 2317 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:54.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[21479]: audit 2024-02-13T14:52:53.320891+0000 mon.a (mon.0) 2314 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:52:54.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[21479]: cluster 2024-02-13T14:52:53.328810+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-02-13T14:52:54.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[21479]: audit 2024-02-13T14:52:53.332395+0000 mon.c (mon.2) 659 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:54.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[21479]: audit 2024-02-13T14:52:53.334340+0000 mon.a (mon.0) 2316 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:54.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[21479]: audit 2024-02-13T14:52:53.334488+0000 mon.c (mon.2) 660 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:54.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[21479]: audit 2024-02-13T14:52:53.336469+0000 mon.a (mon.0) 2317 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:54.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[28859]: audit 2024-02-13T14:52:53.320891+0000 mon.a (mon.0) 2314 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:52:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[28859]: cluster 2024-02-13T14:52:53.328810+0000 mon.a (mon.0) 2315 : cluster 0 osdmap e347: 8 total, 8 up, 8 in 2024-02-13T14:52:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[28859]: audit 2024-02-13T14:52:53.332395+0000 mon.c (mon.2) 659 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[28859]: audit 2024-02-13T14:52:53.334340+0000 mon.a (mon.0) 2316 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:52:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[28859]: audit 2024-02-13T14:52:53.334488+0000 mon.c (mon.2) 660 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:54 smithi062 bash[28859]: audit 2024-02-13T14:52:53.336469+0000 mon.a (mon.0) 2317 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: cluster 2024-02-13T14:52:53.898033+0000 mgr.y (mgr.14613) 373 : cluster 0 pgmap v532: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s wr, 2 op/s 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: cluster 2024-02-13T14:52:54.320816+0000 mon.a (mon.0) 2318 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: audit 2024-02-13T14:52:54.329743+0000 mon.a (mon.0) 2319 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: audit 2024-02-13T14:52:54.329993+0000 mon.a (mon.0) 2320 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: cluster 2024-02-13T14:52:54.339461+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: audit 2024-02-13T14:52:54.341991+0000 mon.c (mon.2) 661 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: audit 2024-02-13T14:52:54.342622+0000 mon.c (mon.2) 662 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: audit 2024-02-13T14:52:54.348137+0000 mon.a (mon.0) 2322 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[21479]: audit 2024-02-13T14:52:54.349402+0000 mon.a (mon.0) 2323 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: cluster 2024-02-13T14:52:53.898033+0000 mgr.y (mgr.14613) 373 : cluster 0 pgmap v532: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s wr, 2 op/s 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: cluster 2024-02-13T14:52:54.320816+0000 mon.a (mon.0) 2318 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: audit 2024-02-13T14:52:54.329743+0000 mon.a (mon.0) 2319 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: audit 2024-02-13T14:52:54.329993+0000 mon.a (mon.0) 2320 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: cluster 2024-02-13T14:52:54.339461+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: audit 2024-02-13T14:52:54.341991+0000 mon.c (mon.2) 661 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: audit 2024-02-13T14:52:54.342622+0000 mon.c (mon.2) 662 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: audit 2024-02-13T14:52:54.348137+0000 mon.a (mon.0) 2322 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:55 smithi062 bash[28859]: audit 2024-02-13T14:52:54.349402+0000 mon.a (mon.0) 2323 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: cluster 2024-02-13T14:52:53.898033+0000 mgr.y (mgr.14613) 373 : cluster 0 pgmap v532: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s wr, 2 op/s 2024-02-13T14:52:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: cluster 2024-02-13T14:52:54.320816+0000 mon.a (mon.0) 2318 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:52:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: audit 2024-02-13T14:52:54.329743+0000 mon.a (mon.0) 2319 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:52:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: audit 2024-02-13T14:52:54.329993+0000 mon.a (mon.0) 2320 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: cluster 2024-02-13T14:52:54.339461+0000 mon.a (mon.0) 2321 : cluster 0 osdmap e348: 8 total, 8 up, 8 in 2024-02-13T14:52:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: audit 2024-02-13T14:52:54.341991+0000 mon.c (mon.2) 661 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: audit 2024-02-13T14:52:54.342622+0000 mon.c (mon.2) 662 : audit 1 from='client.? v1:172.21.15.62:0/364906572' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: audit 2024-02-13T14:52:54.348137+0000 mon.a (mon.0) 2322 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:52:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:55 smithi111 bash[23388]: audit 2024-02-13T14:52:54.349402+0000 mon.a (mon.0) 2323 : audit 1 from='client.46973 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]: dispatch 2024-02-13T14:52:56.560 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:52:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:52:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: cluster 2024-02-13T14:52:55.330901+0000 mon.a (mon.0) 2324 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.333349+0000 mon.a (mon.0) 2325 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:52:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.333563+0000 mon.a (mon.0) 2326 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: cluster 2024-02-13T14:52:55.344604+0000 mon.a (mon.0) 2327 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-02-13T14:52:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.346707+0000 mon.c (mon.2) 663 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:52:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.349201+0000 mon.a (mon.0) 2328 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:52:56.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.380602+0000 mon.c (mon.2) 664 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.380973+0000 mon.a (mon.0) 2329 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.382348+0000 mon.c (mon.2) 665 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.382659+0000 mon.a (mon.0) 2330 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.383228+0000 mon.c (mon.2) 666 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:55.383587+0000 mon.a (mon.0) 2331 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:56.335892+0000 mon.a (mon.0) 2332 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:56.336112+0000 mon.a (mon.0) 2333 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: cluster 2024-02-13T14:52:56.343093+0000 mon.a (mon.0) 2334 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: cluster 2024-02-13T14:52:55.330901+0000 mon.a (mon.0) 2324 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.333349+0000 mon.a (mon.0) 2325 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.333563+0000 mon.a (mon.0) 2326 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: cluster 2024-02-13T14:52:55.344604+0000 mon.a (mon.0) 2327 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.346707+0000 mon.c (mon.2) 663 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.349201+0000 mon.a (mon.0) 2328 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.380602+0000 mon.c (mon.2) 664 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.380973+0000 mon.a (mon.0) 2329 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.382348+0000 mon.c (mon.2) 665 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.382659+0000 mon.a (mon.0) 2330 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.383228+0000 mon.c (mon.2) 666 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:55.383587+0000 mon.a (mon.0) 2331 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:56.335892+0000 mon.a (mon.0) 2332 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:56.336112+0000 mon.a (mon.0) 2333 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: cluster 2024-02-13T14:52:56.343093+0000 mon.a (mon.0) 2334 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-02-13T14:52:56.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:56.344934+0000 mon.c (mon.2) 667 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T14:52:56.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:56.345914+0000 mon.c (mon.2) 668 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:56.346167+0000 mon.a (mon.0) 2335 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T14:52:56.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[21479]: audit 2024-02-13T14:52:56.348067+0000 mon.a (mon.0) 2336 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:56.344934+0000 mon.c (mon.2) 667 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T14:52:56.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:56.345914+0000 mon.c (mon.2) 668 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:56.346167+0000 mon.a (mon.0) 2335 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T14:52:56.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:56 smithi062 bash[28859]: audit 2024-02-13T14:52:56.348067+0000 mon.a (mon.0) 2336 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: cluster 2024-02-13T14:52:55.330901+0000 mon.a (mon.0) 2324 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:52:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.333349+0000 mon.a (mon.0) 2325 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.333563+0000 mon.a (mon.0) 2326 : audit 1 from='client.46973 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"SimpleStatPPNS_smithi062-64512-62"}]': finished 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: cluster 2024-02-13T14:52:55.344604+0000 mon.a (mon.0) 2327 : cluster 0 osdmap e349: 8 total, 8 up, 8 in 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.346707+0000 mon.c (mon.2) 663 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.349201+0000 mon.a (mon.0) 2328 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.380602+0000 mon.c (mon.2) 664 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.380973+0000 mon.a (mon.0) 2329 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.382348+0000 mon.c (mon.2) 665 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.382659+0000 mon.a (mon.0) 2330 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.383228+0000 mon.c (mon.2) 666 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:55.383587+0000 mon.a (mon.0) 2331 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:56.335892+0000 mon.a (mon.0) 2332 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:56.336112+0000 mon.a (mon.0) 2333 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-StatRemovePP_smithi062-64512-63", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:52:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: cluster 2024-02-13T14:52:56.343093+0000 mon.a (mon.0) 2334 : cluster 0 osdmap e350: 8 total, 8 up, 8 in 2024-02-13T14:52:56.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:56.344934+0000 mon.c (mon.2) 667 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T14:52:56.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:56.345914+0000 mon.c (mon.2) 668 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:56.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:56.346167+0000 mon.a (mon.0) 2335 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T14:52:56.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:56 smithi111 bash[23388]: audit 2024-02-13T14:52:56.348067+0000 mon.a (mon.0) 2336 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:52:58.060 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:57 smithi062 bash[21479]: cluster 2024-02-13T14:52:55.898982+0000 mgr.y (mgr.14613) 374 : cluster 0 pgmap v535: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:58.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:57 smithi062 bash[21479]: audit 2024-02-13T14:52:57.339263+0000 mon.a (mon.0) 2337 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T14:52:58.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:57 smithi062 bash[28859]: cluster 2024-02-13T14:52:55.898982+0000 mgr.y (mgr.14613) 374 : cluster 0 pgmap v535: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:58.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:57 smithi062 bash[28859]: audit 2024-02-13T14:52:57.339263+0000 mon.a (mon.0) 2337 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T14:52:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:57 smithi111 bash[23388]: cluster 2024-02-13T14:52:55.898982+0000 mgr.y (mgr.14613) 374 : cluster 0 pgmap v535: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:58.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:57 smithi111 bash[23388]: audit 2024-02-13T14:52:57.339263+0000 mon.a (mon.0) 2337 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T14:52:59.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: audit 2024-02-13T14:52:57.349845+0000 mon.c (mon.2) 669 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T14:52:59.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: cluster 2024-02-13T14:52:57.805709+0000 mon.a (mon.0) 2338 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-02-13T14:52:59.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: audit 2024-02-13T14:52:57.807126+0000 mon.a (mon.0) 2339 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T14:52:59.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: cluster 2024-02-13T14:52:57.899915+0000 mgr.y (mgr.14613) 375 : cluster 0 pgmap v538: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:59.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: audit 2024-02-13T14:52:58.342427+0000 mon.a (mon.0) 2340 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:52:59.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: audit 2024-02-13T14:52:58.342685+0000 mon.a (mon.0) 2341 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T14:52:59.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: cluster 2024-02-13T14:52:58.349979+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: audit 2024-02-13T14:52:58.423544+0000 mon.c (mon.2) 670 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[21479]: audit 2024-02-13T14:52:58.424202+0000 mon.a (mon.0) 2343 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: audit 2024-02-13T14:52:57.349845+0000 mon.c (mon.2) 669 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: cluster 2024-02-13T14:52:57.805709+0000 mon.a (mon.0) 2338 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: audit 2024-02-13T14:52:57.807126+0000 mon.a (mon.0) 2339 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: cluster 2024-02-13T14:52:57.899915+0000 mgr.y (mgr.14613) 375 : cluster 0 pgmap v538: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: audit 2024-02-13T14:52:58.342427+0000 mon.a (mon.0) 2340 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: audit 2024-02-13T14:52:58.342685+0000 mon.a (mon.0) 2341 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: cluster 2024-02-13T14:52:58.349979+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: audit 2024-02-13T14:52:58.423544+0000 mon.c (mon.2) 670 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:52:58 smithi062 bash[28859]: audit 2024-02-13T14:52:58.424202+0000 mon.a (mon.0) 2343 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:59.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: audit 2024-02-13T14:52:57.349845+0000 mon.c (mon.2) 669 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T14:52:59.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: cluster 2024-02-13T14:52:57.805709+0000 mon.a (mon.0) 2338 : cluster 0 osdmap e351: 8 total, 8 up, 8 in 2024-02-13T14:52:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: audit 2024-02-13T14:52:57.807126+0000 mon.a (mon.0) 2339 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T14:52:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: cluster 2024-02-13T14:52:57.899915+0000 mgr.y (mgr.14613) 375 : cluster 0 pgmap v538: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:52:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: audit 2024-02-13T14:52:58.342427+0000 mon.a (mon.0) 2340 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "StatRemovePP_smithi062-64512-63", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:52:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: audit 2024-02-13T14:52:58.342685+0000 mon.a (mon.0) 2341 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-47","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T14:52:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: cluster 2024-02-13T14:52:58.349979+0000 mon.a (mon.0) 2342 : cluster 0 osdmap e352: 8 total, 8 up, 8 in 2024-02-13T14:52:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: audit 2024-02-13T14:52:58.423544+0000 mon.c (mon.2) 670 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:52:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:52:58 smithi111 bash[23388]: audit 2024-02-13T14:52:58.424202+0000 mon.a (mon.0) 2343 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:00 smithi062 bash[21479]: audit 2024-02-13T14:52:59.345178+0000 mon.a (mon.0) 2344 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:00 smithi062 bash[21479]: cluster 2024-02-13T14:52:59.352488+0000 mon.a (mon.0) 2345 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-02-13T14:53:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:00 smithi062 bash[21479]: audit 2024-02-13T14:52:59.355303+0000 mon.c (mon.2) 671 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:00 smithi062 bash[21479]: audit 2024-02-13T14:52:59.356392+0000 mon.a (mon.0) 2346 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:00 smithi062 bash[28859]: audit 2024-02-13T14:52:59.345178+0000 mon.a (mon.0) 2344 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:00 smithi062 bash[28859]: cluster 2024-02-13T14:52:59.352488+0000 mon.a (mon.0) 2345 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-02-13T14:53:00.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:00 smithi062 bash[28859]: audit 2024-02-13T14:52:59.355303+0000 mon.c (mon.2) 671 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:00 smithi062 bash[28859]: audit 2024-02-13T14:52:59.356392+0000 mon.a (mon.0) 2346 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:00.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:53:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:53:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:00 smithi111 bash[23388]: audit 2024-02-13T14:52:59.345178+0000 mon.a (mon.0) 2344 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:00 smithi111 bash[23388]: cluster 2024-02-13T14:52:59.352488+0000 mon.a (mon.0) 2345 : cluster 0 osdmap e353: 8 total, 8 up, 8 in 2024-02-13T14:53:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:00 smithi111 bash[23388]: audit 2024-02-13T14:52:59.355303+0000 mon.c (mon.2) 671 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:00 smithi111 bash[23388]: audit 2024-02-13T14:52:59.356392+0000 mon.a (mon.0) 2346 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: cluster 2024-02-13T14:52:59.902078+0000 mgr.y (mgr.14613) 376 : cluster 0 pgmap v541: 332 pgs: 5 unknown, 327 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: cluster 2024-02-13T14:53:00.345123+0000 mon.a (mon.0) 2347 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: audit 2024-02-13T14:53:00.356664+0000 mon.a (mon.0) 2348 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]': finished 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: audit 2024-02-13T14:53:00.357378+0000 mgr.y (mgr.14613) 377 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: cluster 2024-02-13T14:53:00.369272+0000 mon.a (mon.0) 2349 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: audit 2024-02-13T14:53:00.372051+0000 mon.c (mon.2) 672 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: audit 2024-02-13T14:53:00.372792+0000 mon.a (mon.0) 2350 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: audit 2024-02-13T14:53:00.440343+0000 mon.c (mon.2) 673 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:01.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: audit 2024-02-13T14:53:00.440938+0000 mon.a (mon.0) 2351 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: audit 2024-02-13T14:53:00.441766+0000 mon.c (mon.2) 674 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[21479]: audit 2024-02-13T14:53:00.442241+0000 mon.a (mon.0) 2352 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: cluster 2024-02-13T14:52:59.902078+0000 mgr.y (mgr.14613) 376 : cluster 0 pgmap v541: 332 pgs: 5 unknown, 327 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: cluster 2024-02-13T14:53:00.345123+0000 mon.a (mon.0) 2347 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: audit 2024-02-13T14:53:00.356664+0000 mon.a (mon.0) 2348 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]': finished 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: audit 2024-02-13T14:53:00.357378+0000 mgr.y (mgr.14613) 377 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: cluster 2024-02-13T14:53:00.369272+0000 mon.a (mon.0) 2349 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: audit 2024-02-13T14:53:00.372051+0000 mon.c (mon.2) 672 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: audit 2024-02-13T14:53:00.372792+0000 mon.a (mon.0) 2350 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: audit 2024-02-13T14:53:00.440343+0000 mon.c (mon.2) 673 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: audit 2024-02-13T14:53:00.440938+0000 mon.a (mon.0) 2351 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:01.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: audit 2024-02-13T14:53:00.441766+0000 mon.c (mon.2) 674 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:01.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:01 smithi062 bash[28859]: audit 2024-02-13T14:53:00.442241+0000 mon.a (mon.0) 2352 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:01.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: cluster 2024-02-13T14:52:59.902078+0000 mgr.y (mgr.14613) 376 : cluster 0 pgmap v541: 332 pgs: 5 unknown, 327 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:53:01.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: cluster 2024-02-13T14:53:00.345123+0000 mon.a (mon.0) 2347 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: audit 2024-02-13T14:53:00.356664+0000 mon.a (mon.0) 2348 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]': finished 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: audit 2024-02-13T14:53:00.357378+0000 mgr.y (mgr.14613) 377 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: cluster 2024-02-13T14:53:00.369272+0000 mon.a (mon.0) 2349 : cluster 0 osdmap e354: 8 total, 8 up, 8 in 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: audit 2024-02-13T14:53:00.372051+0000 mon.c (mon.2) 672 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: audit 2024-02-13T14:53:00.372792+0000 mon.a (mon.0) 2350 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: audit 2024-02-13T14:53:00.440343+0000 mon.c (mon.2) 673 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: audit 2024-02-13T14:53:00.440938+0000 mon.a (mon.0) 2351 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: audit 2024-02-13T14:53:00.441766+0000 mon.c (mon.2) 674 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:01 smithi111 bash[23388]: audit 2024-02-13T14:53:00.442241+0000 mon.a (mon.0) 2352 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-47"}]: dispatch 2024-02-13T14:53:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[21479]: audit 2024-02-13T14:53:01.370176+0000 mon.a (mon.0) 2353 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:53:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[21479]: cluster 2024-02-13T14:53:01.377108+0000 mon.a (mon.0) 2354 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-02-13T14:53:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[21479]: audit 2024-02-13T14:53:01.383018+0000 mon.c (mon.2) 675 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[21479]: audit 2024-02-13T14:53:01.383982+0000 mon.a (mon.0) 2355 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[21479]: cluster 2024-02-13T14:53:01.903002+0000 mgr.y (mgr.14613) 378 : cluster 0 pgmap v544: 292 pgs: 292 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T14:53:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[28859]: audit 2024-02-13T14:53:01.370176+0000 mon.a (mon.0) 2353 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:53:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[28859]: cluster 2024-02-13T14:53:01.377108+0000 mon.a (mon.0) 2354 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-02-13T14:53:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[28859]: audit 2024-02-13T14:53:01.383018+0000 mon.c (mon.2) 675 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[28859]: audit 2024-02-13T14:53:01.383982+0000 mon.a (mon.0) 2355 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:02 smithi062 bash[28859]: cluster 2024-02-13T14:53:01.903002+0000 mgr.y (mgr.14613) 378 : cluster 0 pgmap v544: 292 pgs: 292 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T14:53:02.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:02 smithi111 bash[23388]: audit 2024-02-13T14:53:01.370176+0000 mon.a (mon.0) 2353 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:53:02.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:02 smithi111 bash[23388]: cluster 2024-02-13T14:53:01.377108+0000 mon.a (mon.0) 2354 : cluster 0 osdmap e355: 8 total, 8 up, 8 in 2024-02-13T14:53:02.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:02 smithi111 bash[23388]: audit 2024-02-13T14:53:01.383018+0000 mon.c (mon.2) 675 : audit 1 from='client.? v1:172.21.15.62:0/3816373934' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:02.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:02 smithi111 bash[23388]: audit 2024-02-13T14:53:01.383982+0000 mon.a (mon.0) 2355 : audit 1 from='client.46979 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]: dispatch 2024-02-13T14:53:02.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:02 smithi111 bash[23388]: cluster 2024-02-13T14:53:01.903002+0000 mgr.y (mgr.14613) 378 : cluster 0 pgmap v544: 292 pgs: 292 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T14:53:03.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.382604+0000 mon.a (mon.0) 2356 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:53:03.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: cluster 2024-02-13T14:53:02.392797+0000 mon.a (mon.0) 2357 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.398862+0000 mon.c (mon.2) 676 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.401144+0000 mon.a (mon.0) 2358 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.438107+0000 mon.c (mon.2) 677 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.438561+0000 mon.a (mon.0) 2359 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.439542+0000 mon.c (mon.2) 678 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.439899+0000 mon.a (mon.0) 2360 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.440442+0000 mon.c (mon.2) 679 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:02.440744+0000 mon.a (mon.0) 2361 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[21479]: audit 2024-02-13T14:53:03.147848+0000 mon.b (mon.1) 201 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:03.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.382604+0000 mon.a (mon.0) 2356 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: cluster 2024-02-13T14:53:02.392797+0000 mon.a (mon.0) 2357 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.398862+0000 mon.c (mon.2) 676 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.401144+0000 mon.a (mon.0) 2358 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.438107+0000 mon.c (mon.2) 677 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.438561+0000 mon.a (mon.0) 2359 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.439542+0000 mon.c (mon.2) 678 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.439899+0000 mon.a (mon.0) 2360 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.440442+0000 mon.c (mon.2) 679 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:02.440744+0000 mon.a (mon.0) 2361 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:03 smithi062 bash[28859]: audit 2024-02-13T14:53:03.147848+0000 mon.b (mon.1) 201 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:03.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.382604+0000 mon.a (mon.0) 2356 : audit 1 from='client.46979 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"StatRemovePP_smithi062-64512-63"}]': finished 2024-02-13T14:53:03.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: cluster 2024-02-13T14:53:02.392797+0000 mon.a (mon.0) 2357 : cluster 0 osdmap e356: 8 total, 8 up, 8 in 2024-02-13T14:53:03.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.398862+0000 mon.c (mon.2) 676 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.401144+0000 mon.a (mon.0) 2358 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.438107+0000 mon.c (mon.2) 677 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.438561+0000 mon.a (mon.0) 2359 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.439542+0000 mon.c (mon.2) 678 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.439899+0000 mon.a (mon.0) 2360 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.440442+0000 mon.c (mon.2) 679 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:02.440744+0000 mon.a (mon.0) 2361 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:03 smithi111 bash[23388]: audit 2024-02-13T14:53:03.147848+0000 mon.b (mon.1) 201 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: audit 2024-02-13T14:53:03.385566+0000 mon.a (mon.0) 2362 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: audit 2024-02-13T14:53:03.385882+0000 mon.a (mon.0) 2363 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: cluster 2024-02-13T14:53:03.396439+0000 mon.a (mon.0) 2364 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-02-13T14:53:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: audit 2024-02-13T14:53:03.397852+0000 mon.c (mon.2) 680 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: audit 2024-02-13T14:53:03.404237+0000 mon.a (mon.0) 2365 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:05.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: audit 2024-02-13T14:53:03.447359+0000 mon.c (mon.2) 681 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: audit 2024-02-13T14:53:03.449093+0000 mon.a (mon.0) 2366 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: cluster 2024-02-13T14:53:03.903920+0000 mgr.y (mgr.14613) 379 : cluster 0 pgmap v547: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[28859]: audit 2024-02-13T14:53:04.389427+0000 mon.a (mon.0) 2367 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: audit 2024-02-13T14:53:03.385566+0000 mon.a (mon.0) 2362 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: audit 2024-02-13T14:53:03.385882+0000 mon.a (mon.0) 2363 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: cluster 2024-02-13T14:53:03.396439+0000 mon.a (mon.0) 2364 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: audit 2024-02-13T14:53:03.397852+0000 mon.c (mon.2) 680 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: audit 2024-02-13T14:53:03.404237+0000 mon.a (mon.0) 2365 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: audit 2024-02-13T14:53:03.447359+0000 mon.c (mon.2) 681 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: audit 2024-02-13T14:53:03.449093+0000 mon.a (mon.0) 2366 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: cluster 2024-02-13T14:53:03.903920+0000 mgr.y (mgr.14613) 379 : cluster 0 pgmap v547: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:04 smithi062 bash[21479]: audit 2024-02-13T14:53:04.389427+0000 mon.a (mon.0) 2367 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:53:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: audit 2024-02-13T14:53:03.385566+0000 mon.a (mon.0) 2362 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-49","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:05.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: audit 2024-02-13T14:53:03.385882+0000 mon.a (mon.0) 2363 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-ExecuteClassPP_smithi062-64512-64", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:05.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: cluster 2024-02-13T14:53:03.396439+0000 mon.a (mon.0) 2364 : cluster 0 osdmap e357: 8 total, 8 up, 8 in 2024-02-13T14:53:05.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: audit 2024-02-13T14:53:03.397852+0000 mon.c (mon.2) 680 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:05.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: audit 2024-02-13T14:53:03.404237+0000 mon.a (mon.0) 2365 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:05.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: audit 2024-02-13T14:53:03.447359+0000 mon.c (mon.2) 681 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:05.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: audit 2024-02-13T14:53:03.449093+0000 mon.a (mon.0) 2366 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:05.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: cluster 2024-02-13T14:53:03.903920+0000 mgr.y (mgr.14613) 379 : cluster 0 pgmap v547: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:05.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:04 smithi111 bash[23388]: audit 2024-02-13T14:53:04.389427+0000 mon.a (mon.0) 2367 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:53:06.225 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[21479]: audit 2024-02-13T14:53:04.400679+0000 mon.c (mon.2) 682 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[21479]: cluster 2024-02-13T14:53:04.857185+0000 mon.a (mon.0) 2368 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[21479]: audit 2024-02-13T14:53:04.858658+0000 mon.a (mon.0) 2369 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[21479]: audit 2024-02-13T14:53:05.392502+0000 mon.a (mon.0) 2370 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[21479]: audit 2024-02-13T14:53:05.392713+0000 mon.a (mon.0) 2371 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]': finished 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[21479]: cluster 2024-02-13T14:53:05.401805+0000 mon.a (mon.0) 2372 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[21479]: audit 2024-02-13T14:53:05.408816+0000 mon.c (mon.2) 683 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]: dispatch 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[21479]: audit 2024-02-13T14:53:05.409866+0000 mon.a (mon.0) 2373 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]: dispatch 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[28859]: audit 2024-02-13T14:53:04.400679+0000 mon.c (mon.2) 682 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[28859]: cluster 2024-02-13T14:53:04.857185+0000 mon.a (mon.0) 2368 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[28859]: audit 2024-02-13T14:53:04.858658+0000 mon.a (mon.0) 2369 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:06.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[28859]: audit 2024-02-13T14:53:05.392502+0000 mon.a (mon.0) 2370 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:06.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[28859]: audit 2024-02-13T14:53:05.392713+0000 mon.a (mon.0) 2371 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]': finished 2024-02-13T14:53:06.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[28859]: cluster 2024-02-13T14:53:05.401805+0000 mon.a (mon.0) 2372 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-02-13T14:53:06.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[28859]: audit 2024-02-13T14:53:05.408816+0000 mon.c (mon.2) 683 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]: dispatch 2024-02-13T14:53:06.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:05 smithi062 bash[28859]: audit 2024-02-13T14:53:05.409866+0000 mon.a (mon.0) 2373 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]: dispatch 2024-02-13T14:53:06.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:05 smithi111 bash[23388]: audit 2024-02-13T14:53:04.400679+0000 mon.c (mon.2) 682 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:06.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:05 smithi111 bash[23388]: cluster 2024-02-13T14:53:04.857185+0000 mon.a (mon.0) 2368 : cluster 0 osdmap e358: 8 total, 8 up, 8 in 2024-02-13T14:53:06.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:05 smithi111 bash[23388]: audit 2024-02-13T14:53:04.858658+0000 mon.a (mon.0) 2369 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:06.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:05 smithi111 bash[23388]: audit 2024-02-13T14:53:05.392502+0000 mon.a (mon.0) 2370 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "ExecuteClassPP_smithi062-64512-64", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:06.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:05 smithi111 bash[23388]: audit 2024-02-13T14:53:05.392713+0000 mon.a (mon.0) 2371 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-49"}]': finished 2024-02-13T14:53:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:05 smithi111 bash[23388]: cluster 2024-02-13T14:53:05.401805+0000 mon.a (mon.0) 2372 : cluster 0 osdmap e359: 8 total, 8 up, 8 in 2024-02-13T14:53:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:05 smithi111 bash[23388]: audit 2024-02-13T14:53:05.408816+0000 mon.c (mon.2) 683 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]: dispatch 2024-02-13T14:53:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:05 smithi111 bash[23388]: audit 2024-02-13T14:53:05.409866+0000 mon.a (mon.0) 2373 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]: dispatch 2024-02-13T14:53:06.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:53:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:53:07.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[21479]: cluster 2024-02-13T14:53:05.904856+0000 mgr.y (mgr.14613) 380 : cluster 0 pgmap v550: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:53:07.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[21479]: cluster 2024-02-13T14:53:06.393051+0000 mon.a (mon.0) 2374 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:53:07.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[21479]: audit 2024-02-13T14:53:06.395482+0000 mon.a (mon.0) 2375 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]': finished 2024-02-13T14:53:07.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[21479]: cluster 2024-02-13T14:53:06.404064+0000 mon.a (mon.0) 2376 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-02-13T14:53:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[28859]: cluster 2024-02-13T14:53:05.904856+0000 mgr.y (mgr.14613) 380 : cluster 0 pgmap v550: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:53:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[28859]: cluster 2024-02-13T14:53:06.393051+0000 mon.a (mon.0) 2374 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:53:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[28859]: audit 2024-02-13T14:53:06.395482+0000 mon.a (mon.0) 2375 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]': finished 2024-02-13T14:53:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:06 smithi062 bash[28859]: cluster 2024-02-13T14:53:06.404064+0000 mon.a (mon.0) 2376 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-02-13T14:53:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:06 smithi111 bash[23388]: cluster 2024-02-13T14:53:05.904856+0000 mgr.y (mgr.14613) 380 : cluster 0 pgmap v550: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:53:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:06 smithi111 bash[23388]: cluster 2024-02-13T14:53:06.393051+0000 mon.a (mon.0) 2374 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:53:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:06 smithi111 bash[23388]: audit 2024-02-13T14:53:06.395482+0000 mon.a (mon.0) 2375 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-49", "mode": "readproxy"}]': finished 2024-02-13T14:53:07.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:06 smithi111 bash[23388]: cluster 2024-02-13T14:53:06.404064+0000 mon.a (mon.0) 2376 : cluster 0 osdmap e360: 8 total, 8 up, 8 in 2024-02-13T14:53:08.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:07 smithi062 bash[28859]: cluster 2024-02-13T14:53:06.868500+0000 mon.a (mon.0) 2377 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:08.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:07 smithi062 bash[28859]: cluster 2024-02-13T14:53:07.405300+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-02-13T14:53:08.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:07 smithi062 bash[28859]: audit 2024-02-13T14:53:07.407650+0000 mon.c (mon.2) 684 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:08.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:07 smithi062 bash[28859]: audit 2024-02-13T14:53:07.408440+0000 mon.a (mon.0) 2379 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:08.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:07 smithi062 bash[21479]: cluster 2024-02-13T14:53:06.868500+0000 mon.a (mon.0) 2377 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:08.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:07 smithi062 bash[21479]: cluster 2024-02-13T14:53:07.405300+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-02-13T14:53:08.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:07 smithi062 bash[21479]: audit 2024-02-13T14:53:07.407650+0000 mon.c (mon.2) 684 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:08.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:07 smithi062 bash[21479]: audit 2024-02-13T14:53:07.408440+0000 mon.a (mon.0) 2379 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:08.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:07 smithi111 bash[23388]: cluster 2024-02-13T14:53:06.868500+0000 mon.a (mon.0) 2377 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:08.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:07 smithi111 bash[23388]: cluster 2024-02-13T14:53:07.405300+0000 mon.a (mon.0) 2378 : cluster 0 osdmap e361: 8 total, 8 up, 8 in 2024-02-13T14:53:08.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:07 smithi111 bash[23388]: audit 2024-02-13T14:53:07.407650+0000 mon.c (mon.2) 684 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:08.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:07 smithi111 bash[23388]: audit 2024-02-13T14:53:07.408440+0000 mon.a (mon.0) 2379 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:09.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[21479]: cluster 2024-02-13T14:53:07.905771+0000 mgr.y (mgr.14613) 381 : cluster 0 pgmap v553: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:53:09.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[21479]: audit 2024-02-13T14:53:08.400816+0000 mon.a (mon.0) 2380 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:09.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[21479]: cluster 2024-02-13T14:53:08.408367+0000 mon.a (mon.0) 2381 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-02-13T14:53:09.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[21479]: audit 2024-02-13T14:53:08.409769+0000 mon.c (mon.2) 685 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:09.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[21479]: audit 2024-02-13T14:53:08.411147+0000 mon.a (mon.0) 2382 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:09.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[28859]: cluster 2024-02-13T14:53:07.905771+0000 mgr.y (mgr.14613) 381 : cluster 0 pgmap v553: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:53:09.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[28859]: audit 2024-02-13T14:53:08.400816+0000 mon.a (mon.0) 2380 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:09.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[28859]: cluster 2024-02-13T14:53:08.408367+0000 mon.a (mon.0) 2381 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-02-13T14:53:09.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[28859]: audit 2024-02-13T14:53:08.409769+0000 mon.c (mon.2) 685 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:09.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:08 smithi062 bash[28859]: audit 2024-02-13T14:53:08.411147+0000 mon.a (mon.0) 2382 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:08 smithi111 bash[23388]: cluster 2024-02-13T14:53:07.905771+0000 mgr.y (mgr.14613) 381 : cluster 0 pgmap v553: 324 pgs: 324 active+clean; 8.4 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:53:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:08 smithi111 bash[23388]: audit 2024-02-13T14:53:08.400816+0000 mon.a (mon.0) 2380 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:08 smithi111 bash[23388]: cluster 2024-02-13T14:53:08.408367+0000 mon.a (mon.0) 2381 : cluster 0 osdmap e362: 8 total, 8 up, 8 in 2024-02-13T14:53:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:08 smithi111 bash[23388]: audit 2024-02-13T14:53:08.409769+0000 mon.c (mon.2) 685 : audit 1 from='client.? v1:172.21.15.62:0/3555149777' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:08 smithi111 bash[23388]: audit 2024-02-13T14:53:08.411147+0000 mon.a (mon.0) 2382 : audit 1 from='client.46985 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]: dispatch 2024-02-13T14:53:10.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[21479]: audit 2024-02-13T14:53:09.404396+0000 mon.a (mon.0) 2383 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:10.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[21479]: cluster 2024-02-13T14:53:09.412306+0000 mon.a (mon.0) 2384 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-02-13T14:53:10.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[21479]: audit 2024-02-13T14:53:09.443907+0000 mon.a (mon.0) 2385 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:10.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[21479]: audit 2024-02-13T14:53:09.445322+0000 mon.a (mon.0) 2386 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:10.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[21479]: audit 2024-02-13T14:53:09.445669+0000 mon.a (mon.0) 2387 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi062-64512-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:10.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[21479]: cluster 2024-02-13T14:53:09.908028+0000 mgr.y (mgr.14613) 382 : cluster 0 pgmap v556: 324 pgs: 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T14:53:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[21479]: audit 2024-02-13T14:53:10.361539+0000 mgr.y (mgr.14613) 383 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[28859]: audit 2024-02-13T14:53:09.404396+0000 mon.a (mon.0) 2383 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[28859]: cluster 2024-02-13T14:53:09.412306+0000 mon.a (mon.0) 2384 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-02-13T14:53:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[28859]: audit 2024-02-13T14:53:09.443907+0000 mon.a (mon.0) 2385 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[28859]: audit 2024-02-13T14:53:09.445322+0000 mon.a (mon.0) 2386 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[28859]: audit 2024-02-13T14:53:09.445669+0000 mon.a (mon.0) 2387 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi062-64512-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[28859]: cluster 2024-02-13T14:53:09.908028+0000 mgr.y (mgr.14613) 382 : cluster 0 pgmap v556: 324 pgs: 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T14:53:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:10 smithi062 bash[28859]: audit 2024-02-13T14:53:10.361539+0000 mgr.y (mgr.14613) 383 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:10.842 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:53:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:53:10.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:10 smithi111 bash[23388]: audit 2024-02-13T14:53:09.404396+0000 mon.a (mon.0) 2383 : audit 1 from='client.46985 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"ExecuteClassPP_smithi062-64512-64"}]': finished 2024-02-13T14:53:10.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:10 smithi111 bash[23388]: cluster 2024-02-13T14:53:09.412306+0000 mon.a (mon.0) 2384 : cluster 0 osdmap e363: 8 total, 8 up, 8 in 2024-02-13T14:53:10.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:10 smithi111 bash[23388]: audit 2024-02-13T14:53:09.443907+0000 mon.a (mon.0) 2385 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:10.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:10 smithi111 bash[23388]: audit 2024-02-13T14:53:09.445322+0000 mon.a (mon.0) 2386 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:10 smithi111 bash[23388]: audit 2024-02-13T14:53:09.445669+0000 mon.a (mon.0) 2387 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi062-64512-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:10 smithi111 bash[23388]: cluster 2024-02-13T14:53:09.908028+0000 mgr.y (mgr.14613) 382 : cluster 0 pgmap v556: 324 pgs: 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T14:53:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:10 smithi111 bash[23388]: audit 2024-02-13T14:53:10.361539+0000 mgr.y (mgr.14613) 383 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:11 smithi062 bash[21479]: audit 2024-02-13T14:53:10.406899+0000 mon.a (mon.0) 2388 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi062-64512-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:11 smithi062 bash[21479]: cluster 2024-02-13T14:53:10.414945+0000 mon.a (mon.0) 2389 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-02-13T14:53:12.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:11 smithi062 bash[21479]: audit 2024-02-13T14:53:10.420886+0000 mon.a (mon.0) 2390 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi062-64512-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:11 smithi062 bash[28859]: audit 2024-02-13T14:53:10.406899+0000 mon.a (mon.0) 2388 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi062-64512-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:11 smithi062 bash[28859]: cluster 2024-02-13T14:53:10.414945+0000 mon.a (mon.0) 2389 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-02-13T14:53:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:11 smithi062 bash[28859]: audit 2024-02-13T14:53:10.420886+0000 mon.a (mon.0) 2390 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi062-64512-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:11 smithi111 bash[23388]: audit 2024-02-13T14:53:10.406899+0000 mon.a (mon.0) 2388 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-OmapPP_smithi062-64512-65", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:11 smithi111 bash[23388]: cluster 2024-02-13T14:53:10.414945+0000 mon.a (mon.0) 2389 : cluster 0 osdmap e364: 8 total, 8 up, 8 in 2024-02-13T14:53:12.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:11 smithi111 bash[23388]: audit 2024-02-13T14:53:10.420886+0000 mon.a (mon.0) 2390 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "OmapPP_smithi062-64512-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[28859]: cluster 2024-02-13T14:53:11.876238+0000 mon.a (mon.0) 2391 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-02-13T14:53:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[28859]: cluster 2024-02-13T14:53:11.908675+0000 mgr.y (mgr.14613) 384 : cluster 0 pgmap v559: 324 pgs: 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T14:53:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[28859]: cluster 2024-02-13T14:53:12.007505+0000 mon.a (mon.0) 2392 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[28859]: audit 2024-02-13T14:53:12.413713+0000 mon.a (mon.0) 2393 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi062-64512-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[28859]: cluster 2024-02-13T14:53:12.422969+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-02-13T14:53:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[21479]: cluster 2024-02-13T14:53:11.876238+0000 mon.a (mon.0) 2391 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-02-13T14:53:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[21479]: cluster 2024-02-13T14:53:11.908675+0000 mgr.y (mgr.14613) 384 : cluster 0 pgmap v559: 324 pgs: 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T14:53:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[21479]: cluster 2024-02-13T14:53:12.007505+0000 mon.a (mon.0) 2392 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[21479]: audit 2024-02-13T14:53:12.413713+0000 mon.a (mon.0) 2393 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi062-64512-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:12 smithi062 bash[21479]: cluster 2024-02-13T14:53:12.422969+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-02-13T14:53:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:12 smithi111 bash[23388]: cluster 2024-02-13T14:53:11.876238+0000 mon.a (mon.0) 2391 : cluster 0 osdmap e365: 8 total, 8 up, 8 in 2024-02-13T14:53:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:12 smithi111 bash[23388]: cluster 2024-02-13T14:53:11.908675+0000 mgr.y (mgr.14613) 384 : cluster 0 pgmap v559: 324 pgs: 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-02-13T14:53:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:12 smithi111 bash[23388]: cluster 2024-02-13T14:53:12.007505+0000 mon.a (mon.0) 2392 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:13.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:12 smithi111 bash[23388]: audit 2024-02-13T14:53:12.413713+0000 mon.a (mon.0) 2393 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "OmapPP_smithi062-64512-65", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:13.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:12 smithi111 bash[23388]: cluster 2024-02-13T14:53:12.422969+0000 mon.a (mon.0) 2394 : cluster 0 osdmap e366: 8 total, 8 up, 8 in 2024-02-13T14:53:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:14 smithi062 bash[21479]: cluster 2024-02-13T14:53:13.424939+0000 mon.a (mon.0) 2395 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-02-13T14:53:14.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:14 smithi062 bash[21479]: cluster 2024-02-13T14:53:13.909581+0000 mgr.y (mgr.14613) 385 : cluster 0 pgmap v562: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:14.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:14 smithi062 bash[28859]: cluster 2024-02-13T14:53:13.424939+0000 mon.a (mon.0) 2395 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-02-13T14:53:14.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:14 smithi062 bash[28859]: cluster 2024-02-13T14:53:13.909581+0000 mgr.y (mgr.14613) 385 : cluster 0 pgmap v562: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:14 smithi111 bash[23388]: cluster 2024-02-13T14:53:13.424939+0000 mon.a (mon.0) 2395 : cluster 0 osdmap e367: 8 total, 8 up, 8 in 2024-02-13T14:53:14.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:14 smithi111 bash[23388]: cluster 2024-02-13T14:53:13.909581+0000 mgr.y (mgr.14613) 385 : cluster 0 pgmap v562: 332 pgs: 8 unknown, 324 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:15.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:15 smithi062 bash[28859]: cluster 2024-02-13T14:53:14.439018+0000 mon.a (mon.0) 2396 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-02-13T14:53:15.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:15 smithi062 bash[28859]: audit 2024-02-13T14:53:14.441415+0000 mon.a (mon.0) 2397 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:15.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:15 smithi062 bash[21479]: cluster 2024-02-13T14:53:14.439018+0000 mon.a (mon.0) 2396 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-02-13T14:53:15.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:15 smithi062 bash[21479]: audit 2024-02-13T14:53:14.441415+0000 mon.a (mon.0) 2397 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:15.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:15 smithi111 bash[23388]: cluster 2024-02-13T14:53:14.439018+0000 mon.a (mon.0) 2396 : cluster 0 osdmap e368: 8 total, 8 up, 8 in 2024-02-13T14:53:15.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:15 smithi111 bash[23388]: audit 2024-02-13T14:53:14.441415+0000 mon.a (mon.0) 2397 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:16.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:53:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:53:16.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[28859]: audit 2024-02-13T14:53:15.438035+0000 mon.a (mon.0) 2398 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[28859]: cluster 2024-02-13T14:53:15.447905+0000 mon.a (mon.0) 2399 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-02-13T14:53:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[28859]: audit 2024-02-13T14:53:15.449108+0000 mon.a (mon.0) 2400 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[28859]: cluster 2024-02-13T14:53:15.910511+0000 mgr.y (mgr.14613) 386 : cluster 0 pgmap v565: 324 pgs: 324 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[21479]: audit 2024-02-13T14:53:15.438035+0000 mon.a (mon.0) 2398 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[21479]: cluster 2024-02-13T14:53:15.447905+0000 mon.a (mon.0) 2399 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-02-13T14:53:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[21479]: audit 2024-02-13T14:53:15.449108+0000 mon.a (mon.0) 2400 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:16 smithi062 bash[21479]: cluster 2024-02-13T14:53:15.910511+0000 mgr.y (mgr.14613) 386 : cluster 0 pgmap v565: 324 pgs: 324 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:16.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:16 smithi111 bash[23388]: audit 2024-02-13T14:53:15.438035+0000 mon.a (mon.0) 2398 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:16.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:16 smithi111 bash[23388]: cluster 2024-02-13T14:53:15.447905+0000 mon.a (mon.0) 2399 : cluster 0 osdmap e369: 8 total, 8 up, 8 in 2024-02-13T14:53:16.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:16 smithi111 bash[23388]: audit 2024-02-13T14:53:15.449108+0000 mon.a (mon.0) 2400 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]: dispatch 2024-02-13T14:53:16.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:16 smithi111 bash[23388]: cluster 2024-02-13T14:53:15.910511+0000 mgr.y (mgr.14613) 386 : cluster 0 pgmap v565: 324 pgs: 324 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:17.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[21479]: audit 2024-02-13T14:53:16.448524+0000 mon.a (mon.0) 2401 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:17.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[21479]: cluster 2024-02-13T14:53:16.457928+0000 mon.a (mon.0) 2402 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-02-13T14:53:17.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[21479]: audit 2024-02-13T14:53:16.483045+0000 mon.a (mon.0) 2403 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:17.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[21479]: audit 2024-02-13T14:53:16.484578+0000 mon.a (mon.0) 2404 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:17.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[21479]: audit 2024-02-13T14:53:16.484980+0000 mon.a (mon.0) 2405 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi062-64512-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[21479]: audit 2024-02-13T14:53:17.092093+0000 mon.c (mon.2) 686 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[21479]: audit 2024-02-13T14:53:17.092895+0000 mon.a (mon.0) 2406 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[28859]: audit 2024-02-13T14:53:16.448524+0000 mon.a (mon.0) 2401 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[28859]: cluster 2024-02-13T14:53:16.457928+0000 mon.a (mon.0) 2402 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[28859]: audit 2024-02-13T14:53:16.483045+0000 mon.a (mon.0) 2403 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[28859]: audit 2024-02-13T14:53:16.484578+0000 mon.a (mon.0) 2404 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[28859]: audit 2024-02-13T14:53:16.484980+0000 mon.a (mon.0) 2405 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi062-64512-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[28859]: audit 2024-02-13T14:53:17.092093+0000 mon.c (mon.2) 686 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:17 smithi062 bash[28859]: audit 2024-02-13T14:53:17.092895+0000 mon.a (mon.0) 2406 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:17.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:17 smithi111 bash[23388]: audit 2024-02-13T14:53:16.448524+0000 mon.a (mon.0) 2401 : audit 1 from='client.? v1:172.21.15.62:0/1491939275' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"OmapPP_smithi062-64512-65"}]': finished 2024-02-13T14:53:17.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:17 smithi111 bash[23388]: cluster 2024-02-13T14:53:16.457928+0000 mon.a (mon.0) 2402 : cluster 0 osdmap e370: 8 total, 8 up, 8 in 2024-02-13T14:53:17.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:17 smithi111 bash[23388]: audit 2024-02-13T14:53:16.483045+0000 mon.a (mon.0) 2403 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:17.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:17 smithi111 bash[23388]: audit 2024-02-13T14:53:16.484578+0000 mon.a (mon.0) 2404 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:17.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:17 smithi111 bash[23388]: audit 2024-02-13T14:53:16.484980+0000 mon.a (mon.0) 2405 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi062-64512-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:53:17.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:17 smithi111 bash[23388]: audit 2024-02-13T14:53:17.092093+0000 mon.c (mon.2) 686 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:17.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:17 smithi111 bash[23388]: audit 2024-02-13T14:53:17.092895+0000 mon.a (mon.0) 2406 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:19.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: audit 2024-02-13T14:53:17.451281+0000 mon.a (mon.0) 2407 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi062-64512-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:19.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: audit 2024-02-13T14:53:17.451483+0000 mon.a (mon.0) 2408 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:19.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: cluster 2024-02-13T14:53:17.459594+0000 mon.a (mon.0) 2409 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-02-13T14:53:19.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: audit 2024-02-13T14:53:17.462332+0000 mon.a (mon.0) 2410 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi062-64512-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:19.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: audit 2024-02-13T14:53:17.469118+0000 mon.c (mon.2) 687 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: audit 2024-02-13T14:53:17.480199+0000 mon.a (mon.0) 2411 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: cluster 2024-02-13T14:53:17.911382+0000 mgr.y (mgr.14613) 387 : cluster 0 pgmap v568: 324 pgs: 324 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: audit 2024-02-13T14:53:18.189462+0000 mon.a (mon.0) 2412 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: audit 2024-02-13T14:53:18.193643+0000 mon.b (mon.1) 202 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: cluster 2024-02-13T14:53:18.452465+0000 mon.a (mon.0) 2413 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[21479]: audit 2024-02-13T14:53:18.456868+0000 mon.a (mon.0) 2414 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]': finished 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: audit 2024-02-13T14:53:17.451281+0000 mon.a (mon.0) 2407 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi062-64512-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: audit 2024-02-13T14:53:17.451483+0000 mon.a (mon.0) 2408 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: cluster 2024-02-13T14:53:17.459594+0000 mon.a (mon.0) 2409 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: audit 2024-02-13T14:53:17.462332+0000 mon.a (mon.0) 2410 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi062-64512-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: audit 2024-02-13T14:53:17.469118+0000 mon.c (mon.2) 687 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:19.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: audit 2024-02-13T14:53:17.480199+0000 mon.a (mon.0) 2411 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:19.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: cluster 2024-02-13T14:53:17.911382+0000 mgr.y (mgr.14613) 387 : cluster 0 pgmap v568: 324 pgs: 324 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:19.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: audit 2024-02-13T14:53:18.189462+0000 mon.a (mon.0) 2412 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:19.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: audit 2024-02-13T14:53:18.193643+0000 mon.b (mon.1) 202 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:19.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: cluster 2024-02-13T14:53:18.452465+0000 mon.a (mon.0) 2413 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:53:19.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:18 smithi062 bash[28859]: audit 2024-02-13T14:53:18.456868+0000 mon.a (mon.0) 2414 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]': finished 2024-02-13T14:53:19.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: audit 2024-02-13T14:53:17.451281+0000 mon.a (mon.0) 2407 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-MultiWritePP_smithi062-64512-66", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: audit 2024-02-13T14:53:17.451483+0000 mon.a (mon.0) 2408 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: cluster 2024-02-13T14:53:17.459594+0000 mon.a (mon.0) 2409 : cluster 0 osdmap e371: 8 total, 8 up, 8 in 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: audit 2024-02-13T14:53:17.462332+0000 mon.a (mon.0) 2410 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi062-64512-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: audit 2024-02-13T14:53:17.469118+0000 mon.c (mon.2) 687 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: audit 2024-02-13T14:53:17.480199+0000 mon.a (mon.0) 2411 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: cluster 2024-02-13T14:53:17.911382+0000 mgr.y (mgr.14613) 387 : cluster 0 pgmap v568: 324 pgs: 324 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: audit 2024-02-13T14:53:18.189462+0000 mon.a (mon.0) 2412 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: audit 2024-02-13T14:53:18.193643+0000 mon.b (mon.1) 202 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: cluster 2024-02-13T14:53:18.452465+0000 mon.a (mon.0) 2413 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:53:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:18 smithi111 bash[23388]: audit 2024-02-13T14:53:18.456868+0000 mon.a (mon.0) 2414 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]': finished 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout:::163:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:5d165639:::164:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f43765fc:::165:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b4c720e9:::166:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:e694b040:::167:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:afa38db2:::168:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:77ba9f53:::169:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:87495034:::170:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:7c96bf0e:::171:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:dbe346cc:::172:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:e943ec24:::173:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f97a9c0c:::174:head 2024-02-13T14:53:19.473 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:6f26e74d:::175:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:4f95e106:::176:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:0e6f2f8f:::177:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:05db05f1:::178:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:38a78d66:::179:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:d095610b:::180:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:a1a9d709:::181:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:1e5d39db:::182:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:f7df4fb9:::183:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:03a7f161:::184:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:ba70721e:::185:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:28e5662d:::186:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:973d52de:::187:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:4303eb1c:::188:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:b990b48e:::189:head 2024-02-13T14:53:19.474 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:29b8165b:::190:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:3547f197:::191:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:7e260936:::192:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:1abec7b1:::193:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:10fdda93:::194:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:15817eea:::195:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:770bab57:::196:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:ed9e13e7:::197:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:71471a8f:::198:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: checking for 257:10fb1d02:::199:head 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetWrite (8507 ms) 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HitSetTrim 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,0 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: first is 1707835954 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,0 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,0 2024-02-13T14:53:19.475 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,1707835959,1707835960,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,1707835959,1707835960,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,1707835959,1707835960,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,1707835959,1707835960,1707835962,1707835963,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,1707835959,1707835960,1707835962,1707835963,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835954,1707835956,1707835957,1707835959,1707835960,1707835962,1707835963,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707835957,1707835959,1707835960,1707835962,1707835963,1707835965,1707835966,0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: first now 1707835957, trimmed 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HitSetTrim (20772 ms) 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PromoteOn2ndRead 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: foo0 2024-02-13T14:53:19.476 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-02-13T14:53:19.477 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PromoteOn2ndRead (14073 ms) 2024-02-13T14:53:19.477 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ProxyRead 2024-02-13T14:53:20.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[21479]: audit 2024-02-13T14:53:18.572715+0000 mon.c (mon.2) 688 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:20.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[21479]: cluster 2024-02-13T14:53:18.924547+0000 mon.a (mon.0) 2415 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-02-13T14:53:20.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[21479]: audit 2024-02-13T14:53:18.927221+0000 mon.a (mon.0) 2416 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:20.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[21479]: audit 2024-02-13T14:53:18.935814+0000 mon.c (mon.2) 689 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:20.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[21479]: audit 2024-02-13T14:53:18.938476+0000 mon.a (mon.0) 2417 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:20.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[21479]: audit 2024-02-13T14:53:19.459656+0000 mon.a (mon.0) 2418 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi062-64512-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:20.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[21479]: cluster 2024-02-13T14:53:19.470119+0000 mon.a (mon.0) 2419 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-02-13T14:53:20.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[28859]: audit 2024-02-13T14:53:18.572715+0000 mon.c (mon.2) 688 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:20.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[28859]: cluster 2024-02-13T14:53:18.924547+0000 mon.a (mon.0) 2415 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-02-13T14:53:20.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[28859]: audit 2024-02-13T14:53:18.927221+0000 mon.a (mon.0) 2416 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:20.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[28859]: audit 2024-02-13T14:53:18.935814+0000 mon.c (mon.2) 689 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:20.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[28859]: audit 2024-02-13T14:53:18.938476+0000 mon.a (mon.0) 2417 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:20.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[28859]: audit 2024-02-13T14:53:19.459656+0000 mon.a (mon.0) 2418 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi062-64512-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:20.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:19 smithi062 bash[28859]: cluster 2024-02-13T14:53:19.470119+0000 mon.a (mon.0) 2419 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-02-13T14:53:20.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:19 smithi111 bash[23388]: audit 2024-02-13T14:53:18.572715+0000 mon.c (mon.2) 688 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:20.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:19 smithi111 bash[23388]: cluster 2024-02-13T14:53:18.924547+0000 mon.a (mon.0) 2415 : cluster 0 osdmap e372: 8 total, 8 up, 8 in 2024-02-13T14:53:20.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:19 smithi111 bash[23388]: audit 2024-02-13T14:53:18.927221+0000 mon.a (mon.0) 2416 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:20.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:19 smithi111 bash[23388]: audit 2024-02-13T14:53:18.935814+0000 mon.c (mon.2) 689 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:20.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:19 smithi111 bash[23388]: audit 2024-02-13T14:53:18.938476+0000 mon.a (mon.0) 2417 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-49"}]: dispatch 2024-02-13T14:53:20.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:19 smithi111 bash[23388]: audit 2024-02-13T14:53:19.459656+0000 mon.a (mon.0) 2418 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "MultiWritePP_smithi062-64512-66", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:20.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:19 smithi111 bash[23388]: cluster 2024-02-13T14:53:19.470119+0000 mon.a (mon.0) 2419 : cluster 0 osdmap e373: 8 total, 8 up, 8 in 2024-02-13T14:53:20.842 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:53:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:53:21.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[21479]: cluster 2024-02-13T14:53:19.913294+0000 mgr.y (mgr.14613) 388 : cluster 0 pgmap v571: 300 pgs: 4 creating+peering, 4 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:21.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[21479]: cluster 2024-02-13T14:53:20.459527+0000 mon.a (mon.0) 2420 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:21.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[21479]: cluster 2024-02-13T14:53:20.477434+0000 mon.a (mon.0) 2421 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-02-13T14:53:21.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[21479]: audit 2024-02-13T14:53:20.483062+0000 mon.c (mon.2) 690 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:21.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[21479]: audit 2024-02-13T14:53:20.484849+0000 mon.a (mon.0) 2422 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:21.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[28859]: cluster 2024-02-13T14:53:19.913294+0000 mgr.y (mgr.14613) 388 : cluster 0 pgmap v571: 300 pgs: 4 creating+peering, 4 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:21.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[28859]: cluster 2024-02-13T14:53:20.459527+0000 mon.a (mon.0) 2420 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[28859]: cluster 2024-02-13T14:53:20.477434+0000 mon.a (mon.0) 2421 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-02-13T14:53:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[28859]: audit 2024-02-13T14:53:20.483062+0000 mon.c (mon.2) 690 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:20 smithi062 bash[28859]: audit 2024-02-13T14:53:20.484849+0000 mon.a (mon.0) 2422 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:21.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:20 smithi111 bash[23388]: cluster 2024-02-13T14:53:19.913294+0000 mgr.y (mgr.14613) 388 : cluster 0 pgmap v571: 300 pgs: 4 creating+peering, 4 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:21.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:20 smithi111 bash[23388]: cluster 2024-02-13T14:53:20.459527+0000 mon.a (mon.0) 2420 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:21.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:20 smithi111 bash[23388]: cluster 2024-02-13T14:53:20.477434+0000 mon.a (mon.0) 2421 : cluster 0 osdmap e374: 8 total, 8 up, 8 in 2024-02-13T14:53:21.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:20 smithi111 bash[23388]: audit 2024-02-13T14:53:20.483062+0000 mon.c (mon.2) 690 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:21.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:20 smithi111 bash[23388]: audit 2024-02-13T14:53:20.484849+0000 mon.a (mon.0) 2422 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[28859]: audit 2024-02-13T14:53:20.369435+0000 mgr.y (mgr.14613) 389 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[28859]: audit 2024-02-13T14:53:21.472851+0000 mon.a (mon.0) 2423 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[28859]: cluster 2024-02-13T14:53:21.480575+0000 mon.a (mon.0) 2424 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-02-13T14:53:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[28859]: audit 2024-02-13T14:53:21.486879+0000 mon.a (mon.0) 2425 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[28859]: audit 2024-02-13T14:53:21.548048+0000 mon.c (mon.2) 691 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:22.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[28859]: audit 2024-02-13T14:53:21.548636+0000 mon.a (mon.0) 2426 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:22.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[21479]: audit 2024-02-13T14:53:20.369435+0000 mgr.y (mgr.14613) 389 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[21479]: audit 2024-02-13T14:53:21.472851+0000 mon.a (mon.0) 2423 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[21479]: cluster 2024-02-13T14:53:21.480575+0000 mon.a (mon.0) 2424 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-02-13T14:53:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[21479]: audit 2024-02-13T14:53:21.486879+0000 mon.a (mon.0) 2425 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[21479]: audit 2024-02-13T14:53:21.548048+0000 mon.c (mon.2) 691 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:21 smithi062 bash[21479]: audit 2024-02-13T14:53:21.548636+0000 mon.a (mon.0) 2426 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:21 smithi111 bash[23388]: audit 2024-02-13T14:53:20.369435+0000 mgr.y (mgr.14613) 389 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:21 smithi111 bash[23388]: audit 2024-02-13T14:53:21.472851+0000 mon.a (mon.0) 2423 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-51","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:21 smithi111 bash[23388]: cluster 2024-02-13T14:53:21.480575+0000 mon.a (mon.0) 2424 : cluster 0 osdmap e375: 8 total, 8 up, 8 in 2024-02-13T14:53:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:21 smithi111 bash[23388]: audit 2024-02-13T14:53:21.486879+0000 mon.a (mon.0) 2425 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:21 smithi111 bash[23388]: audit 2024-02-13T14:53:21.548048+0000 mon.c (mon.2) 691 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:21 smithi111 bash[23388]: audit 2024-02-13T14:53:21.548636+0000 mon.a (mon.0) 2426 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:53:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[21479]: cluster 2024-02-13T14:53:21.914188+0000 mgr.y (mgr.14613) 390 : cluster 0 pgmap v574: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[21479]: audit 2024-02-13T14:53:22.483999+0000 mon.a (mon.0) 2427 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[21479]: audit 2024-02-13T14:53:22.484209+0000 mon.a (mon.0) 2428 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:53:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[21479]: cluster 2024-02-13T14:53:22.493101+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-02-13T14:53:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[21479]: audit 2024-02-13T14:53:22.494025+0000 mon.a (mon.0) 2430 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:23.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[21479]: audit 2024-02-13T14:53:22.494919+0000 mon.c (mon.2) 692 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:23.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[21479]: audit 2024-02-13T14:53:22.495923+0000 mon.a (mon.0) 2431 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[28859]: cluster 2024-02-13T14:53:21.914188+0000 mgr.y (mgr.14613) 390 : cluster 0 pgmap v574: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:23.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[28859]: audit 2024-02-13T14:53:22.483999+0000 mon.a (mon.0) 2427 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:23.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[28859]: audit 2024-02-13T14:53:22.484209+0000 mon.a (mon.0) 2428 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:53:23.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[28859]: cluster 2024-02-13T14:53:22.493101+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-02-13T14:53:23.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[28859]: audit 2024-02-13T14:53:22.494025+0000 mon.a (mon.0) 2430 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:23.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[28859]: audit 2024-02-13T14:53:22.494919+0000 mon.c (mon.2) 692 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:23.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:22 smithi062 bash[28859]: audit 2024-02-13T14:53:22.495923+0000 mon.a (mon.0) 2431 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:22 smithi111 bash[23388]: cluster 2024-02-13T14:53:21.914188+0000 mgr.y (mgr.14613) 390 : cluster 0 pgmap v574: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:53:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:22 smithi111 bash[23388]: audit 2024-02-13T14:53:22.483999+0000 mon.a (mon.0) 2427 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:22 smithi111 bash[23388]: audit 2024-02-13T14:53:22.484209+0000 mon.a (mon.0) 2428 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:53:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:22 smithi111 bash[23388]: cluster 2024-02-13T14:53:22.493101+0000 mon.a (mon.0) 2429 : cluster 0 osdmap e376: 8 total, 8 up, 8 in 2024-02-13T14:53:23.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:22 smithi111 bash[23388]: audit 2024-02-13T14:53:22.494025+0000 mon.a (mon.0) 2430 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]: dispatch 2024-02-13T14:53:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:22 smithi111 bash[23388]: audit 2024-02-13T14:53:22.494919+0000 mon.c (mon.2) 692 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:22 smithi111 bash[23388]: audit 2024-02-13T14:53:22.495923+0000 mon.a (mon.0) 2431 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:23.512 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ api_aio_pp: [ OK ] LibRadosAioEC.RoundTripWriteFullPP2 (3050 ms) 2024-02-13T14:53:23.512 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPP 2024-02-13T14:53:23.512 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPP (7096 ms) 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.SimpleStatPPNS 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.SimpleStatPPNS (7018 ms) 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.StatRemovePP 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.StatRemovePP (7050 ms) 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.ExecuteClassPP 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.ExecuteClassPP (7018 ms) 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.OmapPP 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.OmapPP (7043 ms) 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ RUN ] LibRadosAioEC.MultiWritePP 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ OK ] LibRadosAioEC.MultiWritePP (7043 ms) 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] 20 tests from LibRadosAioEC (139139 ms total) 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [----------] Global test environment tear-down 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [==========] 57 tests from 4 test suites ran. (324866 ms total) 2024-02-13T14:53:23.513 INFO:tasks.workunit.client.0.smithi062.stdout: api_aio_pp: [ PASSED ] 57 tests. 2024-02-13T14:53:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[21479]: audit 2024-02-13T14:53:23.487427+0000 mon.a (mon.0) 2432 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[21479]: audit 2024-02-13T14:53:23.487586+0000 mon.a (mon.0) 2433 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]': finished 2024-02-13T14:53:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[21479]: cluster 2024-02-13T14:53:23.497448+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-02-13T14:53:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[21479]: audit 2024-02-13T14:53:23.498371+0000 mon.c (mon.2) 693 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]: dispatch 2024-02-13T14:53:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[21479]: audit 2024-02-13T14:53:23.500133+0000 mon.a (mon.0) 2435 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]: dispatch 2024-02-13T14:53:24.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[21479]: cluster 2024-02-13T14:53:23.915256+0000 mgr.y (mgr.14613) 391 : cluster 0 pgmap v577: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[28859]: audit 2024-02-13T14:53:23.487427+0000 mon.a (mon.0) 2432 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[28859]: audit 2024-02-13T14:53:23.487586+0000 mon.a (mon.0) 2433 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]': finished 2024-02-13T14:53:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[28859]: cluster 2024-02-13T14:53:23.497448+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-02-13T14:53:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[28859]: audit 2024-02-13T14:53:23.498371+0000 mon.c (mon.2) 693 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]: dispatch 2024-02-13T14:53:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[28859]: audit 2024-02-13T14:53:23.500133+0000 mon.a (mon.0) 2435 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]: dispatch 2024-02-13T14:53:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:24 smithi062 bash[28859]: cluster 2024-02-13T14:53:23.915256+0000 mgr.y (mgr.14613) 391 : cluster 0 pgmap v577: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:24 smithi111 bash[23388]: audit 2024-02-13T14:53:23.487427+0000 mon.a (mon.0) 2432 : audit 1 from='client.? v1:172.21.15.62:0/3770008546' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"MultiWritePP_smithi062-64512-66"}]': finished 2024-02-13T14:53:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:24 smithi111 bash[23388]: audit 2024-02-13T14:53:23.487586+0000 mon.a (mon.0) 2433 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-51"}]': finished 2024-02-13T14:53:24.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:24 smithi111 bash[23388]: cluster 2024-02-13T14:53:23.497448+0000 mon.a (mon.0) 2434 : cluster 0 osdmap e377: 8 total, 8 up, 8 in 2024-02-13T14:53:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:24 smithi111 bash[23388]: audit 2024-02-13T14:53:23.498371+0000 mon.c (mon.2) 693 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]: dispatch 2024-02-13T14:53:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:24 smithi111 bash[23388]: audit 2024-02-13T14:53:23.500133+0000 mon.a (mon.0) 2435 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]: dispatch 2024-02-13T14:53:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:24 smithi111 bash[23388]: cluster 2024-02-13T14:53:23.915256+0000 mgr.y (mgr.14613) 391 : cluster 0 pgmap v577: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[21479]: cluster 2024-02-13T14:53:24.487790+0000 mon.a (mon.0) 2436 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:53:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[21479]: audit 2024-02-13T14:53:24.492126+0000 mon.a (mon.0) 2437 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]': finished 2024-02-13T14:53:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[21479]: cluster 2024-02-13T14:53:24.499592+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-02-13T14:53:25.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[21479]: audit 2024-02-13T14:53:24.631625+0000 mon.c (mon.2) 694 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:53:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[21479]: audit 2024-02-13T14:53:24.632279+0000 mon.a (mon.0) 2439 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:53:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[28859]: cluster 2024-02-13T14:53:24.487790+0000 mon.a (mon.0) 2436 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:53:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[28859]: audit 2024-02-13T14:53:24.492126+0000 mon.a (mon.0) 2437 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]': finished 2024-02-13T14:53:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[28859]: cluster 2024-02-13T14:53:24.499592+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-02-13T14:53:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[28859]: audit 2024-02-13T14:53:24.631625+0000 mon.c (mon.2) 694 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:53:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:25 smithi062 bash[28859]: audit 2024-02-13T14:53:24.632279+0000 mon.a (mon.0) 2439 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:53:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:25 smithi111 bash[23388]: cluster 2024-02-13T14:53:24.487790+0000 mon.a (mon.0) 2436 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:53:25.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:25 smithi111 bash[23388]: audit 2024-02-13T14:53:24.492126+0000 mon.a (mon.0) 2437 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-51", "mode": "writeback"}]': finished 2024-02-13T14:53:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:25 smithi111 bash[23388]: cluster 2024-02-13T14:53:24.499592+0000 mon.a (mon.0) 2438 : cluster 0 osdmap e378: 8 total, 8 up, 8 in 2024-02-13T14:53:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:25 smithi111 bash[23388]: audit 2024-02-13T14:53:24.631625+0000 mon.c (mon.2) 694 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:53:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:25 smithi111 bash[23388]: audit 2024-02-13T14:53:24.632279+0000 mon.a (mon.0) 2439 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:53:26.531 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:53:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:53:26.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[21479]: audit 2024-02-13T14:53:25.521672+0000 mon.a (mon.0) 2440 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:53:26.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[21479]: cluster 2024-02-13T14:53:25.530734+0000 mon.a (mon.0) 2441 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-02-13T14:53:26.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[21479]: audit 2024-02-13T14:53:25.532025+0000 mon.c (mon.2) 695 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:53:26.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[21479]: audit 2024-02-13T14:53:25.534145+0000 mon.a (mon.0) 2442 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:53:26.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[21479]: cluster 2024-02-13T14:53:25.916202+0000 mgr.y (mgr.14613) 392 : cluster 0 pgmap v580: 324 pgs: 324 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-13T14:53:26.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[28859]: audit 2024-02-13T14:53:25.521672+0000 mon.a (mon.0) 2440 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:53:26.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[28859]: cluster 2024-02-13T14:53:25.530734+0000 mon.a (mon.0) 2441 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-02-13T14:53:26.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[28859]: audit 2024-02-13T14:53:25.532025+0000 mon.c (mon.2) 695 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:53:26.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[28859]: audit 2024-02-13T14:53:25.534145+0000 mon.a (mon.0) 2442 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:53:26.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:26 smithi062 bash[28859]: cluster 2024-02-13T14:53:25.916202+0000 mgr.y (mgr.14613) 392 : cluster 0 pgmap v580: 324 pgs: 324 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-13T14:53:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:26 smithi111 bash[23388]: audit 2024-02-13T14:53:25.521672+0000 mon.a (mon.0) 2440 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:53:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:26 smithi111 bash[23388]: cluster 2024-02-13T14:53:25.530734+0000 mon.a (mon.0) 2441 : cluster 0 osdmap e379: 8 total, 8 up, 8 in 2024-02-13T14:53:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:26 smithi111 bash[23388]: audit 2024-02-13T14:53:25.532025+0000 mon.c (mon.2) 695 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:53:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:26 smithi111 bash[23388]: audit 2024-02-13T14:53:25.534145+0000 mon.a (mon.0) 2442 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:53:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:26 smithi111 bash[23388]: cluster 2024-02-13T14:53:25.916202+0000 mgr.y (mgr.14613) 392 : cluster 0 pgmap v580: 324 pgs: 324 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-13T14:53:27.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[21479]: audit 2024-02-13T14:53:26.530700+0000 mon.a (mon.0) 2443 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:53:27.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[21479]: cluster 2024-02-13T14:53:26.539447+0000 mon.a (mon.0) 2444 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-02-13T14:53:27.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[21479]: audit 2024-02-13T14:53:26.540771+0000 mon.c (mon.2) 696 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:53:27.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[21479]: audit 2024-02-13T14:53:26.543229+0000 mon.a (mon.0) 2445 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:53:27.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[21479]: cluster 2024-02-13T14:53:27.013132+0000 mon.a (mon.0) 2446 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[28859]: audit 2024-02-13T14:53:26.530700+0000 mon.a (mon.0) 2443 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:53:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[28859]: cluster 2024-02-13T14:53:26.539447+0000 mon.a (mon.0) 2444 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-02-13T14:53:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[28859]: audit 2024-02-13T14:53:26.540771+0000 mon.c (mon.2) 696 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:53:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[28859]: audit 2024-02-13T14:53:26.543229+0000 mon.a (mon.0) 2445 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:53:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:27 smithi062 bash[28859]: cluster 2024-02-13T14:53:27.013132+0000 mon.a (mon.0) 2446 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:27.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:27 smithi111 bash[23388]: audit 2024-02-13T14:53:26.530700+0000 mon.a (mon.0) 2443 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:53:27.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:27 smithi111 bash[23388]: cluster 2024-02-13T14:53:26.539447+0000 mon.a (mon.0) 2444 : cluster 0 osdmap e380: 8 total, 8 up, 8 in 2024-02-13T14:53:27.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:27 smithi111 bash[23388]: audit 2024-02-13T14:53:26.540771+0000 mon.c (mon.2) 696 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:53:27.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:27 smithi111 bash[23388]: audit 2024-02-13T14:53:26.543229+0000 mon.a (mon.0) 2445 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:53:27.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:27 smithi111 bash[23388]: cluster 2024-02-13T14:53:27.013132+0000 mon.a (mon.0) 2446 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:28.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[21479]: cluster 2024-02-13T14:53:27.530973+0000 mon.a (mon.0) 2447 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:53:28.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[21479]: audit 2024-02-13T14:53:27.533260+0000 mon.a (mon.0) 2448 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:53:28.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[21479]: cluster 2024-02-13T14:53:27.542223+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-02-13T14:53:28.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[21479]: audit 2024-02-13T14:53:27.544045+0000 mon.c (mon.2) 697 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:53:28.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[21479]: audit 2024-02-13T14:53:27.545087+0000 mon.a (mon.0) 2450 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:53:28.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[21479]: cluster 2024-02-13T14:53:27.917117+0000 mgr.y (mgr.14613) 393 : cluster 0 pgmap v583: 324 pgs: 324 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[21479]: audit 2024-02-13T14:53:28.538140+0000 mon.a (mon.0) 2451 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[21479]: cluster 2024-02-13T14:53:28.545335+0000 mon.a (mon.0) 2452 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[28859]: cluster 2024-02-13T14:53:27.530973+0000 mon.a (mon.0) 2447 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[28859]: audit 2024-02-13T14:53:27.533260+0000 mon.a (mon.0) 2448 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[28859]: cluster 2024-02-13T14:53:27.542223+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[28859]: audit 2024-02-13T14:53:27.544045+0000 mon.c (mon.2) 697 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[28859]: audit 2024-02-13T14:53:27.545087+0000 mon.a (mon.0) 2450 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[28859]: cluster 2024-02-13T14:53:27.917117+0000 mgr.y (mgr.14613) 393 : cluster 0 pgmap v583: 324 pgs: 324 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[28859]: audit 2024-02-13T14:53:28.538140+0000 mon.a (mon.0) 2451 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T14:53:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:28 smithi062 bash[28859]: cluster 2024-02-13T14:53:28.545335+0000 mon.a (mon.0) 2452 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-02-13T14:53:28.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:28 smithi111 bash[23388]: cluster 2024-02-13T14:53:27.530973+0000 mon.a (mon.0) 2447 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:53:28.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:28 smithi111 bash[23388]: audit 2024-02-13T14:53:27.533260+0000 mon.a (mon.0) 2448 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:53:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:28 smithi111 bash[23388]: cluster 2024-02-13T14:53:27.542223+0000 mon.a (mon.0) 2449 : cluster 0 osdmap e381: 8 total, 8 up, 8 in 2024-02-13T14:53:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:28 smithi111 bash[23388]: audit 2024-02-13T14:53:27.544045+0000 mon.c (mon.2) 697 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:53:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:28 smithi111 bash[23388]: audit 2024-02-13T14:53:27.545087+0000 mon.a (mon.0) 2450 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T14:53:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:28 smithi111 bash[23388]: cluster 2024-02-13T14:53:27.917117+0000 mgr.y (mgr.14613) 393 : cluster 0 pgmap v583: 324 pgs: 324 active+clean; 8.4 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 1023 B/s wr, 4 op/s 2024-02-13T14:53:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:28 smithi111 bash[23388]: audit 2024-02-13T14:53:28.538140+0000 mon.a (mon.0) 2451 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T14:53:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:28 smithi111 bash[23388]: cluster 2024-02-13T14:53:28.545335+0000 mon.a (mon.0) 2452 : cluster 0 osdmap e382: 8 total, 8 up, 8 in 2024-02-13T14:53:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[21479]: audit 2024-02-13T14:53:28.548140+0000 mon.c (mon.2) 698 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T14:53:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[21479]: audit 2024-02-13T14:53:28.551004+0000 mon.a (mon.0) 2453 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T14:53:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[21479]: audit 2024-02-13T14:53:28.974071+0000 mon.b (mon.1) 203 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:53:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[21479]: audit 2024-02-13T14:53:29.298357+0000 mon.a (mon.0) 2454 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]: dispatch 2024-02-13T14:53:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[21479]: audit 2024-02-13T14:53:29.299064+0000 mon.b (mon.1) 204 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]: dispatch 2024-02-13T14:53:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[21479]: audit 2024-02-13T14:53:29.539506+0000 mon.a (mon.0) 2455 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]': finished 2024-02-13T14:53:29.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[21479]: audit 2024-02-13T14:53:29.539636+0000 mon.a (mon.0) 2456 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]': finished 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[21479]: cluster 2024-02-13T14:53:29.545698+0000 mon.a (mon.0) 2457 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[28859]: audit 2024-02-13T14:53:28.548140+0000 mon.c (mon.2) 698 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[28859]: audit 2024-02-13T14:53:28.551004+0000 mon.a (mon.0) 2453 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[28859]: audit 2024-02-13T14:53:28.974071+0000 mon.b (mon.1) 203 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[28859]: audit 2024-02-13T14:53:29.298357+0000 mon.a (mon.0) 2454 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]: dispatch 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[28859]: audit 2024-02-13T14:53:29.299064+0000 mon.b (mon.1) 204 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]: dispatch 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[28859]: audit 2024-02-13T14:53:29.539506+0000 mon.a (mon.0) 2455 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]': finished 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[28859]: audit 2024-02-13T14:53:29.539636+0000 mon.a (mon.0) 2456 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]': finished 2024-02-13T14:53:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:29 smithi062 bash[28859]: cluster 2024-02-13T14:53:29.545698+0000 mon.a (mon.0) 2457 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-02-13T14:53:29.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:29 smithi111 bash[23388]: audit 2024-02-13T14:53:28.548140+0000 mon.c (mon.2) 698 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T14:53:29.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:29 smithi111 bash[23388]: audit 2024-02-13T14:53:28.551004+0000 mon.a (mon.0) 2453 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T14:53:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:29 smithi111 bash[23388]: audit 2024-02-13T14:53:28.974071+0000 mon.b (mon.1) 203 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:53:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:29 smithi111 bash[23388]: audit 2024-02-13T14:53:29.298357+0000 mon.a (mon.0) 2454 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]: dispatch 2024-02-13T14:53:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:29 smithi111 bash[23388]: audit 2024-02-13T14:53:29.299064+0000 mon.b (mon.1) 204 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]: dispatch 2024-02-13T14:53:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:29 smithi111 bash[23388]: audit 2024-02-13T14:53:29.539506+0000 mon.a (mon.0) 2455 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-51","var": "target_max_objects","val": "1"}]': finished 2024-02-13T14:53:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:29 smithi111 bash[23388]: audit 2024-02-13T14:53:29.539636+0000 mon.a (mon.0) 2456 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "99.1b", "id": [4, 3]}]': finished 2024-02-13T14:53:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:29 smithi111 bash[23388]: cluster 2024-02-13T14:53:29.545698+0000 mon.a (mon.0) 2457 : cluster 0 osdmap e383: 8 total, 8 up, 8 in 2024-02-13T14:53:30.842 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:53:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:53:30.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:30 smithi111 bash[23388]: audit 2024-02-13T14:53:29.781002+0000 mon.b (mon.1) 205 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:53:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:30 smithi111 bash[23388]: audit 2024-02-13T14:53:29.783139+0000 mon.b (mon.1) 206 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:53:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:30 smithi111 bash[23388]: audit 2024-02-13T14:53:29.794997+0000 mon.a (mon.0) 2458 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:30 smithi111 bash[23388]: cluster 2024-02-13T14:53:29.919361+0000 mgr.y (mgr.14613) 394 : cluster 0 pgmap v586: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:30 smithi111 bash[23388]: cluster 2024-02-13T14:53:30.548913+0000 mon.a (mon.0) 2459 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-02-13T14:53:31.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[21479]: audit 2024-02-13T14:53:29.781002+0000 mon.b (mon.1) 205 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:53:31.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[21479]: audit 2024-02-13T14:53:29.783139+0000 mon.b (mon.1) 206 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:53:31.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[21479]: audit 2024-02-13T14:53:29.794997+0000 mon.a (mon.0) 2458 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:31.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[21479]: cluster 2024-02-13T14:53:29.919361+0000 mgr.y (mgr.14613) 394 : cluster 0 pgmap v586: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:31.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[21479]: cluster 2024-02-13T14:53:30.548913+0000 mon.a (mon.0) 2459 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-02-13T14:53:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[28859]: audit 2024-02-13T14:53:29.781002+0000 mon.b (mon.1) 205 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:53:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[28859]: audit 2024-02-13T14:53:29.783139+0000 mon.b (mon.1) 206 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:53:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[28859]: audit 2024-02-13T14:53:29.794997+0000 mon.a (mon.0) 2458 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[28859]: cluster 2024-02-13T14:53:29.919361+0000 mgr.y (mgr.14613) 394 : cluster 0 pgmap v586: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:30 smithi062 bash[28859]: cluster 2024-02-13T14:53:30.548913+0000 mon.a (mon.0) 2459 : cluster 0 osdmap e384: 8 total, 8 up, 8 in 2024-02-13T14:53:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:31 smithi111 bash[23388]: audit 2024-02-13T14:53:30.377353+0000 mgr.y (mgr.14613) 395 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:31 smithi111 bash[23388]: cluster 2024-02-13T14:53:30.790980+0000 mon.a (mon.0) 2460 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T14:53:32.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:31 smithi062 bash[21479]: audit 2024-02-13T14:53:30.377353+0000 mgr.y (mgr.14613) 395 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:32.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:31 smithi062 bash[21479]: cluster 2024-02-13T14:53:30.790980+0000 mon.a (mon.0) 2460 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T14:53:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:31 smithi062 bash[28859]: audit 2024-02-13T14:53:30.377353+0000 mgr.y (mgr.14613) 395 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:32.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:31 smithi062 bash[28859]: cluster 2024-02-13T14:53:30.790980+0000 mon.a (mon.0) 2460 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T14:53:32.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:32 smithi111 bash[23388]: cluster 2024-02-13T14:53:31.920297+0000 mgr.y (mgr.14613) 396 : cluster 0 pgmap v588: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:33.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:32 smithi062 bash[21479]: cluster 2024-02-13T14:53:31.920297+0000 mgr.y (mgr.14613) 396 : cluster 0 pgmap v588: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:33.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:32 smithi062 bash[28859]: cluster 2024-02-13T14:53:31.920297+0000 mgr.y (mgr.14613) 396 : cluster 0 pgmap v588: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:34.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:34 smithi062 bash[21479]: audit 2024-02-13T14:53:33.234878+0000 mon.a (mon.0) 2461 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:34.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:34 smithi062 bash[21479]: audit 2024-02-13T14:53:33.239564+0000 mon.b (mon.1) 207 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:34 smithi062 bash[28859]: audit 2024-02-13T14:53:33.234878+0000 mon.a (mon.0) 2461 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:34.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:34 smithi062 bash[28859]: audit 2024-02-13T14:53:33.239564+0000 mon.b (mon.1) 207 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:34 smithi111 bash[23388]: audit 2024-02-13T14:53:33.234878+0000 mon.a (mon.0) 2461 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:34.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:34 smithi111 bash[23388]: audit 2024-02-13T14:53:33.239564+0000 mon.b (mon.1) 207 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:35.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:35 smithi062 bash[21479]: cluster 2024-02-13T14:53:33.921190+0000 mgr.y (mgr.14613) 397 : cluster 0 pgmap v589: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:35 smithi062 bash[28859]: cluster 2024-02-13T14:53:33.921190+0000 mgr.y (mgr.14613) 397 : cluster 0 pgmap v589: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:35.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:35 smithi111 bash[23388]: cluster 2024-02-13T14:53:33.921190+0000 mgr.y (mgr.14613) 397 : cluster 0 pgmap v589: 324 pgs: 1 peering, 323 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:53:36.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:53:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:53:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:53:37.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:37 smithi062 bash[21479]: cluster 2024-02-13T14:53:35.924195+0000 mgr.y (mgr.14613) 398 : cluster 0 pgmap v590: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s; 7 B/s, 3 objects/s recovering 2024-02-13T14:53:37.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:37 smithi062 bash[28859]: cluster 2024-02-13T14:53:35.924195+0000 mgr.y (mgr.14613) 398 : cluster 0 pgmap v590: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s; 7 B/s, 3 objects/s recovering 2024-02-13T14:53:37.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:37 smithi111 bash[23388]: cluster 2024-02-13T14:53:35.924195+0000 mgr.y (mgr.14613) 398 : cluster 0 pgmap v590: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s; 7 B/s, 3 objects/s recovering 2024-02-13T14:53:39.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:39 smithi062 bash[21479]: cluster 2024-02-13T14:53:37.925159+0000 mgr.y (mgr.14613) 399 : cluster 0 pgmap v591: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 6 B/s, 2 objects/s recovering 2024-02-13T14:53:39.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:39 smithi062 bash[28859]: cluster 2024-02-13T14:53:37.925159+0000 mgr.y (mgr.14613) 399 : cluster 0 pgmap v591: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 6 B/s, 2 objects/s recovering 2024-02-13T14:53:39.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:39 smithi111 bash[23388]: cluster 2024-02-13T14:53:37.925159+0000 mgr.y (mgr.14613) 399 : cluster 0 pgmap v591: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s; 6 B/s, 2 objects/s recovering 2024-02-13T14:53:40.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:40 smithi062 bash[28859]: audit 2024-02-13T14:53:39.577023+0000 mon.c (mon.2) 699 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:40.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:40 smithi062 bash[28859]: audit 2024-02-13T14:53:39.577721+0000 mon.a (mon.0) 2462 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:40 smithi062 bash[21479]: audit 2024-02-13T14:53:39.577023+0000 mon.c (mon.2) 699 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:40 smithi062 bash[21479]: audit 2024-02-13T14:53:39.577721+0000 mon.a (mon.0) 2462 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:40.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:40 smithi111 bash[23388]: audit 2024-02-13T14:53:39.577023+0000 mon.c (mon.2) 699 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:40.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:40 smithi111 bash[23388]: audit 2024-02-13T14:53:39.577721+0000 mon.a (mon.0) 2462 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:40.593 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:53:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:53:41.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[21479]: cluster 2024-02-13T14:53:39.927361+0000 mgr.y (mgr.14613) 400 : cluster 0 pgmap v592: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 5 B/s, 2 objects/s recovering 2024-02-13T14:53:41.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[21479]: audit 2024-02-13T14:53:40.259875+0000 mon.a (mon.0) 2463 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:41.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[21479]: cluster 2024-02-13T14:53:40.267111+0000 mon.a (mon.0) 2464 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-02-13T14:53:41.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[21479]: audit 2024-02-13T14:53:40.270421+0000 mon.c (mon.2) 700 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:41.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[21479]: audit 2024-02-13T14:53:40.273550+0000 mon.a (mon.0) 2465 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:41.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[28859]: cluster 2024-02-13T14:53:39.927361+0000 mgr.y (mgr.14613) 400 : cluster 0 pgmap v592: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 5 B/s, 2 objects/s recovering 2024-02-13T14:53:41.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[28859]: audit 2024-02-13T14:53:40.259875+0000 mon.a (mon.0) 2463 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:41.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[28859]: cluster 2024-02-13T14:53:40.267111+0000 mon.a (mon.0) 2464 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-02-13T14:53:41.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[28859]: audit 2024-02-13T14:53:40.270421+0000 mon.c (mon.2) 700 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:41.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:41 smithi062 bash[28859]: audit 2024-02-13T14:53:40.273550+0000 mon.a (mon.0) 2465 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:41.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:41 smithi111 bash[23388]: cluster 2024-02-13T14:53:39.927361+0000 mgr.y (mgr.14613) 400 : cluster 0 pgmap v592: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s; 5 B/s, 2 objects/s recovering 2024-02-13T14:53:41.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:41 smithi111 bash[23388]: audit 2024-02-13T14:53:40.259875+0000 mon.a (mon.0) 2463 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:53:41.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:41 smithi111 bash[23388]: cluster 2024-02-13T14:53:40.267111+0000 mon.a (mon.0) 2464 : cluster 0 osdmap e385: 8 total, 8 up, 8 in 2024-02-13T14:53:41.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:41 smithi111 bash[23388]: audit 2024-02-13T14:53:40.270421+0000 mon.c (mon.2) 700 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:41.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:41 smithi111 bash[23388]: audit 2024-02-13T14:53:40.273550+0000 mon.a (mon.0) 2465 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:42.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[21479]: audit 2024-02-13T14:53:40.388637+0000 mgr.y (mgr.14613) 401 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:42.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[21479]: audit 2024-02-13T14:53:41.269965+0000 mon.a (mon.0) 2466 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]': finished 2024-02-13T14:53:42.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[21479]: cluster 2024-02-13T14:53:41.276912+0000 mon.a (mon.0) 2467 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[21479]: audit 2024-02-13T14:53:41.369230+0000 mon.c (mon.2) 701 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[21479]: audit 2024-02-13T14:53:41.369978+0000 mon.a (mon.0) 2468 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[21479]: audit 2024-02-13T14:53:41.371227+0000 mon.c (mon.2) 702 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[21479]: audit 2024-02-13T14:53:41.371920+0000 mon.a (mon.0) 2469 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[28859]: audit 2024-02-13T14:53:40.388637+0000 mgr.y (mgr.14613) 401 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[28859]: audit 2024-02-13T14:53:41.269965+0000 mon.a (mon.0) 2466 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]': finished 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[28859]: cluster 2024-02-13T14:53:41.276912+0000 mon.a (mon.0) 2467 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[28859]: audit 2024-02-13T14:53:41.369230+0000 mon.c (mon.2) 701 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[28859]: audit 2024-02-13T14:53:41.369978+0000 mon.a (mon.0) 2468 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[28859]: audit 2024-02-13T14:53:41.371227+0000 mon.c (mon.2) 702 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:42 smithi062 bash[28859]: audit 2024-02-13T14:53:41.371920+0000 mon.a (mon.0) 2469 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:42.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:42 smithi111 bash[23388]: audit 2024-02-13T14:53:40.388637+0000 mgr.y (mgr.14613) 401 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:42 smithi111 bash[23388]: audit 2024-02-13T14:53:41.269965+0000 mon.a (mon.0) 2466 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]': finished 2024-02-13T14:53:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:42 smithi111 bash[23388]: cluster 2024-02-13T14:53:41.276912+0000 mon.a (mon.0) 2467 : cluster 0 osdmap e386: 8 total, 8 up, 8 in 2024-02-13T14:53:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:42 smithi111 bash[23388]: audit 2024-02-13T14:53:41.369230+0000 mon.c (mon.2) 701 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:42 smithi111 bash[23388]: audit 2024-02-13T14:53:41.369978+0000 mon.a (mon.0) 2468 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:42 smithi111 bash[23388]: audit 2024-02-13T14:53:41.371227+0000 mon.c (mon.2) 702 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:42 smithi111 bash[23388]: audit 2024-02-13T14:53:41.371920+0000 mon.a (mon.0) 2469 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-51"}]: dispatch 2024-02-13T14:53:43.592 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:43 smithi111 bash[23388]: cluster 2024-02-13T14:53:41.928268+0000 mgr.y (mgr.14613) 402 : cluster 0 pgmap v595: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 6 B/s, 2 objects/s recovering 2024-02-13T14:53:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:43 smithi111 bash[23388]: cluster 2024-02-13T14:53:42.270018+0000 mon.a (mon.0) 2470 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T14:53:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:43 smithi111 bash[23388]: cluster 2024-02-13T14:53:42.296462+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-02-13T14:53:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:43 smithi062 bash[21479]: cluster 2024-02-13T14:53:41.928268+0000 mgr.y (mgr.14613) 402 : cluster 0 pgmap v595: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 6 B/s, 2 objects/s recovering 2024-02-13T14:53:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:43 smithi062 bash[21479]: cluster 2024-02-13T14:53:42.270018+0000 mon.a (mon.0) 2470 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T14:53:43.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:43 smithi062 bash[21479]: cluster 2024-02-13T14:53:42.296462+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-02-13T14:53:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:43 smithi062 bash[28859]: cluster 2024-02-13T14:53:41.928268+0000 mgr.y (mgr.14613) 402 : cluster 0 pgmap v595: 324 pgs: 324 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s; 6 B/s, 2 objects/s recovering 2024-02-13T14:53:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:43 smithi062 bash[28859]: cluster 2024-02-13T14:53:42.270018+0000 mon.a (mon.0) 2470 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T14:53:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:43 smithi062 bash[28859]: cluster 2024-02-13T14:53:42.296462+0000 mon.a (mon.0) 2471 : cluster 0 osdmap e387: 8 total, 8 up, 8 in 2024-02-13T14:53:44.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[21479]: cluster 2024-02-13T14:53:43.299010+0000 mon.a (mon.0) 2472 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-02-13T14:53:44.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[21479]: audit 2024-02-13T14:53:43.308448+0000 mon.c (mon.2) 703 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:44.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[21479]: audit 2024-02-13T14:53:43.320257+0000 mon.a (mon.0) 2473 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:44.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[21479]: audit 2024-02-13T14:53:44.290407+0000 mon.a (mon.0) 2474 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:44.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[21479]: cluster 2024-02-13T14:53:44.298907+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-02-13T14:53:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[28859]: cluster 2024-02-13T14:53:43.299010+0000 mon.a (mon.0) 2472 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-02-13T14:53:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[28859]: audit 2024-02-13T14:53:43.308448+0000 mon.c (mon.2) 703 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[28859]: audit 2024-02-13T14:53:43.320257+0000 mon.a (mon.0) 2473 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[28859]: audit 2024-02-13T14:53:44.290407+0000 mon.a (mon.0) 2474 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:44 smithi062 bash[28859]: cluster 2024-02-13T14:53:44.298907+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-02-13T14:53:44.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:44 smithi111 bash[23388]: cluster 2024-02-13T14:53:43.299010+0000 mon.a (mon.0) 2472 : cluster 0 osdmap e388: 8 total, 8 up, 8 in 2024-02-13T14:53:44.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:44 smithi111 bash[23388]: audit 2024-02-13T14:53:43.308448+0000 mon.c (mon.2) 703 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:44 smithi111 bash[23388]: audit 2024-02-13T14:53:43.320257+0000 mon.a (mon.0) 2473 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:44 smithi111 bash[23388]: audit 2024-02-13T14:53:44.290407+0000 mon.a (mon.0) 2474 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-53","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:44 smithi111 bash[23388]: cluster 2024-02-13T14:53:44.298907+0000 mon.a (mon.0) 2475 : cluster 0 osdmap e389: 8 total, 8 up, 8 in 2024-02-13T14:53:46.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[21479]: cluster 2024-02-13T14:53:43.929204+0000 mgr.y (mgr.14613) 403 : cluster 0 pgmap v598: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:46.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[21479]: cluster 2024-02-13T14:53:44.321359+0000 mon.a (mon.0) 2476 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:46.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[21479]: audit 2024-02-13T14:53:44.750341+0000 mon.c (mon.2) 704 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:46.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[21479]: audit 2024-02-13T14:53:44.751140+0000 mon.a (mon.0) 2477 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[21479]: audit 2024-02-13T14:53:44.752634+0000 mon.c (mon.2) 705 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-53"}]: dispatch 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[21479]: audit 2024-02-13T14:53:44.753375+0000 mon.a (mon.0) 2478 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-53"}]: dispatch 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[21479]: cluster 2024-02-13T14:53:45.337052+0000 mon.a (mon.0) 2479 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[28859]: cluster 2024-02-13T14:53:43.929204+0000 mgr.y (mgr.14613) 403 : cluster 0 pgmap v598: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[28859]: cluster 2024-02-13T14:53:44.321359+0000 mon.a (mon.0) 2476 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[28859]: audit 2024-02-13T14:53:44.750341+0000 mon.c (mon.2) 704 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[28859]: audit 2024-02-13T14:53:44.751140+0000 mon.a (mon.0) 2477 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[28859]: audit 2024-02-13T14:53:44.752634+0000 mon.c (mon.2) 705 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-53"}]: dispatch 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[28859]: audit 2024-02-13T14:53:44.753375+0000 mon.a (mon.0) 2478 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-53"}]: dispatch 2024-02-13T14:53:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:45 smithi062 bash[28859]: cluster 2024-02-13T14:53:45.337052+0000 mon.a (mon.0) 2479 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-02-13T14:53:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:45 smithi111 bash[23388]: cluster 2024-02-13T14:53:43.929204+0000 mgr.y (mgr.14613) 403 : cluster 0 pgmap v598: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:53:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:45 smithi111 bash[23388]: cluster 2024-02-13T14:53:44.321359+0000 mon.a (mon.0) 2476 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:45 smithi111 bash[23388]: audit 2024-02-13T14:53:44.750341+0000 mon.c (mon.2) 704 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:45 smithi111 bash[23388]: audit 2024-02-13T14:53:44.751140+0000 mon.a (mon.0) 2477 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:45 smithi111 bash[23388]: audit 2024-02-13T14:53:44.752634+0000 mon.c (mon.2) 705 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-53"}]: dispatch 2024-02-13T14:53:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:45 smithi111 bash[23388]: audit 2024-02-13T14:53:44.753375+0000 mon.a (mon.0) 2478 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-53"}]: dispatch 2024-02-13T14:53:46.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:45 smithi111 bash[23388]: cluster 2024-02-13T14:53:45.337052+0000 mon.a (mon.0) 2479 : cluster 0 osdmap e390: 8 total, 8 up, 8 in 2024-02-13T14:53:46.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:53:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:53:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:53:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:47 smithi062 bash[21479]: cluster 2024-02-13T14:53:45.930095+0000 mgr.y (mgr.14613) 404 : cluster 0 pgmap v601: 292 pgs: 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 511 B/s wr, 178 op/s 2024-02-13T14:53:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:47 smithi062 bash[21479]: cluster 2024-02-13T14:53:46.345172+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-02-13T14:53:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:47 smithi062 bash[21479]: audit 2024-02-13T14:53:46.352278+0000 mon.c (mon.2) 706 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:47.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:47 smithi062 bash[21479]: audit 2024-02-13T14:53:46.353782+0000 mon.a (mon.0) 2481 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:47.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:47 smithi062 bash[28859]: cluster 2024-02-13T14:53:45.930095+0000 mgr.y (mgr.14613) 404 : cluster 0 pgmap v601: 292 pgs: 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 511 B/s wr, 178 op/s 2024-02-13T14:53:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:47 smithi062 bash[28859]: cluster 2024-02-13T14:53:46.345172+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-02-13T14:53:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:47 smithi062 bash[28859]: audit 2024-02-13T14:53:46.352278+0000 mon.c (mon.2) 706 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:47 smithi062 bash[28859]: audit 2024-02-13T14:53:46.353782+0000 mon.a (mon.0) 2481 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:47.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:47 smithi111 bash[23388]: cluster 2024-02-13T14:53:45.930095+0000 mgr.y (mgr.14613) 404 : cluster 0 pgmap v601: 292 pgs: 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 511 B/s wr, 178 op/s 2024-02-13T14:53:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:47 smithi111 bash[23388]: cluster 2024-02-13T14:53:46.345172+0000 mon.a (mon.0) 2480 : cluster 0 osdmap e391: 8 total, 8 up, 8 in 2024-02-13T14:53:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:47 smithi111 bash[23388]: audit 2024-02-13T14:53:46.352278+0000 mon.c (mon.2) 706 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:47 smithi111 bash[23388]: audit 2024-02-13T14:53:46.353782+0000 mon.a (mon.0) 2481 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: audit 2024-02-13T14:53:47.334863+0000 mon.a (mon.0) 2482 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: cluster 2024-02-13T14:53:47.343742+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: audit 2024-02-13T14:53:47.364829+0000 mon.c (mon.2) 707 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: audit 2024-02-13T14:53:47.453399+0000 mon.c (mon.2) 708 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: audit 2024-02-13T14:53:47.454078+0000 mon.a (mon.0) 2484 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: audit 2024-02-13T14:53:47.455139+0000 mon.c (mon.2) 709 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-55"}]: dispatch 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: audit 2024-02-13T14:53:47.455702+0000 mon.a (mon.0) 2485 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-55"}]: dispatch 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: audit 2024-02-13T14:53:48.279758+0000 mon.a (mon.0) 2486 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[21479]: audit 2024-02-13T14:53:48.284502+0000 mon.b (mon.1) 208 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: audit 2024-02-13T14:53:47.334863+0000 mon.a (mon.0) 2482 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: cluster 2024-02-13T14:53:47.343742+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-02-13T14:53:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: audit 2024-02-13T14:53:47.364829+0000 mon.c (mon.2) 707 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: audit 2024-02-13T14:53:47.453399+0000 mon.c (mon.2) 708 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: audit 2024-02-13T14:53:47.454078+0000 mon.a (mon.0) 2484 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: audit 2024-02-13T14:53:47.455139+0000 mon.c (mon.2) 709 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-55"}]: dispatch 2024-02-13T14:53:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: audit 2024-02-13T14:53:47.455702+0000 mon.a (mon.0) 2485 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-55"}]: dispatch 2024-02-13T14:53:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: audit 2024-02-13T14:53:48.279758+0000 mon.a (mon.0) 2486 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:48 smithi062 bash[28859]: audit 2024-02-13T14:53:48.284502+0000 mon.b (mon.1) 208 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: audit 2024-02-13T14:53:47.334863+0000 mon.a (mon.0) 2482 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-55","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: cluster 2024-02-13T14:53:47.343742+0000 mon.a (mon.0) 2483 : cluster 0 osdmap e392: 8 total, 8 up, 8 in 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: audit 2024-02-13T14:53:47.364829+0000 mon.c (mon.2) 707 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: audit 2024-02-13T14:53:47.453399+0000 mon.c (mon.2) 708 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: audit 2024-02-13T14:53:47.454078+0000 mon.a (mon.0) 2484 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: audit 2024-02-13T14:53:47.455139+0000 mon.c (mon.2) 709 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-55"}]: dispatch 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: audit 2024-02-13T14:53:47.455702+0000 mon.a (mon.0) 2485 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-55"}]: dispatch 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: audit 2024-02-13T14:53:48.279758+0000 mon.a (mon.0) 2486 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:53:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:48 smithi111 bash[23388]: audit 2024-02-13T14:53:48.284502+0000 mon.b (mon.1) 208 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:53:49.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:49 smithi062 bash[21479]: cluster 2024-02-13T14:53:47.931062+0000 mgr.y (mgr.14613) 405 : cluster 0 pgmap v604: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 511 B/s wr, 180 op/s 2024-02-13T14:53:49.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:49 smithi062 bash[21479]: cluster 2024-02-13T14:53:48.368444+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-02-13T14:53:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:49 smithi062 bash[28859]: cluster 2024-02-13T14:53:47.931062+0000 mgr.y (mgr.14613) 405 : cluster 0 pgmap v604: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 511 B/s wr, 180 op/s 2024-02-13T14:53:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:49 smithi062 bash[28859]: cluster 2024-02-13T14:53:48.368444+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-02-13T14:53:49.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:49 smithi111 bash[23388]: cluster 2024-02-13T14:53:47.931062+0000 mgr.y (mgr.14613) 405 : cluster 0 pgmap v604: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 641 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 511 B/s wr, 180 op/s 2024-02-13T14:53:49.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:49 smithi111 bash[23388]: cluster 2024-02-13T14:53:48.368444+0000 mon.a (mon.0) 2487 : cluster 0 osdmap e393: 8 total, 8 up, 8 in 2024-02-13T14:53:50.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:50 smithi062 bash[21479]: cluster 2024-02-13T14:53:49.380213+0000 mon.a (mon.0) 2488 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-02-13T14:53:50.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:50 smithi062 bash[21479]: audit 2024-02-13T14:53:49.383957+0000 mon.c (mon.2) 710 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:50.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:50 smithi062 bash[21479]: audit 2024-02-13T14:53:49.400330+0000 mon.a (mon.0) 2489 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:50 smithi062 bash[28859]: cluster 2024-02-13T14:53:49.380213+0000 mon.a (mon.0) 2488 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-02-13T14:53:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:50 smithi062 bash[28859]: audit 2024-02-13T14:53:49.383957+0000 mon.c (mon.2) 710 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:50 smithi062 bash[28859]: audit 2024-02-13T14:53:49.400330+0000 mon.a (mon.0) 2489 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:50.842 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:53:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:53:50.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:50 smithi111 bash[23388]: cluster 2024-02-13T14:53:49.380213+0000 mon.a (mon.0) 2488 : cluster 0 osdmap e394: 8 total, 8 up, 8 in 2024-02-13T14:53:50.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:50 smithi111 bash[23388]: audit 2024-02-13T14:53:49.383957+0000 mon.c (mon.2) 710 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:50.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:50 smithi111 bash[23388]: audit 2024-02-13T14:53:49.400330+0000 mon.a (mon.0) 2489 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:51.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: cluster 2024-02-13T14:53:49.933192+0000 mgr.y (mgr.14613) 406 : cluster 0 pgmap v607: 324 pgs: 23 creating+peering, 9 unknown, 292 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: cluster 2024-02-13T14:53:50.371989+0000 mon.a (mon.0) 2490 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: audit 2024-02-13T14:53:50.381863+0000 mon.a (mon.0) 2491 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: cluster 2024-02-13T14:53:50.391525+0000 mon.a (mon.0) 2492 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: audit 2024-02-13T14:53:50.399336+0000 mgr.y (mgr.14613) 407 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: audit 2024-02-13T14:53:50.498111+0000 mon.c (mon.2) 711 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: audit 2024-02-13T14:53:50.498671+0000 mon.a (mon.0) 2493 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: audit 2024-02-13T14:53:50.499573+0000 mon.c (mon.2) 712 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-57"}]: dispatch 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[21479]: audit 2024-02-13T14:53:50.500042+0000 mon.a (mon.0) 2494 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-57"}]: dispatch 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: cluster 2024-02-13T14:53:49.933192+0000 mgr.y (mgr.14613) 406 : cluster 0 pgmap v607: 324 pgs: 23 creating+peering, 9 unknown, 292 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: cluster 2024-02-13T14:53:50.371989+0000 mon.a (mon.0) 2490 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: audit 2024-02-13T14:53:50.381863+0000 mon.a (mon.0) 2491 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: cluster 2024-02-13T14:53:50.391525+0000 mon.a (mon.0) 2492 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-02-13T14:53:51.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: audit 2024-02-13T14:53:50.399336+0000 mgr.y (mgr.14613) 407 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:51.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: audit 2024-02-13T14:53:50.498111+0000 mon.c (mon.2) 711 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:51.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: audit 2024-02-13T14:53:50.498671+0000 mon.a (mon.0) 2493 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:51.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: audit 2024-02-13T14:53:50.499573+0000 mon.c (mon.2) 712 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-57"}]: dispatch 2024-02-13T14:53:51.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:51 smithi062 bash[28859]: audit 2024-02-13T14:53:50.500042+0000 mon.a (mon.0) 2494 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-57"}]: dispatch 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: cluster 2024-02-13T14:53:49.933192+0000 mgr.y (mgr.14613) 406 : cluster 0 pgmap v607: 324 pgs: 23 creating+peering, 9 unknown, 292 active+clean; 8.4 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: cluster 2024-02-13T14:53:50.371989+0000 mon.a (mon.0) 2490 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: audit 2024-02-13T14:53:50.381863+0000 mon.a (mon.0) 2491 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-57","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: cluster 2024-02-13T14:53:50.391525+0000 mon.a (mon.0) 2492 : cluster 0 osdmap e395: 8 total, 8 up, 8 in 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: audit 2024-02-13T14:53:50.399336+0000 mgr.y (mgr.14613) 407 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: audit 2024-02-13T14:53:50.498111+0000 mon.c (mon.2) 711 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: audit 2024-02-13T14:53:50.498671+0000 mon.a (mon.0) 2493 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: audit 2024-02-13T14:53:50.499573+0000 mon.c (mon.2) 712 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-57"}]: dispatch 2024-02-13T14:53:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:51 smithi111 bash[23388]: audit 2024-02-13T14:53:50.500042+0000 mon.a (mon.0) 2494 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-57"}]: dispatch 2024-02-13T14:53:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:52 smithi062 bash[21479]: cluster 2024-02-13T14:53:51.408701+0000 mon.a (mon.0) 2495 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-02-13T14:53:52.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:52 smithi062 bash[21479]: cluster 2024-02-13T14:53:51.934145+0000 mgr.y (mgr.14613) 408 : cluster 0 pgmap v610: 292 pgs: 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T14:53:52.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:52 smithi062 bash[28859]: cluster 2024-02-13T14:53:51.408701+0000 mon.a (mon.0) 2495 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-02-13T14:53:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:52 smithi062 bash[28859]: cluster 2024-02-13T14:53:51.934145+0000 mgr.y (mgr.14613) 408 : cluster 0 pgmap v610: 292 pgs: 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T14:53:52.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:52 smithi111 bash[23388]: cluster 2024-02-13T14:53:51.408701+0000 mon.a (mon.0) 2495 : cluster 0 osdmap e396: 8 total, 8 up, 8 in 2024-02-13T14:53:52.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:52 smithi111 bash[23388]: cluster 2024-02-13T14:53:51.934145+0000 mgr.y (mgr.14613) 408 : cluster 0 pgmap v610: 292 pgs: 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T14:53:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:53 smithi062 bash[28859]: cluster 2024-02-13T14:53:52.421998+0000 mon.a (mon.0) 2496 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-02-13T14:53:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:53 smithi062 bash[28859]: audit 2024-02-13T14:53:52.425411+0000 mon.c (mon.2) 713 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:53.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:53 smithi062 bash[28859]: audit 2024-02-13T14:53:52.428768+0000 mon.a (mon.0) 2497 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:53 smithi062 bash[21479]: cluster 2024-02-13T14:53:52.421998+0000 mon.a (mon.0) 2496 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-02-13T14:53:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:53 smithi062 bash[21479]: audit 2024-02-13T14:53:52.425411+0000 mon.c (mon.2) 713 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:53 smithi062 bash[21479]: audit 2024-02-13T14:53:52.428768+0000 mon.a (mon.0) 2497 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:53.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:53 smithi111 bash[23388]: cluster 2024-02-13T14:53:52.421998+0000 mon.a (mon.0) 2496 : cluster 0 osdmap e397: 8 total, 8 up, 8 in 2024-02-13T14:53:53.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:53 smithi111 bash[23388]: audit 2024-02-13T14:53:52.425411+0000 mon.c (mon.2) 713 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:53.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:53 smithi111 bash[23388]: audit 2024-02-13T14:53:52.428768+0000 mon.a (mon.0) 2497 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:54.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[21479]: audit 2024-02-13T14:53:53.415628+0000 mon.a (mon.0) 2498 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:54.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[21479]: cluster 2024-02-13T14:53:53.425341+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-02-13T14:53:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[21479]: audit 2024-02-13T14:53:53.448835+0000 mon.c (mon.2) 714 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[21479]: audit 2024-02-13T14:53:53.530589+0000 mon.c (mon.2) 715 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[21479]: audit 2024-02-13T14:53:53.531088+0000 mon.a (mon.0) 2500 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[21479]: audit 2024-02-13T14:53:53.531995+0000 mon.c (mon.2) 716 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-59"}]: dispatch 2024-02-13T14:53:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[21479]: audit 2024-02-13T14:53:53.532438+0000 mon.a (mon.0) 2501 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-59"}]: dispatch 2024-02-13T14:53:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[21479]: cluster 2024-02-13T14:53:53.935113+0000 mgr.y (mgr.14613) 409 : cluster 0 pgmap v613: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 0 op/s 2024-02-13T14:53:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[28859]: audit 2024-02-13T14:53:53.415628+0000 mon.a (mon.0) 2498 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[28859]: cluster 2024-02-13T14:53:53.425341+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-02-13T14:53:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[28859]: audit 2024-02-13T14:53:53.448835+0000 mon.c (mon.2) 714 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[28859]: audit 2024-02-13T14:53:53.530589+0000 mon.c (mon.2) 715 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[28859]: audit 2024-02-13T14:53:53.531088+0000 mon.a (mon.0) 2500 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[28859]: audit 2024-02-13T14:53:53.531995+0000 mon.c (mon.2) 716 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-59"}]: dispatch 2024-02-13T14:53:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[28859]: audit 2024-02-13T14:53:53.532438+0000 mon.a (mon.0) 2501 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-59"}]: dispatch 2024-02-13T14:53:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:54 smithi062 bash[28859]: cluster 2024-02-13T14:53:53.935113+0000 mgr.y (mgr.14613) 409 : cluster 0 pgmap v613: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 0 op/s 2024-02-13T14:53:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:54 smithi111 bash[23388]: audit 2024-02-13T14:53:53.415628+0000 mon.a (mon.0) 2498 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-59","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:54 smithi111 bash[23388]: cluster 2024-02-13T14:53:53.425341+0000 mon.a (mon.0) 2499 : cluster 0 osdmap e398: 8 total, 8 up, 8 in 2024-02-13T14:53:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:54 smithi111 bash[23388]: audit 2024-02-13T14:53:53.448835+0000 mon.c (mon.2) 714 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:54 smithi111 bash[23388]: audit 2024-02-13T14:53:53.530589+0000 mon.c (mon.2) 715 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:54 smithi111 bash[23388]: audit 2024-02-13T14:53:53.531088+0000 mon.a (mon.0) 2500 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:54 smithi111 bash[23388]: audit 2024-02-13T14:53:53.531995+0000 mon.c (mon.2) 716 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-59"}]: dispatch 2024-02-13T14:53:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:54 smithi111 bash[23388]: audit 2024-02-13T14:53:53.532438+0000 mon.a (mon.0) 2501 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-59"}]: dispatch 2024-02-13T14:53:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:54 smithi111 bash[23388]: cluster 2024-02-13T14:53:53.935113+0000 mgr.y (mgr.14613) 409 : cluster 0 pgmap v613: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 511 B/s wr, 0 op/s 2024-02-13T14:53:55.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:55 smithi062 bash[21479]: cluster 2024-02-13T14:53:54.449325+0000 mon.a (mon.0) 2502 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-02-13T14:53:55.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:55 smithi062 bash[28859]: cluster 2024-02-13T14:53:54.449325+0000 mon.a (mon.0) 2502 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-02-13T14:53:55.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:55 smithi111 bash[23388]: cluster 2024-02-13T14:53:54.449325+0000 mon.a (mon.0) 2502 : cluster 0 osdmap e399: 8 total, 8 up, 8 in 2024-02-13T14:53:56.500 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:53:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:53:56.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[21479]: cluster 2024-02-13T14:53:55.453838+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[21479]: audit 2024-02-13T14:53:55.464699+0000 mon.c (mon.2) 717 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[21479]: audit 2024-02-13T14:53:55.479141+0000 mon.a (mon.0) 2504 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[21479]: cluster 2024-02-13T14:53:55.935967+0000 mgr.y (mgr.14613) 410 : cluster 0 pgmap v616: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[21479]: audit 2024-02-13T14:53:56.446782+0000 mon.a (mon.0) 2505 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[21479]: cluster 2024-02-13T14:53:56.456737+0000 mon.a (mon.0) 2506 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[28859]: cluster 2024-02-13T14:53:55.453838+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[28859]: audit 2024-02-13T14:53:55.464699+0000 mon.c (mon.2) 717 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[28859]: audit 2024-02-13T14:53:55.479141+0000 mon.a (mon.0) 2504 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[28859]: cluster 2024-02-13T14:53:55.935967+0000 mgr.y (mgr.14613) 410 : cluster 0 pgmap v616: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[28859]: audit 2024-02-13T14:53:56.446782+0000 mon.a (mon.0) 2505 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:56 smithi062 bash[28859]: cluster 2024-02-13T14:53:56.456737+0000 mon.a (mon.0) 2506 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-02-13T14:53:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:56 smithi111 bash[23388]: cluster 2024-02-13T14:53:55.453838+0000 mon.a (mon.0) 2503 : cluster 0 osdmap e400: 8 total, 8 up, 8 in 2024-02-13T14:53:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:56 smithi111 bash[23388]: audit 2024-02-13T14:53:55.464699+0000 mon.c (mon.2) 717 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:56 smithi111 bash[23388]: audit 2024-02-13T14:53:55.479141+0000 mon.a (mon.0) 2504 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:53:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:56 smithi111 bash[23388]: cluster 2024-02-13T14:53:55.935967+0000 mgr.y (mgr.14613) 410 : cluster 0 pgmap v616: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T14:53:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:56 smithi111 bash[23388]: audit 2024-02-13T14:53:56.446782+0000 mon.a (mon.0) 2505 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-61","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:53:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:56 smithi111 bash[23388]: cluster 2024-02-13T14:53:56.456737+0000 mon.a (mon.0) 2506 : cluster 0 osdmap e401: 8 total, 8 up, 8 in 2024-02-13T14:53:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[28859]: audit 2024-02-13T14:53:56.461313+0000 mon.c (mon.2) 718 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[28859]: cluster 2024-02-13T14:53:56.469076+0000 mon.a (mon.0) 2507 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[28859]: audit 2024-02-13T14:53:56.481450+0000 mon.c (mon.2) 719 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:53:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[28859]: audit 2024-02-13T14:53:56.497913+0000 mon.a (mon.0) 2508 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:53:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[28859]: audit 2024-02-13T14:53:57.485463+0000 mon.a (mon.0) 2509 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:53:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[28859]: cluster 2024-02-13T14:53:57.494670+0000 mon.a (mon.0) 2510 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-02-13T14:53:57.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[21479]: audit 2024-02-13T14:53:56.461313+0000 mon.c (mon.2) 718 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[21479]: cluster 2024-02-13T14:53:56.469076+0000 mon.a (mon.0) 2507 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[21479]: audit 2024-02-13T14:53:56.481450+0000 mon.c (mon.2) 719 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:53:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[21479]: audit 2024-02-13T14:53:56.497913+0000 mon.a (mon.0) 2508 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:53:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[21479]: audit 2024-02-13T14:53:57.485463+0000 mon.a (mon.0) 2509 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:53:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:57 smithi062 bash[21479]: cluster 2024-02-13T14:53:57.494670+0000 mon.a (mon.0) 2510 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-02-13T14:53:57.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:57 smithi111 bash[23388]: audit 2024-02-13T14:53:56.461313+0000 mon.c (mon.2) 718 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:53:57.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:57 smithi111 bash[23388]: cluster 2024-02-13T14:53:56.469076+0000 mon.a (mon.0) 2507 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:53:57.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:57 smithi111 bash[23388]: audit 2024-02-13T14:53:56.481450+0000 mon.c (mon.2) 719 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:53:57.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:57 smithi111 bash[23388]: audit 2024-02-13T14:53:56.497913+0000 mon.a (mon.0) 2508 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:53:57.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:57 smithi111 bash[23388]: audit 2024-02-13T14:53:57.485463+0000 mon.a (mon.0) 2509 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:53:57.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:57 smithi111 bash[23388]: cluster 2024-02-13T14:53:57.494670+0000 mon.a (mon.0) 2510 : cluster 0 osdmap e402: 8 total, 8 up, 8 in 2024-02-13T14:53:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[28859]: audit 2024-02-13T14:53:57.584883+0000 mon.c (mon.2) 720 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[28859]: audit 2024-02-13T14:53:57.585631+0000 mon.a (mon.0) 2511 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:58.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[28859]: audit 2024-02-13T14:53:57.586833+0000 mon.c (mon.2) 721 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-61"}]: dispatch 2024-02-13T14:53:58.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[28859]: audit 2024-02-13T14:53:57.587505+0000 mon.a (mon.0) 2512 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-61"}]: dispatch 2024-02-13T14:53:58.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[28859]: cluster 2024-02-13T14:53:57.936914+0000 mgr.y (mgr.14613) 411 : cluster 0 pgmap v619: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T14:53:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[21479]: audit 2024-02-13T14:53:57.584883+0000 mon.c (mon.2) 720 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[21479]: audit 2024-02-13T14:53:57.585631+0000 mon.a (mon.0) 2511 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[21479]: audit 2024-02-13T14:53:57.586833+0000 mon.c (mon.2) 721 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-61"}]: dispatch 2024-02-13T14:53:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[21479]: audit 2024-02-13T14:53:57.587505+0000 mon.a (mon.0) 2512 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-61"}]: dispatch 2024-02-13T14:53:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:58 smithi062 bash[21479]: cluster 2024-02-13T14:53:57.936914+0000 mgr.y (mgr.14613) 411 : cluster 0 pgmap v619: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T14:53:58.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:58 smithi111 bash[23388]: audit 2024-02-13T14:53:57.584883+0000 mon.c (mon.2) 720 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:58 smithi111 bash[23388]: audit 2024-02-13T14:53:57.585631+0000 mon.a (mon.0) 2511 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:53:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:58 smithi111 bash[23388]: audit 2024-02-13T14:53:57.586833+0000 mon.c (mon.2) 721 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-61"}]: dispatch 2024-02-13T14:53:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:58 smithi111 bash[23388]: audit 2024-02-13T14:53:57.587505+0000 mon.a (mon.0) 2512 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-61"}]: dispatch 2024-02-13T14:53:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:58 smithi111 bash[23388]: cluster 2024-02-13T14:53:57.936914+0000 mgr.y (mgr.14613) 411 : cluster 0 pgmap v619: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 3 op/s 2024-02-13T14:53:59.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:53:59 smithi062 bash[21479]: cluster 2024-02-13T14:53:58.525904+0000 mon.a (mon.0) 2513 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-02-13T14:53:59.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:53:59 smithi062 bash[28859]: cluster 2024-02-13T14:53:58.525904+0000 mon.a (mon.0) 2513 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-02-13T14:53:59.842 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:53:59 smithi111 bash[23388]: cluster 2024-02-13T14:53:58.525904+0000 mon.a (mon.0) 2513 : cluster 0 osdmap e403: 8 total, 8 up, 8 in 2024-02-13T14:54:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:00 smithi062 bash[21479]: cluster 2024-02-13T14:53:59.543871+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-02-13T14:54:00.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:00 smithi062 bash[21479]: audit 2024-02-13T14:53:59.558934+0000 mon.c (mon.2) 722 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:00 smithi062 bash[21479]: audit 2024-02-13T14:53:59.560923+0000 mon.a (mon.0) 2515 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:00 smithi062 bash[21479]: cluster 2024-02-13T14:53:59.939086+0000 mgr.y (mgr.14613) 412 : cluster 0 pgmap v622: 324 pgs: 21 creating+peering, 11 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:54:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:00 smithi062 bash[28859]: cluster 2024-02-13T14:53:59.543871+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-02-13T14:54:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:00 smithi062 bash[28859]: audit 2024-02-13T14:53:59.558934+0000 mon.c (mon.2) 722 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:00 smithi062 bash[28859]: audit 2024-02-13T14:53:59.560923+0000 mon.a (mon.0) 2515 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:00 smithi062 bash[28859]: cluster 2024-02-13T14:53:59.939086+0000 mgr.y (mgr.14613) 412 : cluster 0 pgmap v622: 324 pgs: 21 creating+peering, 11 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:54:00.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:54:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:54:00.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:00 smithi111 bash[23388]: cluster 2024-02-13T14:53:59.543871+0000 mon.a (mon.0) 2514 : cluster 0 osdmap e404: 8 total, 8 up, 8 in 2024-02-13T14:54:00.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:00 smithi111 bash[23388]: audit 2024-02-13T14:53:59.558934+0000 mon.c (mon.2) 722 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:00.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:00 smithi111 bash[23388]: audit 2024-02-13T14:53:59.560923+0000 mon.a (mon.0) 2515 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:00 smithi111 bash[23388]: cluster 2024-02-13T14:53:59.939086+0000 mgr.y (mgr.14613) 412 : cluster 0 pgmap v622: 324 pgs: 21 creating+peering, 11 unknown, 292 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:54:01.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[28859]: audit 2024-02-13T14:54:00.405470+0000 mgr.y (mgr.14613) 413 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[28859]: audit 2024-02-13T14:54:00.542272+0000 mon.a (mon.0) 2516 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[28859]: cluster 2024-02-13T14:54:00.555387+0000 mon.a (mon.0) 2517 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[28859]: audit 2024-02-13T14:54:00.558819+0000 mon.c (mon.2) 723 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[28859]: audit 2024-02-13T14:54:00.572559+0000 mon.c (mon.2) 724 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[28859]: audit 2024-02-13T14:54:00.574015+0000 mon.a (mon.0) 2518 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[21479]: audit 2024-02-13T14:54:00.405470+0000 mgr.y (mgr.14613) 413 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[21479]: audit 2024-02-13T14:54:00.542272+0000 mon.a (mon.0) 2516 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[21479]: cluster 2024-02-13T14:54:00.555387+0000 mon.a (mon.0) 2517 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-02-13T14:54:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[21479]: audit 2024-02-13T14:54:00.558819+0000 mon.c (mon.2) 723 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[21479]: audit 2024-02-13T14:54:00.572559+0000 mon.c (mon.2) 724 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:01 smithi062 bash[21479]: audit 2024-02-13T14:54:00.574015+0000 mon.a (mon.0) 2518 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:01 smithi111 bash[23388]: audit 2024-02-13T14:54:00.405470+0000 mgr.y (mgr.14613) 413 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:01 smithi111 bash[23388]: audit 2024-02-13T14:54:00.542272+0000 mon.a (mon.0) 2516 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-63","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:01 smithi111 bash[23388]: cluster 2024-02-13T14:54:00.555387+0000 mon.a (mon.0) 2517 : cluster 0 osdmap e405: 8 total, 8 up, 8 in 2024-02-13T14:54:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:01 smithi111 bash[23388]: audit 2024-02-13T14:54:00.558819+0000 mon.c (mon.2) 723 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:01 smithi111 bash[23388]: audit 2024-02-13T14:54:00.572559+0000 mon.c (mon.2) 724 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:01 smithi111 bash[23388]: audit 2024-02-13T14:54:00.574015+0000 mon.a (mon.0) 2518 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:02 smithi062 bash[21479]: audit 2024-02-13T14:54:01.545079+0000 mon.a (mon.0) 2519 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:54:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:02 smithi062 bash[21479]: cluster 2024-02-13T14:54:01.552343+0000 mon.a (mon.0) 2520 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-02-13T14:54:02.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:02 smithi062 bash[21479]: cluster 2024-02-13T14:54:01.940009+0000 mgr.y (mgr.14613) 414 : cluster 0 pgmap v625: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:54:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:02 smithi062 bash[28859]: audit 2024-02-13T14:54:01.545079+0000 mon.a (mon.0) 2519 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:54:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:02 smithi062 bash[28859]: cluster 2024-02-13T14:54:01.552343+0000 mon.a (mon.0) 2520 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-02-13T14:54:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:02 smithi062 bash[28859]: cluster 2024-02-13T14:54:01.940009+0000 mgr.y (mgr.14613) 414 : cluster 0 pgmap v625: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:54:02.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:02 smithi111 bash[23388]: audit 2024-02-13T14:54:01.545079+0000 mon.a (mon.0) 2519 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:54:02.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:02 smithi111 bash[23388]: cluster 2024-02-13T14:54:01.552343+0000 mon.a (mon.0) 2520 : cluster 0 osdmap e406: 8 total, 8 up, 8 in 2024-02-13T14:54:02.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:02 smithi111 bash[23388]: cluster 2024-02-13T14:54:01.940009+0000 mgr.y (mgr.14613) 414 : cluster 0 pgmap v625: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:54:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:03 smithi111 bash[23388]: cluster 2024-02-13T14:54:02.558468+0000 mon.a (mon.0) 2521 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:03 smithi111 bash[23388]: cluster 2024-02-13T14:54:02.581816+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-02-13T14:54:03.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:03 smithi111 bash[23388]: audit 2024-02-13T14:54:03.320420+0000 mon.b (mon.1) 209 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:04.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:03 smithi062 bash[28859]: cluster 2024-02-13T14:54:02.558468+0000 mon.a (mon.0) 2521 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:04.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:03 smithi062 bash[28859]: cluster 2024-02-13T14:54:02.581816+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-02-13T14:54:04.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:03 smithi062 bash[28859]: audit 2024-02-13T14:54:03.320420+0000 mon.b (mon.1) 209 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:04.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:03 smithi062 bash[21479]: cluster 2024-02-13T14:54:02.558468+0000 mon.a (mon.0) 2521 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:04.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:03 smithi062 bash[21479]: cluster 2024-02-13T14:54:02.581816+0000 mon.a (mon.0) 2522 : cluster 0 osdmap e407: 8 total, 8 up, 8 in 2024-02-13T14:54:04.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:03 smithi062 bash[21479]: audit 2024-02-13T14:54:03.320420+0000 mon.b (mon.1) 209 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:04.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:04 smithi111 bash[23388]: cluster 2024-02-13T14:54:03.585957+0000 mon.a (mon.0) 2523 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-02-13T14:54:04.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:04 smithi111 bash[23388]: cluster 2024-02-13T14:54:03.940979+0000 mgr.y (mgr.14613) 415 : cluster 0 pgmap v628: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-02-13T14:54:05.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:04 smithi062 bash[21479]: cluster 2024-02-13T14:54:03.585957+0000 mon.a (mon.0) 2523 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-02-13T14:54:05.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:04 smithi062 bash[21479]: cluster 2024-02-13T14:54:03.940979+0000 mgr.y (mgr.14613) 415 : cluster 0 pgmap v628: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-02-13T14:54:05.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:04 smithi062 bash[28859]: cluster 2024-02-13T14:54:03.585957+0000 mon.a (mon.0) 2523 : cluster 0 osdmap e408: 8 total, 8 up, 8 in 2024-02-13T14:54:05.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:04 smithi062 bash[28859]: cluster 2024-02-13T14:54:03.940979+0000 mgr.y (mgr.14613) 415 : cluster 0 pgmap v628: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2024-02-13T14:54:06.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:05 smithi062 bash[21479]: cluster 2024-02-13T14:54:04.597074+0000 mon.a (mon.0) 2524 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-02-13T14:54:06.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:05 smithi062 bash[28859]: cluster 2024-02-13T14:54:04.597074+0000 mon.a (mon.0) 2524 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-02-13T14:54:06.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:05 smithi111 bash[23388]: cluster 2024-02-13T14:54:04.597074+0000 mon.a (mon.0) 2524 : cluster 0 osdmap e409: 8 total, 8 up, 8 in 2024-02-13T14:54:06.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:54:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:54:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:54:07.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:06 smithi062 bash[28859]: cluster 2024-02-13T14:54:05.599144+0000 mon.a (mon.0) 2525 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-02-13T14:54:07.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:06 smithi062 bash[28859]: cluster 2024-02-13T14:54:05.941886+0000 mgr.y (mgr.14613) 416 : cluster 0 pgmap v631: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-02-13T14:54:07.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:06 smithi062 bash[21479]: cluster 2024-02-13T14:54:05.599144+0000 mon.a (mon.0) 2525 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-02-13T14:54:07.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:06 smithi062 bash[21479]: cluster 2024-02-13T14:54:05.941886+0000 mgr.y (mgr.14613) 416 : cluster 0 pgmap v631: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-02-13T14:54:07.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:06 smithi111 bash[23388]: cluster 2024-02-13T14:54:05.599144+0000 mon.a (mon.0) 2525 : cluster 0 osdmap e410: 8 total, 8 up, 8 in 2024-02-13T14:54:07.092 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:06 smithi111 bash[23388]: cluster 2024-02-13T14:54:05.941886+0000 mgr.y (mgr.14613) 416 : cluster 0 pgmap v631: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 2.7 KiB/s wr, 7 op/s 2024-02-13T14:54:09.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:09 smithi062 bash[21479]: cluster 2024-02-13T14:54:07.942824+0000 mgr.y (mgr.14613) 417 : cluster 0 pgmap v632: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-13T14:54:09.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:09 smithi062 bash[28859]: cluster 2024-02-13T14:54:07.942824+0000 mgr.y (mgr.14613) 417 : cluster 0 pgmap v632: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-13T14:54:09.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:09 smithi111 bash[23388]: cluster 2024-02-13T14:54:07.942824+0000 mgr.y (mgr.14613) 417 : cluster 0 pgmap v632: 324 pgs: 324 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 5 op/s 2024-02-13T14:54:10.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:54:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:54:11.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:11 smithi062 bash[21479]: cluster 2024-02-13T14:54:09.944965+0000 mgr.y (mgr.14613) 418 : cluster 0 pgmap v633: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-02-13T14:54:11.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:11 smithi062 bash[28859]: cluster 2024-02-13T14:54:09.944965+0000 mgr.y (mgr.14613) 418 : cluster 0 pgmap v633: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-02-13T14:54:11.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:11 smithi111 bash[23388]: cluster 2024-02-13T14:54:09.944965+0000 mgr.y (mgr.14613) 418 : cluster 0 pgmap v633: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-02-13T14:54:12.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:12 smithi062 bash[28859]: audit 2024-02-13T14:54:10.415795+0000 mgr.y (mgr.14613) 419 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:12.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:12 smithi062 bash[21479]: audit 2024-02-13T14:54:10.415795+0000 mgr.y (mgr.14613) 419 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:12.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:12 smithi111 bash[23388]: audit 2024-02-13T14:54:10.415795+0000 mgr.y (mgr.14613) 419 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:13 smithi062 bash[28859]: cluster 2024-02-13T14:54:11.946772+0000 mgr.y (mgr.14613) 420 : cluster 0 pgmap v634: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-13T14:54:13.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:13 smithi062 bash[28859]: cluster 2024-02-13T14:54:12.033874+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-02-13T14:54:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:13 smithi062 bash[21479]: cluster 2024-02-13T14:54:11.946772+0000 mgr.y (mgr.14613) 420 : cluster 0 pgmap v634: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-13T14:54:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:13 smithi062 bash[21479]: cluster 2024-02-13T14:54:12.033874+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-02-13T14:54:13.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:13 smithi111 bash[23388]: cluster 2024-02-13T14:54:11.946772+0000 mgr.y (mgr.14613) 420 : cluster 0 pgmap v634: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 2.1 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-13T14:54:13.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:13 smithi111 bash[23388]: cluster 2024-02-13T14:54:12.033874+0000 mon.a (mon.0) 2526 : cluster 0 osdmap e411: 8 total, 8 up, 8 in 2024-02-13T14:54:15.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:15 smithi062 bash[21479]: cluster 2024-02-13T14:54:13.947803+0000 mgr.y (mgr.14613) 421 : cluster 0 pgmap v636: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 735 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:15.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:15 smithi062 bash[28859]: cluster 2024-02-13T14:54:13.947803+0000 mgr.y (mgr.14613) 421 : cluster 0 pgmap v636: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 735 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:15.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:15 smithi111 bash[23388]: cluster 2024-02-13T14:54:13.947803+0000 mgr.y (mgr.14613) 421 : cluster 0 pgmap v636: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 735 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:16.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:54:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:54:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:54:17.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:17 smithi062 bash[28859]: cluster 2024-02-13T14:54:15.950878+0000 mgr.y (mgr.14613) 422 : cluster 0 pgmap v637: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:17.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:17 smithi062 bash[28859]: cluster 2024-02-13T14:54:16.051757+0000 mon.a (mon.0) 2527 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-02-13T14:54:17.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:17 smithi062 bash[21479]: cluster 2024-02-13T14:54:15.950878+0000 mgr.y (mgr.14613) 422 : cluster 0 pgmap v637: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:17.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:17 smithi062 bash[21479]: cluster 2024-02-13T14:54:16.051757+0000 mon.a (mon.0) 2527 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-02-13T14:54:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:17 smithi111 bash[23388]: cluster 2024-02-13T14:54:15.950878+0000 mgr.y (mgr.14613) 422 : cluster 0 pgmap v637: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:17.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:17 smithi111 bash[23388]: cluster 2024-02-13T14:54:16.051757+0000 mon.a (mon.0) 2527 : cluster 0 osdmap e412: 8 total, 8 up, 8 in 2024-02-13T14:54:19.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:19 smithi062 bash[28859]: cluster 2024-02-13T14:54:17.951931+0000 mgr.y (mgr.14613) 423 : cluster 0 pgmap v639: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:19.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:19 smithi062 bash[28859]: audit 2024-02-13T14:54:18.356214+0000 mon.b (mon.1) 210 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:19 smithi062 bash[21479]: cluster 2024-02-13T14:54:17.951931+0000 mgr.y (mgr.14613) 423 : cluster 0 pgmap v639: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:19 smithi062 bash[21479]: audit 2024-02-13T14:54:18.356214+0000 mon.b (mon.1) 210 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:19.342 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:19 smithi111 bash[23388]: cluster 2024-02-13T14:54:17.951931+0000 mgr.y (mgr.14613) 423 : cluster 0 pgmap v639: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:19.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:19 smithi111 bash[23388]: audit 2024-02-13T14:54:18.356214+0000 mon.b (mon.1) 210 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:20.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:54:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:54:21.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:21 smithi062 bash[21479]: cluster 2024-02-13T14:54:19.954186+0000 mgr.y (mgr.14613) 424 : cluster 0 pgmap v640: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:21.311 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:21 smithi062 bash[28859]: cluster 2024-02-13T14:54:19.954186+0000 mgr.y (mgr.14613) 424 : cluster 0 pgmap v640: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:21.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:21 smithi111 bash[23388]: cluster 2024-02-13T14:54:19.954186+0000 mgr.y (mgr.14613) 424 : cluster 0 pgmap v640: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:22 smithi111 bash[23388]: audit 2024-02-13T14:54:20.427256+0000 mgr.y (mgr.14613) 425 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:22.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:22 smithi062 bash[28859]: audit 2024-02-13T14:54:20.427256+0000 mgr.y (mgr.14613) 425 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:22 smithi062 bash[21479]: audit 2024-02-13T14:54:20.427256+0000 mgr.y (mgr.14613) 425 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:23 smithi111 bash[23388]: cluster 2024-02-13T14:54:21.956003+0000 mgr.y (mgr.14613) 426 : cluster 0 pgmap v641: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:23.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:23 smithi062 bash[21479]: cluster 2024-02-13T14:54:21.956003+0000 mgr.y (mgr.14613) 426 : cluster 0 pgmap v641: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:23 smithi062 bash[28859]: cluster 2024-02-13T14:54:21.956003+0000 mgr.y (mgr.14613) 426 : cluster 0 pgmap v641: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:25.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:25 smithi111 bash[23388]: cluster 2024-02-13T14:54:23.956903+0000 mgr.y (mgr.14613) 427 : cluster 0 pgmap v642: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:25.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:25 smithi062 bash[28859]: cluster 2024-02-13T14:54:23.956903+0000 mgr.y (mgr.14613) 427 : cluster 0 pgmap v642: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:25 smithi062 bash[21479]: cluster 2024-02-13T14:54:23.956903+0000 mgr.y (mgr.14613) 427 : cluster 0 pgmap v642: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:26.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:54:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:54:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:54:27.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:27 smithi111 bash[23388]: cluster 2024-02-13T14:54:25.959922+0000 mgr.y (mgr.14613) 428 : cluster 0 pgmap v643: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:27.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:27 smithi111 bash[23388]: cluster 2024-02-13T14:54:26.088856+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-02-13T14:54:27.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:27 smithi111 bash[23388]: cluster 2024-02-13T14:54:27.038877+0000 mon.a (mon.0) 2529 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-02-13T14:54:27.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:27 smithi062 bash[21479]: cluster 2024-02-13T14:54:25.959922+0000 mgr.y (mgr.14613) 428 : cluster 0 pgmap v643: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:27.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:27 smithi062 bash[21479]: cluster 2024-02-13T14:54:26.088856+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-02-13T14:54:27.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:27 smithi062 bash[21479]: cluster 2024-02-13T14:54:27.038877+0000 mon.a (mon.0) 2529 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-02-13T14:54:27.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:27 smithi062 bash[28859]: cluster 2024-02-13T14:54:25.959922+0000 mgr.y (mgr.14613) 428 : cluster 0 pgmap v643: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:54:27.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:27 smithi062 bash[28859]: cluster 2024-02-13T14:54:26.088856+0000 mon.a (mon.0) 2528 : cluster 0 osdmap e413: 8 total, 8 up, 8 in 2024-02-13T14:54:27.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:27 smithi062 bash[28859]: cluster 2024-02-13T14:54:27.038877+0000 mon.a (mon.0) 2529 : cluster 0 osdmap e414: 8 total, 8 up, 8 in 2024-02-13T14:54:29.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:29 smithi111 bash[23388]: cluster 2024-02-13T14:54:27.960818+0000 mgr.y (mgr.14613) 429 : cluster 0 pgmap v646: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:29.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:29 smithi062 bash[21479]: cluster 2024-02-13T14:54:27.960818+0000 mgr.y (mgr.14613) 429 : cluster 0 pgmap v646: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:29.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:29 smithi062 bash[28859]: cluster 2024-02-13T14:54:27.960818+0000 mgr.y (mgr.14613) 429 : cluster 0 pgmap v646: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T14:54:30.436 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:30 smithi111 bash[23388]: audit 2024-02-13T14:54:29.581602+0000 mon.a (mon.0) 2530 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]: dispatch 2024-02-13T14:54:30.436 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:30 smithi111 bash[23388]: audit 2024-02-13T14:54:29.582029+0000 mon.b (mon.1) 211 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]: dispatch 2024-02-13T14:54:30.436 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:30 smithi111 bash[23388]: audit 2024-02-13T14:54:29.890393+0000 mon.b (mon.1) 212 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:54:30.437 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:54:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:54:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:30 smithi062 bash[21479]: audit 2024-02-13T14:54:29.581602+0000 mon.a (mon.0) 2530 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]: dispatch 2024-02-13T14:54:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:30 smithi062 bash[21479]: audit 2024-02-13T14:54:29.582029+0000 mon.b (mon.1) 211 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]: dispatch 2024-02-13T14:54:30.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:30 smithi062 bash[21479]: audit 2024-02-13T14:54:29.890393+0000 mon.b (mon.1) 212 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:54:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:30 smithi062 bash[28859]: audit 2024-02-13T14:54:29.581602+0000 mon.a (mon.0) 2530 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]: dispatch 2024-02-13T14:54:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:30 smithi062 bash[28859]: audit 2024-02-13T14:54:29.582029+0000 mon.b (mon.1) 211 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]: dispatch 2024-02-13T14:54:30.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:30 smithi062 bash[28859]: audit 2024-02-13T14:54:29.890393+0000 mon.b (mon.1) 212 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:54:31.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[28859]: cluster 2024-02-13T14:54:29.962485+0000 mgr.y (mgr.14613) 430 : cluster 0 pgmap v647: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T14:54:31.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[28859]: audit 2024-02-13T14:54:30.097981+0000 mon.a (mon.0) 2531 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]': finished 2024-02-13T14:54:31.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[28859]: cluster 2024-02-13T14:54:30.110642+0000 mon.a (mon.0) 2532 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-02-13T14:54:31.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[28859]: audit 2024-02-13T14:54:30.477152+0000 mon.a (mon.0) 2533 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:31.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[28859]: audit 2024-02-13T14:54:30.493143+0000 mon.a (mon.0) 2534 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[21479]: cluster 2024-02-13T14:54:29.962485+0000 mgr.y (mgr.14613) 430 : cluster 0 pgmap v647: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T14:54:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[21479]: audit 2024-02-13T14:54:30.097981+0000 mon.a (mon.0) 2531 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]': finished 2024-02-13T14:54:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[21479]: cluster 2024-02-13T14:54:30.110642+0000 mon.a (mon.0) 2532 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-02-13T14:54:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[21479]: audit 2024-02-13T14:54:30.477152+0000 mon.a (mon.0) 2533 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:31.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:31 smithi062 bash[21479]: audit 2024-02-13T14:54:30.493143+0000 mon.a (mon.0) 2534 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:31.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:31 smithi111 bash[23388]: cluster 2024-02-13T14:54:29.962485+0000 mgr.y (mgr.14613) 430 : cluster 0 pgmap v647: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T14:54:31.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:31 smithi111 bash[23388]: audit 2024-02-13T14:54:30.097981+0000 mon.a (mon.0) 2531 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "277.15", "id": [0, 3]}]': finished 2024-02-13T14:54:31.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:31 smithi111 bash[23388]: cluster 2024-02-13T14:54:30.110642+0000 mon.a (mon.0) 2532 : cluster 0 osdmap e415: 8 total, 8 up, 8 in 2024-02-13T14:54:31.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:31 smithi111 bash[23388]: audit 2024-02-13T14:54:30.477152+0000 mon.a (mon.0) 2533 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:31.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:31 smithi111 bash[23388]: audit 2024-02-13T14:54:30.493143+0000 mon.a (mon.0) 2534 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[21479]: audit 2024-02-13T14:54:30.437164+0000 mgr.y (mgr.14613) 431 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:32.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[21479]: cluster 2024-02-13T14:54:31.103706+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-02-13T14:54:32.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[21479]: audit 2024-02-13T14:54:31.190786+0000 mon.b (mon.1) 213 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:54:32.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[21479]: audit 2024-02-13T14:54:31.193051+0000 mon.b (mon.1) 214 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:54:32.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[21479]: audit 2024-02-13T14:54:31.202795+0000 mon.a (mon.0) 2536 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[28859]: audit 2024-02-13T14:54:30.437164+0000 mgr.y (mgr.14613) 431 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[28859]: cluster 2024-02-13T14:54:31.103706+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-02-13T14:54:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[28859]: audit 2024-02-13T14:54:31.190786+0000 mon.b (mon.1) 213 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:54:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[28859]: audit 2024-02-13T14:54:31.193051+0000 mon.b (mon.1) 214 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:54:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:32 smithi062 bash[28859]: audit 2024-02-13T14:54:31.202795+0000 mon.a (mon.0) 2536 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:32 smithi111 bash[23388]: audit 2024-02-13T14:54:30.437164+0000 mgr.y (mgr.14613) 431 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:32 smithi111 bash[23388]: cluster 2024-02-13T14:54:31.103706+0000 mon.a (mon.0) 2535 : cluster 0 osdmap e416: 8 total, 8 up, 8 in 2024-02-13T14:54:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:32 smithi111 bash[23388]: audit 2024-02-13T14:54:31.190786+0000 mon.b (mon.1) 213 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:54:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:32 smithi111 bash[23388]: audit 2024-02-13T14:54:31.193051+0000 mon.b (mon.1) 214 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:54:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:32 smithi111 bash[23388]: audit 2024-02-13T14:54:31.202795+0000 mon.a (mon.0) 2536 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:54:33.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:33 smithi062 bash[21479]: cluster 2024-02-13T14:54:31.963333+0000 mgr.y (mgr.14613) 432 : cluster 0 pgmap v650: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T14:54:33.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:33 smithi062 bash[28859]: cluster 2024-02-13T14:54:31.963333+0000 mgr.y (mgr.14613) 432 : cluster 0 pgmap v650: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T14:54:33.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:33 smithi111 bash[23388]: cluster 2024-02-13T14:54:31.963333+0000 mgr.y (mgr.14613) 432 : cluster 0 pgmap v650: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T14:54:34.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:34 smithi062 bash[21479]: audit 2024-02-13T14:54:33.392900+0000 mon.b (mon.1) 215 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:34.608 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:34 smithi062 bash[28859]: audit 2024-02-13T14:54:33.392900+0000 mon.b (mon.1) 215 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:34.609 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:34 smithi111 bash[23388]: audit 2024-02-13T14:54:33.392900+0000 mon.b (mon.1) 215 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:35.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:35 smithi062 bash[28859]: cluster 2024-02-13T14:54:33.964223+0000 mgr.y (mgr.14613) 433 : cluster 0 pgmap v651: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 886 B/s rd, 0 op/s 2024-02-13T14:54:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:35 smithi062 bash[21479]: cluster 2024-02-13T14:54:33.964223+0000 mgr.y (mgr.14613) 433 : cluster 0 pgmap v651: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 886 B/s rd, 0 op/s 2024-02-13T14:54:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:35 smithi111 bash[23388]: cluster 2024-02-13T14:54:33.964223+0000 mgr.y (mgr.14613) 433 : cluster 0 pgmap v651: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 886 B/s rd, 0 op/s 2024-02-13T14:54:36.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:54:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:54:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[21479]: audit 2024-02-13T14:54:36.140362+0000 mon.c (mon.2) 725 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[21479]: audit 2024-02-13T14:54:36.141115+0000 mon.a (mon.0) 2537 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[21479]: audit 2024-02-13T14:54:36.142218+0000 mon.c (mon.2) 726 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-63"}]: dispatch 2024-02-13T14:54:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[21479]: audit 2024-02-13T14:54:36.142975+0000 mon.a (mon.0) 2538 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-63"}]: dispatch 2024-02-13T14:54:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[28859]: audit 2024-02-13T14:54:36.140362+0000 mon.c (mon.2) 725 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[28859]: audit 2024-02-13T14:54:36.141115+0000 mon.a (mon.0) 2537 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[28859]: audit 2024-02-13T14:54:36.142218+0000 mon.c (mon.2) 726 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-63"}]: dispatch 2024-02-13T14:54:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:36 smithi062 bash[28859]: audit 2024-02-13T14:54:36.142975+0000 mon.a (mon.0) 2538 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-63"}]: dispatch 2024-02-13T14:54:36.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:36 smithi111 bash[23388]: audit 2024-02-13T14:54:36.140362+0000 mon.c (mon.2) 725 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:36.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:36 smithi111 bash[23388]: audit 2024-02-13T14:54:36.141115+0000 mon.a (mon.0) 2537 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:36.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:36 smithi111 bash[23388]: audit 2024-02-13T14:54:36.142218+0000 mon.c (mon.2) 726 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-63"}]: dispatch 2024-02-13T14:54:36.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:36 smithi111 bash[23388]: audit 2024-02-13T14:54:36.142975+0000 mon.a (mon.0) 2538 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-63"}]: dispatch 2024-02-13T14:54:37.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[28859]: cluster 2024-02-13T14:54:35.967175+0000 mgr.y (mgr.14613) 434 : cluster 0 pgmap v652: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[28859]: cluster 2024-02-13T14:54:36.240559+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[28859]: cluster 2024-02-13T14:54:37.048739+0000 mon.a (mon.0) 2540 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[28859]: audit 2024-02-13T14:54:37.055162+0000 mon.c (mon.2) 727 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[28859]: audit 2024-02-13T14:54:37.056900+0000 mon.a (mon.0) 2541 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[21479]: cluster 2024-02-13T14:54:35.967175+0000 mgr.y (mgr.14613) 434 : cluster 0 pgmap v652: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[21479]: cluster 2024-02-13T14:54:36.240559+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[21479]: cluster 2024-02-13T14:54:37.048739+0000 mon.a (mon.0) 2540 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[21479]: audit 2024-02-13T14:54:37.055162+0000 mon.c (mon.2) 727 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:37 smithi062 bash[21479]: audit 2024-02-13T14:54:37.056900+0000 mon.a (mon.0) 2541 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:37 smithi111 bash[23388]: cluster 2024-02-13T14:54:35.967175+0000 mgr.y (mgr.14613) 434 : cluster 0 pgmap v652: 324 pgs: 324 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T14:54:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:37 smithi111 bash[23388]: cluster 2024-02-13T14:54:36.240559+0000 mon.a (mon.0) 2539 : cluster 0 osdmap e417: 8 total, 8 up, 8 in 2024-02-13T14:54:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:37 smithi111 bash[23388]: cluster 2024-02-13T14:54:37.048739+0000 mon.a (mon.0) 2540 : cluster 0 osdmap e418: 8 total, 8 up, 8 in 2024-02-13T14:54:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:37 smithi111 bash[23388]: audit 2024-02-13T14:54:37.055162+0000 mon.c (mon.2) 727 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:37 smithi111 bash[23388]: audit 2024-02-13T14:54:37.056900+0000 mon.a (mon.0) 2541 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:39.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[21479]: cluster 2024-02-13T14:54:37.968121+0000 mgr.y (mgr.14613) 435 : cluster 0 pgmap v655: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[21479]: audit 2024-02-13T14:54:38.040901+0000 mon.a (mon.0) 2542 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[21479]: cluster 2024-02-13T14:54:38.051680+0000 mon.a (mon.0) 2543 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[21479]: audit 2024-02-13T14:54:38.053885+0000 mon.c (mon.2) 728 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[21479]: audit 2024-02-13T14:54:38.072382+0000 mon.c (mon.2) 729 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[21479]: audit 2024-02-13T14:54:38.073651+0000 mon.a (mon.0) 2544 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[21479]: cluster 2024-02-13T14:54:38.231750+0000 mon.a (mon.0) 2545 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[28859]: cluster 2024-02-13T14:54:37.968121+0000 mgr.y (mgr.14613) 435 : cluster 0 pgmap v655: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[28859]: audit 2024-02-13T14:54:38.040901+0000 mon.a (mon.0) 2542 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[28859]: cluster 2024-02-13T14:54:38.051680+0000 mon.a (mon.0) 2543 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[28859]: audit 2024-02-13T14:54:38.053885+0000 mon.c (mon.2) 728 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[28859]: audit 2024-02-13T14:54:38.072382+0000 mon.c (mon.2) 729 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[28859]: audit 2024-02-13T14:54:38.073651+0000 mon.a (mon.0) 2544 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:39 smithi062 bash[28859]: cluster 2024-02-13T14:54:38.231750+0000 mon.a (mon.0) 2545 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:39 smithi111 bash[23388]: cluster 2024-02-13T14:54:37.968121+0000 mgr.y (mgr.14613) 435 : cluster 0 pgmap v655: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 640 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:39 smithi111 bash[23388]: audit 2024-02-13T14:54:38.040901+0000 mon.a (mon.0) 2542 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-65","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:39 smithi111 bash[23388]: cluster 2024-02-13T14:54:38.051680+0000 mon.a (mon.0) 2543 : cluster 0 osdmap e419: 8 total, 8 up, 8 in 2024-02-13T14:54:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:39 smithi111 bash[23388]: audit 2024-02-13T14:54:38.053885+0000 mon.c (mon.2) 728 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:39 smithi111 bash[23388]: audit 2024-02-13T14:54:38.072382+0000 mon.c (mon.2) 729 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:39 smithi111 bash[23388]: audit 2024-02-13T14:54:38.073651+0000 mon.a (mon.0) 2544 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:54:39.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:39 smithi111 bash[23388]: cluster 2024-02-13T14:54:38.231750+0000 mon.a (mon.0) 2545 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:40.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:40 smithi111 bash[23388]: audit 2024-02-13T14:54:39.043591+0000 mon.a (mon.0) 2546 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:54:40.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:40 smithi111 bash[23388]: cluster 2024-02-13T14:54:39.051463+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-02-13T14:54:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:40 smithi062 bash[21479]: audit 2024-02-13T14:54:39.043591+0000 mon.a (mon.0) 2546 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:54:40.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:40 smithi062 bash[21479]: cluster 2024-02-13T14:54:39.051463+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-02-13T14:54:40.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:40 smithi062 bash[28859]: audit 2024-02-13T14:54:39.043591+0000 mon.a (mon.0) 2546 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:54:40.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:40 smithi062 bash[28859]: cluster 2024-02-13T14:54:39.051463+0000 mon.a (mon.0) 2547 : cluster 0 osdmap e420: 8 total, 8 up, 8 in 2024-02-13T14:54:40.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:54:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:54:41.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:41 smithi111 bash[23388]: cluster 2024-02-13T14:54:39.970240+0000 mgr.y (mgr.14613) 436 : cluster 0 pgmap v658: 324 pgs: 7 unknown, 317 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:41.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:41 smithi111 bash[23388]: cluster 2024-02-13T14:54:40.075012+0000 mon.a (mon.0) 2548 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-02-13T14:54:41.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:41 smithi062 bash[28859]: cluster 2024-02-13T14:54:39.970240+0000 mgr.y (mgr.14613) 436 : cluster 0 pgmap v658: 324 pgs: 7 unknown, 317 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:41.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:41 smithi062 bash[28859]: cluster 2024-02-13T14:54:40.075012+0000 mon.a (mon.0) 2548 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-02-13T14:54:41.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:41 smithi062 bash[21479]: cluster 2024-02-13T14:54:39.970240+0000 mgr.y (mgr.14613) 436 : cluster 0 pgmap v658: 324 pgs: 7 unknown, 317 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:41.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:41 smithi062 bash[21479]: cluster 2024-02-13T14:54:40.075012+0000 mon.a (mon.0) 2548 : cluster 0 osdmap e421: 8 total, 8 up, 8 in 2024-02-13T14:54:42.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:42 smithi111 bash[23388]: audit 2024-02-13T14:54:40.445449+0000 mgr.y (mgr.14613) 437 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:42.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:42 smithi111 bash[23388]: cluster 2024-02-13T14:54:41.075862+0000 mon.a (mon.0) 2549 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-02-13T14:54:42.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:42 smithi062 bash[28859]: audit 2024-02-13T14:54:40.445449+0000 mgr.y (mgr.14613) 437 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:42 smithi062 bash[28859]: cluster 2024-02-13T14:54:41.075862+0000 mon.a (mon.0) 2549 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-02-13T14:54:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:42 smithi062 bash[21479]: audit 2024-02-13T14:54:40.445449+0000 mgr.y (mgr.14613) 437 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:42 smithi062 bash[21479]: cluster 2024-02-13T14:54:41.075862+0000 mon.a (mon.0) 2549 : cluster 0 osdmap e422: 8 total, 8 up, 8 in 2024-02-13T14:54:43.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:43 smithi111 bash[23388]: cluster 2024-02-13T14:54:41.971155+0000 mgr.y (mgr.14613) 438 : cluster 0 pgmap v661: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:54:43.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:43 smithi111 bash[23388]: cluster 2024-02-13T14:54:42.098758+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-02-13T14:54:43.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:43 smithi062 bash[21479]: cluster 2024-02-13T14:54:41.971155+0000 mgr.y (mgr.14613) 438 : cluster 0 pgmap v661: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:54:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:43 smithi062 bash[21479]: cluster 2024-02-13T14:54:42.098758+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-02-13T14:54:43.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:43 smithi062 bash[28859]: cluster 2024-02-13T14:54:41.971155+0000 mgr.y (mgr.14613) 438 : cluster 0 pgmap v661: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:54:43.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:43 smithi062 bash[28859]: cluster 2024-02-13T14:54:42.098758+0000 mon.a (mon.0) 2550 : cluster 0 osdmap e423: 8 total, 8 up, 8 in 2024-02-13T14:54:45.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:45 smithi062 bash[21479]: cluster 2024-02-13T14:54:43.972072+0000 mgr.y (mgr.14613) 439 : cluster 0 pgmap v663: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T14:54:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:45 smithi062 bash[28859]: cluster 2024-02-13T14:54:43.972072+0000 mgr.y (mgr.14613) 439 : cluster 0 pgmap v663: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T14:54:45.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:45 smithi111 bash[23388]: cluster 2024-02-13T14:54:43.972072+0000 mgr.y (mgr.14613) 439 : cluster 0 pgmap v663: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1.2 KiB/s wr, 3 op/s 2024-02-13T14:54:46.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:54:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:54:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:54:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:47 smithi062 bash[21479]: cluster 2024-02-13T14:54:45.975020+0000 mgr.y (mgr.14613) 440 : cluster 0 pgmap v664: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-02-13T14:54:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:47 smithi062 bash[21479]: cluster 2024-02-13T14:54:47.037963+0000 mon.a (mon.0) 2551 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:47 smithi062 bash[21479]: cluster 2024-02-13T14:54:47.049592+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-02-13T14:54:47.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:47 smithi062 bash[28859]: cluster 2024-02-13T14:54:45.975020+0000 mgr.y (mgr.14613) 440 : cluster 0 pgmap v664: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-02-13T14:54:47.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:47 smithi062 bash[28859]: cluster 2024-02-13T14:54:47.037963+0000 mon.a (mon.0) 2551 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:47.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:47 smithi062 bash[28859]: cluster 2024-02-13T14:54:47.049592+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-02-13T14:54:47.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:47 smithi111 bash[23388]: cluster 2024-02-13T14:54:45.975020+0000 mgr.y (mgr.14613) 440 : cluster 0 pgmap v664: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 682 B/s wr, 4 op/s 2024-02-13T14:54:47.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:47 smithi111 bash[23388]: cluster 2024-02-13T14:54:47.037963+0000 mon.a (mon.0) 2551 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:54:47.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:47 smithi111 bash[23388]: cluster 2024-02-13T14:54:47.049592+0000 mon.a (mon.0) 2552 : cluster 0 osdmap e424: 8 total, 8 up, 8 in 2024-02-13T14:54:49.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:49 smithi062 bash[21479]: cluster 2024-02-13T14:54:47.975914+0000 mgr.y (mgr.14613) 441 : cluster 0 pgmap v666: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 593 B/s wr, 4 op/s 2024-02-13T14:54:49.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:49 smithi062 bash[21479]: audit 2024-02-13T14:54:48.439316+0000 mon.b (mon.1) 216 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:49.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:49 smithi062 bash[28859]: cluster 2024-02-13T14:54:47.975914+0000 mgr.y (mgr.14613) 441 : cluster 0 pgmap v666: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 593 B/s wr, 4 op/s 2024-02-13T14:54:49.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:49 smithi062 bash[28859]: audit 2024-02-13T14:54:48.439316+0000 mon.b (mon.1) 216 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:49.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:49 smithi111 bash[23388]: cluster 2024-02-13T14:54:47.975914+0000 mgr.y (mgr.14613) 441 : cluster 0 pgmap v666: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 593 B/s wr, 4 op/s 2024-02-13T14:54:49.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:49 smithi111 bash[23388]: audit 2024-02-13T14:54:48.439316+0000 mon.b (mon.1) 216 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:54:50.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:54:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:54:51.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:51 smithi062 bash[28859]: cluster 2024-02-13T14:54:49.978226+0000 mgr.y (mgr.14613) 442 : cluster 0 pgmap v667: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T14:54:51.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:51 smithi062 bash[21479]: cluster 2024-02-13T14:54:49.978226+0000 mgr.y (mgr.14613) 442 : cluster 0 pgmap v667: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T14:54:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:51 smithi111 bash[23388]: cluster 2024-02-13T14:54:49.978226+0000 mgr.y (mgr.14613) 442 : cluster 0 pgmap v667: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 511 B/s wr, 4 op/s 2024-02-13T14:54:52.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:52 smithi062 bash[21479]: audit 2024-02-13T14:54:50.456758+0000 mgr.y (mgr.14613) 443 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:52.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:52 smithi062 bash[28859]: audit 2024-02-13T14:54:50.456758+0000 mgr.y (mgr.14613) 443 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:52 smithi111 bash[23388]: audit 2024-02-13T14:54:50.456758+0000 mgr.y (mgr.14613) 443 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[21479]: cluster 2024-02-13T14:54:51.980044+0000 mgr.y (mgr.14613) 444 : cluster 0 pgmap v668: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 414 B/s wr, 3 op/s 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[21479]: audit 2024-02-13T14:54:52.139393+0000 mon.c (mon.2) 730 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[21479]: audit 2024-02-13T14:54:52.140090+0000 mon.a (mon.0) 2553 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[21479]: audit 2024-02-13T14:54:52.141346+0000 mon.c (mon.2) 731 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-65"}]: dispatch 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[21479]: audit 2024-02-13T14:54:52.142162+0000 mon.a (mon.0) 2554 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-65"}]: dispatch 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[28859]: cluster 2024-02-13T14:54:51.980044+0000 mgr.y (mgr.14613) 444 : cluster 0 pgmap v668: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 414 B/s wr, 3 op/s 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[28859]: audit 2024-02-13T14:54:52.139393+0000 mon.c (mon.2) 730 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[28859]: audit 2024-02-13T14:54:52.140090+0000 mon.a (mon.0) 2553 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[28859]: audit 2024-02-13T14:54:52.141346+0000 mon.c (mon.2) 731 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-65"}]: dispatch 2024-02-13T14:54:53.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:53 smithi062 bash[28859]: audit 2024-02-13T14:54:52.142162+0000 mon.a (mon.0) 2554 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-65"}]: dispatch 2024-02-13T14:54:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:53 smithi111 bash[23388]: cluster 2024-02-13T14:54:51.980044+0000 mgr.y (mgr.14613) 444 : cluster 0 pgmap v668: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 414 B/s wr, 3 op/s 2024-02-13T14:54:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:53 smithi111 bash[23388]: audit 2024-02-13T14:54:52.139393+0000 mon.c (mon.2) 730 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:53 smithi111 bash[23388]: audit 2024-02-13T14:54:52.140090+0000 mon.a (mon.0) 2553 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:53 smithi111 bash[23388]: audit 2024-02-13T14:54:52.141346+0000 mon.c (mon.2) 731 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-65"}]: dispatch 2024-02-13T14:54:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:53 smithi111 bash[23388]: audit 2024-02-13T14:54:52.142162+0000 mon.a (mon.0) 2554 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-65"}]: dispatch 2024-02-13T14:54:54.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:54 smithi062 bash[28859]: cluster 2024-02-13T14:54:53.136145+0000 mon.a (mon.0) 2555 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-02-13T14:54:54.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:54 smithi062 bash[21479]: cluster 2024-02-13T14:54:53.136145+0000 mon.a (mon.0) 2555 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-02-13T14:54:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:54 smithi111 bash[23388]: cluster 2024-02-13T14:54:53.136145+0000 mon.a (mon.0) 2555 : cluster 0 osdmap e425: 8 total, 8 up, 8 in 2024-02-13T14:54:55.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:55 smithi062 bash[28859]: cluster 2024-02-13T14:54:53.980869+0000 mgr.y (mgr.14613) 445 : cluster 0 pgmap v670: 292 pgs: 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:55 smithi062 bash[28859]: cluster 2024-02-13T14:54:54.149285+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-02-13T14:54:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:55 smithi062 bash[28859]: audit 2024-02-13T14:54:54.153720+0000 mon.c (mon.2) 732 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:55 smithi062 bash[28859]: audit 2024-02-13T14:54:54.155538+0000 mon.a (mon.0) 2557 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:55.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:55 smithi062 bash[21479]: cluster 2024-02-13T14:54:53.980869+0000 mgr.y (mgr.14613) 445 : cluster 0 pgmap v670: 292 pgs: 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:55.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:55 smithi062 bash[21479]: cluster 2024-02-13T14:54:54.149285+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-02-13T14:54:55.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:55 smithi062 bash[21479]: audit 2024-02-13T14:54:54.153720+0000 mon.c (mon.2) 732 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:55.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:55 smithi062 bash[21479]: audit 2024-02-13T14:54:54.155538+0000 mon.a (mon.0) 2557 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:55 smithi111 bash[23388]: cluster 2024-02-13T14:54:53.980869+0000 mgr.y (mgr.14613) 445 : cluster 0 pgmap v670: 292 pgs: 292 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:55 smithi111 bash[23388]: cluster 2024-02-13T14:54:54.149285+0000 mon.a (mon.0) 2556 : cluster 0 osdmap e426: 8 total, 8 up, 8 in 2024-02-13T14:54:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:55 smithi111 bash[23388]: audit 2024-02-13T14:54:54.153720+0000 mon.c (mon.2) 732 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:55.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:55 smithi111 bash[23388]: audit 2024-02-13T14:54:54.155538+0000 mon.a (mon.0) 2557 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:56.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:54:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:54:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:54:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:56 smithi062 bash[21479]: audit 2024-02-13T14:54:55.142389+0000 mon.a (mon.0) 2558 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:56 smithi062 bash[21479]: cluster 2024-02-13T14:54:55.151308+0000 mon.a (mon.0) 2559 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-02-13T14:54:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:56 smithi062 bash[21479]: audit 2024-02-13T14:54:55.154922+0000 mon.c (mon.2) 733 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:56 smithi062 bash[28859]: audit 2024-02-13T14:54:55.142389+0000 mon.a (mon.0) 2558 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:56 smithi062 bash[28859]: cluster 2024-02-13T14:54:55.151308+0000 mon.a (mon.0) 2559 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-02-13T14:54:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:56 smithi062 bash[28859]: audit 2024-02-13T14:54:55.154922+0000 mon.c (mon.2) 733 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:56.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:56 smithi111 bash[23388]: audit 2024-02-13T14:54:55.142389+0000 mon.a (mon.0) 2558 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-67","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:56.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:56 smithi111 bash[23388]: cluster 2024-02-13T14:54:55.151308+0000 mon.a (mon.0) 2559 : cluster 0 osdmap e427: 8 total, 8 up, 8 in 2024-02-13T14:54:56.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:56 smithi111 bash[23388]: audit 2024-02-13T14:54:55.154922+0000 mon.c (mon.2) 733 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:54:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[28859]: cluster 2024-02-13T14:54:55.981876+0000 mgr.y (mgr.14613) 446 : cluster 0 pgmap v673: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[28859]: cluster 2024-02-13T14:54:56.187618+0000 mon.a (mon.0) 2560 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-02-13T14:54:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[28859]: audit 2024-02-13T14:54:56.285416+0000 mon.c (mon.2) 734 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[28859]: audit 2024-02-13T14:54:56.286131+0000 mon.a (mon.0) 2561 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[28859]: audit 2024-02-13T14:54:56.287308+0000 mon.c (mon.2) 735 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-67"}]: dispatch 2024-02-13T14:54:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[28859]: audit 2024-02-13T14:54:56.287895+0000 mon.a (mon.0) 2562 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-67"}]: dispatch 2024-02-13T14:54:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[21479]: cluster 2024-02-13T14:54:55.981876+0000 mgr.y (mgr.14613) 446 : cluster 0 pgmap v673: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[21479]: cluster 2024-02-13T14:54:56.187618+0000 mon.a (mon.0) 2560 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-02-13T14:54:57.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[21479]: audit 2024-02-13T14:54:56.285416+0000 mon.c (mon.2) 734 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:57.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[21479]: audit 2024-02-13T14:54:56.286131+0000 mon.a (mon.0) 2561 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:57.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[21479]: audit 2024-02-13T14:54:56.287308+0000 mon.c (mon.2) 735 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-67"}]: dispatch 2024-02-13T14:54:57.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:57 smithi062 bash[21479]: audit 2024-02-13T14:54:56.287895+0000 mon.a (mon.0) 2562 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-67"}]: dispatch 2024-02-13T14:54:57.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:57 smithi111 bash[23388]: cluster 2024-02-13T14:54:55.981876+0000 mgr.y (mgr.14613) 446 : cluster 0 pgmap v673: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:54:57.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:57 smithi111 bash[23388]: cluster 2024-02-13T14:54:56.187618+0000 mon.a (mon.0) 2560 : cluster 0 osdmap e428: 8 total, 8 up, 8 in 2024-02-13T14:54:57.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:57 smithi111 bash[23388]: audit 2024-02-13T14:54:56.285416+0000 mon.c (mon.2) 734 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:57.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:57 smithi111 bash[23388]: audit 2024-02-13T14:54:56.286131+0000 mon.a (mon.0) 2561 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:54:57.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:57 smithi111 bash[23388]: audit 2024-02-13T14:54:56.287308+0000 mon.c (mon.2) 735 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-67"}]: dispatch 2024-02-13T14:54:57.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:57 smithi111 bash[23388]: audit 2024-02-13T14:54:56.287895+0000 mon.a (mon.0) 2562 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-67"}]: dispatch 2024-02-13T14:54:58.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:58 smithi062 bash[28859]: cluster 2024-02-13T14:54:57.208077+0000 mon.a (mon.0) 2563 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-02-13T14:54:58.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:58 smithi062 bash[21479]: cluster 2024-02-13T14:54:57.208077+0000 mon.a (mon.0) 2563 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-02-13T14:54:58.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:58 smithi111 bash[23388]: cluster 2024-02-13T14:54:57.208077+0000 mon.a (mon.0) 2563 : cluster 0 osdmap e429: 8 total, 8 up, 8 in 2024-02-13T14:54:59.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[21479]: cluster 2024-02-13T14:54:57.983012+0000 mgr.y (mgr.14613) 447 : cluster 0 pgmap v676: 292 pgs: 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:54:59.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[21479]: cluster 2024-02-13T14:54:58.231952+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-02-13T14:54:59.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[21479]: audit 2024-02-13T14:54:58.238663+0000 mon.c (mon.2) 736 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:59.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[21479]: audit 2024-02-13T14:54:58.257405+0000 mon.a (mon.0) 2565 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:59.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[21479]: audit 2024-02-13T14:54:59.221795+0000 mon.a (mon.0) 2566 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:59.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[21479]: cluster 2024-02-13T14:54:59.228736+0000 mon.a (mon.0) 2567 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-02-13T14:54:59.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[28859]: cluster 2024-02-13T14:54:57.983012+0000 mgr.y (mgr.14613) 447 : cluster 0 pgmap v676: 292 pgs: 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:54:59.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[28859]: cluster 2024-02-13T14:54:58.231952+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-02-13T14:54:59.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[28859]: audit 2024-02-13T14:54:58.238663+0000 mon.c (mon.2) 736 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:59.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[28859]: audit 2024-02-13T14:54:58.257405+0000 mon.a (mon.0) 2565 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:59.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[28859]: audit 2024-02-13T14:54:59.221795+0000 mon.a (mon.0) 2566 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:59.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:54:59 smithi062 bash[28859]: cluster 2024-02-13T14:54:59.228736+0000 mon.a (mon.0) 2567 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-02-13T14:54:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:59 smithi111 bash[23388]: cluster 2024-02-13T14:54:57.983012+0000 mgr.y (mgr.14613) 447 : cluster 0 pgmap v676: 292 pgs: 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:54:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:59 smithi111 bash[23388]: cluster 2024-02-13T14:54:58.231952+0000 mon.a (mon.0) 2564 : cluster 0 osdmap e430: 8 total, 8 up, 8 in 2024-02-13T14:54:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:59 smithi111 bash[23388]: audit 2024-02-13T14:54:58.238663+0000 mon.c (mon.2) 736 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:59 smithi111 bash[23388]: audit 2024-02-13T14:54:58.257405+0000 mon.a (mon.0) 2565 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:54:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:59 smithi111 bash[23388]: audit 2024-02-13T14:54:59.221795+0000 mon.a (mon.0) 2566 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-69","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:54:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:54:59 smithi111 bash[23388]: cluster 2024-02-13T14:54:59.228736+0000 mon.a (mon.0) 2567 : cluster 0 osdmap e431: 8 total, 8 up, 8 in 2024-02-13T14:55:00.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[28859]: audit 2024-02-13T14:54:59.240490+0000 mon.c (mon.2) 737 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:00.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[28859]: audit 2024-02-13T14:54:59.330657+0000 mon.c (mon.2) 738 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:00.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[28859]: audit 2024-02-13T14:54:59.331154+0000 mon.a (mon.0) 2568 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:00.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[28859]: audit 2024-02-13T14:54:59.331885+0000 mon.c (mon.2) 739 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-69"}]: dispatch 2024-02-13T14:55:00.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[28859]: audit 2024-02-13T14:54:59.332310+0000 mon.a (mon.0) 2569 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-69"}]: dispatch 2024-02-13T14:55:00.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[21479]: audit 2024-02-13T14:54:59.240490+0000 mon.c (mon.2) 737 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:00.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[21479]: audit 2024-02-13T14:54:59.330657+0000 mon.c (mon.2) 738 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:00.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[21479]: audit 2024-02-13T14:54:59.331154+0000 mon.a (mon.0) 2568 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:00.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[21479]: audit 2024-02-13T14:54:59.331885+0000 mon.c (mon.2) 739 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-69"}]: dispatch 2024-02-13T14:55:00.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:00 smithi062 bash[21479]: audit 2024-02-13T14:54:59.332310+0000 mon.a (mon.0) 2569 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-69"}]: dispatch 2024-02-13T14:55:00.593 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:55:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:55:00.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:00 smithi111 bash[23388]: audit 2024-02-13T14:54:59.240490+0000 mon.c (mon.2) 737 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:00.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:00 smithi111 bash[23388]: audit 2024-02-13T14:54:59.330657+0000 mon.c (mon.2) 738 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:00.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:00 smithi111 bash[23388]: audit 2024-02-13T14:54:59.331154+0000 mon.a (mon.0) 2568 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:00.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:00 smithi111 bash[23388]: audit 2024-02-13T14:54:59.331885+0000 mon.c (mon.2) 739 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-69"}]: dispatch 2024-02-13T14:55:00.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:00 smithi111 bash[23388]: audit 2024-02-13T14:54:59.332310+0000 mon.a (mon.0) 2569 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-69"}]: dispatch 2024-02-13T14:55:01.561 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:01 smithi062 bash[28859]: cluster 2024-02-13T14:54:59.985061+0000 mgr.y (mgr.14613) 448 : cluster 0 pgmap v679: 324 pgs: 12 unknown, 312 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:55:01.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:01 smithi062 bash[28859]: cluster 2024-02-13T14:55:00.277878+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-02-13T14:55:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:01 smithi062 bash[21479]: cluster 2024-02-13T14:54:59.985061+0000 mgr.y (mgr.14613) 448 : cluster 0 pgmap v679: 324 pgs: 12 unknown, 312 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:55:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:01 smithi062 bash[21479]: cluster 2024-02-13T14:55:00.277878+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-02-13T14:55:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:01 smithi111 bash[23388]: cluster 2024-02-13T14:54:59.985061+0000 mgr.y (mgr.14613) 448 : cluster 0 pgmap v679: 324 pgs: 12 unknown, 312 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:55:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:01 smithi111 bash[23388]: cluster 2024-02-13T14:55:00.277878+0000 mon.a (mon.0) 2570 : cluster 0 osdmap e432: 8 total, 8 up, 8 in 2024-02-13T14:55:02.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:02 smithi111 bash[23388]: audit 2024-02-13T14:55:00.468049+0000 mgr.y (mgr.14613) 449 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:02 smithi111 bash[23388]: cluster 2024-02-13T14:55:01.280601+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-02-13T14:55:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:02 smithi111 bash[23388]: audit 2024-02-13T14:55:01.283251+0000 mon.c (mon.2) 740 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:02 smithi111 bash[23388]: audit 2024-02-13T14:55:01.301851+0000 mon.a (mon.0) 2572 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:02 smithi111 bash[23388]: audit 2024-02-13T14:55:02.272687+0000 mon.a (mon.0) 2573 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:02 smithi111 bash[23388]: cluster 2024-02-13T14:55:02.280539+0000 mon.a (mon.0) 2574 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[21479]: audit 2024-02-13T14:55:00.468049+0000 mgr.y (mgr.14613) 449 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[21479]: cluster 2024-02-13T14:55:01.280601+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[21479]: audit 2024-02-13T14:55:01.283251+0000 mon.c (mon.2) 740 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[21479]: audit 2024-02-13T14:55:01.301851+0000 mon.a (mon.0) 2572 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[21479]: audit 2024-02-13T14:55:02.272687+0000 mon.a (mon.0) 2573 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[21479]: cluster 2024-02-13T14:55:02.280539+0000 mon.a (mon.0) 2574 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[28859]: audit 2024-02-13T14:55:00.468049+0000 mgr.y (mgr.14613) 449 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[28859]: cluster 2024-02-13T14:55:01.280601+0000 mon.a (mon.0) 2571 : cluster 0 osdmap e433: 8 total, 8 up, 8 in 2024-02-13T14:55:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[28859]: audit 2024-02-13T14:55:01.283251+0000 mon.c (mon.2) 740 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:02.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[28859]: audit 2024-02-13T14:55:01.301851+0000 mon.a (mon.0) 2572 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:02.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[28859]: audit 2024-02-13T14:55:02.272687+0000 mon.a (mon.0) 2573 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-71","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:02.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:02 smithi062 bash[28859]: cluster 2024-02-13T14:55:02.280539+0000 mon.a (mon.0) 2574 : cluster 0 osdmap e434: 8 total, 8 up, 8 in 2024-02-13T14:55:03.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:03 smithi111 bash[23388]: cluster 2024-02-13T14:55:01.986073+0000 mgr.y (mgr.14613) 450 : cluster 0 pgmap v682: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:55:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:03 smithi111 bash[23388]: cluster 2024-02-13T14:55:02.284541+0000 mon.a (mon.0) 2575 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:03 smithi111 bash[23388]: audit 2024-02-13T14:55:02.306337+0000 mon.c (mon.2) 741 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:03 smithi111 bash[23388]: audit 2024-02-13T14:55:02.344270+0000 mon.c (mon.2) 742 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:55:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:03 smithi111 bash[23388]: audit 2024-02-13T14:55:02.344859+0000 mon.a (mon.0) 2576 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:55:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:03 smithi111 bash[23388]: audit 2024-02-13T14:55:03.313847+0000 mon.a (mon.0) 2577 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:55:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:03 smithi111 bash[23388]: cluster 2024-02-13T14:55:03.320811+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-02-13T14:55:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[21479]: cluster 2024-02-13T14:55:01.986073+0000 mgr.y (mgr.14613) 450 : cluster 0 pgmap v682: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:55:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[21479]: cluster 2024-02-13T14:55:02.284541+0000 mon.a (mon.0) 2575 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[21479]: audit 2024-02-13T14:55:02.306337+0000 mon.c (mon.2) 741 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[21479]: audit 2024-02-13T14:55:02.344270+0000 mon.c (mon.2) 742 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:55:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[21479]: audit 2024-02-13T14:55:02.344859+0000 mon.a (mon.0) 2576 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:55:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[21479]: audit 2024-02-13T14:55:03.313847+0000 mon.a (mon.0) 2577 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:55:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[21479]: cluster 2024-02-13T14:55:03.320811+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-02-13T14:55:03.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[28859]: cluster 2024-02-13T14:55:01.986073+0000 mgr.y (mgr.14613) 450 : cluster 0 pgmap v682: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:55:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[28859]: cluster 2024-02-13T14:55:02.284541+0000 mon.a (mon.0) 2575 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[28859]: audit 2024-02-13T14:55:02.306337+0000 mon.c (mon.2) 741 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[28859]: audit 2024-02-13T14:55:02.344270+0000 mon.c (mon.2) 742 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:55:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[28859]: audit 2024-02-13T14:55:02.344859+0000 mon.a (mon.0) 2576 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:55:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[28859]: audit 2024-02-13T14:55:03.313847+0000 mon.a (mon.0) 2577 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:55:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:03 smithi062 bash[28859]: cluster 2024-02-13T14:55:03.320811+0000 mon.a (mon.0) 2578 : cluster 0 osdmap e435: 8 total, 8 up, 8 in 2024-02-13T14:55:04.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:04 smithi062 bash[28859]: audit 2024-02-13T14:55:03.478482+0000 mon.b (mon.1) 217 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:04.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:04 smithi062 bash[21479]: audit 2024-02-13T14:55:03.478482+0000 mon.b (mon.1) 217 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:04.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:04 smithi111 bash[23388]: audit 2024-02-13T14:55:03.478482+0000 mon.b (mon.1) 217 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:05.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:05 smithi062 bash[28859]: cluster 2024-02-13T14:55:03.987005+0000 mgr.y (mgr.14613) 451 : cluster 0 pgmap v685: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:05 smithi062 bash[28859]: cluster 2024-02-13T14:55:04.359574+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-02-13T14:55:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:05 smithi062 bash[21479]: cluster 2024-02-13T14:55:03.987005+0000 mgr.y (mgr.14613) 451 : cluster 0 pgmap v685: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:05 smithi062 bash[21479]: cluster 2024-02-13T14:55:04.359574+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-02-13T14:55:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:05 smithi111 bash[23388]: cluster 2024-02-13T14:55:03.987005+0000 mgr.y (mgr.14613) 451 : cluster 0 pgmap v685: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 650 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:05 smithi111 bash[23388]: cluster 2024-02-13T14:55:04.359574+0000 mon.a (mon.0) 2579 : cluster 0 osdmap e436: 8 total, 8 up, 8 in 2024-02-13T14:55:06.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:55:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:55:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:55:07.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:07 smithi062 bash[28859]: cluster 2024-02-13T14:55:05.990245+0000 mgr.y (mgr.14613) 452 : cluster 0 pgmap v687: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-02-13T14:55:07.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:07 smithi062 bash[21479]: cluster 2024-02-13T14:55:05.990245+0000 mgr.y (mgr.14613) 452 : cluster 0 pgmap v687: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-02-13T14:55:07.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:07 smithi111 bash[23388]: cluster 2024-02-13T14:55:05.990245+0000 mgr.y (mgr.14613) 452 : cluster 0 pgmap v687: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 2.8 KiB/s wr, 6 op/s 2024-02-13T14:55:09.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:09 smithi062 bash[28859]: cluster 2024-02-13T14:55:07.991149+0000 mgr.y (mgr.14613) 453 : cluster 0 pgmap v688: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-02-13T14:55:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:09 smithi062 bash[21479]: cluster 2024-02-13T14:55:07.991149+0000 mgr.y (mgr.14613) 453 : cluster 0 pgmap v688: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-02-13T14:55:09.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:09 smithi111 bash[23388]: cluster 2024-02-13T14:55:07.991149+0000 mgr.y (mgr.14613) 453 : cluster 0 pgmap v688: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 4 op/s 2024-02-13T14:55:10.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:55:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:55:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:11 smithi062 bash[21479]: cluster 2024-02-13T14:55:09.993711+0000 mgr.y (mgr.14613) 454 : cluster 0 pgmap v689: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T14:55:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:11 smithi062 bash[28859]: cluster 2024-02-13T14:55:09.993711+0000 mgr.y (mgr.14613) 454 : cluster 0 pgmap v689: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T14:55:11.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:11 smithi111 bash[23388]: cluster 2024-02-13T14:55:09.993711+0000 mgr.y (mgr.14613) 454 : cluster 0 pgmap v689: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.7 KiB/s wr, 4 op/s 2024-02-13T14:55:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:12 smithi062 bash[21479]: audit 2024-02-13T14:55:10.477610+0000 mgr.y (mgr.14613) 455 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:12 smithi062 bash[21479]: cluster 2024-02-13T14:55:12.045338+0000 mon.a (mon.0) 2580 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:12.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:12 smithi062 bash[28859]: audit 2024-02-13T14:55:10.477610+0000 mgr.y (mgr.14613) 455 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:12.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:12 smithi062 bash[28859]: cluster 2024-02-13T14:55:12.045338+0000 mon.a (mon.0) 2580 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:12.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:12 smithi111 bash[23388]: audit 2024-02-13T14:55:10.477610+0000 mgr.y (mgr.14613) 455 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:12.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:12 smithi111 bash[23388]: cluster 2024-02-13T14:55:12.045338+0000 mon.a (mon.0) 2580 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:13.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:13 smithi062 bash[21479]: cluster 2024-02-13T14:55:11.995002+0000 mgr.y (mgr.14613) 456 : cluster 0 pgmap v690: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:55:13.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:13 smithi062 bash[28859]: cluster 2024-02-13T14:55:11.995002+0000 mgr.y (mgr.14613) 456 : cluster 0 pgmap v690: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:55:13.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:13 smithi111 bash[23388]: cluster 2024-02-13T14:55:11.995002+0000 mgr.y (mgr.14613) 456 : cluster 0 pgmap v690: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.5 KiB/s wr, 4 op/s 2024-02-13T14:55:15.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:15 smithi062 bash[21479]: cluster 2024-02-13T14:55:13.996178+0000 mgr.y (mgr.14613) 457 : cluster 0 pgmap v691: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-13T14:55:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:15 smithi062 bash[28859]: cluster 2024-02-13T14:55:13.996178+0000 mgr.y (mgr.14613) 457 : cluster 0 pgmap v691: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-13T14:55:15.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:15 smithi111 bash[23388]: cluster 2024-02-13T14:55:13.996178+0000 mgr.y (mgr.14613) 457 : cluster 0 pgmap v691: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2024-02-13T14:55:16.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:55:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:55:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:55:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:17 smithi062 bash[28859]: cluster 2024-02-13T14:55:15.999166+0000 mgr.y (mgr.14613) 458 : cluster 0 pgmap v692: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-13T14:55:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:17 smithi062 bash[21479]: cluster 2024-02-13T14:55:15.999166+0000 mgr.y (mgr.14613) 458 : cluster 0 pgmap v692: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-13T14:55:17.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:17 smithi111 bash[23388]: cluster 2024-02-13T14:55:15.999166+0000 mgr.y (mgr.14613) 458 : cluster 0 pgmap v692: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.4 KiB/s wr, 4 op/s 2024-02-13T14:55:18.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:18 smithi062 bash[21479]: cluster 2024-02-13T14:55:18.000089+0000 mgr.y (mgr.14613) 459 : cluster 0 pgmap v693: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:18.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:18 smithi062 bash[28859]: cluster 2024-02-13T14:55:18.000089+0000 mgr.y (mgr.14613) 459 : cluster 0 pgmap v693: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:18.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:18 smithi111 bash[23388]: cluster 2024-02-13T14:55:18.000089+0000 mgr.y (mgr.14613) 459 : cluster 0 pgmap v693: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:19.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:19 smithi062 bash[21479]: audit 2024-02-13T14:55:18.515899+0000 mon.b (mon.1) 218 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:19 smithi062 bash[28859]: audit 2024-02-13T14:55:18.515899+0000 mon.b (mon.1) 218 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:19 smithi111 bash[23388]: audit 2024-02-13T14:55:18.515899+0000 mon.b (mon.1) 218 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:20 smithi062 bash[21479]: cluster 2024-02-13T14:55:20.002697+0000 mgr.y (mgr.14613) 460 : cluster 0 pgmap v694: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:20 smithi062 bash[28859]: cluster 2024-02-13T14:55:20.002697+0000 mgr.y (mgr.14613) 460 : cluster 0 pgmap v694: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:20.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:55:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:55:20.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:20 smithi111 bash[23388]: cluster 2024-02-13T14:55:20.002697+0000 mgr.y (mgr.14613) 460 : cluster 0 pgmap v694: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:21.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:21 smithi062 bash[28859]: audit 2024-02-13T14:55:20.485637+0000 mgr.y (mgr.14613) 461 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:21 smithi062 bash[21479]: audit 2024-02-13T14:55:20.485637+0000 mgr.y (mgr.14613) 461 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:21.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:21 smithi111 bash[23388]: audit 2024-02-13T14:55:20.485637+0000 mgr.y (mgr.14613) 461 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:22 smithi062 bash[21479]: cluster 2024-02-13T14:55:22.004522+0000 mgr.y (mgr.14613) 462 : cluster 0 pgmap v695: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:22 smithi062 bash[28859]: cluster 2024-02-13T14:55:22.004522+0000 mgr.y (mgr.14613) 462 : cluster 0 pgmap v695: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:22.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:22 smithi111 bash[23388]: cluster 2024-02-13T14:55:22.004522+0000 mgr.y (mgr.14613) 462 : cluster 0 pgmap v695: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[21479]: cluster 2024-02-13T14:55:24.005441+0000 mgr.y (mgr.14613) 463 : cluster 0 pgmap v696: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[21479]: audit 2024-02-13T14:55:24.482312+0000 mon.c (mon.2) 743 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[21479]: audit 2024-02-13T14:55:24.483043+0000 mon.a (mon.0) 2581 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[21479]: audit 2024-02-13T14:55:24.484220+0000 mon.c (mon.2) 744 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-71"}]: dispatch 2024-02-13T14:55:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[21479]: audit 2024-02-13T14:55:24.484924+0000 mon.a (mon.0) 2582 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-71"}]: dispatch 2024-02-13T14:55:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[28859]: cluster 2024-02-13T14:55:24.005441+0000 mgr.y (mgr.14613) 463 : cluster 0 pgmap v696: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:25.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[28859]: audit 2024-02-13T14:55:24.482312+0000 mon.c (mon.2) 743 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:25.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[28859]: audit 2024-02-13T14:55:24.483043+0000 mon.a (mon.0) 2581 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:25.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[28859]: audit 2024-02-13T14:55:24.484220+0000 mon.c (mon.2) 744 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-71"}]: dispatch 2024-02-13T14:55:25.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:25 smithi062 bash[28859]: audit 2024-02-13T14:55:24.484924+0000 mon.a (mon.0) 2582 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-71"}]: dispatch 2024-02-13T14:55:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:25 smithi111 bash[23388]: cluster 2024-02-13T14:55:24.005441+0000 mgr.y (mgr.14613) 463 : cluster 0 pgmap v696: 324 pgs: 324 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:55:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:25 smithi111 bash[23388]: audit 2024-02-13T14:55:24.482312+0000 mon.c (mon.2) 743 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:25 smithi111 bash[23388]: audit 2024-02-13T14:55:24.483043+0000 mon.a (mon.0) 2581 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:25.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:25 smithi111 bash[23388]: audit 2024-02-13T14:55:24.484220+0000 mon.c (mon.2) 744 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-71"}]: dispatch 2024-02-13T14:55:25.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:25 smithi111 bash[23388]: audit 2024-02-13T14:55:24.484924+0000 mon.a (mon.0) 2582 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-71"}]: dispatch 2024-02-13T14:55:26.541 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:55:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:55:26.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[21479]: cluster 2024-02-13T14:55:25.072073+0000 mon.a (mon.0) 2583 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-02-13T14:55:26.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[21479]: cluster 2024-02-13T14:55:26.006314+0000 mgr.y (mgr.14613) 464 : cluster 0 pgmap v698: 292 pgs: 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:26.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[21479]: cluster 2024-02-13T14:55:26.075749+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-02-13T14:55:26.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[21479]: audit 2024-02-13T14:55:26.081352+0000 mon.c (mon.2) 745 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:26.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[21479]: audit 2024-02-13T14:55:26.086758+0000 mon.a (mon.0) 2585 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:26.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[28859]: cluster 2024-02-13T14:55:25.072073+0000 mon.a (mon.0) 2583 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-02-13T14:55:26.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[28859]: cluster 2024-02-13T14:55:26.006314+0000 mgr.y (mgr.14613) 464 : cluster 0 pgmap v698: 292 pgs: 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:26.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[28859]: cluster 2024-02-13T14:55:26.075749+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-02-13T14:55:26.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[28859]: audit 2024-02-13T14:55:26.081352+0000 mon.c (mon.2) 745 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:26.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:26 smithi062 bash[28859]: audit 2024-02-13T14:55:26.086758+0000 mon.a (mon.0) 2585 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:26 smithi111 bash[23388]: cluster 2024-02-13T14:55:25.072073+0000 mon.a (mon.0) 2583 : cluster 0 osdmap e437: 8 total, 8 up, 8 in 2024-02-13T14:55:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:26 smithi111 bash[23388]: cluster 2024-02-13T14:55:26.006314+0000 mgr.y (mgr.14613) 464 : cluster 0 pgmap v698: 292 pgs: 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:26 smithi111 bash[23388]: cluster 2024-02-13T14:55:26.075749+0000 mon.a (mon.0) 2584 : cluster 0 osdmap e438: 8 total, 8 up, 8 in 2024-02-13T14:55:26.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:26 smithi111 bash[23388]: audit 2024-02-13T14:55:26.081352+0000 mon.c (mon.2) 745 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:26.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:26 smithi111 bash[23388]: audit 2024-02-13T14:55:26.086758+0000 mon.a (mon.0) 2585 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:28.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:28 smithi111 bash[23388]: audit 2024-02-13T14:55:27.070803+0000 mon.a (mon.0) 2586 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:28.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:28 smithi111 bash[23388]: cluster 2024-02-13T14:55:27.080483+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-02-13T14:55:28.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:28 smithi111 bash[23388]: audit 2024-02-13T14:55:27.085227+0000 mon.c (mon.2) 746 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:28 smithi062 bash[21479]: audit 2024-02-13T14:55:27.070803+0000 mon.a (mon.0) 2586 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:28 smithi062 bash[21479]: cluster 2024-02-13T14:55:27.080483+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-02-13T14:55:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:28 smithi062 bash[21479]: audit 2024-02-13T14:55:27.085227+0000 mon.c (mon.2) 746 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:28.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:28 smithi062 bash[28859]: audit 2024-02-13T14:55:27.070803+0000 mon.a (mon.0) 2586 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-73","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:28.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:28 smithi062 bash[28859]: cluster 2024-02-13T14:55:27.080483+0000 mon.a (mon.0) 2587 : cluster 0 osdmap e439: 8 total, 8 up, 8 in 2024-02-13T14:55:28.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:28 smithi062 bash[28859]: audit 2024-02-13T14:55:27.085227+0000 mon.c (mon.2) 746 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:29.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:29 smithi062 bash[28859]: cluster 2024-02-13T14:55:28.007164+0000 mgr.y (mgr.14613) 465 : cluster 0 pgmap v701: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:29.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:29 smithi062 bash[28859]: cluster 2024-02-13T14:55:28.097328+0000 mon.a (mon.0) 2588 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-02-13T14:55:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:29 smithi062 bash[21479]: cluster 2024-02-13T14:55:28.007164+0000 mgr.y (mgr.14613) 465 : cluster 0 pgmap v701: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:29 smithi062 bash[21479]: cluster 2024-02-13T14:55:28.097328+0000 mon.a (mon.0) 2588 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-02-13T14:55:29.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:29 smithi111 bash[23388]: cluster 2024-02-13T14:55:28.007164+0000 mgr.y (mgr.14613) 465 : cluster 0 pgmap v701: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 619 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:29.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:29 smithi111 bash[23388]: cluster 2024-02-13T14:55:28.097328+0000 mon.a (mon.0) 2588 : cluster 0 osdmap e440: 8 total, 8 up, 8 in 2024-02-13T14:55:30.497 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:30 smithi111 bash[23388]: cluster 2024-02-13T14:55:29.094497+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-02-13T14:55:30.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:30 smithi062 bash[21479]: cluster 2024-02-13T14:55:29.094497+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-02-13T14:55:30.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:30 smithi062 bash[28859]: cluster 2024-02-13T14:55:29.094497+0000 mon.a (mon.0) 2589 : cluster 0 osdmap e441: 8 total, 8 up, 8 in 2024-02-13T14:55:30.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:55:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:55:31.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:31 smithi062 bash[21479]: cluster 2024-02-13T14:55:30.010204+0000 mgr.y (mgr.14613) 466 : cluster 0 pgmap v704: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-13T14:55:31.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:31 smithi062 bash[28859]: cluster 2024-02-13T14:55:30.010204+0000 mgr.y (mgr.14613) 466 : cluster 0 pgmap v704: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-13T14:55:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:31 smithi111 bash[23388]: cluster 2024-02-13T14:55:30.010204+0000 mgr.y (mgr.14613) 466 : cluster 0 pgmap v704: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-02-13T14:55:32.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:30.497052+0000 mgr.y (mgr.14613) 467 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:31.291810+0000 mon.b (mon.1) 219 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:31.870647+0000 mon.a (mon.0) 2590 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:31.880744+0000 mon.a (mon.0) 2591 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.026005+0000 mon.a (mon.0) 2592 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.026410+0000 mon.b (mon.1) 220 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.029044+0000 mon.a (mon.0) 2593 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.029639+0000 mon.b (mon.1) 221 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.032218+0000 mon.a (mon.0) 2594 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.032854+0000 mon.b (mon.1) 222 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.035432+0000 mon.a (mon.0) 2595 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.036002+0000 mon.b (mon.1) 223 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[21479]: audit 2024-02-13T14:55:32.047921+0000 mon.a (mon.0) 2596 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:30.497052+0000 mgr.y (mgr.14613) 467 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:31.291810+0000 mon.b (mon.1) 219 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:31.870647+0000 mon.a (mon.0) 2590 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:31.880744+0000 mon.a (mon.0) 2591 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.026005+0000 mon.a (mon.0) 2592 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.026410+0000 mon.b (mon.1) 220 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.029044+0000 mon.a (mon.0) 2593 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.029639+0000 mon.b (mon.1) 221 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.032218+0000 mon.a (mon.0) 2594 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.032854+0000 mon.b (mon.1) 222 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.035432+0000 mon.a (mon.0) 2595 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.036002+0000 mon.b (mon.1) 223 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.565 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:32 smithi062 bash[28859]: audit 2024-02-13T14:55:32.047921+0000 mon.a (mon.0) 2596 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:30.497052+0000 mgr.y (mgr.14613) 467 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:31.291810+0000 mon.b (mon.1) 219 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:31.870647+0000 mon.a (mon.0) 2590 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:31.880744+0000 mon.a (mon.0) 2591 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.026005+0000 mon.a (mon.0) 2592 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.026410+0000 mon.b (mon.1) 220 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.029044+0000 mon.a (mon.0) 2593 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.029639+0000 mon.b (mon.1) 221 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.032218+0000 mon.a (mon.0) 2594 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.032854+0000 mon.b (mon.1) 222 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.035432+0000 mon.a (mon.0) 2595 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.036002+0000 mon.b (mon.1) 223 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:32 smithi111 bash[23388]: audit 2024-02-13T14:55:32.047921+0000 mon.a (mon.0) 2596 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:33.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: cluster 2024-02-13T14:55:32.011517+0000 mgr.y (mgr.14613) 468 : cluster 0 pgmap v705: 324 pgs: 324 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-13T14:55:33.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: cephadm 2024-02-13T14:55:32.037354+0000 mgr.y (mgr.14613) 469 : cephadm 1 Adjusting osd_memory_target on smithi062 to 3292M 2024-02-13T14:55:33.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.643128+0000 mon.a (mon.0) 2597 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.643507+0000 mon.b (mon.1) 224 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.646436+0000 mon.a (mon.0) 2598 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.647084+0000 mon.b (mon.1) 225 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.649580+0000 mon.a (mon.0) 2599 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.650216+0000 mon.b (mon.1) 226 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.652459+0000 mon.a (mon.0) 2600 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.653186+0000 mon.b (mon.1) 227 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.662072+0000 mon.a (mon.0) 2601 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.668196+0000 mon.b (mon.1) 228 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.670070+0000 mon.b (mon.1) 229 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[28859]: audit 2024-02-13T14:55:32.683695+0000 mon.a (mon.0) 2602 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:33.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: cluster 2024-02-13T14:55:32.011517+0000 mgr.y (mgr.14613) 468 : cluster 0 pgmap v705: 324 pgs: 324 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: cephadm 2024-02-13T14:55:32.037354+0000 mgr.y (mgr.14613) 469 : cephadm 1 Adjusting osd_memory_target on smithi062 to 3292M 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.643128+0000 mon.a (mon.0) 2597 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.643507+0000 mon.b (mon.1) 224 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.646436+0000 mon.a (mon.0) 2598 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.647084+0000 mon.b (mon.1) 225 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.649580+0000 mon.a (mon.0) 2599 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.650216+0000 mon.b (mon.1) 226 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.652459+0000 mon.a (mon.0) 2600 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.653186+0000 mon.b (mon.1) 227 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.662072+0000 mon.a (mon.0) 2601 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.668196+0000 mon.b (mon.1) 228 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.670070+0000 mon.b (mon.1) 229 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:55:33.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:33 smithi062 bash[21479]: audit 2024-02-13T14:55:32.683695+0000 mon.a (mon.0) 2602 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: cluster 2024-02-13T14:55:32.011517+0000 mgr.y (mgr.14613) 468 : cluster 0 pgmap v705: 324 pgs: 324 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1.2 KiB/s wr, 4 op/s 2024-02-13T14:55:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: cephadm 2024-02-13T14:55:32.037354+0000 mgr.y (mgr.14613) 469 : cephadm 1 Adjusting osd_memory_target on smithi062 to 3292M 2024-02-13T14:55:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.643128+0000 mon.a (mon.0) 2597 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.643507+0000 mon.b (mon.1) 224 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.646436+0000 mon.a (mon.0) 2598 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.647084+0000 mon.b (mon.1) 225 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.649580+0000 mon.a (mon.0) 2599 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.650216+0000 mon.b (mon.1) 226 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.652459+0000 mon.a (mon.0) 2600 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.653186+0000 mon.b (mon.1) 227 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-02-13T14:55:33.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.662072+0000 mon.a (mon.0) 2601 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:33.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.668196+0000 mon.b (mon.1) 228 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:55:33.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.670070+0000 mon.b (mon.1) 229 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:55:33.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:33 smithi111 bash[23388]: audit 2024-02-13T14:55:32.683695+0000 mon.a (mon.0) 2602 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:55:34.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:34 smithi062 bash[28859]: cephadm 2024-02-13T14:55:32.654209+0000 mgr.y (mgr.14613) 470 : cephadm 1 Adjusting osd_memory_target on smithi111 to 3292M 2024-02-13T14:55:34.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:34 smithi062 bash[28859]: audit 2024-02-13T14:55:33.553116+0000 mon.b (mon.1) 230 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:34.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:34 smithi062 bash[21479]: cephadm 2024-02-13T14:55:32.654209+0000 mgr.y (mgr.14613) 470 : cephadm 1 Adjusting osd_memory_target on smithi111 to 3292M 2024-02-13T14:55:34.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:34 smithi062 bash[21479]: audit 2024-02-13T14:55:33.553116+0000 mon.b (mon.1) 230 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:34.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:34 smithi111 bash[23388]: cephadm 2024-02-13T14:55:32.654209+0000 mgr.y (mgr.14613) 470 : cephadm 1 Adjusting osd_memory_target on smithi111 to 3292M 2024-02-13T14:55:34.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:34 smithi111 bash[23388]: audit 2024-02-13T14:55:33.553116+0000 mon.b (mon.1) 230 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:35.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:35 smithi062 bash[28859]: cluster 2024-02-13T14:55:34.012416+0000 mgr.y (mgr.14613) 471 : cluster 0 pgmap v706: 324 pgs: 324 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-02-13T14:55:35.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:35 smithi062 bash[21479]: cluster 2024-02-13T14:55:34.012416+0000 mgr.y (mgr.14613) 471 : cluster 0 pgmap v706: 324 pgs: 324 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-02-13T14:55:35.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:35 smithi111 bash[23388]: cluster 2024-02-13T14:55:34.012416+0000 mgr.y (mgr.14613) 471 : cluster 0 pgmap v706: 324 pgs: 324 active+clean; 8.4 MiB data, 623 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.0 KiB/s wr, 3 op/s 2024-02-13T14:55:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:55:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:55:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:55:37.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:37 smithi062 bash[28859]: cluster 2024-02-13T14:55:36.015473+0000 mgr.y (mgr.14613) 472 : cluster 0 pgmap v707: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-13T14:55:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:37 smithi062 bash[21479]: cluster 2024-02-13T14:55:36.015473+0000 mgr.y (mgr.14613) 472 : cluster 0 pgmap v707: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-13T14:55:37.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:37 smithi111 bash[23388]: cluster 2024-02-13T14:55:36.015473+0000 mgr.y (mgr.14613) 472 : cluster 0 pgmap v707: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 895 B/s wr, 3 op/s 2024-02-13T14:55:39.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:39 smithi062 bash[28859]: cluster 2024-02-13T14:55:38.016629+0000 mgr.y (mgr.14613) 473 : cluster 0 pgmap v708: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 721 B/s wr, 3 op/s 2024-02-13T14:55:39.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:39 smithi062 bash[21479]: cluster 2024-02-13T14:55:38.016629+0000 mgr.y (mgr.14613) 473 : cluster 0 pgmap v708: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 721 B/s wr, 3 op/s 2024-02-13T14:55:39.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:39 smithi111 bash[23388]: cluster 2024-02-13T14:55:38.016629+0000 mgr.y (mgr.14613) 473 : cluster 0 pgmap v708: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 721 B/s wr, 3 op/s 2024-02-13T14:55:40.509 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:40 smithi111 bash[23388]: audit 2024-02-13T14:55:39.207307+0000 mon.c (mon.2) 747 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:40.509 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:40 smithi111 bash[23388]: audit 2024-02-13T14:55:39.207981+0000 mon.a (mon.0) 2603 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:40.509 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:40 smithi111 bash[23388]: audit 2024-02-13T14:55:39.209077+0000 mon.c (mon.2) 748 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-73"}]: dispatch 2024-02-13T14:55:40.509 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:40 smithi111 bash[23388]: audit 2024-02-13T14:55:39.209642+0000 mon.a (mon.0) 2604 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-73"}]: dispatch 2024-02-13T14:55:40.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:40 smithi062 bash[21479]: audit 2024-02-13T14:55:39.207307+0000 mon.c (mon.2) 747 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:40.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:40 smithi062 bash[21479]: audit 2024-02-13T14:55:39.207981+0000 mon.a (mon.0) 2603 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:40.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:40 smithi062 bash[21479]: audit 2024-02-13T14:55:39.209077+0000 mon.c (mon.2) 748 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-73"}]: dispatch 2024-02-13T14:55:40.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:40 smithi062 bash[21479]: audit 2024-02-13T14:55:39.209642+0000 mon.a (mon.0) 2604 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-73"}]: dispatch 2024-02-13T14:55:40.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:40 smithi062 bash[28859]: audit 2024-02-13T14:55:39.207307+0000 mon.c (mon.2) 747 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:40.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:40 smithi062 bash[28859]: audit 2024-02-13T14:55:39.207981+0000 mon.a (mon.0) 2603 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:40.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:40 smithi062 bash[28859]: audit 2024-02-13T14:55:39.209077+0000 mon.c (mon.2) 748 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-73"}]: dispatch 2024-02-13T14:55:40.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:40 smithi062 bash[28859]: audit 2024-02-13T14:55:39.209642+0000 mon.a (mon.0) 2604 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-73"}]: dispatch 2024-02-13T14:55:40.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:55:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:55:41.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:41 smithi062 bash[28859]: cluster 2024-02-13T14:55:40.019266+0000 mgr.y (mgr.14613) 474 : cluster 0 pgmap v709: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 655 B/s wr, 3 op/s 2024-02-13T14:55:41.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:41 smithi062 bash[28859]: cluster 2024-02-13T14:55:40.160104+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-02-13T14:55:41.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:41 smithi062 bash[21479]: cluster 2024-02-13T14:55:40.019266+0000 mgr.y (mgr.14613) 474 : cluster 0 pgmap v709: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 655 B/s wr, 3 op/s 2024-02-13T14:55:41.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:41 smithi062 bash[21479]: cluster 2024-02-13T14:55:40.160104+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-02-13T14:55:41.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:41 smithi111 bash[23388]: cluster 2024-02-13T14:55:40.019266+0000 mgr.y (mgr.14613) 474 : cluster 0 pgmap v709: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 655 B/s wr, 3 op/s 2024-02-13T14:55:41.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:41 smithi111 bash[23388]: cluster 2024-02-13T14:55:40.160104+0000 mon.a (mon.0) 2605 : cluster 0 osdmap e442: 8 total, 8 up, 8 in 2024-02-13T14:55:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:42 smithi062 bash[28859]: audit 2024-02-13T14:55:40.508364+0000 mgr.y (mgr.14613) 475 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:42 smithi062 bash[28859]: cluster 2024-02-13T14:55:41.169581+0000 mon.a (mon.0) 2606 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-02-13T14:55:42.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:42 smithi062 bash[28859]: audit 2024-02-13T14:55:41.184353+0000 mon.c (mon.2) 749 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:42.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:42 smithi062 bash[28859]: audit 2024-02-13T14:55:41.185579+0000 mon.a (mon.0) 2607 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:42 smithi062 bash[21479]: audit 2024-02-13T14:55:40.508364+0000 mgr.y (mgr.14613) 475 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:42 smithi062 bash[21479]: cluster 2024-02-13T14:55:41.169581+0000 mon.a (mon.0) 2606 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-02-13T14:55:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:42 smithi062 bash[21479]: audit 2024-02-13T14:55:41.184353+0000 mon.c (mon.2) 749 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:42 smithi062 bash[21479]: audit 2024-02-13T14:55:41.185579+0000 mon.a (mon.0) 2607 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:42.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:42 smithi111 bash[23388]: audit 2024-02-13T14:55:40.508364+0000 mgr.y (mgr.14613) 475 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:42 smithi111 bash[23388]: cluster 2024-02-13T14:55:41.169581+0000 mon.a (mon.0) 2606 : cluster 0 osdmap e443: 8 total, 8 up, 8 in 2024-02-13T14:55:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:42 smithi111 bash[23388]: audit 2024-02-13T14:55:41.184353+0000 mon.c (mon.2) 749 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:42 smithi111 bash[23388]: audit 2024-02-13T14:55:41.185579+0000 mon.a (mon.0) 2607 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[21479]: cluster 2024-02-13T14:55:42.020184+0000 mgr.y (mgr.14613) 476 : cluster 0 pgmap v712: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:55:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[21479]: cluster 2024-02-13T14:55:42.162944+0000 mon.a (mon.0) 2608 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[21479]: audit 2024-02-13T14:55:42.172599+0000 mon.a (mon.0) 2609 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[21479]: cluster 2024-02-13T14:55:42.182642+0000 mon.a (mon.0) 2610 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-02-13T14:55:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[21479]: audit 2024-02-13T14:55:42.191132+0000 mon.c (mon.2) 750 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:43.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[28859]: cluster 2024-02-13T14:55:42.020184+0000 mgr.y (mgr.14613) 476 : cluster 0 pgmap v712: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:55:43.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[28859]: cluster 2024-02-13T14:55:42.162944+0000 mon.a (mon.0) 2608 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:43.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[28859]: audit 2024-02-13T14:55:42.172599+0000 mon.a (mon.0) 2609 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:43.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[28859]: cluster 2024-02-13T14:55:42.182642+0000 mon.a (mon.0) 2610 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-02-13T14:55:43.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:43 smithi062 bash[28859]: audit 2024-02-13T14:55:42.191132+0000 mon.c (mon.2) 750 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:43.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:43 smithi111 bash[23388]: cluster 2024-02-13T14:55:42.020184+0000 mgr.y (mgr.14613) 476 : cluster 0 pgmap v712: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:55:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:43 smithi111 bash[23388]: cluster 2024-02-13T14:55:42.162944+0000 mon.a (mon.0) 2608 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:43 smithi111 bash[23388]: audit 2024-02-13T14:55:42.172599+0000 mon.a (mon.0) 2609 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-75","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:43 smithi111 bash[23388]: cluster 2024-02-13T14:55:42.182642+0000 mon.a (mon.0) 2610 : cluster 0 osdmap e444: 8 total, 8 up, 8 in 2024-02-13T14:55:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:43 smithi111 bash[23388]: audit 2024-02-13T14:55:42.191132+0000 mon.c (mon.2) 750 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:44 smithi062 bash[28859]: cluster 2024-02-13T14:55:43.190034+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-02-13T14:55:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:44 smithi062 bash[21479]: cluster 2024-02-13T14:55:43.190034+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-02-13T14:55:44.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:44 smithi111 bash[23388]: cluster 2024-02-13T14:55:43.190034+0000 mon.a (mon.0) 2611 : cluster 0 osdmap e445: 8 total, 8 up, 8 in 2024-02-13T14:55:45.093 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 14:55:44 smithi111 bash[50603]: logger=cleanup t=2024-02-13T14:55:44.788211522Z level=info msg="Completed cleanup jobs" duration=432.344507ms 2024-02-13T14:55:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[28859]: cluster 2024-02-13T14:55:44.021082+0000 mgr.y (mgr.14613) 477 : cluster 0 pgmap v715: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[28859]: cluster 2024-02-13T14:55:44.201804+0000 mon.a (mon.0) 2612 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-02-13T14:55:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[28859]: audit 2024-02-13T14:55:44.326546+0000 mon.c (mon.2) 751 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[28859]: audit 2024-02-13T14:55:44.327449+0000 mon.a (mon.0) 2613 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[28859]: audit 2024-02-13T14:55:44.328641+0000 mon.c (mon.2) 752 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-75"}]: dispatch 2024-02-13T14:55:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[28859]: audit 2024-02-13T14:55:44.329265+0000 mon.a (mon.0) 2614 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-75"}]: dispatch 2024-02-13T14:55:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[21479]: cluster 2024-02-13T14:55:44.021082+0000 mgr.y (mgr.14613) 477 : cluster 0 pgmap v715: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[21479]: cluster 2024-02-13T14:55:44.201804+0000 mon.a (mon.0) 2612 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-02-13T14:55:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[21479]: audit 2024-02-13T14:55:44.326546+0000 mon.c (mon.2) 751 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[21479]: audit 2024-02-13T14:55:44.327449+0000 mon.a (mon.0) 2613 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[21479]: audit 2024-02-13T14:55:44.328641+0000 mon.c (mon.2) 752 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-75"}]: dispatch 2024-02-13T14:55:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:45 smithi062 bash[21479]: audit 2024-02-13T14:55:44.329265+0000 mon.a (mon.0) 2614 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-75"}]: dispatch 2024-02-13T14:55:45.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:45 smithi111 bash[23388]: cluster 2024-02-13T14:55:44.021082+0000 mgr.y (mgr.14613) 477 : cluster 0 pgmap v715: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:45 smithi111 bash[23388]: cluster 2024-02-13T14:55:44.201804+0000 mon.a (mon.0) 2612 : cluster 0 osdmap e446: 8 total, 8 up, 8 in 2024-02-13T14:55:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:45 smithi111 bash[23388]: audit 2024-02-13T14:55:44.326546+0000 mon.c (mon.2) 751 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:45 smithi111 bash[23388]: audit 2024-02-13T14:55:44.327449+0000 mon.a (mon.0) 2613 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:45 smithi111 bash[23388]: audit 2024-02-13T14:55:44.328641+0000 mon.c (mon.2) 752 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-75"}]: dispatch 2024-02-13T14:55:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:45 smithi111 bash[23388]: audit 2024-02-13T14:55:44.329265+0000 mon.a (mon.0) 2614 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-75"}]: dispatch 2024-02-13T14:55:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:55:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:55:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:55:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:46 smithi062 bash[21479]: cluster 2024-02-13T14:55:45.200694+0000 mon.a (mon.0) 2615 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-02-13T14:55:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:46 smithi062 bash[28859]: cluster 2024-02-13T14:55:45.200694+0000 mon.a (mon.0) 2615 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-02-13T14:55:46.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:46 smithi111 bash[23388]: cluster 2024-02-13T14:55:45.200694+0000 mon.a (mon.0) 2615 : cluster 0 osdmap e447: 8 total, 8 up, 8 in 2024-02-13T14:55:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:47 smithi062 bash[21479]: cluster 2024-02-13T14:55:46.021985+0000 mgr.y (mgr.14613) 478 : cluster 0 pgmap v718: 292 pgs: 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:55:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:47 smithi062 bash[21479]: cluster 2024-02-13T14:55:46.235855+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-02-13T14:55:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:47 smithi062 bash[21479]: audit 2024-02-13T14:55:46.241530+0000 mon.c (mon.2) 753 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:47 smithi062 bash[21479]: audit 2024-02-13T14:55:46.243308+0000 mon.a (mon.0) 2617 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:47.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:47 smithi062 bash[28859]: cluster 2024-02-13T14:55:46.021985+0000 mgr.y (mgr.14613) 478 : cluster 0 pgmap v718: 292 pgs: 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:55:47.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:47 smithi062 bash[28859]: cluster 2024-02-13T14:55:46.235855+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-02-13T14:55:47.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:47 smithi062 bash[28859]: audit 2024-02-13T14:55:46.241530+0000 mon.c (mon.2) 753 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:47.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:47 smithi062 bash[28859]: audit 2024-02-13T14:55:46.243308+0000 mon.a (mon.0) 2617 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:47 smithi111 bash[23388]: cluster 2024-02-13T14:55:46.021985+0000 mgr.y (mgr.14613) 478 : cluster 0 pgmap v718: 292 pgs: 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:55:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:47 smithi111 bash[23388]: cluster 2024-02-13T14:55:46.235855+0000 mon.a (mon.0) 2616 : cluster 0 osdmap e448: 8 total, 8 up, 8 in 2024-02-13T14:55:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:47 smithi111 bash[23388]: audit 2024-02-13T14:55:46.241530+0000 mon.c (mon.2) 753 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:47 smithi111 bash[23388]: audit 2024-02-13T14:55:46.243308+0000 mon.a (mon.0) 2617 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:48 smithi062 bash[28859]: audit 2024-02-13T14:55:47.238338+0000 mon.a (mon.0) 2618 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:48 smithi062 bash[28859]: cluster 2024-02-13T14:55:47.246251+0000 mon.a (mon.0) 2619 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-02-13T14:55:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:48 smithi062 bash[28859]: audit 2024-02-13T14:55:47.249722+0000 mon.c (mon.2) 754 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:48 smithi062 bash[21479]: audit 2024-02-13T14:55:47.238338+0000 mon.a (mon.0) 2618 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:48 smithi062 bash[21479]: cluster 2024-02-13T14:55:47.246251+0000 mon.a (mon.0) 2619 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-02-13T14:55:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:48 smithi062 bash[21479]: audit 2024-02-13T14:55:47.249722+0000 mon.c (mon.2) 754 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:48.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:48 smithi111 bash[23388]: audit 2024-02-13T14:55:47.238338+0000 mon.a (mon.0) 2618 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-77","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:48 smithi111 bash[23388]: cluster 2024-02-13T14:55:47.246251+0000 mon.a (mon.0) 2619 : cluster 0 osdmap e449: 8 total, 8 up, 8 in 2024-02-13T14:55:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:48 smithi111 bash[23388]: audit 2024-02-13T14:55:47.249722+0000 mon.c (mon.2) 754 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:49.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[28859]: cluster 2024-02-13T14:55:48.023045+0000 mgr.y (mgr.14613) 479 : cluster 0 pgmap v721: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:55:49.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[28859]: cluster 2024-02-13T14:55:48.260630+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-02-13T14:55:49.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[28859]: audit 2024-02-13T14:55:48.351571+0000 mon.c (mon.2) 755 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:49.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[28859]: audit 2024-02-13T14:55:48.352351+0000 mon.a (mon.0) 2621 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[28859]: audit 2024-02-13T14:55:48.353380+0000 mon.c (mon.2) 756 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-77"}]: dispatch 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[28859]: audit 2024-02-13T14:55:48.354057+0000 mon.a (mon.0) 2622 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-77"}]: dispatch 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[28859]: audit 2024-02-13T14:55:48.588824+0000 mon.b (mon.1) 231 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[21479]: cluster 2024-02-13T14:55:48.023045+0000 mgr.y (mgr.14613) 479 : cluster 0 pgmap v721: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[21479]: cluster 2024-02-13T14:55:48.260630+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[21479]: audit 2024-02-13T14:55:48.351571+0000 mon.c (mon.2) 755 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[21479]: audit 2024-02-13T14:55:48.352351+0000 mon.a (mon.0) 2621 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[21479]: audit 2024-02-13T14:55:48.353380+0000 mon.c (mon.2) 756 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-77"}]: dispatch 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[21479]: audit 2024-02-13T14:55:48.354057+0000 mon.a (mon.0) 2622 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-77"}]: dispatch 2024-02-13T14:55:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:49 smithi062 bash[21479]: audit 2024-02-13T14:55:48.588824+0000 mon.b (mon.1) 231 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:49.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:49 smithi111 bash[23388]: cluster 2024-02-13T14:55:48.023045+0000 mgr.y (mgr.14613) 479 : cluster 0 pgmap v721: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:55:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:49 smithi111 bash[23388]: cluster 2024-02-13T14:55:48.260630+0000 mon.a (mon.0) 2620 : cluster 0 osdmap e450: 8 total, 8 up, 8 in 2024-02-13T14:55:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:49 smithi111 bash[23388]: audit 2024-02-13T14:55:48.351571+0000 mon.c (mon.2) 755 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:49 smithi111 bash[23388]: audit 2024-02-13T14:55:48.352351+0000 mon.a (mon.0) 2621 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:55:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:49 smithi111 bash[23388]: audit 2024-02-13T14:55:48.353380+0000 mon.c (mon.2) 756 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-77"}]: dispatch 2024-02-13T14:55:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:49 smithi111 bash[23388]: audit 2024-02-13T14:55:48.354057+0000 mon.a (mon.0) 2622 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-77"}]: dispatch 2024-02-13T14:55:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:49 smithi111 bash[23388]: audit 2024-02-13T14:55:48.588824+0000 mon.b (mon.1) 231 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:55:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:50 smithi062 bash[28859]: cluster 2024-02-13T14:55:49.263595+0000 mon.a (mon.0) 2623 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-02-13T14:55:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:50 smithi062 bash[21479]: cluster 2024-02-13T14:55:49.263595+0000 mon.a (mon.0) 2623 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-02-13T14:55:50.593 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:55:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:55:50.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:50 smithi111 bash[23388]: cluster 2024-02-13T14:55:49.263595+0000 mon.a (mon.0) 2623 : cluster 0 osdmap e451: 8 total, 8 up, 8 in 2024-02-13T14:55:51.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:51 smithi111 bash[23388]: cluster 2024-02-13T14:55:50.025479+0000 mgr.y (mgr.14613) 480 : cluster 0 pgmap v724: 292 pgs: 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:55:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:51 smithi111 bash[23388]: cluster 2024-02-13T14:55:50.291592+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-02-13T14:55:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:51 smithi111 bash[23388]: audit 2024-02-13T14:55:50.308240+0000 mon.c (mon.2) 757 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:51 smithi111 bash[23388]: audit 2024-02-13T14:55:50.310056+0000 mon.a (mon.0) 2625 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:51 smithi062 bash[28859]: cluster 2024-02-13T14:55:50.025479+0000 mgr.y (mgr.14613) 480 : cluster 0 pgmap v724: 292 pgs: 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:55:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:51 smithi062 bash[28859]: cluster 2024-02-13T14:55:50.291592+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-02-13T14:55:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:51 smithi062 bash[28859]: audit 2024-02-13T14:55:50.308240+0000 mon.c (mon.2) 757 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:51 smithi062 bash[28859]: audit 2024-02-13T14:55:50.310056+0000 mon.a (mon.0) 2625 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:51 smithi062 bash[21479]: cluster 2024-02-13T14:55:50.025479+0000 mgr.y (mgr.14613) 480 : cluster 0 pgmap v724: 292 pgs: 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:55:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:51 smithi062 bash[21479]: cluster 2024-02-13T14:55:50.291592+0000 mon.a (mon.0) 2624 : cluster 0 osdmap e452: 8 total, 8 up, 8 in 2024-02-13T14:55:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:51 smithi062 bash[21479]: audit 2024-02-13T14:55:50.308240+0000 mon.c (mon.2) 757 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:51 smithi062 bash[21479]: audit 2024-02-13T14:55:50.310056+0000 mon.a (mon.0) 2625 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:55:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[21479]: audit 2024-02-13T14:55:50.514847+0000 mgr.y (mgr.14613) 481 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[21479]: audit 2024-02-13T14:55:51.285138+0000 mon.a (mon.0) 2626 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[21479]: cluster 2024-02-13T14:55:51.292210+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-02-13T14:55:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[21479]: audit 2024-02-13T14:55:51.347431+0000 mon.c (mon.2) 758 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[21479]: cluster 2024-02-13T14:55:52.058061+0000 mon.a (mon.0) 2628 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[28859]: audit 2024-02-13T14:55:50.514847+0000 mgr.y (mgr.14613) 481 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[28859]: audit 2024-02-13T14:55:51.285138+0000 mon.a (mon.0) 2626 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[28859]: cluster 2024-02-13T14:55:51.292210+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-02-13T14:55:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[28859]: audit 2024-02-13T14:55:51.347431+0000 mon.c (mon.2) 758 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:52 smithi062 bash[28859]: cluster 2024-02-13T14:55:52.058061+0000 mon.a (mon.0) 2628 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:52 smithi111 bash[23388]: audit 2024-02-13T14:55:50.514847+0000 mgr.y (mgr.14613) 481 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:55:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:52 smithi111 bash[23388]: audit 2024-02-13T14:55:51.285138+0000 mon.a (mon.0) 2626 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-79","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:55:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:52 smithi111 bash[23388]: cluster 2024-02-13T14:55:51.292210+0000 mon.a (mon.0) 2627 : cluster 0 osdmap e453: 8 total, 8 up, 8 in 2024-02-13T14:55:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:52 smithi111 bash[23388]: audit 2024-02-13T14:55:51.347431+0000 mon.c (mon.2) 758 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:55:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:52 smithi111 bash[23388]: cluster 2024-02-13T14:55:52.058061+0000 mon.a (mon.0) 2628 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:55:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:53 smithi111 bash[23388]: cluster 2024-02-13T14:55:52.026415+0000 mgr.y (mgr.14613) 482 : cluster 0 pgmap v727: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:55:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:53 smithi111 bash[23388]: cluster 2024-02-13T14:55:52.319227+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-02-13T14:55:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:53 smithi062 bash[28859]: cluster 2024-02-13T14:55:52.026415+0000 mgr.y (mgr.14613) 482 : cluster 0 pgmap v727: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:55:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:53 smithi062 bash[28859]: cluster 2024-02-13T14:55:52.319227+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-02-13T14:55:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:53 smithi062 bash[21479]: cluster 2024-02-13T14:55:52.026415+0000 mgr.y (mgr.14613) 482 : cluster 0 pgmap v727: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:55:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:53 smithi062 bash[21479]: cluster 2024-02-13T14:55:52.319227+0000 mon.a (mon.0) 2629 : cluster 0 osdmap e454: 8 total, 8 up, 8 in 2024-02-13T14:55:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:54 smithi111 bash[23388]: cluster 2024-02-13T14:55:53.321977+0000 mon.a (mon.0) 2630 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-02-13T14:55:54.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:54 smithi111 bash[23388]: audit 2024-02-13T14:55:53.371622+0000 mon.c (mon.2) 759 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "285.19"}]: dispatch 2024-02-13T14:55:54.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:54 smithi111 bash[23388]: audit 2024-02-13T14:55:53.372038+0000 mgr.y (mgr.14613) 483 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "285.19"}]: dispatch 2024-02-13T14:55:54.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:54 smithi111 bash[23388]: cluster 2024-02-13T14:55:53.695673+0000 osd.5 (osd.5) 7 : cluster 0 285.19 deep-scrub starts 2024-02-13T14:55:54.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:54 smithi111 bash[23388]: cluster 2024-02-13T14:55:53.700933+0000 osd.5 (osd.5) 8 : cluster 0 285.19 deep-scrub ok 2024-02-13T14:55:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[21479]: cluster 2024-02-13T14:55:53.321977+0000 mon.a (mon.0) 2630 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-02-13T14:55:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[21479]: audit 2024-02-13T14:55:53.371622+0000 mon.c (mon.2) 759 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "285.19"}]: dispatch 2024-02-13T14:55:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[21479]: audit 2024-02-13T14:55:53.372038+0000 mgr.y (mgr.14613) 483 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "285.19"}]: dispatch 2024-02-13T14:55:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[21479]: cluster 2024-02-13T14:55:53.695673+0000 osd.5 (osd.5) 7 : cluster 0 285.19 deep-scrub starts 2024-02-13T14:55:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[21479]: cluster 2024-02-13T14:55:53.700933+0000 osd.5 (osd.5) 8 : cluster 0 285.19 deep-scrub ok 2024-02-13T14:55:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[28859]: cluster 2024-02-13T14:55:53.321977+0000 mon.a (mon.0) 2630 : cluster 0 osdmap e455: 8 total, 8 up, 8 in 2024-02-13T14:55:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[28859]: audit 2024-02-13T14:55:53.371622+0000 mon.c (mon.2) 759 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "pg deep-scrub", "pgid": "285.19"}]: dispatch 2024-02-13T14:55:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[28859]: audit 2024-02-13T14:55:53.372038+0000 mgr.y (mgr.14613) 483 : audit 0 from='mon.? v1:172.21.15.62:0/805196410' entity='mon.' cmd=[{"prefix": "pg deep-scrub", "pgid": "285.19"}]: dispatch 2024-02-13T14:55:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[28859]: cluster 2024-02-13T14:55:53.695673+0000 osd.5 (osd.5) 7 : cluster 0 285.19 deep-scrub starts 2024-02-13T14:55:54.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:54 smithi062 bash[28859]: cluster 2024-02-13T14:55:53.700933+0000 osd.5 (osd.5) 8 : cluster 0 285.19 deep-scrub ok 2024-02-13T14:55:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:55 smithi062 bash[28859]: cluster 2024-02-13T14:55:54.027492+0000 mgr.y (mgr.14613) 484 : cluster 0 pgmap v730: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:55.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:55 smithi062 bash[21479]: cluster 2024-02-13T14:55:54.027492+0000 mgr.y (mgr.14613) 484 : cluster 0 pgmap v730: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:55 smithi111 bash[23388]: cluster 2024-02-13T14:55:54.027492+0000 mgr.y (mgr.14613) 484 : cluster 0 pgmap v730: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:55:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:55:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:55:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:55:57.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:57 smithi062 bash[21479]: cluster 2024-02-13T14:55:56.030422+0000 mgr.y (mgr.14613) 485 : cluster 0 pgmap v731: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 891 B/s rd, 891 B/s wr, 2 op/s 2024-02-13T14:55:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:57 smithi062 bash[28859]: cluster 2024-02-13T14:55:56.030422+0000 mgr.y (mgr.14613) 485 : cluster 0 pgmap v731: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 891 B/s rd, 891 B/s wr, 2 op/s 2024-02-13T14:55:57.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:57 smithi111 bash[23388]: cluster 2024-02-13T14:55:56.030422+0000 mgr.y (mgr.14613) 485 : cluster 0 pgmap v731: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 891 B/s rd, 891 B/s wr, 2 op/s 2024-02-13T14:55:59.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:55:59 smithi062 bash[21479]: cluster 2024-02-13T14:55:58.031350+0000 mgr.y (mgr.14613) 486 : cluster 0 pgmap v732: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 759 B/s rd, 759 B/s wr, 2 op/s 2024-02-13T14:55:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:55:59 smithi062 bash[28859]: cluster 2024-02-13T14:55:58.031350+0000 mgr.y (mgr.14613) 486 : cluster 0 pgmap v732: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 759 B/s rd, 759 B/s wr, 2 op/s 2024-02-13T14:55:59.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:55:59 smithi111 bash[23388]: cluster 2024-02-13T14:55:58.031350+0000 mgr.y (mgr.14613) 486 : cluster 0 pgmap v732: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 759 B/s rd, 759 B/s wr, 2 op/s 2024-02-13T14:56:00.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:56:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:56:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:01 smithi062 bash[28859]: cluster 2024-02-13T14:56:00.033917+0000 mgr.y (mgr.14613) 487 : cluster 0 pgmap v733: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-02-13T14:56:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:01 smithi062 bash[21479]: cluster 2024-02-13T14:56:00.033917+0000 mgr.y (mgr.14613) 487 : cluster 0 pgmap v733: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-02-13T14:56:01.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:01 smithi111 bash[23388]: cluster 2024-02-13T14:56:00.033917+0000 mgr.y (mgr.14613) 487 : cluster 0 pgmap v733: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 639 B/s wr, 2 op/s 2024-02-13T14:56:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:02 smithi062 bash[28859]: audit 2024-02-13T14:56:00.525635+0000 mgr.y (mgr.14613) 488 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:02 smithi062 bash[21479]: audit 2024-02-13T14:56:00.525635+0000 mgr.y (mgr.14613) 488 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:02.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:02 smithi111 bash[23388]: audit 2024-02-13T14:56:00.525635+0000 mgr.y (mgr.14613) 488 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:03 smithi062 bash[21479]: cluster 2024-02-13T14:56:02.035401+0000 mgr.y (mgr.14613) 489 : cluster 0 pgmap v734: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 526 B/s wr, 2 op/s 2024-02-13T14:56:03.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:03 smithi062 bash[28859]: cluster 2024-02-13T14:56:02.035401+0000 mgr.y (mgr.14613) 489 : cluster 0 pgmap v734: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 526 B/s wr, 2 op/s 2024-02-13T14:56:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:03 smithi111 bash[23388]: cluster 2024-02-13T14:56:02.035401+0000 mgr.y (mgr.14613) 489 : cluster 0 pgmap v734: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 526 B/s wr, 2 op/s 2024-02-13T14:56:04.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:04 smithi062 bash[21479]: audit 2024-02-13T14:56:03.624062+0000 mon.b (mon.1) 232 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:04.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:04 smithi062 bash[28859]: audit 2024-02-13T14:56:03.624062+0000 mon.b (mon.1) 232 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:04.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:04 smithi111 bash[23388]: audit 2024-02-13T14:56:03.624062+0000 mon.b (mon.1) 232 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:05 smithi062 bash[21479]: cluster 2024-02-13T14:56:04.036462+0000 mgr.y (mgr.14613) 490 : cluster 0 pgmap v735: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 477 B/s wr, 1 op/s 2024-02-13T14:56:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:05 smithi062 bash[28859]: cluster 2024-02-13T14:56:04.036462+0000 mgr.y (mgr.14613) 490 : cluster 0 pgmap v735: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 477 B/s wr, 1 op/s 2024-02-13T14:56:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:05 smithi111 bash[23388]: cluster 2024-02-13T14:56:04.036462+0000 mgr.y (mgr.14613) 490 : cluster 0 pgmap v735: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 955 B/s rd, 477 B/s wr, 1 op/s 2024-02-13T14:56:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:56:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:56:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:56:07.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:07 smithi062 bash[21479]: cluster 2024-02-13T14:56:06.039493+0000 mgr.y (mgr.14613) 491 : cluster 0 pgmap v736: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-02-13T14:56:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:07 smithi062 bash[28859]: cluster 2024-02-13T14:56:06.039493+0000 mgr.y (mgr.14613) 491 : cluster 0 pgmap v736: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-02-13T14:56:07.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:07 smithi111 bash[23388]: cluster 2024-02-13T14:56:06.039493+0000 mgr.y (mgr.14613) 491 : cluster 0 pgmap v736: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 426 B/s wr, 2 op/s 2024-02-13T14:56:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:09 smithi062 bash[21479]: cluster 2024-02-13T14:56:08.040429+0000 mgr.y (mgr.14613) 492 : cluster 0 pgmap v737: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:09.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:09 smithi062 bash[28859]: cluster 2024-02-13T14:56:08.040429+0000 mgr.y (mgr.14613) 492 : cluster 0 pgmap v737: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:09.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:09 smithi111 bash[23388]: cluster 2024-02-13T14:56:08.040429+0000 mgr.y (mgr.14613) 492 : cluster 0 pgmap v737: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:10.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:56:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:56:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:11 smithi062 bash[28859]: cluster 2024-02-13T14:56:10.043390+0000 mgr.y (mgr.14613) 493 : cluster 0 pgmap v738: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:11 smithi062 bash[21479]: cluster 2024-02-13T14:56:10.043390+0000 mgr.y (mgr.14613) 493 : cluster 0 pgmap v738: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:11.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:11 smithi111 bash[23388]: cluster 2024-02-13T14:56:10.043390+0000 mgr.y (mgr.14613) 493 : cluster 0 pgmap v738: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:12 smithi062 bash[21479]: audit 2024-02-13T14:56:10.528174+0000 mgr.y (mgr.14613) 494 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:12.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:12 smithi062 bash[28859]: audit 2024-02-13T14:56:10.528174+0000 mgr.y (mgr.14613) 494 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:12.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:12 smithi111 bash[23388]: audit 2024-02-13T14:56:10.528174+0000 mgr.y (mgr.14613) 494 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:13.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:13 smithi062 bash[28859]: cluster 2024-02-13T14:56:12.044698+0000 mgr.y (mgr.14613) 495 : cluster 0 pgmap v739: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:13.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:13 smithi062 bash[21479]: cluster 2024-02-13T14:56:12.044698+0000 mgr.y (mgr.14613) 495 : cluster 0 pgmap v739: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:13.813 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 14:56:13 smithi062 bash[43264]: debug 2024-02-13T14:56:13.403+0000 7fe6e0fc1700 -1 snap_mapper.add_oid found existing snaps mapped on 285:983464fd:test-rados-api-smithi062-64695-80::foo:2, removing 2024-02-13T14:56:13.813 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:56:13 smithi062 bash[31865]: debug 2024-02-13T14:56:13.403+0000 7f6061432700 -1 snap_mapper.add_oid found existing snaps mapped on 285:983464fd:test-rados-api-smithi062-64695-80::foo:2, removing 2024-02-13T14:56:13.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:13 smithi111 bash[23388]: cluster 2024-02-13T14:56:12.044698+0000 mgr.y (mgr.14613) 495 : cluster 0 pgmap v739: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:13.844 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 14:56:13 smithi111 bash[32478]: debug 2024-02-13T14:56:13.404+0000 7f60a3bc2700 -1 snap_mapper.add_oid found existing snaps mapped on 285:983464fd:test-rados-api-smithi062-64695-80::foo:2, removing 2024-02-13T14:56:14.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[28859]: audit 2024-02-13T14:56:13.411775+0000 mon.c (mon.2) 760 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:14.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[28859]: audit 2024-02-13T14:56:13.412650+0000 mon.a (mon.0) 2631 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:14.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[28859]: audit 2024-02-13T14:56:13.413894+0000 mon.c (mon.2) 761 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-79"}]: dispatch 2024-02-13T14:56:14.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[28859]: audit 2024-02-13T14:56:13.414538+0000 mon.a (mon.0) 2632 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-79"}]: dispatch 2024-02-13T14:56:14.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[28859]: cluster 2024-02-13T14:56:14.045594+0000 mgr.y (mgr.14613) 496 : cluster 0 pgmap v740: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[21479]: audit 2024-02-13T14:56:13.411775+0000 mon.c (mon.2) 760 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:14.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[21479]: audit 2024-02-13T14:56:13.412650+0000 mon.a (mon.0) 2631 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:14.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[21479]: audit 2024-02-13T14:56:13.413894+0000 mon.c (mon.2) 761 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-79"}]: dispatch 2024-02-13T14:56:14.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[21479]: audit 2024-02-13T14:56:13.414538+0000 mon.a (mon.0) 2632 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-79"}]: dispatch 2024-02-13T14:56:14.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:14 smithi062 bash[21479]: cluster 2024-02-13T14:56:14.045594+0000 mgr.y (mgr.14613) 496 : cluster 0 pgmap v740: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:14 smithi111 bash[23388]: audit 2024-02-13T14:56:13.411775+0000 mon.c (mon.2) 760 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:14 smithi111 bash[23388]: audit 2024-02-13T14:56:13.412650+0000 mon.a (mon.0) 2631 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:14 smithi111 bash[23388]: audit 2024-02-13T14:56:13.413894+0000 mon.c (mon.2) 761 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-79"}]: dispatch 2024-02-13T14:56:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:14 smithi111 bash[23388]: audit 2024-02-13T14:56:13.414538+0000 mon.a (mon.0) 2632 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-79"}]: dispatch 2024-02-13T14:56:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:14 smithi111 bash[23388]: cluster 2024-02-13T14:56:14.045594+0000 mgr.y (mgr.14613) 496 : cluster 0 pgmap v740: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:56:15.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:15 smithi062 bash[21479]: cluster 2024-02-13T14:56:14.428741+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-02-13T14:56:15.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:15 smithi062 bash[28859]: cluster 2024-02-13T14:56:14.428741+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-02-13T14:56:15.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:15 smithi111 bash[23388]: cluster 2024-02-13T14:56:14.428741+0000 mon.a (mon.0) 2633 : cluster 0 osdmap e456: 8 total, 8 up, 8 in 2024-02-13T14:56:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:56:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[21479]: cluster 2024-02-13T14:56:15.431080+0000 mon.a (mon.0) 2634 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[21479]: audit 2024-02-13T14:56:15.455278+0000 mon.c (mon.2) 762 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[21479]: audit 2024-02-13T14:56:15.468162+0000 mon.a (mon.0) 2635 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[21479]: cluster 2024-02-13T14:56:16.046539+0000 mgr.y (mgr.14613) 497 : cluster 0 pgmap v743: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[21479]: audit 2024-02-13T14:56:16.424128+0000 mon.a (mon.0) 2636 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[21479]: cluster 2024-02-13T14:56:16.436107+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[21479]: audit 2024-02-13T14:56:16.438297+0000 mon.c (mon.2) 763 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[28859]: cluster 2024-02-13T14:56:15.431080+0000 mon.a (mon.0) 2634 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[28859]: audit 2024-02-13T14:56:15.455278+0000 mon.c (mon.2) 762 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:16.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[28859]: audit 2024-02-13T14:56:15.468162+0000 mon.a (mon.0) 2635 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:16.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[28859]: cluster 2024-02-13T14:56:16.046539+0000 mgr.y (mgr.14613) 497 : cluster 0 pgmap v743: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-02-13T14:56:16.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[28859]: audit 2024-02-13T14:56:16.424128+0000 mon.a (mon.0) 2636 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:16.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[28859]: cluster 2024-02-13T14:56:16.436107+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-02-13T14:56:16.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:16 smithi062 bash[28859]: audit 2024-02-13T14:56:16.438297+0000 mon.c (mon.2) 763 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:16 smithi111 bash[23388]: cluster 2024-02-13T14:56:15.431080+0000 mon.a (mon.0) 2634 : cluster 0 osdmap e457: 8 total, 8 up, 8 in 2024-02-13T14:56:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:16 smithi111 bash[23388]: audit 2024-02-13T14:56:15.455278+0000 mon.c (mon.2) 762 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:16 smithi111 bash[23388]: audit 2024-02-13T14:56:15.468162+0000 mon.a (mon.0) 2635 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:16 smithi111 bash[23388]: cluster 2024-02-13T14:56:16.046539+0000 mgr.y (mgr.14613) 497 : cluster 0 pgmap v743: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1 op/s 2024-02-13T14:56:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:16 smithi111 bash[23388]: audit 2024-02-13T14:56:16.424128+0000 mon.a (mon.0) 2636 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-81","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:16 smithi111 bash[23388]: cluster 2024-02-13T14:56:16.436107+0000 mon.a (mon.0) 2637 : cluster 0 osdmap e458: 8 total, 8 up, 8 in 2024-02-13T14:56:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:16 smithi111 bash[23388]: audit 2024-02-13T14:56:16.438297+0000 mon.c (mon.2) 763 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[21479]: audit 2024-02-13T14:56:16.455453+0000 mon.c (mon.2) 764 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[21479]: audit 2024-02-13T14:56:16.456306+0000 mon.a (mon.0) 2638 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[21479]: cluster 2024-02-13T14:56:16.457829+0000 mon.a (mon.0) 2639 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[21479]: audit 2024-02-13T14:56:17.426782+0000 mon.a (mon.0) 2640 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[21479]: cluster 2024-02-13T14:56:17.435809+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[21479]: audit 2024-02-13T14:56:17.437084+0000 mon.c (mon.2) 765 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[21479]: audit 2024-02-13T14:56:17.440381+0000 mon.a (mon.0) 2642 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[28859]: audit 2024-02-13T14:56:16.455453+0000 mon.c (mon.2) 764 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[28859]: audit 2024-02-13T14:56:16.456306+0000 mon.a (mon.0) 2638 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[28859]: cluster 2024-02-13T14:56:16.457829+0000 mon.a (mon.0) 2639 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[28859]: audit 2024-02-13T14:56:17.426782+0000 mon.a (mon.0) 2640 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[28859]: cluster 2024-02-13T14:56:17.435809+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[28859]: audit 2024-02-13T14:56:17.437084+0000 mon.c (mon.2) 765 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:17.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:17 smithi062 bash[28859]: audit 2024-02-13T14:56:17.440381+0000 mon.a (mon.0) 2642 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:17 smithi111 bash[23388]: audit 2024-02-13T14:56:16.455453+0000 mon.c (mon.2) 764 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:17 smithi111 bash[23388]: audit 2024-02-13T14:56:16.456306+0000 mon.a (mon.0) 2638 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:17 smithi111 bash[23388]: cluster 2024-02-13T14:56:16.457829+0000 mon.a (mon.0) 2639 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:17 smithi111 bash[23388]: audit 2024-02-13T14:56:17.426782+0000 mon.a (mon.0) 2640 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:17 smithi111 bash[23388]: cluster 2024-02-13T14:56:17.435809+0000 mon.a (mon.0) 2641 : cluster 0 osdmap e459: 8 total, 8 up, 8 in 2024-02-13T14:56:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:17 smithi111 bash[23388]: audit 2024-02-13T14:56:17.437084+0000 mon.c (mon.2) 765 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:17 smithi111 bash[23388]: audit 2024-02-13T14:56:17.440381+0000 mon.a (mon.0) 2642 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[21479]: cluster 2024-02-13T14:56:18.047495+0000 mgr.y (mgr.14613) 498 : cluster 0 pgmap v746: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-13T14:56:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[21479]: audit 2024-02-13T14:56:18.429471+0000 mon.a (mon.0) 2643 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:18.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[21479]: cluster 2024-02-13T14:56:18.438383+0000 mon.a (mon.0) 2644 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-02-13T14:56:18.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[21479]: audit 2024-02-13T14:56:18.439236+0000 mon.c (mon.2) 766 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:18.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[21479]: audit 2024-02-13T14:56:18.441173+0000 mon.a (mon.0) 2645 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:18.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[28859]: cluster 2024-02-13T14:56:18.047495+0000 mgr.y (mgr.14613) 498 : cluster 0 pgmap v746: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-13T14:56:18.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[28859]: audit 2024-02-13T14:56:18.429471+0000 mon.a (mon.0) 2643 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:18.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[28859]: cluster 2024-02-13T14:56:18.438383+0000 mon.a (mon.0) 2644 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-02-13T14:56:18.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[28859]: audit 2024-02-13T14:56:18.439236+0000 mon.c (mon.2) 766 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:18.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:18 smithi062 bash[28859]: audit 2024-02-13T14:56:18.441173+0000 mon.a (mon.0) 2645 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:18.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:18 smithi111 bash[23388]: cluster 2024-02-13T14:56:18.047495+0000 mgr.y (mgr.14613) 498 : cluster 0 pgmap v746: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-13T14:56:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:18 smithi111 bash[23388]: audit 2024-02-13T14:56:18.429471+0000 mon.a (mon.0) 2643 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:18 smithi111 bash[23388]: cluster 2024-02-13T14:56:18.438383+0000 mon.a (mon.0) 2644 : cluster 0 osdmap e460: 8 total, 8 up, 8 in 2024-02-13T14:56:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:18 smithi111 bash[23388]: audit 2024-02-13T14:56:18.439236+0000 mon.c (mon.2) 766 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:18 smithi111 bash[23388]: audit 2024-02-13T14:56:18.441173+0000 mon.a (mon.0) 2645 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[21479]: audit 2024-02-13T14:56:18.659194+0000 mon.b (mon.1) 233 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[21479]: audit 2024-02-13T14:56:19.432190+0000 mon.a (mon.0) 2646 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[21479]: cluster 2024-02-13T14:56:19.439247+0000 mon.a (mon.0) 2647 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-02-13T14:56:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[21479]: audit 2024-02-13T14:56:19.441032+0000 mon.c (mon.2) 767 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:19.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[21479]: audit 2024-02-13T14:56:19.443499+0000 mon.a (mon.0) 2648 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[28859]: audit 2024-02-13T14:56:18.659194+0000 mon.b (mon.1) 233 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[28859]: audit 2024-02-13T14:56:19.432190+0000 mon.a (mon.0) 2646 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[28859]: cluster 2024-02-13T14:56:19.439247+0000 mon.a (mon.0) 2647 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-02-13T14:56:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[28859]: audit 2024-02-13T14:56:19.441032+0000 mon.c (mon.2) 767 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:19 smithi062 bash[28859]: audit 2024-02-13T14:56:19.443499+0000 mon.a (mon.0) 2648 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:19 smithi111 bash[23388]: audit 2024-02-13T14:56:18.659194+0000 mon.b (mon.1) 233 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:19 smithi111 bash[23388]: audit 2024-02-13T14:56:19.432190+0000 mon.a (mon.0) 2646 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:19 smithi111 bash[23388]: cluster 2024-02-13T14:56:19.439247+0000 mon.a (mon.0) 2647 : cluster 0 osdmap e461: 8 total, 8 up, 8 in 2024-02-13T14:56:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:19 smithi111 bash[23388]: audit 2024-02-13T14:56:19.441032+0000 mon.c (mon.2) 767 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:19 smithi111 bash[23388]: audit 2024-02-13T14:56:19.443499+0000 mon.a (mon.0) 2648 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:20 smithi062 bash[21479]: cluster 2024-02-13T14:56:20.050108+0000 mgr.y (mgr.14613) 499 : cluster 0 pgmap v749: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:20 smithi062 bash[21479]: audit 2024-02-13T14:56:20.434918+0000 mon.a (mon.0) 2649 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:20 smithi062 bash[21479]: cluster 2024-02-13T14:56:20.441988+0000 mon.a (mon.0) 2650 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-02-13T14:56:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:20 smithi062 bash[28859]: cluster 2024-02-13T14:56:20.050108+0000 mgr.y (mgr.14613) 499 : cluster 0 pgmap v749: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:20.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:20 smithi062 bash[28859]: audit 2024-02-13T14:56:20.434918+0000 mon.a (mon.0) 2649 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:20.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:20 smithi062 bash[28859]: cluster 2024-02-13T14:56:20.441988+0000 mon.a (mon.0) 2650 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-02-13T14:56:20.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:56:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:56:20.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:20 smithi111 bash[23388]: cluster 2024-02-13T14:56:20.050108+0000 mgr.y (mgr.14613) 499 : cluster 0 pgmap v749: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:20 smithi111 bash[23388]: audit 2024-02-13T14:56:20.434918+0000 mon.a (mon.0) 2649 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:20 smithi111 bash[23388]: cluster 2024-02-13T14:56:20.441988+0000 mon.a (mon.0) 2650 : cluster 0 osdmap e462: 8 total, 8 up, 8 in 2024-02-13T14:56:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:21 smithi062 bash[28859]: audit 2024-02-13T14:56:20.502291+0000 mon.c (mon.2) 768 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T14:56:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:21 smithi062 bash[28859]: audit 2024-02-13T14:56:20.503083+0000 mon.a (mon.0) 2651 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T14:56:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:21 smithi062 bash[28859]: audit 2024-02-13T14:56:20.539612+0000 mgr.y (mgr.14613) 500 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:21.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:21 smithi062 bash[21479]: audit 2024-02-13T14:56:20.502291+0000 mon.c (mon.2) 768 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T14:56:21.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:21 smithi062 bash[21479]: audit 2024-02-13T14:56:20.503083+0000 mon.a (mon.0) 2651 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T14:56:21.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:21 smithi062 bash[21479]: audit 2024-02-13T14:56:20.539612+0000 mgr.y (mgr.14613) 500 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:21.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:21 smithi111 bash[23388]: audit 2024-02-13T14:56:20.502291+0000 mon.c (mon.2) 768 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T14:56:21.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:21 smithi111 bash[23388]: audit 2024-02-13T14:56:20.503083+0000 mon.a (mon.0) 2651 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]: dispatch 2024-02-13T14:56:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:21 smithi111 bash[23388]: audit 2024-02-13T14:56:20.539612+0000 mgr.y (mgr.14613) 500 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[21479]: audit 2024-02-13T14:56:21.501231+0000 mon.a (mon.0) 2652 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-13T14:56:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[21479]: cluster 2024-02-13T14:56:21.508483+0000 mon.a (mon.0) 2653 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-02-13T14:56:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[21479]: audit 2024-02-13T14:56:21.553048+0000 mon.c (mon.2) 769 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T14:56:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[21479]: audit 2024-02-13T14:56:21.554318+0000 mon.a (mon.0) 2654 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T14:56:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[21479]: cluster 2024-02-13T14:56:22.051214+0000 mgr.y (mgr.14613) 501 : cluster 0 pgmap v752: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:22.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[21479]: cluster 2024-02-13T14:56:22.066178+0000 mon.a (mon.0) 2655 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:22.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[28859]: audit 2024-02-13T14:56:21.501231+0000 mon.a (mon.0) 2652 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-13T14:56:22.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[28859]: cluster 2024-02-13T14:56:21.508483+0000 mon.a (mon.0) 2653 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-02-13T14:56:22.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[28859]: audit 2024-02-13T14:56:21.553048+0000 mon.c (mon.2) 769 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T14:56:22.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[28859]: audit 2024-02-13T14:56:21.554318+0000 mon.a (mon.0) 2654 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T14:56:22.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[28859]: cluster 2024-02-13T14:56:22.051214+0000 mgr.y (mgr.14613) 501 : cluster 0 pgmap v752: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:22.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:22 smithi062 bash[28859]: cluster 2024-02-13T14:56:22.066178+0000 mon.a (mon.0) 2655 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:22 smithi111 bash[23388]: audit 2024-02-13T14:56:21.501231+0000 mon.a (mon.0) 2652 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "512"}]': finished 2024-02-13T14:56:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:22 smithi111 bash[23388]: cluster 2024-02-13T14:56:21.508483+0000 mon.a (mon.0) 2653 : cluster 0 osdmap e463: 8 total, 8 up, 8 in 2024-02-13T14:56:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:22 smithi111 bash[23388]: audit 2024-02-13T14:56:21.553048+0000 mon.c (mon.2) 769 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T14:56:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:22 smithi111 bash[23388]: audit 2024-02-13T14:56:21.554318+0000 mon.a (mon.0) 2654 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]: dispatch 2024-02-13T14:56:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:22 smithi111 bash[23388]: cluster 2024-02-13T14:56:22.051214+0000 mgr.y (mgr.14613) 501 : cluster 0 pgmap v752: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:22 smithi111 bash[23388]: cluster 2024-02-13T14:56:22.066178+0000 mon.a (mon.0) 2655 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:23 smithi062 bash[21479]: audit 2024-02-13T14:56:22.510029+0000 mon.a (mon.0) 2656 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-13T14:56:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:23 smithi062 bash[21479]: cluster 2024-02-13T14:56:22.523919+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-02-13T14:56:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:23 smithi062 bash[21479]: audit 2024-02-13T14:56:22.555370+0000 mon.c (mon.2) 770 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:23 smithi062 bash[21479]: audit 2024-02-13T14:56:22.556428+0000 mon.a (mon.0) 2658 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:23 smithi062 bash[28859]: audit 2024-02-13T14:56:22.510029+0000 mon.a (mon.0) 2656 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-13T14:56:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:23 smithi062 bash[28859]: cluster 2024-02-13T14:56:22.523919+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-02-13T14:56:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:23 smithi062 bash[28859]: audit 2024-02-13T14:56:22.555370+0000 mon.c (mon.2) 770 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:23 smithi062 bash[28859]: audit 2024-02-13T14:56:22.556428+0000 mon.a (mon.0) 2658 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:23.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:23 smithi111 bash[23388]: audit 2024-02-13T14:56:22.510029+0000 mon.a (mon.0) 2656 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "16384"}]': finished 2024-02-13T14:56:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:23 smithi111 bash[23388]: cluster 2024-02-13T14:56:22.523919+0000 mon.a (mon.0) 2657 : cluster 0 osdmap e464: 8 total, 8 up, 8 in 2024-02-13T14:56:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:23 smithi111 bash[23388]: audit 2024-02-13T14:56:22.555370+0000 mon.c (mon.2) 770 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:23 smithi111 bash[23388]: audit 2024-02-13T14:56:22.556428+0000 mon.a (mon.0) 2658 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[21479]: audit 2024-02-13T14:56:23.520359+0000 mon.a (mon.0) 2659 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[21479]: cluster 2024-02-13T14:56:23.526602+0000 mon.a (mon.0) 2660 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-02-13T14:56:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[21479]: audit 2024-02-13T14:56:23.615785+0000 mon.c (mon.2) 771 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[21479]: audit 2024-02-13T14:56:23.616736+0000 mon.a (mon.0) 2661 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[21479]: audit 2024-02-13T14:56:23.618170+0000 mon.c (mon.2) 772 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-81"}]: dispatch 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[21479]: audit 2024-02-13T14:56:23.618989+0000 mon.a (mon.0) 2662 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-81"}]: dispatch 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[21479]: cluster 2024-02-13T14:56:24.052155+0000 mgr.y (mgr.14613) 502 : cluster 0 pgmap v755: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[28859]: audit 2024-02-13T14:56:23.520359+0000 mon.a (mon.0) 2659 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[28859]: cluster 2024-02-13T14:56:23.526602+0000 mon.a (mon.0) 2660 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[28859]: audit 2024-02-13T14:56:23.615785+0000 mon.c (mon.2) 771 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[28859]: audit 2024-02-13T14:56:23.616736+0000 mon.a (mon.0) 2661 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[28859]: audit 2024-02-13T14:56:23.618170+0000 mon.c (mon.2) 772 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-81"}]: dispatch 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[28859]: audit 2024-02-13T14:56:23.618989+0000 mon.a (mon.0) 2662 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-81"}]: dispatch 2024-02-13T14:56:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:24 smithi062 bash[28859]: cluster 2024-02-13T14:56:24.052155+0000 mgr.y (mgr.14613) 502 : cluster 0 pgmap v755: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:24 smithi111 bash[23388]: audit 2024-02-13T14:56:23.520359+0000 mon.a (mon.0) 2659 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-81","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:24 smithi111 bash[23388]: cluster 2024-02-13T14:56:23.526602+0000 mon.a (mon.0) 2660 : cluster 0 osdmap e465: 8 total, 8 up, 8 in 2024-02-13T14:56:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:24 smithi111 bash[23388]: audit 2024-02-13T14:56:23.615785+0000 mon.c (mon.2) 771 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:24 smithi111 bash[23388]: audit 2024-02-13T14:56:23.616736+0000 mon.a (mon.0) 2661 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:24 smithi111 bash[23388]: audit 2024-02-13T14:56:23.618170+0000 mon.c (mon.2) 772 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-81"}]: dispatch 2024-02-13T14:56:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:24 smithi111 bash[23388]: audit 2024-02-13T14:56:23.618989+0000 mon.a (mon.0) 2662 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-81"}]: dispatch 2024-02-13T14:56:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:24 smithi111 bash[23388]: cluster 2024-02-13T14:56:24.052155+0000 mgr.y (mgr.14613) 502 : cluster 0 pgmap v755: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:25 smithi111 bash[23388]: cluster 2024-02-13T14:56:24.541086+0000 mon.a (mon.0) 2663 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-02-13T14:56:26.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:25 smithi062 bash[21479]: cluster 2024-02-13T14:56:24.541086+0000 mon.a (mon.0) 2663 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-02-13T14:56:26.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:25 smithi062 bash[28859]: cluster 2024-02-13T14:56:24.541086+0000 mon.a (mon.0) 2663 : cluster 0 osdmap e466: 8 total, 8 up, 8 in 2024-02-13T14:56:26.567 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:56:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:56:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[21479]: cluster 2024-02-13T14:56:25.543508+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-02-13T14:56:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[21479]: audit 2024-02-13T14:56:25.549923+0000 mon.c (mon.2) 773 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[21479]: audit 2024-02-13T14:56:25.568515+0000 mon.a (mon.0) 2665 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[21479]: cluster 2024-02-13T14:56:26.053089+0000 mgr.y (mgr.14613) 503 : cluster 0 pgmap v758: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-02-13T14:56:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[21479]: audit 2024-02-13T14:56:26.536313+0000 mon.a (mon.0) 2666 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[21479]: cluster 2024-02-13T14:56:26.545314+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[21479]: audit 2024-02-13T14:56:26.548362+0000 mon.c (mon.2) 774 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[28859]: cluster 2024-02-13T14:56:25.543508+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[28859]: audit 2024-02-13T14:56:25.549923+0000 mon.c (mon.2) 773 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[28859]: audit 2024-02-13T14:56:25.568515+0000 mon.a (mon.0) 2665 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[28859]: cluster 2024-02-13T14:56:26.053089+0000 mgr.y (mgr.14613) 503 : cluster 0 pgmap v758: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[28859]: audit 2024-02-13T14:56:26.536313+0000 mon.a (mon.0) 2666 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[28859]: cluster 2024-02-13T14:56:26.545314+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-02-13T14:56:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:26 smithi062 bash[28859]: audit 2024-02-13T14:56:26.548362+0000 mon.c (mon.2) 774 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:26 smithi111 bash[23388]: cluster 2024-02-13T14:56:25.543508+0000 mon.a (mon.0) 2664 : cluster 0 osdmap e467: 8 total, 8 up, 8 in 2024-02-13T14:56:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:26 smithi111 bash[23388]: audit 2024-02-13T14:56:25.549923+0000 mon.c (mon.2) 773 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:26 smithi111 bash[23388]: audit 2024-02-13T14:56:25.568515+0000 mon.a (mon.0) 2665 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:26 smithi111 bash[23388]: cluster 2024-02-13T14:56:26.053089+0000 mgr.y (mgr.14613) 503 : cluster 0 pgmap v758: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-02-13T14:56:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:26 smithi111 bash[23388]: audit 2024-02-13T14:56:26.536313+0000 mon.a (mon.0) 2666 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-83","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:26 smithi111 bash[23388]: cluster 2024-02-13T14:56:26.545314+0000 mon.a (mon.0) 2667 : cluster 0 osdmap e468: 8 total, 8 up, 8 in 2024-02-13T14:56:27.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:26 smithi111 bash[23388]: audit 2024-02-13T14:56:26.548362+0000 mon.c (mon.2) 774 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:28.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[21479]: audit 2024-02-13T14:56:26.574032+0000 mon.c (mon.2) 775 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[21479]: audit 2024-02-13T14:56:26.594899+0000 mon.a (mon.0) 2668 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[21479]: cluster 2024-02-13T14:56:27.067377+0000 mon.a (mon.0) 2669 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[21479]: audit 2024-02-13T14:56:27.539066+0000 mon.a (mon.0) 2670 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[21479]: cluster 2024-02-13T14:56:27.546588+0000 mon.a (mon.0) 2671 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[21479]: audit 2024-02-13T14:56:27.548643+0000 mon.c (mon.2) 776 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[21479]: audit 2024-02-13T14:56:27.550721+0000 mon.a (mon.0) 2672 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[28859]: audit 2024-02-13T14:56:26.574032+0000 mon.c (mon.2) 775 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[28859]: audit 2024-02-13T14:56:26.594899+0000 mon.a (mon.0) 2668 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[28859]: cluster 2024-02-13T14:56:27.067377+0000 mon.a (mon.0) 2669 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:28.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[28859]: audit 2024-02-13T14:56:27.539066+0000 mon.a (mon.0) 2670 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:28.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[28859]: cluster 2024-02-13T14:56:27.546588+0000 mon.a (mon.0) 2671 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-02-13T14:56:28.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[28859]: audit 2024-02-13T14:56:27.548643+0000 mon.c (mon.2) 776 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:28.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:27 smithi062 bash[28859]: audit 2024-02-13T14:56:27.550721+0000 mon.a (mon.0) 2672 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:27 smithi111 bash[23388]: audit 2024-02-13T14:56:26.574032+0000 mon.c (mon.2) 775 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:27 smithi111 bash[23388]: audit 2024-02-13T14:56:26.594899+0000 mon.a (mon.0) 2668 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:27 smithi111 bash[23388]: cluster 2024-02-13T14:56:27.067377+0000 mon.a (mon.0) 2669 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:27 smithi111 bash[23388]: audit 2024-02-13T14:56:27.539066+0000 mon.a (mon.0) 2670 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:27 smithi111 bash[23388]: cluster 2024-02-13T14:56:27.546588+0000 mon.a (mon.0) 2671 : cluster 0 osdmap e469: 8 total, 8 up, 8 in 2024-02-13T14:56:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:27 smithi111 bash[23388]: audit 2024-02-13T14:56:27.548643+0000 mon.c (mon.2) 776 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:27 smithi111 bash[23388]: audit 2024-02-13T14:56:27.550721+0000 mon.a (mon.0) 2672 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:29.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[21479]: cluster 2024-02-13T14:56:28.054047+0000 mgr.y (mgr.14613) 504 : cluster 0 pgmap v761: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-02-13T14:56:29.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[21479]: audit 2024-02-13T14:56:28.541724+0000 mon.a (mon.0) 2673 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:29.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[21479]: cluster 2024-02-13T14:56:28.548497+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-02-13T14:56:29.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[21479]: audit 2024-02-13T14:56:28.550764+0000 mon.c (mon.2) 777 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:29.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[21479]: audit 2024-02-13T14:56:28.552322+0000 mon.a (mon.0) 2675 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:29.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[28859]: cluster 2024-02-13T14:56:28.054047+0000 mgr.y (mgr.14613) 504 : cluster 0 pgmap v761: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-02-13T14:56:29.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[28859]: audit 2024-02-13T14:56:28.541724+0000 mon.a (mon.0) 2673 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:29.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[28859]: cluster 2024-02-13T14:56:28.548497+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-02-13T14:56:29.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[28859]: audit 2024-02-13T14:56:28.550764+0000 mon.c (mon.2) 777 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:29.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:28 smithi062 bash[28859]: audit 2024-02-13T14:56:28.552322+0000 mon.a (mon.0) 2675 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:28 smithi111 bash[23388]: cluster 2024-02-13T14:56:28.054047+0000 mgr.y (mgr.14613) 504 : cluster 0 pgmap v761: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 10 KiB/s rd, 12 KiB/s wr, 39 op/s 2024-02-13T14:56:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:28 smithi111 bash[23388]: audit 2024-02-13T14:56:28.541724+0000 mon.a (mon.0) 2673 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:28 smithi111 bash[23388]: cluster 2024-02-13T14:56:28.548497+0000 mon.a (mon.0) 2674 : cluster 0 osdmap e470: 8 total, 8 up, 8 in 2024-02-13T14:56:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:28 smithi111 bash[23388]: audit 2024-02-13T14:56:28.550764+0000 mon.c (mon.2) 777 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:28 smithi111 bash[23388]: audit 2024-02-13T14:56:28.552322+0000 mon.a (mon.0) 2675 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[28859]: audit 2024-02-13T14:56:29.544324+0000 mon.a (mon.0) 2676 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[28859]: cluster 2024-02-13T14:56:29.551263+0000 mon.a (mon.0) 2677 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-02-13T14:56:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[28859]: audit 2024-02-13T14:56:29.555188+0000 mon.c (mon.2) 778 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[28859]: audit 2024-02-13T14:56:29.556156+0000 mon.a (mon.0) 2678 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[28859]: cluster 2024-02-13T14:56:30.056604+0000 mgr.y (mgr.14613) 505 : cluster 0 pgmap v764: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[21479]: audit 2024-02-13T14:56:29.544324+0000 mon.a (mon.0) 2676 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[21479]: cluster 2024-02-13T14:56:29.551263+0000 mon.a (mon.0) 2677 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-02-13T14:56:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[21479]: audit 2024-02-13T14:56:29.555188+0000 mon.c (mon.2) 778 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[21479]: audit 2024-02-13T14:56:29.556156+0000 mon.a (mon.0) 2678 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:30 smithi062 bash[21479]: cluster 2024-02-13T14:56:30.056604+0000 mgr.y (mgr.14613) 505 : cluster 0 pgmap v764: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:30.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:56:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:56:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:30 smithi111 bash[23388]: audit 2024-02-13T14:56:29.544324+0000 mon.a (mon.0) 2676 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:30.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:30 smithi111 bash[23388]: cluster 2024-02-13T14:56:29.551263+0000 mon.a (mon.0) 2677 : cluster 0 osdmap e471: 8 total, 8 up, 8 in 2024-02-13T14:56:30.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:30 smithi111 bash[23388]: audit 2024-02-13T14:56:29.555188+0000 mon.c (mon.2) 778 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:30.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:30 smithi111 bash[23388]: audit 2024-02-13T14:56:29.556156+0000 mon.a (mon.0) 2678 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:30.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:30 smithi111 bash[23388]: cluster 2024-02-13T14:56:30.056604+0000 mgr.y (mgr.14613) 505 : cluster 0 pgmap v764: 324 pgs: 3 unknown, 321 active+clean; 8.4 MiB data, 639 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:31 smithi111 bash[23388]: audit 2024-02-13T14:56:30.549638+0000 mgr.y (mgr.14613) 506 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:31 smithi111 bash[23388]: audit 2024-02-13T14:56:30.555358+0000 mon.a (mon.0) 2679 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:31 smithi111 bash[23388]: cluster 2024-02-13T14:56:30.564559+0000 mon.a (mon.0) 2680 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-02-13T14:56:32.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:31 smithi062 bash[28859]: audit 2024-02-13T14:56:30.549638+0000 mgr.y (mgr.14613) 506 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:32.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:31 smithi062 bash[28859]: audit 2024-02-13T14:56:30.555358+0000 mon.a (mon.0) 2679 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:32.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:31 smithi062 bash[28859]: cluster 2024-02-13T14:56:30.564559+0000 mon.a (mon.0) 2680 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-02-13T14:56:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:31 smithi062 bash[21479]: audit 2024-02-13T14:56:30.549638+0000 mgr.y (mgr.14613) 506 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:31 smithi062 bash[21479]: audit 2024-02-13T14:56:30.555358+0000 mon.a (mon.0) 2679 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-83","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:31 smithi062 bash[21479]: cluster 2024-02-13T14:56:30.564559+0000 mon.a (mon.0) 2680 : cluster 0 osdmap e472: 8 total, 8 up, 8 in 2024-02-13T14:56:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:32 smithi111 bash[23388]: cluster 2024-02-13T14:56:31.564968+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-02-13T14:56:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:32 smithi111 bash[23388]: cluster 2024-02-13T14:56:32.057541+0000 mgr.y (mgr.14613) 507 : cluster 0 pgmap v767: 324 pgs: 324 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:32 smithi111 bash[23388]: cluster 2024-02-13T14:56:32.068600+0000 mon.a (mon.0) 2682 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:32 smithi062 bash[28859]: cluster 2024-02-13T14:56:31.564968+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-02-13T14:56:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:32 smithi062 bash[28859]: cluster 2024-02-13T14:56:32.057541+0000 mgr.y (mgr.14613) 507 : cluster 0 pgmap v767: 324 pgs: 324 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:32 smithi062 bash[28859]: cluster 2024-02-13T14:56:32.068600+0000 mon.a (mon.0) 2682 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:32 smithi062 bash[21479]: cluster 2024-02-13T14:56:31.564968+0000 mon.a (mon.0) 2681 : cluster 0 osdmap e473: 8 total, 8 up, 8 in 2024-02-13T14:56:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:32 smithi062 bash[21479]: cluster 2024-02-13T14:56:32.057541+0000 mgr.y (mgr.14613) 507 : cluster 0 pgmap v767: 324 pgs: 324 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:32 smithi062 bash[21479]: cluster 2024-02-13T14:56:32.068600+0000 mon.a (mon.0) 2682 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:33 smithi111 bash[23388]: cluster 2024-02-13T14:56:32.589424+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-02-13T14:56:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:33 smithi111 bash[23388]: audit 2024-02-13T14:56:32.677721+0000 mon.c (mon.2) 779 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:33 smithi111 bash[23388]: audit 2024-02-13T14:56:32.678577+0000 mon.a (mon.0) 2684 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:33 smithi111 bash[23388]: audit 2024-02-13T14:56:32.679908+0000 mon.c (mon.2) 780 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-83"}]: dispatch 2024-02-13T14:56:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:33 smithi111 bash[23388]: audit 2024-02-13T14:56:32.680624+0000 mon.a (mon.0) 2685 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-83"}]: dispatch 2024-02-13T14:56:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:33 smithi111 bash[23388]: audit 2024-02-13T14:56:32.774942+0000 mon.b (mon.1) 234 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:56:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[28859]: cluster 2024-02-13T14:56:32.589424+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-02-13T14:56:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[28859]: audit 2024-02-13T14:56:32.677721+0000 mon.c (mon.2) 779 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[28859]: audit 2024-02-13T14:56:32.678577+0000 mon.a (mon.0) 2684 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[28859]: audit 2024-02-13T14:56:32.679908+0000 mon.c (mon.2) 780 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-83"}]: dispatch 2024-02-13T14:56:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[28859]: audit 2024-02-13T14:56:32.680624+0000 mon.a (mon.0) 2685 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-83"}]: dispatch 2024-02-13T14:56:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[28859]: audit 2024-02-13T14:56:32.774942+0000 mon.b (mon.1) 234 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:56:34.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[21479]: cluster 2024-02-13T14:56:32.589424+0000 mon.a (mon.0) 2683 : cluster 0 osdmap e474: 8 total, 8 up, 8 in 2024-02-13T14:56:34.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[21479]: audit 2024-02-13T14:56:32.677721+0000 mon.c (mon.2) 779 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:34.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[21479]: audit 2024-02-13T14:56:32.678577+0000 mon.a (mon.0) 2684 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:34.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[21479]: audit 2024-02-13T14:56:32.679908+0000 mon.c (mon.2) 780 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-83"}]: dispatch 2024-02-13T14:56:34.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[21479]: audit 2024-02-13T14:56:32.680624+0000 mon.a (mon.0) 2685 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-83"}]: dispatch 2024-02-13T14:56:34.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:33 smithi062 bash[21479]: audit 2024-02-13T14:56:32.774942+0000 mon.b (mon.1) 234 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:56:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:34 smithi062 bash[28859]: cluster 2024-02-13T14:56:33.595449+0000 mon.a (mon.0) 2686 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-02-13T14:56:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:34 smithi062 bash[28859]: audit 2024-02-13T14:56:33.694752+0000 mon.b (mon.1) 235 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:34 smithi062 bash[28859]: cluster 2024-02-13T14:56:34.058341+0000 mgr.y (mgr.14613) 508 : cluster 0 pgmap v770: 292 pgs: 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:35.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:34 smithi062 bash[21479]: cluster 2024-02-13T14:56:33.595449+0000 mon.a (mon.0) 2686 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-02-13T14:56:35.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:34 smithi062 bash[21479]: audit 2024-02-13T14:56:33.694752+0000 mon.b (mon.1) 235 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:35.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:34 smithi062 bash[21479]: cluster 2024-02-13T14:56:34.058341+0000 mgr.y (mgr.14613) 508 : cluster 0 pgmap v770: 292 pgs: 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:35.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:34 smithi111 bash[23388]: cluster 2024-02-13T14:56:33.595449+0000 mon.a (mon.0) 2686 : cluster 0 osdmap e475: 8 total, 8 up, 8 in 2024-02-13T14:56:35.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:34 smithi111 bash[23388]: audit 2024-02-13T14:56:33.694752+0000 mon.b (mon.1) 235 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:35.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:34 smithi111 bash[23388]: cluster 2024-02-13T14:56:34.058341+0000 mgr.y (mgr.14613) 508 : cluster 0 pgmap v770: 292 pgs: 292 active+clean; 8.4 MiB data, 644 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:36.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:35 smithi062 bash[28859]: cluster 2024-02-13T14:56:34.613830+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-02-13T14:56:36.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:35 smithi062 bash[28859]: audit 2024-02-13T14:56:34.618757+0000 mon.c (mon.2) 781 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:36.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:35 smithi062 bash[28859]: audit 2024-02-13T14:56:34.628853+0000 mon.a (mon.0) 2688 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:36.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:35 smithi062 bash[21479]: cluster 2024-02-13T14:56:34.613830+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-02-13T14:56:36.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:35 smithi062 bash[21479]: audit 2024-02-13T14:56:34.618757+0000 mon.c (mon.2) 781 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:36.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:35 smithi062 bash[21479]: audit 2024-02-13T14:56:34.628853+0000 mon.a (mon.0) 2688 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:35 smithi111 bash[23388]: cluster 2024-02-13T14:56:34.613830+0000 mon.a (mon.0) 2687 : cluster 0 osdmap e476: 8 total, 8 up, 8 in 2024-02-13T14:56:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:35 smithi111 bash[23388]: audit 2024-02-13T14:56:34.618757+0000 mon.c (mon.2) 781 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:35 smithi111 bash[23388]: audit 2024-02-13T14:56:34.628853+0000 mon.a (mon.0) 2688 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:56:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:56:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[21479]: audit 2024-02-13T14:56:35.615807+0000 mon.a (mon.0) 2689 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[21479]: cluster 2024-02-13T14:56:35.624487+0000 mon.a (mon.0) 2690 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-02-13T14:56:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[21479]: audit 2024-02-13T14:56:35.628404+0000 mon.c (mon.2) 782 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[21479]: audit 2024-02-13T14:56:35.645624+0000 mon.c (mon.2) 783 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[21479]: audit 2024-02-13T14:56:35.647308+0000 mon.a (mon.0) 2691 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:37.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[21479]: cluster 2024-02-13T14:56:36.059237+0000 mgr.y (mgr.14613) 509 : cluster 0 pgmap v773: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-02-13T14:56:37.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[28859]: audit 2024-02-13T14:56:35.615807+0000 mon.a (mon.0) 2689 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:37.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[28859]: cluster 2024-02-13T14:56:35.624487+0000 mon.a (mon.0) 2690 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-02-13T14:56:37.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[28859]: audit 2024-02-13T14:56:35.628404+0000 mon.c (mon.2) 782 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:37.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[28859]: audit 2024-02-13T14:56:35.645624+0000 mon.c (mon.2) 783 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:37.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[28859]: audit 2024-02-13T14:56:35.647308+0000 mon.a (mon.0) 2691 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:37.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:36 smithi062 bash[28859]: cluster 2024-02-13T14:56:36.059237+0000 mgr.y (mgr.14613) 509 : cluster 0 pgmap v773: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-02-13T14:56:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:36 smithi111 bash[23388]: audit 2024-02-13T14:56:35.615807+0000 mon.a (mon.0) 2689 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-85","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:36 smithi111 bash[23388]: cluster 2024-02-13T14:56:35.624487+0000 mon.a (mon.0) 2690 : cluster 0 osdmap e477: 8 total, 8 up, 8 in 2024-02-13T14:56:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:36 smithi111 bash[23388]: audit 2024-02-13T14:56:35.628404+0000 mon.c (mon.2) 782 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:36 smithi111 bash[23388]: audit 2024-02-13T14:56:35.645624+0000 mon.c (mon.2) 783 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:36 smithi111 bash[23388]: audit 2024-02-13T14:56:35.647308+0000 mon.a (mon.0) 2691 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:36 smithi111 bash[23388]: cluster 2024-02-13T14:56:36.059237+0000 mgr.y (mgr.14613) 509 : cluster 0 pgmap v773: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-02-13T14:56:38.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:37 smithi062 bash[28859]: audit 2024-02-13T14:56:36.627141+0000 mon.a (mon.0) 2692 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:38.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:37 smithi062 bash[28859]: cluster 2024-02-13T14:56:36.637702+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-02-13T14:56:38.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:37 smithi062 bash[28859]: audit 2024-02-13T14:56:36.639784+0000 mon.c (mon.2) 784 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:38.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:37 smithi062 bash[28859]: audit 2024-02-13T14:56:36.640615+0000 mon.a (mon.0) 2694 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:38.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:37 smithi062 bash[21479]: audit 2024-02-13T14:56:36.627141+0000 mon.a (mon.0) 2692 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:38.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:37 smithi062 bash[21479]: cluster 2024-02-13T14:56:36.637702+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-02-13T14:56:38.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:37 smithi062 bash[21479]: audit 2024-02-13T14:56:36.639784+0000 mon.c (mon.2) 784 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:38.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:37 smithi062 bash[21479]: audit 2024-02-13T14:56:36.640615+0000 mon.a (mon.0) 2694 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:38.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:37 smithi111 bash[23388]: audit 2024-02-13T14:56:36.627141+0000 mon.a (mon.0) 2692 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:38.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:37 smithi111 bash[23388]: cluster 2024-02-13T14:56:36.637702+0000 mon.a (mon.0) 2693 : cluster 0 osdmap e478: 8 total, 8 up, 8 in 2024-02-13T14:56:38.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:37 smithi111 bash[23388]: audit 2024-02-13T14:56:36.639784+0000 mon.c (mon.2) 784 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:38.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:37 smithi111 bash[23388]: audit 2024-02-13T14:56:36.640615+0000 mon.a (mon.0) 2694 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[21479]: audit 2024-02-13T14:56:37.629731+0000 mon.a (mon.0) 2695 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[21479]: cluster 2024-02-13T14:56:37.638568+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-02-13T14:56:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[21479]: audit 2024-02-13T14:56:37.644088+0000 mon.c (mon.2) 785 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[21479]: audit 2024-02-13T14:56:37.658344+0000 mon.a (mon.0) 2697 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[21479]: cluster 2024-02-13T14:56:38.059851+0000 mgr.y (mgr.14613) 510 : cluster 0 pgmap v776: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-02-13T14:56:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[21479]: audit 2024-02-13T14:56:38.465492+0000 mon.a (mon.0) 2698 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[21479]: audit 2024-02-13T14:56:38.472852+0000 mon.a (mon.0) 2699 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:39.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[28859]: audit 2024-02-13T14:56:37.629731+0000 mon.a (mon.0) 2695 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:39.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[28859]: cluster 2024-02-13T14:56:37.638568+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-02-13T14:56:39.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[28859]: audit 2024-02-13T14:56:37.644088+0000 mon.c (mon.2) 785 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:39.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[28859]: audit 2024-02-13T14:56:37.658344+0000 mon.a (mon.0) 2697 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:39.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[28859]: cluster 2024-02-13T14:56:38.059851+0000 mgr.y (mgr.14613) 510 : cluster 0 pgmap v776: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-02-13T14:56:39.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[28859]: audit 2024-02-13T14:56:38.465492+0000 mon.a (mon.0) 2698 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:39.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:38 smithi062 bash[28859]: audit 2024-02-13T14:56:38.472852+0000 mon.a (mon.0) 2699 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:39.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:38 smithi111 bash[23388]: audit 2024-02-13T14:56:37.629731+0000 mon.a (mon.0) 2695 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_tier","val": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:56:39.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:38 smithi111 bash[23388]: cluster 2024-02-13T14:56:37.638568+0000 mon.a (mon.0) 2696 : cluster 0 osdmap e479: 8 total, 8 up, 8 in 2024-02-13T14:56:39.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:38 smithi111 bash[23388]: audit 2024-02-13T14:56:37.644088+0000 mon.c (mon.2) 785 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:39.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:38 smithi111 bash[23388]: audit 2024-02-13T14:56:37.658344+0000 mon.a (mon.0) 2697 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:39.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:38 smithi111 bash[23388]: cluster 2024-02-13T14:56:38.059851+0000 mgr.y (mgr.14613) 510 : cluster 0 pgmap v776: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-02-13T14:56:39.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:38 smithi111 bash[23388]: audit 2024-02-13T14:56:38.465492+0000 mon.a (mon.0) 2698 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:39.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:38 smithi111 bash[23388]: audit 2024-02-13T14:56:38.472852+0000 mon.a (mon.0) 2699 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:40.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[28859]: audit 2024-02-13T14:56:38.658879+0000 mon.a (mon.0) 2700 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:40.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[28859]: cluster 2024-02-13T14:56:38.668761+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-02-13T14:56:40.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[28859]: audit 2024-02-13T14:56:38.670211+0000 mon.c (mon.2) 786 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:40.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[28859]: audit 2024-02-13T14:56:38.671371+0000 mon.a (mon.0) 2702 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:40.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[28859]: audit 2024-02-13T14:56:38.924996+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:40.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[28859]: audit 2024-02-13T14:56:38.934000+0000 mon.a (mon.0) 2704 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[21479]: audit 2024-02-13T14:56:38.658879+0000 mon.a (mon.0) 2700 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[21479]: cluster 2024-02-13T14:56:38.668761+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-02-13T14:56:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[21479]: audit 2024-02-13T14:56:38.670211+0000 mon.c (mon.2) 786 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[21479]: audit 2024-02-13T14:56:38.671371+0000 mon.a (mon.0) 2702 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[21479]: audit 2024-02-13T14:56:38.924996+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:39 smithi062 bash[21479]: audit 2024-02-13T14:56:38.934000+0000 mon.a (mon.0) 2704 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:39 smithi111 bash[23388]: audit 2024-02-13T14:56:38.658879+0000 mon.a (mon.0) 2700 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:39 smithi111 bash[23388]: cluster 2024-02-13T14:56:38.668761+0000 mon.a (mon.0) 2701 : cluster 0 osdmap e480: 8 total, 8 up, 8 in 2024-02-13T14:56:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:39 smithi111 bash[23388]: audit 2024-02-13T14:56:38.670211+0000 mon.c (mon.2) 786 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:39 smithi111 bash[23388]: audit 2024-02-13T14:56:38.671371+0000 mon.a (mon.0) 2702 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:39 smithi111 bash[23388]: audit 2024-02-13T14:56:38.924996+0000 mon.a (mon.0) 2703 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:39 smithi111 bash[23388]: audit 2024-02-13T14:56:38.934000+0000 mon.a (mon.0) 2704 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:40.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:56:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:56:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:40 smithi111 bash[23388]: audit 2024-02-13T14:56:39.661524+0000 mon.a (mon.0) 2705 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:40 smithi111 bash[23388]: cluster 2024-02-13T14:56:39.669306+0000 mon.a (mon.0) 2706 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-02-13T14:56:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:40 smithi111 bash[23388]: audit 2024-02-13T14:56:39.675703+0000 mon.b (mon.1) 236 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:56:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:40 smithi111 bash[23388]: audit 2024-02-13T14:56:39.689363+0000 mon.b (mon.1) 237 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:56:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:40 smithi111 bash[23388]: audit 2024-02-13T14:56:39.704065+0000 mon.a (mon.0) 2707 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:40 smithi111 bash[23388]: cluster 2024-02-13T14:56:40.062476+0000 mgr.y (mgr.14613) 511 : cluster 0 pgmap v779: 324 pgs: 6 creating+peering, 318 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T14:56:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[21479]: audit 2024-02-13T14:56:39.661524+0000 mon.a (mon.0) 2705 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[21479]: cluster 2024-02-13T14:56:39.669306+0000 mon.a (mon.0) 2706 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-02-13T14:56:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[21479]: audit 2024-02-13T14:56:39.675703+0000 mon.b (mon.1) 236 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:56:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[21479]: audit 2024-02-13T14:56:39.689363+0000 mon.b (mon.1) 237 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:56:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[21479]: audit 2024-02-13T14:56:39.704065+0000 mon.a (mon.0) 2707 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:41.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[21479]: cluster 2024-02-13T14:56:40.062476+0000 mgr.y (mgr.14613) 511 : cluster 0 pgmap v779: 324 pgs: 6 creating+peering, 318 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T14:56:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[28859]: audit 2024-02-13T14:56:39.661524+0000 mon.a (mon.0) 2705 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-85","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[28859]: cluster 2024-02-13T14:56:39.669306+0000 mon.a (mon.0) 2706 : cluster 0 osdmap e481: 8 total, 8 up, 8 in 2024-02-13T14:56:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[28859]: audit 2024-02-13T14:56:39.675703+0000 mon.b (mon.1) 236 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:56:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[28859]: audit 2024-02-13T14:56:39.689363+0000 mon.b (mon.1) 237 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:56:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[28859]: audit 2024-02-13T14:56:39.704065+0000 mon.a (mon.0) 2707 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:56:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:40 smithi062 bash[28859]: cluster 2024-02-13T14:56:40.062476+0000 mgr.y (mgr.14613) 511 : cluster 0 pgmap v779: 324 pgs: 6 creating+peering, 318 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T14:56:42.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:41 smithi062 bash[21479]: audit 2024-02-13T14:56:40.561114+0000 mgr.y (mgr.14613) 512 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:42.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:41 smithi062 bash[21479]: cluster 2024-02-13T14:56:40.715618+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-02-13T14:56:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:41 smithi062 bash[28859]: audit 2024-02-13T14:56:40.561114+0000 mgr.y (mgr.14613) 512 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:41 smithi062 bash[28859]: cluster 2024-02-13T14:56:40.715618+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-02-13T14:56:42.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:41 smithi111 bash[23388]: audit 2024-02-13T14:56:40.561114+0000 mgr.y (mgr.14613) 512 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:42.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:41 smithi111 bash[23388]: cluster 2024-02-13T14:56:40.715618+0000 mon.a (mon.0) 2708 : cluster 0 osdmap e482: 8 total, 8 up, 8 in 2024-02-13T14:56:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[28859]: cluster 2024-02-13T14:56:41.724549+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-02-13T14:56:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[28859]: audit 2024-02-13T14:56:41.818757+0000 mon.c (mon.2) 787 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[28859]: audit 2024-02-13T14:56:41.819587+0000 mon.a (mon.0) 2710 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[28859]: audit 2024-02-13T14:56:41.820778+0000 mon.c (mon.2) 788 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-85"}]: dispatch 2024-02-13T14:56:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[28859]: audit 2024-02-13T14:56:41.821397+0000 mon.a (mon.0) 2711 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-85"}]: dispatch 2024-02-13T14:56:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[28859]: cluster 2024-02-13T14:56:42.063485+0000 mgr.y (mgr.14613) 513 : cluster 0 pgmap v782: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T14:56:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[21479]: cluster 2024-02-13T14:56:41.724549+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-02-13T14:56:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[21479]: audit 2024-02-13T14:56:41.818757+0000 mon.c (mon.2) 787 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[21479]: audit 2024-02-13T14:56:41.819587+0000 mon.a (mon.0) 2710 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[21479]: audit 2024-02-13T14:56:41.820778+0000 mon.c (mon.2) 788 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-85"}]: dispatch 2024-02-13T14:56:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[21479]: audit 2024-02-13T14:56:41.821397+0000 mon.a (mon.0) 2711 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-85"}]: dispatch 2024-02-13T14:56:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:42 smithi062 bash[21479]: cluster 2024-02-13T14:56:42.063485+0000 mgr.y (mgr.14613) 513 : cluster 0 pgmap v782: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T14:56:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:42 smithi111 bash[23388]: cluster 2024-02-13T14:56:41.724549+0000 mon.a (mon.0) 2709 : cluster 0 osdmap e483: 8 total, 8 up, 8 in 2024-02-13T14:56:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:42 smithi111 bash[23388]: audit 2024-02-13T14:56:41.818757+0000 mon.c (mon.2) 787 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:42 smithi111 bash[23388]: audit 2024-02-13T14:56:41.819587+0000 mon.a (mon.0) 2710 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:42 smithi111 bash[23388]: audit 2024-02-13T14:56:41.820778+0000 mon.c (mon.2) 788 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-85"}]: dispatch 2024-02-13T14:56:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:42 smithi111 bash[23388]: audit 2024-02-13T14:56:41.821397+0000 mon.a (mon.0) 2711 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-85"}]: dispatch 2024-02-13T14:56:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:42 smithi111 bash[23388]: cluster 2024-02-13T14:56:42.063485+0000 mgr.y (mgr.14613) 513 : cluster 0 pgmap v782: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 2.2 KiB/s wr, 1 op/s 2024-02-13T14:56:44.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:43 smithi062 bash[28859]: cluster 2024-02-13T14:56:42.753207+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-02-13T14:56:44.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:43 smithi062 bash[21479]: cluster 2024-02-13T14:56:42.753207+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-02-13T14:56:44.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:43 smithi111 bash[23388]: cluster 2024-02-13T14:56:42.753207+0000 mon.a (mon.0) 2712 : cluster 0 osdmap e484: 8 total, 8 up, 8 in 2024-02-13T14:56:44.803 INFO:tasks.workunit.client.0.smithi062.stdout: OK ] LibRadosTwoPoolsPP.ProxyRead (18092 ms) 2024-02-13T14:56:44.803 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.CachePin 2024-02-13T14:56:44.803 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.CachePin (22824 ms) 2024-02-13T14:56:44.803 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.SetRedirectRead 2024-02-13T14:56:44.803 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.SetRedirectRead (3042 ms) 2024-02-13T14:56:44.803 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestPromoteRead 2024-02-13T14:56:44.803 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestPromoteRead (3039 ms) 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRefRead 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRefRead (3032 ms) 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestUnset 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestUnset (3041 ms) 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestDedupRefRead 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestDedupRefRead (4078 ms) 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount (37720 ms) 2024-02-13T14:56:44.804 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapRefcount2 (16892 ms) 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestTestSnapCreate 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestTestSnapCreate (4072 ms) 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRedirectAfterPromote (3067 ms) 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestCheckRefcountWhenModification (24796 ms) 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapIncCount 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.805 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapIncCount (15085 ms) 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvict 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvict (5046 ms) 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictPromote 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictPromote (4057 ms) 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: waiting for scrubs... 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: done waiting 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapSizeMismatch (25165 ms) 2024-02-13T14:56:44.806 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.DedupFlushRead 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.DedupFlushRead (10112 ms) 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushSnap 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushSnap (9056 ms) 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestFlushDupCount 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestFlushDupCount (9157 ms) 2024-02-13T14:56:44.807 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringFlush 2024-02-13T14:56:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:44 smithi062 bash[21479]: cluster 2024-02-13T14:56:43.764192+0000 mon.a (mon.0) 2713 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-02-13T14:56:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:44 smithi062 bash[21479]: audit 2024-02-13T14:56:43.769467+0000 mon.c (mon.2) 789 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:44 smithi062 bash[21479]: audit 2024-02-13T14:56:43.775911+0000 mon.a (mon.0) 2714 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:44 smithi062 bash[21479]: cluster 2024-02-13T14:56:44.064417+0000 mgr.y (mgr.14613) 514 : cluster 0 pgmap v785: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:44 smithi062 bash[28859]: cluster 2024-02-13T14:56:43.764192+0000 mon.a (mon.0) 2713 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-02-13T14:56:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:44 smithi062 bash[28859]: audit 2024-02-13T14:56:43.769467+0000 mon.c (mon.2) 789 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:44 smithi062 bash[28859]: audit 2024-02-13T14:56:43.775911+0000 mon.a (mon.0) 2714 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:44 smithi062 bash[28859]: cluster 2024-02-13T14:56:44.064417+0000 mgr.y (mgr.14613) 514 : cluster 0 pgmap v785: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:45.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:44 smithi111 bash[23388]: cluster 2024-02-13T14:56:43.764192+0000 mon.a (mon.0) 2713 : cluster 0 osdmap e485: 8 total, 8 up, 8 in 2024-02-13T14:56:45.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:44 smithi111 bash[23388]: audit 2024-02-13T14:56:43.769467+0000 mon.c (mon.2) 789 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:45.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:44 smithi111 bash[23388]: audit 2024-02-13T14:56:43.775911+0000 mon.a (mon.0) 2714 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:45.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:44 smithi111 bash[23388]: cluster 2024-02-13T14:56:44.064417+0000 mgr.y (mgr.14613) 514 : cluster 0 pgmap v785: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:45 smithi062 bash[21479]: cluster 2024-02-13T14:56:44.756756+0000 mon.a (mon.0) 2715 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:45 smithi062 bash[21479]: audit 2024-02-13T14:56:44.765957+0000 mon.a (mon.0) 2716 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:45 smithi062 bash[21479]: cluster 2024-02-13T14:56:44.776614+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-02-13T14:56:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:45 smithi062 bash[21479]: audit 2024-02-13T14:56:44.781784+0000 mon.c (mon.2) 790 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:46.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:45 smithi062 bash[28859]: cluster 2024-02-13T14:56:44.756756+0000 mon.a (mon.0) 2715 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:46.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:45 smithi062 bash[28859]: audit 2024-02-13T14:56:44.765957+0000 mon.a (mon.0) 2716 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:46.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:45 smithi062 bash[28859]: cluster 2024-02-13T14:56:44.776614+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-02-13T14:56:46.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:45 smithi062 bash[28859]: audit 2024-02-13T14:56:44.781784+0000 mon.c (mon.2) 790 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:46.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:45 smithi111 bash[23388]: cluster 2024-02-13T14:56:44.756756+0000 mon.a (mon.0) 2715 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:46.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:45 smithi111 bash[23388]: audit 2024-02-13T14:56:44.765957+0000 mon.a (mon.0) 2716 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-87","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:46.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:45 smithi111 bash[23388]: cluster 2024-02-13T14:56:44.776614+0000 mon.a (mon.0) 2717 : cluster 0 osdmap e486: 8 total, 8 up, 8 in 2024-02-13T14:56:46.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:45 smithi111 bash[23388]: audit 2024-02-13T14:56:44.781784+0000 mon.c (mon.2) 790 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:56:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:56:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[28859]: cluster 2024-02-13T14:56:45.787814+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-02-13T14:56:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[28859]: audit 2024-02-13T14:56:45.794088+0000 mon.c (mon.2) 791 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[28859]: audit 2024-02-13T14:56:45.795611+0000 mon.a (mon.0) 2719 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[28859]: cluster 2024-02-13T14:56:46.065419+0000 mgr.y (mgr.14613) 515 : cluster 0 pgmap v788: 356 pgs: 32 unknown, 8 creating+activating, 316 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-02-13T14:56:47.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[21479]: cluster 2024-02-13T14:56:45.787814+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-02-13T14:56:47.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[21479]: audit 2024-02-13T14:56:45.794088+0000 mon.c (mon.2) 791 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:47.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[21479]: audit 2024-02-13T14:56:45.795611+0000 mon.a (mon.0) 2719 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:47.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:46 smithi062 bash[21479]: cluster 2024-02-13T14:56:46.065419+0000 mgr.y (mgr.14613) 515 : cluster 0 pgmap v788: 356 pgs: 32 unknown, 8 creating+activating, 316 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-02-13T14:56:47.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:46 smithi111 bash[23388]: cluster 2024-02-13T14:56:45.787814+0000 mon.a (mon.0) 2718 : cluster 0 osdmap e487: 8 total, 8 up, 8 in 2024-02-13T14:56:47.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:46 smithi111 bash[23388]: audit 2024-02-13T14:56:45.794088+0000 mon.c (mon.2) 791 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:47.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:46 smithi111 bash[23388]: audit 2024-02-13T14:56:45.795611+0000 mon.a (mon.0) 2719 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:47.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:46 smithi111 bash[23388]: cluster 2024-02-13T14:56:46.065419+0000 mgr.y (mgr.14613) 515 : cluster 0 pgmap v788: 356 pgs: 32 unknown, 8 creating+activating, 316 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 2.5 KiB/s wr, 10 op/s 2024-02-13T14:56:48.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:47 smithi062 bash[21479]: audit 2024-02-13T14:56:46.789695+0000 mon.a (mon.0) 2720 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:48.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:47 smithi062 bash[21479]: cluster 2024-02-13T14:56:46.799476+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-02-13T14:56:48.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:47 smithi062 bash[21479]: audit 2024-02-13T14:56:46.805164+0000 mon.c (mon.2) 792 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]: dispatch 2024-02-13T14:56:48.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:47 smithi062 bash[21479]: audit 2024-02-13T14:56:46.806277+0000 mon.a (mon.0) 2722 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]: dispatch 2024-02-13T14:56:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:47 smithi062 bash[28859]: audit 2024-02-13T14:56:46.789695+0000 mon.a (mon.0) 2720 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:47 smithi062 bash[28859]: cluster 2024-02-13T14:56:46.799476+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-02-13T14:56:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:47 smithi062 bash[28859]: audit 2024-02-13T14:56:46.805164+0000 mon.c (mon.2) 792 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]: dispatch 2024-02-13T14:56:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:47 smithi062 bash[28859]: audit 2024-02-13T14:56:46.806277+0000 mon.a (mon.0) 2722 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]: dispatch 2024-02-13T14:56:48.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:47 smithi111 bash[23388]: audit 2024-02-13T14:56:46.789695+0000 mon.a (mon.0) 2720 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:47 smithi111 bash[23388]: cluster 2024-02-13T14:56:46.799476+0000 mon.a (mon.0) 2721 : cluster 0 osdmap e488: 8 total, 8 up, 8 in 2024-02-13T14:56:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:47 smithi111 bash[23388]: audit 2024-02-13T14:56:46.805164+0000 mon.c (mon.2) 792 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]: dispatch 2024-02-13T14:56:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:47 smithi111 bash[23388]: audit 2024-02-13T14:56:46.806277+0000 mon.a (mon.0) 2722 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]: dispatch 2024-02-13T14:56:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:48 smithi111 bash[23388]: audit 2024-02-13T14:56:47.792728+0000 mon.a (mon.0) 2723 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]': finished 2024-02-13T14:56:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:48 smithi111 bash[23388]: cluster 2024-02-13T14:56:47.800108+0000 mon.a (mon.0) 2724 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-02-13T14:56:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:48 smithi111 bash[23388]: audit 2024-02-13T14:56:47.804247+0000 mon.c (mon.2) 793 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:48 smithi111 bash[23388]: audit 2024-02-13T14:56:47.825878+0000 mon.a (mon.0) 2725 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:48 smithi111 bash[23388]: cluster 2024-02-13T14:56:48.066384+0000 mgr.y (mgr.14613) 516 : cluster 0 pgmap v791: 356 pgs: 32 unknown, 8 creating+activating, 316 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-13T14:56:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:48 smithi111 bash[23388]: audit 2024-02-13T14:56:48.725198+0000 mon.b (mon.1) 238 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:49.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[28859]: audit 2024-02-13T14:56:47.792728+0000 mon.a (mon.0) 2723 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]': finished 2024-02-13T14:56:49.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[28859]: cluster 2024-02-13T14:56:47.800108+0000 mon.a (mon.0) 2724 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-02-13T14:56:49.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[28859]: audit 2024-02-13T14:56:47.804247+0000 mon.c (mon.2) 793 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:49.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[28859]: audit 2024-02-13T14:56:47.825878+0000 mon.a (mon.0) 2725 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:49.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[28859]: cluster 2024-02-13T14:56:48.066384+0000 mgr.y (mgr.14613) 516 : cluster 0 pgmap v791: 356 pgs: 32 unknown, 8 creating+activating, 316 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-13T14:56:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[28859]: audit 2024-02-13T14:56:48.725198+0000 mon.b (mon.1) 238 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[21479]: audit 2024-02-13T14:56:47.792728+0000 mon.a (mon.0) 2723 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_tier","val": "test-rados-api-smithi062-64695-89-test-flush"}]': finished 2024-02-13T14:56:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[21479]: cluster 2024-02-13T14:56:47.800108+0000 mon.a (mon.0) 2724 : cluster 0 osdmap e489: 8 total, 8 up, 8 in 2024-02-13T14:56:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[21479]: audit 2024-02-13T14:56:47.804247+0000 mon.c (mon.2) 793 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[21479]: audit 2024-02-13T14:56:47.825878+0000 mon.a (mon.0) 2725 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:56:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[21479]: cluster 2024-02-13T14:56:48.066384+0000 mgr.y (mgr.14613) 516 : cluster 0 pgmap v791: 356 pgs: 32 unknown, 8 creating+activating, 316 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 4.5 KiB/s wr, 10 op/s 2024-02-13T14:56:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:48 smithi062 bash[21479]: audit 2024-02-13T14:56:48.725198+0000 mon.b (mon.1) 238 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:56:50.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:49 smithi111 bash[23388]: audit 2024-02-13T14:56:48.814832+0000 mon.a (mon.0) 2726 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:50.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:49 smithi111 bash[23388]: cluster 2024-02-13T14:56:48.825231+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-02-13T14:56:50.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:49 smithi111 bash[23388]: audit 2024-02-13T14:56:48.826421+0000 mon.c (mon.2) 794 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:50.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:49 smithi111 bash[23388]: audit 2024-02-13T14:56:48.828815+0000 mon.a (mon.0) 2728 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:49 smithi062 bash[21479]: audit 2024-02-13T14:56:48.814832+0000 mon.a (mon.0) 2726 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:49 smithi062 bash[21479]: cluster 2024-02-13T14:56:48.825231+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-02-13T14:56:50.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:49 smithi062 bash[21479]: audit 2024-02-13T14:56:48.826421+0000 mon.c (mon.2) 794 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:50.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:49 smithi062 bash[21479]: audit 2024-02-13T14:56:48.828815+0000 mon.a (mon.0) 2728 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:49 smithi062 bash[28859]: audit 2024-02-13T14:56:48.814832+0000 mon.a (mon.0) 2726 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:56:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:49 smithi062 bash[28859]: cluster 2024-02-13T14:56:48.825231+0000 mon.a (mon.0) 2727 : cluster 0 osdmap e490: 8 total, 8 up, 8 in 2024-02-13T14:56:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:49 smithi062 bash[28859]: audit 2024-02-13T14:56:48.826421+0000 mon.c (mon.2) 794 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:49 smithi062 bash[28859]: audit 2024-02-13T14:56:48.828815+0000 mon.a (mon.0) 2728 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:56:50.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:56:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:56:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:50 smithi062 bash[21479]: audit 2024-02-13T14:56:49.817633+0000 mon.a (mon.0) 2729 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:50 smithi062 bash[21479]: cluster 2024-02-13T14:56:49.824772+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-02-13T14:56:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:50 smithi062 bash[21479]: cluster 2024-02-13T14:56:50.068866+0000 mgr.y (mgr.14613) 517 : cluster 0 pgmap v794: 356 pgs: 4 unknown, 352 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-02-13T14:56:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:50 smithi062 bash[28859]: audit 2024-02-13T14:56:49.817633+0000 mon.a (mon.0) 2729 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:50 smithi062 bash[28859]: cluster 2024-02-13T14:56:49.824772+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-02-13T14:56:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:50 smithi062 bash[28859]: cluster 2024-02-13T14:56:50.068866+0000 mgr.y (mgr.14613) 517 : cluster 0 pgmap v794: 356 pgs: 4 unknown, 352 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-02-13T14:56:51.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:50 smithi111 bash[23388]: audit 2024-02-13T14:56:49.817633+0000 mon.a (mon.0) 2729 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-87","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:56:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:50 smithi111 bash[23388]: cluster 2024-02-13T14:56:49.824772+0000 mon.a (mon.0) 2730 : cluster 0 osdmap e491: 8 total, 8 up, 8 in 2024-02-13T14:56:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:50 smithi111 bash[23388]: cluster 2024-02-13T14:56:50.068866+0000 mgr.y (mgr.14613) 517 : cluster 0 pgmap v794: 356 pgs: 4 unknown, 352 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 2.0 KiB/s wr, 1 op/s 2024-02-13T14:56:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[21479]: audit 2024-02-13T14:56:50.572546+0000 mgr.y (mgr.14613) 518 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[21479]: cluster 2024-02-13T14:56:50.839968+0000 mon.a (mon.0) 2731 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-02-13T14:56:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[21479]: audit 2024-02-13T14:56:50.926200+0000 mon.c (mon.2) 795 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[21479]: audit 2024-02-13T14:56:50.926901+0000 mon.a (mon.0) 2732 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[21479]: audit 2024-02-13T14:56:50.928025+0000 mon.c (mon.2) 796 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-87"}]: dispatch 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[21479]: audit 2024-02-13T14:56:50.928625+0000 mon.a (mon.0) 2733 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-87"}]: dispatch 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[28859]: audit 2024-02-13T14:56:50.572546+0000 mgr.y (mgr.14613) 518 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[28859]: cluster 2024-02-13T14:56:50.839968+0000 mon.a (mon.0) 2731 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[28859]: audit 2024-02-13T14:56:50.926200+0000 mon.c (mon.2) 795 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[28859]: audit 2024-02-13T14:56:50.926901+0000 mon.a (mon.0) 2732 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[28859]: audit 2024-02-13T14:56:50.928025+0000 mon.c (mon.2) 796 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-87"}]: dispatch 2024-02-13T14:56:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:51 smithi062 bash[28859]: audit 2024-02-13T14:56:50.928625+0000 mon.a (mon.0) 2733 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-87"}]: dispatch 2024-02-13T14:56:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:51 smithi111 bash[23388]: audit 2024-02-13T14:56:50.572546+0000 mgr.y (mgr.14613) 518 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:56:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:51 smithi111 bash[23388]: cluster 2024-02-13T14:56:50.839968+0000 mon.a (mon.0) 2731 : cluster 0 osdmap e492: 8 total, 8 up, 8 in 2024-02-13T14:56:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:51 smithi111 bash[23388]: audit 2024-02-13T14:56:50.926200+0000 mon.c (mon.2) 795 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:51 smithi111 bash[23388]: audit 2024-02-13T14:56:50.926901+0000 mon.a (mon.0) 2732 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:51 smithi111 bash[23388]: audit 2024-02-13T14:56:50.928025+0000 mon.c (mon.2) 796 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-87"}]: dispatch 2024-02-13T14:56:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:51 smithi111 bash[23388]: audit 2024-02-13T14:56:50.928625+0000 mon.a (mon.0) 2733 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-87"}]: dispatch 2024-02-13T14:56:53.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:52 smithi062 bash[21479]: cluster 2024-02-13T14:56:51.876092+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-02-13T14:56:53.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:52 smithi062 bash[21479]: cluster 2024-02-13T14:56:52.069708+0000 mgr.y (mgr.14613) 519 : cluster 0 pgmap v797: 292 pgs: 292 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:53.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:52 smithi062 bash[28859]: cluster 2024-02-13T14:56:51.876092+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-02-13T14:56:53.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:52 smithi062 bash[28859]: cluster 2024-02-13T14:56:52.069708+0000 mgr.y (mgr.14613) 519 : cluster 0 pgmap v797: 292 pgs: 292 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:53.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:52 smithi111 bash[23388]: cluster 2024-02-13T14:56:51.876092+0000 mon.a (mon.0) 2734 : cluster 0 osdmap e493: 8 total, 8 up, 8 in 2024-02-13T14:56:53.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:52 smithi111 bash[23388]: cluster 2024-02-13T14:56:52.069708+0000 mgr.y (mgr.14613) 519 : cluster 0 pgmap v797: 292 pgs: 292 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:56:54.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:53 smithi062 bash[28859]: cluster 2024-02-13T14:56:52.867427+0000 mon.a (mon.0) 2735 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:54.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:53 smithi062 bash[28859]: cluster 2024-02-13T14:56:52.889916+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-02-13T14:56:54.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:53 smithi062 bash[28859]: audit 2024-02-13T14:56:52.893045+0000 mon.c (mon.2) 797 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:54.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:53 smithi062 bash[28859]: audit 2024-02-13T14:56:52.895711+0000 mon.a (mon.0) 2737 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:54.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:53 smithi062 bash[21479]: cluster 2024-02-13T14:56:52.867427+0000 mon.a (mon.0) 2735 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:54.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:53 smithi062 bash[21479]: cluster 2024-02-13T14:56:52.889916+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-02-13T14:56:54.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:53 smithi062 bash[21479]: audit 2024-02-13T14:56:52.893045+0000 mon.c (mon.2) 797 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:54.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:53 smithi062 bash[21479]: audit 2024-02-13T14:56:52.895711+0000 mon.a (mon.0) 2737 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:53 smithi111 bash[23388]: cluster 2024-02-13T14:56:52.867427+0000 mon.a (mon.0) 2735 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:56:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:53 smithi111 bash[23388]: cluster 2024-02-13T14:56:52.889916+0000 mon.a (mon.0) 2736 : cluster 0 osdmap e494: 8 total, 8 up, 8 in 2024-02-13T14:56:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:53 smithi111 bash[23388]: audit 2024-02-13T14:56:52.893045+0000 mon.c (mon.2) 797 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:53 smithi111 bash[23388]: audit 2024-02-13T14:56:52.895711+0000 mon.a (mon.0) 2737 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:56:55.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[28859]: audit 2024-02-13T14:56:53.883288+0000 mon.a (mon.0) 2738 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:55.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[28859]: cluster 2024-02-13T14:56:53.893346+0000 mon.a (mon.0) 2739 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-02-13T14:56:55.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[28859]: audit 2024-02-13T14:56:53.916956+0000 mon.c (mon.2) 798 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[28859]: audit 2024-02-13T14:56:53.934465+0000 mon.c (mon.2) 799 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[28859]: audit 2024-02-13T14:56:53.936473+0000 mon.a (mon.0) 2740 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[28859]: cluster 2024-02-13T14:56:54.070617+0000 mgr.y (mgr.14613) 520 : cluster 0 pgmap v800: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[21479]: audit 2024-02-13T14:56:53.883288+0000 mon.a (mon.0) 2738 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[21479]: cluster 2024-02-13T14:56:53.893346+0000 mon.a (mon.0) 2739 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[21479]: audit 2024-02-13T14:56:53.916956+0000 mon.c (mon.2) 798 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[21479]: audit 2024-02-13T14:56:53.934465+0000 mon.c (mon.2) 799 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[21479]: audit 2024-02-13T14:56:53.936473+0000 mon.a (mon.0) 2740 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:54 smithi062 bash[21479]: cluster 2024-02-13T14:56:54.070617+0000 mgr.y (mgr.14613) 520 : cluster 0 pgmap v800: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:54 smithi111 bash[23388]: audit 2024-02-13T14:56:53.883288+0000 mon.a (mon.0) 2738 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-90","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:56:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:54 smithi111 bash[23388]: cluster 2024-02-13T14:56:53.893346+0000 mon.a (mon.0) 2739 : cluster 0 osdmap e495: 8 total, 8 up, 8 in 2024-02-13T14:56:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:54 smithi111 bash[23388]: audit 2024-02-13T14:56:53.916956+0000 mon.c (mon.2) 798 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:56:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:54 smithi111 bash[23388]: audit 2024-02-13T14:56:53.934465+0000 mon.c (mon.2) 799 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:54 smithi111 bash[23388]: audit 2024-02-13T14:56:53.936473+0000 mon.a (mon.0) 2740 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:56:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:54 smithi111 bash[23388]: cluster 2024-02-13T14:56:54.070617+0000 mgr.y (mgr.14613) 520 : cluster 0 pgmap v800: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 618 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:56:56.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:55 smithi062 bash[21479]: audit 2024-02-13T14:56:54.912491+0000 mon.a (mon.0) 2741 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:56.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:55 smithi062 bash[21479]: cluster 2024-02-13T14:56:54.922770+0000 mon.a (mon.0) 2742 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-02-13T14:56:56.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:55 smithi062 bash[28859]: audit 2024-02-13T14:56:54.912491+0000 mon.a (mon.0) 2741 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:56.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:55 smithi062 bash[28859]: cluster 2024-02-13T14:56:54.922770+0000 mon.a (mon.0) 2742 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-02-13T14:56:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:55 smithi111 bash[23388]: audit 2024-02-13T14:56:54.912491+0000 mon.a (mon.0) 2741 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-6","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:56:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:55 smithi111 bash[23388]: cluster 2024-02-13T14:56:54.922770+0000 mon.a (mon.0) 2742 : cluster 0 osdmap e496: 8 total, 8 up, 8 in 2024-02-13T14:56:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:56:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:56:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:56:57.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:56 smithi062 bash[28859]: cluster 2024-02-13T14:56:55.922650+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-02-13T14:56:57.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:56 smithi062 bash[28859]: cluster 2024-02-13T14:56:56.071497+0000 mgr.y (mgr.14613) 521 : cluster 0 pgmap v803: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:56:57.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:56 smithi062 bash[21479]: cluster 2024-02-13T14:56:55.922650+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-02-13T14:56:57.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:56 smithi062 bash[21479]: cluster 2024-02-13T14:56:56.071497+0000 mgr.y (mgr.14613) 521 : cluster 0 pgmap v803: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:56:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:56 smithi111 bash[23388]: cluster 2024-02-13T14:56:55.922650+0000 mon.a (mon.0) 2743 : cluster 0 osdmap e497: 8 total, 8 up, 8 in 2024-02-13T14:56:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:56 smithi111 bash[23388]: cluster 2024-02-13T14:56:56.071497+0000 mgr.y (mgr.14613) 521 : cluster 0 pgmap v803: 324 pgs: 324 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:56:58.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[28859]: cluster 2024-02-13T14:56:56.953322+0000 mon.a (mon.0) 2744 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-02-13T14:56:58.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[28859]: audit 2024-02-13T14:56:57.058577+0000 mon.c (mon.2) 800 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:58.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[28859]: audit 2024-02-13T14:56:57.059537+0000 mon.a (mon.0) 2745 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:58.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[28859]: audit 2024-02-13T14:56:57.060886+0000 mon.c (mon.2) 801 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-90"}]: dispatch 2024-02-13T14:56:58.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[28859]: audit 2024-02-13T14:56:57.061715+0000 mon.a (mon.0) 2746 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-90"}]: dispatch 2024-02-13T14:56:58.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[21479]: cluster 2024-02-13T14:56:56.953322+0000 mon.a (mon.0) 2744 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-02-13T14:56:58.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[21479]: audit 2024-02-13T14:56:57.058577+0000 mon.c (mon.2) 800 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:58.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[21479]: audit 2024-02-13T14:56:57.059537+0000 mon.a (mon.0) 2745 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:58.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[21479]: audit 2024-02-13T14:56:57.060886+0000 mon.c (mon.2) 801 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-90"}]: dispatch 2024-02-13T14:56:58.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:57 smithi062 bash[21479]: audit 2024-02-13T14:56:57.061715+0000 mon.a (mon.0) 2746 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-90"}]: dispatch 2024-02-13T14:56:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:57 smithi111 bash[23388]: cluster 2024-02-13T14:56:56.953322+0000 mon.a (mon.0) 2744 : cluster 0 osdmap e498: 8 total, 8 up, 8 in 2024-02-13T14:56:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:57 smithi111 bash[23388]: audit 2024-02-13T14:56:57.058577+0000 mon.c (mon.2) 800 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:57 smithi111 bash[23388]: audit 2024-02-13T14:56:57.059537+0000 mon.a (mon.0) 2745 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:56:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:57 smithi111 bash[23388]: audit 2024-02-13T14:56:57.060886+0000 mon.c (mon.2) 801 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-90"}]: dispatch 2024-02-13T14:56:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:57 smithi111 bash[23388]: audit 2024-02-13T14:56:57.061715+0000 mon.a (mon.0) 2746 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-90"}]: dispatch 2024-02-13T14:56:59.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:58 smithi062 bash[21479]: cluster 2024-02-13T14:56:57.959828+0000 mon.a (mon.0) 2747 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-02-13T14:56:59.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:58 smithi062 bash[21479]: cluster 2024-02-13T14:56:58.072120+0000 mgr.y (mgr.14613) 522 : cluster 0 pgmap v806: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:56:59.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:58 smithi062 bash[28859]: cluster 2024-02-13T14:56:57.959828+0000 mon.a (mon.0) 2747 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-02-13T14:56:59.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:58 smithi062 bash[28859]: cluster 2024-02-13T14:56:58.072120+0000 mgr.y (mgr.14613) 522 : cluster 0 pgmap v806: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:56:59.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:58 smithi111 bash[23388]: cluster 2024-02-13T14:56:57.959828+0000 mon.a (mon.0) 2747 : cluster 0 osdmap e499: 8 total, 8 up, 8 in 2024-02-13T14:56:59.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:58 smithi111 bash[23388]: cluster 2024-02-13T14:56:58.072120+0000 mgr.y (mgr.14613) 522 : cluster 0 pgmap v806: 292 pgs: 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T14:57:00.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:59 smithi062 bash[21479]: cluster 2024-02-13T14:56:58.978137+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-02-13T14:57:00.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:59 smithi062 bash[21479]: audit 2024-02-13T14:56:58.982016+0000 mon.c (mon.2) 802 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:00.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:56:59 smithi062 bash[21479]: audit 2024-02-13T14:56:58.988389+0000 mon.a (mon.0) 2749 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:00.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:59 smithi062 bash[28859]: cluster 2024-02-13T14:56:58.978137+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-02-13T14:57:00.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:59 smithi062 bash[28859]: audit 2024-02-13T14:56:58.982016+0000 mon.c (mon.2) 802 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:00.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:56:59 smithi062 bash[28859]: audit 2024-02-13T14:56:58.988389+0000 mon.a (mon.0) 2749 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:00.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:59 smithi111 bash[23388]: cluster 2024-02-13T14:56:58.978137+0000 mon.a (mon.0) 2748 : cluster 0 osdmap e500: 8 total, 8 up, 8 in 2024-02-13T14:57:00.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:59 smithi111 bash[23388]: audit 2024-02-13T14:56:58.982016+0000 mon.c (mon.2) 802 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:00.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:56:59 smithi111 bash[23388]: audit 2024-02-13T14:56:58.988389+0000 mon.a (mon.0) 2749 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:00.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:57:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:57:01.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:00 smithi062 bash[21479]: audit 2024-02-13T14:56:59.967433+0000 mon.a (mon.0) 2750 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:01.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:00 smithi062 bash[21479]: cluster 2024-02-13T14:56:59.976863+0000 mon.a (mon.0) 2751 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-02-13T14:57:01.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:00 smithi062 bash[21479]: audit 2024-02-13T14:57:00.013693+0000 mon.c (mon.2) 803 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:01.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:00 smithi062 bash[21479]: cluster 2024-02-13T14:57:00.073501+0000 mgr.y (mgr.14613) 523 : cluster 0 pgmap v809: 324 pgs: 1 creating+activating, 22 creating+peering, 2 unknown, 299 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:57:01.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:01 smithi062 bash[28859]: audit 2024-02-13T14:56:59.967433+0000 mon.a (mon.0) 2750 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:01.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:01 smithi062 bash[28859]: cluster 2024-02-13T14:56:59.976863+0000 mon.a (mon.0) 2751 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-02-13T14:57:01.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:01 smithi062 bash[28859]: audit 2024-02-13T14:57:00.013693+0000 mon.c (mon.2) 803 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:01.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:01 smithi062 bash[28859]: cluster 2024-02-13T14:57:00.073501+0000 mgr.y (mgr.14613) 523 : cluster 0 pgmap v809: 324 pgs: 1 creating+activating, 22 creating+peering, 2 unknown, 299 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:57:01.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:01 smithi111 bash[23388]: audit 2024-02-13T14:56:59.967433+0000 mon.a (mon.0) 2750 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-92","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:01.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:01 smithi111 bash[23388]: cluster 2024-02-13T14:56:59.976863+0000 mon.a (mon.0) 2751 : cluster 0 osdmap e501: 8 total, 8 up, 8 in 2024-02-13T14:57:01.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:01 smithi111 bash[23388]: audit 2024-02-13T14:57:00.013693+0000 mon.c (mon.2) 803 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:01.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:01 smithi111 bash[23388]: cluster 2024-02-13T14:57:00.073501+0000 mgr.y (mgr.14613) 523 : cluster 0 pgmap v809: 324 pgs: 1 creating+activating, 22 creating+peering, 2 unknown, 299 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:57:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:01 smithi062 bash[21479]: audit 2024-02-13T14:57:00.583952+0000 mgr.y (mgr.14613) 524 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:01 smithi062 bash[21479]: cluster 2024-02-13T14:57:01.007143+0000 mon.a (mon.0) 2752 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-02-13T14:57:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:02 smithi062 bash[28859]: audit 2024-02-13T14:57:00.583952+0000 mgr.y (mgr.14613) 524 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:02 smithi062 bash[28859]: cluster 2024-02-13T14:57:01.007143+0000 mon.a (mon.0) 2752 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-02-13T14:57:02.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:02 smithi111 bash[23388]: audit 2024-02-13T14:57:00.583952+0000 mgr.y (mgr.14613) 524 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:02 smithi111 bash[23388]: cluster 2024-02-13T14:57:01.007143+0000 mon.a (mon.0) 2752 : cluster 0 osdmap e502: 8 total, 8 up, 8 in 2024-02-13T14:57:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[28859]: cluster 2024-02-13T14:57:02.015718+0000 mon.a (mon.0) 2753 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-02-13T14:57:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[28859]: cluster 2024-02-13T14:57:02.074493+0000 mgr.y (mgr.14613) 525 : cluster 0 pgmap v812: 324 pgs: 1 creating+activating, 22 creating+peering, 301 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:57:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[28859]: audit 2024-02-13T14:57:02.106314+0000 mon.c (mon.2) 804 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[28859]: audit 2024-02-13T14:57:02.107105+0000 mon.a (mon.0) 2754 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[28859]: audit 2024-02-13T14:57:02.108439+0000 mon.c (mon.2) 805 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-92"}]: dispatch 2024-02-13T14:57:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[28859]: audit 2024-02-13T14:57:02.109073+0000 mon.a (mon.0) 2755 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-92"}]: dispatch 2024-02-13T14:57:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[21479]: cluster 2024-02-13T14:57:02.015718+0000 mon.a (mon.0) 2753 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-02-13T14:57:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[21479]: cluster 2024-02-13T14:57:02.074493+0000 mgr.y (mgr.14613) 525 : cluster 0 pgmap v812: 324 pgs: 1 creating+activating, 22 creating+peering, 301 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:57:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[21479]: audit 2024-02-13T14:57:02.106314+0000 mon.c (mon.2) 804 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[21479]: audit 2024-02-13T14:57:02.107105+0000 mon.a (mon.0) 2754 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[21479]: audit 2024-02-13T14:57:02.108439+0000 mon.c (mon.2) 805 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-92"}]: dispatch 2024-02-13T14:57:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:03 smithi062 bash[21479]: audit 2024-02-13T14:57:02.109073+0000 mon.a (mon.0) 2755 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-92"}]: dispatch 2024-02-13T14:57:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:03 smithi111 bash[23388]: cluster 2024-02-13T14:57:02.015718+0000 mon.a (mon.0) 2753 : cluster 0 osdmap e503: 8 total, 8 up, 8 in 2024-02-13T14:57:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:03 smithi111 bash[23388]: cluster 2024-02-13T14:57:02.074493+0000 mgr.y (mgr.14613) 525 : cluster 0 pgmap v812: 324 pgs: 1 creating+activating, 22 creating+peering, 301 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-13T14:57:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:03 smithi111 bash[23388]: audit 2024-02-13T14:57:02.106314+0000 mon.c (mon.2) 804 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:03 smithi111 bash[23388]: audit 2024-02-13T14:57:02.107105+0000 mon.a (mon.0) 2754 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:03 smithi111 bash[23388]: audit 2024-02-13T14:57:02.108439+0000 mon.c (mon.2) 805 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-92"}]: dispatch 2024-02-13T14:57:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:03 smithi111 bash[23388]: audit 2024-02-13T14:57:02.109073+0000 mon.a (mon.0) 2755 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-92"}]: dispatch 2024-02-13T14:57:04.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:04 smithi062 bash[28859]: cluster 2024-02-13T14:57:03.027917+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-02-13T14:57:04.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:04 smithi062 bash[28859]: audit 2024-02-13T14:57:03.762576+0000 mon.b (mon.1) 239 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:04 smithi062 bash[21479]: cluster 2024-02-13T14:57:03.027917+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-02-13T14:57:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:04 smithi062 bash[21479]: audit 2024-02-13T14:57:03.762576+0000 mon.b (mon.1) 239 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:04.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:04 smithi111 bash[23388]: cluster 2024-02-13T14:57:03.027917+0000 mon.a (mon.0) 2756 : cluster 0 osdmap e504: 8 total, 8 up, 8 in 2024-02-13T14:57:04.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:04 smithi111 bash[23388]: audit 2024-02-13T14:57:03.762576+0000 mon.b (mon.1) 239 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:05 smithi111 bash[23388]: cluster 2024-02-13T14:57:04.032978+0000 mon.a (mon.0) 2757 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-02-13T14:57:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:05 smithi111 bash[23388]: audit 2024-02-13T14:57:04.038542+0000 mon.c (mon.2) 806 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:05 smithi111 bash[23388]: audit 2024-02-13T14:57:04.058676+0000 mon.a (mon.0) 2758 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:05 smithi111 bash[23388]: cluster 2024-02-13T14:57:04.075387+0000 mgr.y (mgr.14613) 526 : cluster 0 pgmap v815: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:05 smithi111 bash[23388]: audit 2024-02-13T14:57:05.025669+0000 mon.a (mon.0) 2759 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:05 smithi111 bash[23388]: cluster 2024-02-13T14:57:05.034479+0000 mon.a (mon.0) 2760 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-02-13T14:57:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[21479]: cluster 2024-02-13T14:57:04.032978+0000 mon.a (mon.0) 2757 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-02-13T14:57:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[21479]: audit 2024-02-13T14:57:04.038542+0000 mon.c (mon.2) 806 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[21479]: audit 2024-02-13T14:57:04.058676+0000 mon.a (mon.0) 2758 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[21479]: cluster 2024-02-13T14:57:04.075387+0000 mgr.y (mgr.14613) 526 : cluster 0 pgmap v815: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[21479]: audit 2024-02-13T14:57:05.025669+0000 mon.a (mon.0) 2759 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:05.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[21479]: cluster 2024-02-13T14:57:05.034479+0000 mon.a (mon.0) 2760 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-02-13T14:57:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[28859]: cluster 2024-02-13T14:57:04.032978+0000 mon.a (mon.0) 2757 : cluster 0 osdmap e505: 8 total, 8 up, 8 in 2024-02-13T14:57:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[28859]: audit 2024-02-13T14:57:04.038542+0000 mon.c (mon.2) 806 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[28859]: audit 2024-02-13T14:57:04.058676+0000 mon.a (mon.0) 2758 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[28859]: cluster 2024-02-13T14:57:04.075387+0000 mgr.y (mgr.14613) 526 : cluster 0 pgmap v815: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 627 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[28859]: audit 2024-02-13T14:57:05.025669+0000 mon.a (mon.0) 2759 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-94","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:05 smithi062 bash[28859]: cluster 2024-02-13T14:57:05.034479+0000 mon.a (mon.0) 2760 : cluster 0 osdmap e506: 8 total, 8 up, 8 in 2024-02-13T14:57:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:06 smithi111 bash[23388]: audit 2024-02-13T14:57:05.037961+0000 mon.c (mon.2) 807 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:06 smithi111 bash[23388]: cluster 2024-02-13T14:57:05.041873+0000 mon.a (mon.0) 2761 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:06 smithi111 bash[23388]: cluster 2024-02-13T14:57:06.070134+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-02-13T14:57:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:57:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:57:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:57:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:06 smithi062 bash[21479]: audit 2024-02-13T14:57:05.037961+0000 mon.c (mon.2) 807 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:06 smithi062 bash[21479]: cluster 2024-02-13T14:57:05.041873+0000 mon.a (mon.0) 2761 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:06 smithi062 bash[21479]: cluster 2024-02-13T14:57:06.070134+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-02-13T14:57:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:06 smithi062 bash[28859]: audit 2024-02-13T14:57:05.037961+0000 mon.c (mon.2) 807 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:06 smithi062 bash[28859]: cluster 2024-02-13T14:57:05.041873+0000 mon.a (mon.0) 2761 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:06 smithi062 bash[28859]: cluster 2024-02-13T14:57:06.070134+0000 mon.a (mon.0) 2762 : cluster 0 osdmap e507: 8 total, 8 up, 8 in 2024-02-13T14:57:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:07 smithi111 bash[23388]: cluster 2024-02-13T14:57:06.076526+0000 mgr.y (mgr.14613) 527 : cluster 0 pgmap v818: 324 pgs: 31 creating+peering, 293 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:57:07.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:07 smithi062 bash[28859]: cluster 2024-02-13T14:57:06.076526+0000 mgr.y (mgr.14613) 527 : cluster 0 pgmap v818: 324 pgs: 31 creating+peering, 293 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:57:07.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:07 smithi062 bash[21479]: cluster 2024-02-13T14:57:06.076526+0000 mgr.y (mgr.14613) 527 : cluster 0 pgmap v818: 324 pgs: 31 creating+peering, 293 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2024-02-13T14:57:08.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:08 smithi062 bash[21479]: cluster 2024-02-13T14:57:07.106927+0000 mon.a (mon.0) 2763 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-02-13T14:57:08.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:08 smithi062 bash[28859]: cluster 2024-02-13T14:57:07.106927+0000 mon.a (mon.0) 2763 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-02-13T14:57:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:08 smithi111 bash[23388]: cluster 2024-02-13T14:57:07.106927+0000 mon.a (mon.0) 2763 : cluster 0 osdmap e508: 8 total, 8 up, 8 in 2024-02-13T14:57:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:09 smithi062 bash[21479]: cluster 2024-02-13T14:57:08.077623+0000 mgr.y (mgr.14613) 528 : cluster 0 pgmap v820: 324 pgs: 31 creating+peering, 293 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 758 B/s wr, 2 op/s 2024-02-13T14:57:09.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:09 smithi062 bash[28859]: cluster 2024-02-13T14:57:08.077623+0000 mgr.y (mgr.14613) 528 : cluster 0 pgmap v820: 324 pgs: 31 creating+peering, 293 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 758 B/s wr, 2 op/s 2024-02-13T14:57:09.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:09 smithi111 bash[23388]: cluster 2024-02-13T14:57:08.077623+0000 mgr.y (mgr.14613) 528 : cluster 0 pgmap v820: 324 pgs: 31 creating+peering, 293 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 758 B/s wr, 2 op/s 2024-02-13T14:57:11.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:57:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:57:11.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:11 smithi062 bash[21479]: cluster 2024-02-13T14:57:10.080354+0000 mgr.y (mgr.14613) 529 : cluster 0 pgmap v821: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-02-13T14:57:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:11 smithi062 bash[28859]: cluster 2024-02-13T14:57:10.080354+0000 mgr.y (mgr.14613) 529 : cluster 0 pgmap v821: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-02-13T14:57:11.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:11 smithi111 bash[23388]: cluster 2024-02-13T14:57:10.080354+0000 mgr.y (mgr.14613) 529 : cluster 0 pgmap v821: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 2.5 KiB/s rd, 1.7 KiB/s wr, 5 op/s 2024-02-13T14:57:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:12 smithi062 bash[28859]: audit 2024-02-13T14:57:10.593654+0000 mgr.y (mgr.14613) 530 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:12 smithi062 bash[21479]: audit 2024-02-13T14:57:10.593654+0000 mgr.y (mgr.14613) 530 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:12 smithi111 bash[23388]: audit 2024-02-13T14:57:10.593654+0000 mgr.y (mgr.14613) 530 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:13 smithi062 bash[21479]: cluster 2024-02-13T14:57:12.081604+0000 mgr.y (mgr.14613) 531 : cluster 0 pgmap v822: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-13T14:57:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:13 smithi062 bash[21479]: cluster 2024-02-13T14:57:12.355111+0000 mon.a (mon.0) 2764 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:13 smithi062 bash[28859]: cluster 2024-02-13T14:57:12.081604+0000 mgr.y (mgr.14613) 531 : cluster 0 pgmap v822: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-13T14:57:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:13 smithi062 bash[28859]: cluster 2024-02-13T14:57:12.355111+0000 mon.a (mon.0) 2764 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:13.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:13 smithi111 bash[23388]: cluster 2024-02-13T14:57:12.081604+0000 mgr.y (mgr.14613) 531 : cluster 0 pgmap v822: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.1 KiB/s wr, 4 op/s 2024-02-13T14:57:13.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:13 smithi111 bash[23388]: cluster 2024-02-13T14:57:12.355111+0000 mon.a (mon.0) 2764 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:15.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:15 smithi062 bash[21479]: cluster 2024-02-13T14:57:14.082567+0000 mgr.y (mgr.14613) 532 : cluster 0 pgmap v823: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1022 B/s wr, 3 op/s 2024-02-13T14:57:15.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:15 smithi062 bash[28859]: cluster 2024-02-13T14:57:14.082567+0000 mgr.y (mgr.14613) 532 : cluster 0 pgmap v823: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1022 B/s wr, 3 op/s 2024-02-13T14:57:15.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:15 smithi111 bash[23388]: cluster 2024-02-13T14:57:14.082567+0000 mgr.y (mgr.14613) 532 : cluster 0 pgmap v823: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1022 B/s wr, 3 op/s 2024-02-13T14:57:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:57:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:57:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:57:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:17 smithi062 bash[28859]: cluster 2024-02-13T14:57:16.085563+0000 mgr.y (mgr.14613) 533 : cluster 0 pgmap v824: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-02-13T14:57:17.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:17 smithi062 bash[21479]: cluster 2024-02-13T14:57:16.085563+0000 mgr.y (mgr.14613) 533 : cluster 0 pgmap v824: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-02-13T14:57:17.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:17 smithi111 bash[23388]: cluster 2024-02-13T14:57:16.085563+0000 mgr.y (mgr.14613) 533 : cluster 0 pgmap v824: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 818 B/s wr, 3 op/s 2024-02-13T14:57:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:19 smithi062 bash[28859]: cluster 2024-02-13T14:57:18.086424+0000 mgr.y (mgr.14613) 534 : cluster 0 pgmap v825: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 745 B/s wr, 3 op/s 2024-02-13T14:57:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:19 smithi062 bash[28859]: cluster 2024-02-13T14:57:18.147814+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-02-13T14:57:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:19 smithi062 bash[28859]: audit 2024-02-13T14:57:18.801466+0000 mon.b (mon.1) 240 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:19.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:19 smithi062 bash[21479]: cluster 2024-02-13T14:57:18.086424+0000 mgr.y (mgr.14613) 534 : cluster 0 pgmap v825: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 745 B/s wr, 3 op/s 2024-02-13T14:57:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:19 smithi062 bash[21479]: cluster 2024-02-13T14:57:18.147814+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-02-13T14:57:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:19 smithi062 bash[21479]: audit 2024-02-13T14:57:18.801466+0000 mon.b (mon.1) 240 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:19.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:19 smithi111 bash[23388]: cluster 2024-02-13T14:57:18.086424+0000 mgr.y (mgr.14613) 534 : cluster 0 pgmap v825: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 745 B/s wr, 3 op/s 2024-02-13T14:57:19.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:19 smithi111 bash[23388]: cluster 2024-02-13T14:57:18.147814+0000 mon.a (mon.0) 2765 : cluster 0 osdmap e509: 8 total, 8 up, 8 in 2024-02-13T14:57:19.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:19 smithi111 bash[23388]: audit 2024-02-13T14:57:18.801466+0000 mon.b (mon.1) 240 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:21.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:57:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:57:21.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:21 smithi062 bash[28859]: cluster 2024-02-13T14:57:20.089220+0000 mgr.y (mgr.14613) 535 : cluster 0 pgmap v827: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 1 op/s 2024-02-13T14:57:21.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:21 smithi062 bash[21479]: cluster 2024-02-13T14:57:20.089220+0000 mgr.y (mgr.14613) 535 : cluster 0 pgmap v827: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 1 op/s 2024-02-13T14:57:21.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:21 smithi111 bash[23388]: cluster 2024-02-13T14:57:20.089220+0000 mgr.y (mgr.14613) 535 : cluster 0 pgmap v827: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 102 B/s wr, 1 op/s 2024-02-13T14:57:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:22 smithi062 bash[28859]: audit 2024-02-13T14:57:20.601616+0000 mgr.y (mgr.14613) 536 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:22 smithi062 bash[21479]: audit 2024-02-13T14:57:20.601616+0000 mgr.y (mgr.14613) 536 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:22 smithi111 bash[23388]: audit 2024-02-13T14:57:20.601616+0000 mgr.y (mgr.14613) 536 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:23 smithi062 bash[28859]: cluster 2024-02-13T14:57:22.090165+0000 mgr.y (mgr.14613) 537 : cluster 0 pgmap v828: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:23 smithi062 bash[28859]: cluster 2024-02-13T14:57:22.378618+0000 mon.a (mon.0) 2766 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-02-13T14:57:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:23 smithi062 bash[21479]: cluster 2024-02-13T14:57:22.090165+0000 mgr.y (mgr.14613) 537 : cluster 0 pgmap v828: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:23.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:23 smithi062 bash[21479]: cluster 2024-02-13T14:57:22.378618+0000 mon.a (mon.0) 2766 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-02-13T14:57:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:23 smithi111 bash[23388]: cluster 2024-02-13T14:57:22.090165+0000 mgr.y (mgr.14613) 537 : cluster 0 pgmap v828: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:23 smithi111 bash[23388]: cluster 2024-02-13T14:57:22.378618+0000 mon.a (mon.0) 2766 : cluster 0 osdmap e510: 8 total, 8 up, 8 in 2024-02-13T14:57:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:25 smithi062 bash[28859]: cluster 2024-02-13T14:57:24.091123+0000 mgr.y (mgr.14613) 538 : cluster 0 pgmap v830: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:25 smithi062 bash[21479]: cluster 2024-02-13T14:57:24.091123+0000 mgr.y (mgr.14613) 538 : cluster 0 pgmap v830: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:25 smithi111 bash[23388]: cluster 2024-02-13T14:57:24.091123+0000 mgr.y (mgr.14613) 538 : cluster 0 pgmap v830: 324 pgs: 324 active+clean; 8.4 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 895 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:57:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:57:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:57:27.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:27 smithi062 bash[21479]: cluster 2024-02-13T14:57:26.094061+0000 mgr.y (mgr.14613) 539 : cluster 0 pgmap v831: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:27 smithi062 bash[28859]: cluster 2024-02-13T14:57:26.094061+0000 mgr.y (mgr.14613) 539 : cluster 0 pgmap v831: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:27.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:27 smithi111 bash[23388]: cluster 2024-02-13T14:57:26.094061+0000 mgr.y (mgr.14613) 539 : cluster 0 pgmap v831: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:28 smithi062 bash[28859]: audit 2024-02-13T14:57:28.198339+0000 mon.c (mon.2) 808 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:28 smithi062 bash[28859]: audit 2024-02-13T14:57:28.199297+0000 mon.a (mon.0) 2767 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:28 smithi062 bash[28859]: audit 2024-02-13T14:57:28.200706+0000 mon.c (mon.2) 809 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-94"}]: dispatch 2024-02-13T14:57:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:28 smithi062 bash[28859]: audit 2024-02-13T14:57:28.201518+0000 mon.a (mon.0) 2768 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-94"}]: dispatch 2024-02-13T14:57:28.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:28 smithi062 bash[21479]: audit 2024-02-13T14:57:28.198339+0000 mon.c (mon.2) 808 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:28.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:28 smithi062 bash[21479]: audit 2024-02-13T14:57:28.199297+0000 mon.a (mon.0) 2767 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:28.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:28 smithi062 bash[21479]: audit 2024-02-13T14:57:28.200706+0000 mon.c (mon.2) 809 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-94"}]: dispatch 2024-02-13T14:57:28.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:28 smithi062 bash[21479]: audit 2024-02-13T14:57:28.201518+0000 mon.a (mon.0) 2768 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-94"}]: dispatch 2024-02-13T14:57:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:28 smithi111 bash[23388]: audit 2024-02-13T14:57:28.198339+0000 mon.c (mon.2) 808 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:28 smithi111 bash[23388]: audit 2024-02-13T14:57:28.199297+0000 mon.a (mon.0) 2767 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:28 smithi111 bash[23388]: audit 2024-02-13T14:57:28.200706+0000 mon.c (mon.2) 809 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-94"}]: dispatch 2024-02-13T14:57:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:28 smithi111 bash[23388]: audit 2024-02-13T14:57:28.201518+0000 mon.a (mon.0) 2768 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-94"}]: dispatch 2024-02-13T14:57:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:29 smithi062 bash[21479]: cluster 2024-02-13T14:57:28.095010+0000 mgr.y (mgr.14613) 540 : cluster 0 pgmap v832: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:29 smithi062 bash[21479]: cluster 2024-02-13T14:57:28.402421+0000 mon.a (mon.0) 2769 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-02-13T14:57:29.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:29 smithi062 bash[28859]: cluster 2024-02-13T14:57:28.095010+0000 mgr.y (mgr.14613) 540 : cluster 0 pgmap v832: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:29.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:29 smithi062 bash[28859]: cluster 2024-02-13T14:57:28.402421+0000 mon.a (mon.0) 2769 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-02-13T14:57:29.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:29 smithi111 bash[23388]: cluster 2024-02-13T14:57:28.095010+0000 mgr.y (mgr.14613) 540 : cluster 0 pgmap v832: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:57:29.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:29 smithi111 bash[23388]: cluster 2024-02-13T14:57:28.402421+0000 mon.a (mon.0) 2769 : cluster 0 osdmap e511: 8 total, 8 up, 8 in 2024-02-13T14:57:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:30 smithi062 bash[21479]: cluster 2024-02-13T14:57:29.416037+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-02-13T14:57:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:30 smithi062 bash[21479]: audit 2024-02-13T14:57:29.419163+0000 mon.c (mon.2) 810 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:30 smithi062 bash[21479]: audit 2024-02-13T14:57:29.420146+0000 mon.a (mon.0) 2771 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:30 smithi062 bash[28859]: cluster 2024-02-13T14:57:29.416037+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-02-13T14:57:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:30 smithi062 bash[28859]: audit 2024-02-13T14:57:29.419163+0000 mon.c (mon.2) 810 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:30 smithi062 bash[28859]: audit 2024-02-13T14:57:29.420146+0000 mon.a (mon.0) 2771 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:30.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:57:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:57:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:30 smithi111 bash[23388]: cluster 2024-02-13T14:57:29.416037+0000 mon.a (mon.0) 2770 : cluster 0 osdmap e512: 8 total, 8 up, 8 in 2024-02-13T14:57:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:30 smithi111 bash[23388]: audit 2024-02-13T14:57:29.419163+0000 mon.c (mon.2) 810 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:30 smithi111 bash[23388]: audit 2024-02-13T14:57:29.420146+0000 mon.a (mon.0) 2771 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[21479]: cluster 2024-02-13T14:57:30.097823+0000 mgr.y (mgr.14613) 541 : cluster 0 pgmap v835: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[21479]: cluster 2024-02-13T14:57:30.406725+0000 mon.a (mon.0) 2772 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[21479]: audit 2024-02-13T14:57:30.419710+0000 mon.a (mon.0) 2773 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[21479]: cluster 2024-02-13T14:57:30.433527+0000 mon.a (mon.0) 2774 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[21479]: audit 2024-02-13T14:57:30.447217+0000 mon.c (mon.2) 811 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[21479]: audit 2024-02-13T14:57:30.612885+0000 mgr.y (mgr.14613) 542 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[28859]: cluster 2024-02-13T14:57:30.097823+0000 mgr.y (mgr.14613) 541 : cluster 0 pgmap v835: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[28859]: cluster 2024-02-13T14:57:30.406725+0000 mon.a (mon.0) 2772 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[28859]: audit 2024-02-13T14:57:30.419710+0000 mon.a (mon.0) 2773 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[28859]: cluster 2024-02-13T14:57:30.433527+0000 mon.a (mon.0) 2774 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[28859]: audit 2024-02-13T14:57:30.447217+0000 mon.c (mon.2) 811 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:31 smithi062 bash[28859]: audit 2024-02-13T14:57:30.612885+0000 mgr.y (mgr.14613) 542 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:31 smithi111 bash[23388]: cluster 2024-02-13T14:57:30.097823+0000 mgr.y (mgr.14613) 541 : cluster 0 pgmap v835: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:31 smithi111 bash[23388]: cluster 2024-02-13T14:57:30.406725+0000 mon.a (mon.0) 2772 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:31 smithi111 bash[23388]: audit 2024-02-13T14:57:30.419710+0000 mon.a (mon.0) 2773 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-96","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:31 smithi111 bash[23388]: cluster 2024-02-13T14:57:30.433527+0000 mon.a (mon.0) 2774 : cluster 0 osdmap e513: 8 total, 8 up, 8 in 2024-02-13T14:57:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:31 smithi111 bash[23388]: audit 2024-02-13T14:57:30.447217+0000 mon.c (mon.2) 811 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:57:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:31 smithi111 bash[23388]: audit 2024-02-13T14:57:30.612885+0000 mgr.y (mgr.14613) 542 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:32 smithi062 bash[21479]: cluster 2024-02-13T14:57:31.438917+0000 mon.a (mon.0) 2775 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-02-13T14:57:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:32 smithi062 bash[21479]: cluster 2024-02-13T14:57:32.098762+0000 mgr.y (mgr.14613) 543 : cluster 0 pgmap v838: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:32 smithi062 bash[28859]: cluster 2024-02-13T14:57:31.438917+0000 mon.a (mon.0) 2775 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-02-13T14:57:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:32 smithi062 bash[28859]: cluster 2024-02-13T14:57:32.098762+0000 mgr.y (mgr.14613) 543 : cluster 0 pgmap v838: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:32 smithi111 bash[23388]: cluster 2024-02-13T14:57:31.438917+0000 mon.a (mon.0) 2775 : cluster 0 osdmap e514: 8 total, 8 up, 8 in 2024-02-13T14:57:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:32 smithi111 bash[23388]: cluster 2024-02-13T14:57:32.098762+0000 mgr.y (mgr.14613) 543 : cluster 0 pgmap v838: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:34.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:33 smithi062 bash[21479]: audit 2024-02-13T14:57:33.838315+0000 mon.b (mon.1) 241 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:34.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:33 smithi062 bash[28859]: audit 2024-02-13T14:57:33.838315+0000 mon.b (mon.1) 241 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:34.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:33 smithi111 bash[23388]: audit 2024-02-13T14:57:33.838315+0000 mon.b (mon.1) 241 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:35.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:34 smithi062 bash[21479]: cluster 2024-02-13T14:57:34.099635+0000 mgr.y (mgr.14613) 544 : cluster 0 pgmap v839: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 897 B/s rd, 179 B/s wr, 1 op/s 2024-02-13T14:57:35.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:34 smithi062 bash[28859]: cluster 2024-02-13T14:57:34.099635+0000 mgr.y (mgr.14613) 544 : cluster 0 pgmap v839: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 897 B/s rd, 179 B/s wr, 1 op/s 2024-02-13T14:57:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:34 smithi111 bash[23388]: cluster 2024-02-13T14:57:34.099635+0000 mgr.y (mgr.14613) 544 : cluster 0 pgmap v839: 324 pgs: 32 creating+peering, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 897 B/s rd, 179 B/s wr, 1 op/s 2024-02-13T14:57:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:57:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:57:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:57:37.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:37 smithi062 bash[21479]: cluster 2024-02-13T14:57:36.102629+0000 mgr.y (mgr.14613) 545 : cluster 0 pgmap v840: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 918 B/s wr, 3 op/s 2024-02-13T14:57:37.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:37 smithi062 bash[28859]: cluster 2024-02-13T14:57:36.102629+0000 mgr.y (mgr.14613) 545 : cluster 0 pgmap v840: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 918 B/s wr, 3 op/s 2024-02-13T14:57:37.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:37 smithi111 bash[23388]: cluster 2024-02-13T14:57:36.102629+0000 mgr.y (mgr.14613) 545 : cluster 0 pgmap v840: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 918 B/s wr, 3 op/s 2024-02-13T14:57:38.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:38 smithi062 bash[21479]: cluster 2024-02-13T14:57:37.369214+0000 mon.a (mon.0) 2776 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:38.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:38 smithi062 bash[28859]: cluster 2024-02-13T14:57:37.369214+0000 mon.a (mon.0) 2776 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:38.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:38 smithi111 bash[23388]: cluster 2024-02-13T14:57:37.369214+0000 mon.a (mon.0) 2776 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:39.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:39 smithi062 bash[21479]: cluster 2024-02-13T14:57:38.103507+0000 mgr.y (mgr.14613) 546 : cluster 0 pgmap v841: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-02-13T14:57:39.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:39 smithi062 bash[28859]: cluster 2024-02-13T14:57:38.103507+0000 mgr.y (mgr.14613) 546 : cluster 0 pgmap v841: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-02-13T14:57:39.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:39 smithi111 bash[23388]: cluster 2024-02-13T14:57:38.103507+0000 mgr.y (mgr.14613) 546 : cluster 0 pgmap v841: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 639 B/s wr, 1 op/s 2024-02-13T14:57:40.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:40 smithi062 bash[21479]: audit 2024-02-13T14:57:39.797287+0000 mon.b (mon.1) 242 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:57:40.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:40 smithi062 bash[28859]: audit 2024-02-13T14:57:39.797287+0000 mon.b (mon.1) 242 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:57:40.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:40 smithi111 bash[23388]: audit 2024-02-13T14:57:39.797287+0000 mon.b (mon.1) 242 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:57:41.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:57:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:57:41.495 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[28859]: cluster 2024-02-13T14:57:40.106336+0000 mgr.y (mgr.14613) 547 : cluster 0 pgmap v842: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 528 B/s wr, 2 op/s 2024-02-13T14:57:41.495 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[28859]: audit 2024-02-13T14:57:40.531745+0000 mon.b (mon.1) 243 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:57:41.496 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[28859]: audit 2024-02-13T14:57:40.533499+0000 mon.b (mon.1) 244 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:57:41.496 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[28859]: audit 2024-02-13T14:57:40.541989+0000 mon.a (mon.0) 2777 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:57:41.496 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[21479]: cluster 2024-02-13T14:57:40.106336+0000 mgr.y (mgr.14613) 547 : cluster 0 pgmap v842: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 528 B/s wr, 2 op/s 2024-02-13T14:57:41.496 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[21479]: audit 2024-02-13T14:57:40.531745+0000 mon.b (mon.1) 243 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:57:41.496 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[21479]: audit 2024-02-13T14:57:40.533499+0000 mon.b (mon.1) 244 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:57:41.496 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[21479]: audit 2024-02-13T14:57:40.541989+0000 mon.a (mon.0) 2777 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:57:41.496 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:41 smithi111 bash[23388]: cluster 2024-02-13T14:57:40.106336+0000 mgr.y (mgr.14613) 547 : cluster 0 pgmap v842: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 528 B/s wr, 2 op/s 2024-02-13T14:57:41.497 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:41 smithi111 bash[23388]: audit 2024-02-13T14:57:40.531745+0000 mon.b (mon.1) 243 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:57:41.497 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:41 smithi111 bash[23388]: audit 2024-02-13T14:57:40.533499+0000 mon.b (mon.1) 244 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:57:41.497 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:41 smithi111 bash[23388]: audit 2024-02-13T14:57:40.541989+0000 mon.a (mon.0) 2777 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:57:41.812 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[31865]: debug 2024-02-13T14:57:41.493+0000 7f6068440700 -1 snap_mapper.add_oid found existing snaps mapped on 99:6050f5fe:test-rados-api-smithi062-64695-97::foo:21, removing 2024-02-13T14:57:41.813 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 14:57:41 smithi062 bash[49158]: debug 2024-02-13T14:57:41.493+0000 7fd55aa2d700 -1 snap_mapper.add_oid found existing snaps mapped on 99:6050f5fe:test-rados-api-smithi062-64695-97::foo:21, removing 2024-02-13T14:57:41.844 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 14:57:41 smithi111 bash[26921]: debug 2024-02-13T14:57:41.490+0000 7f5ae9cf9700 -1 snap_mapper.add_oid found existing snaps mapped on 99:6050f5fe:test-rados-api-smithi062-64695-97::foo:21, removing 2024-02-13T14:57:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[28859]: audit 2024-02-13T14:57:40.621530+0000 mgr.y (mgr.14613) 548 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[28859]: audit 2024-02-13T14:57:41.532977+0000 mon.c (mon.2) 812 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[28859]: audit 2024-02-13T14:57:41.533761+0000 mon.a (mon.0) 2778 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[28859]: audit 2024-02-13T14:57:41.534835+0000 mon.c (mon.2) 813 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-96"}]: dispatch 2024-02-13T14:57:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[28859]: audit 2024-02-13T14:57:41.535583+0000 mon.a (mon.0) 2779 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-96"}]: dispatch 2024-02-13T14:57:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[21479]: audit 2024-02-13T14:57:40.621530+0000 mgr.y (mgr.14613) 548 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[21479]: audit 2024-02-13T14:57:41.532977+0000 mon.c (mon.2) 812 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[21479]: audit 2024-02-13T14:57:41.533761+0000 mon.a (mon.0) 2778 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[21479]: audit 2024-02-13T14:57:41.534835+0000 mon.c (mon.2) 813 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-96"}]: dispatch 2024-02-13T14:57:42.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:42 smithi062 bash[21479]: audit 2024-02-13T14:57:41.535583+0000 mon.a (mon.0) 2779 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-96"}]: dispatch 2024-02-13T14:57:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:42 smithi111 bash[23388]: audit 2024-02-13T14:57:40.621530+0000 mgr.y (mgr.14613) 548 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:42 smithi111 bash[23388]: audit 2024-02-13T14:57:41.532977+0000 mon.c (mon.2) 812 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:42 smithi111 bash[23388]: audit 2024-02-13T14:57:41.533761+0000 mon.a (mon.0) 2778 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:42 smithi111 bash[23388]: audit 2024-02-13T14:57:41.534835+0000 mon.c (mon.2) 813 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-96"}]: dispatch 2024-02-13T14:57:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:42 smithi111 bash[23388]: audit 2024-02-13T14:57:41.535583+0000 mon.a (mon.0) 2779 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-96"}]: dispatch 2024-02-13T14:57:43.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:43 smithi062 bash[28859]: cluster 2024-02-13T14:57:42.107228+0000 mgr.y (mgr.14613) 549 : cluster 0 pgmap v843: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 479 B/s wr, 1 op/s 2024-02-13T14:57:43.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:43 smithi062 bash[28859]: cluster 2024-02-13T14:57:42.203212+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-02-13T14:57:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:43 smithi062 bash[21479]: cluster 2024-02-13T14:57:42.107228+0000 mgr.y (mgr.14613) 549 : cluster 0 pgmap v843: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 479 B/s wr, 1 op/s 2024-02-13T14:57:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:43 smithi062 bash[21479]: cluster 2024-02-13T14:57:42.203212+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-02-13T14:57:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:43 smithi111 bash[23388]: cluster 2024-02-13T14:57:42.107228+0000 mgr.y (mgr.14613) 549 : cluster 0 pgmap v843: 324 pgs: 324 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 959 B/s rd, 479 B/s wr, 1 op/s 2024-02-13T14:57:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:43 smithi111 bash[23388]: cluster 2024-02-13T14:57:42.203212+0000 mon.a (mon.0) 2780 : cluster 0 osdmap e515: 8 total, 8 up, 8 in 2024-02-13T14:57:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[28859]: cluster 2024-02-13T14:57:43.209961+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-02-13T14:57:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[28859]: audit 2024-02-13T14:57:43.213339+0000 mon.c (mon.2) 814 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[28859]: audit 2024-02-13T14:57:43.249681+0000 mon.a (mon.0) 2782 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[28859]: audit 2024-02-13T14:57:44.202758+0000 mon.a (mon.0) 2783 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:44.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[28859]: cluster 2024-02-13T14:57:44.212491+0000 mon.a (mon.0) 2784 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-02-13T14:57:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[21479]: cluster 2024-02-13T14:57:43.209961+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-02-13T14:57:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[21479]: audit 2024-02-13T14:57:43.213339+0000 mon.c (mon.2) 814 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[21479]: audit 2024-02-13T14:57:43.249681+0000 mon.a (mon.0) 2782 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[21479]: audit 2024-02-13T14:57:44.202758+0000 mon.a (mon.0) 2783 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:44 smithi062 bash[21479]: cluster 2024-02-13T14:57:44.212491+0000 mon.a (mon.0) 2784 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-02-13T14:57:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:44 smithi111 bash[23388]: cluster 2024-02-13T14:57:43.209961+0000 mon.a (mon.0) 2781 : cluster 0 osdmap e516: 8 total, 8 up, 8 in 2024-02-13T14:57:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:44 smithi111 bash[23388]: audit 2024-02-13T14:57:43.213339+0000 mon.c (mon.2) 814 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:44 smithi111 bash[23388]: audit 2024-02-13T14:57:43.249681+0000 mon.a (mon.0) 2782 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:44 smithi111 bash[23388]: audit 2024-02-13T14:57:44.202758+0000 mon.a (mon.0) 2783 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-98","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:44 smithi111 bash[23388]: cluster 2024-02-13T14:57:44.212491+0000 mon.a (mon.0) 2784 : cluster 0 osdmap e517: 8 total, 8 up, 8 in 2024-02-13T14:57:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[28859]: cluster 2024-02-13T14:57:44.108215+0000 mgr.y (mgr.14613) 550 : cluster 0 pgmap v846: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[28859]: cluster 2024-02-13T14:57:44.231047+0000 mon.a (mon.0) 2785 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[28859]: audit 2024-02-13T14:57:44.273122+0000 mon.c (mon.2) 815 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[28859]: audit 2024-02-13T14:57:44.273840+0000 mon.a (mon.0) 2786 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[28859]: audit 2024-02-13T14:57:45.237358+0000 mon.a (mon.0) 2787 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[28859]: cluster 2024-02-13T14:57:45.246872+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[28859]: audit 2024-02-13T14:57:45.249130+0000 mon.c (mon.2) 816 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]: dispatch 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[28859]: audit 2024-02-13T14:57:45.250122+0000 mon.a (mon.0) 2789 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]: dispatch 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[21479]: cluster 2024-02-13T14:57:44.108215+0000 mgr.y (mgr.14613) 550 : cluster 0 pgmap v846: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[21479]: cluster 2024-02-13T14:57:44.231047+0000 mon.a (mon.0) 2785 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[21479]: audit 2024-02-13T14:57:44.273122+0000 mon.c (mon.2) 815 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:45.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[21479]: audit 2024-02-13T14:57:44.273840+0000 mon.a (mon.0) 2786 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:45.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[21479]: audit 2024-02-13T14:57:45.237358+0000 mon.a (mon.0) 2787 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:57:45.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[21479]: cluster 2024-02-13T14:57:45.246872+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-02-13T14:57:45.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[21479]: audit 2024-02-13T14:57:45.249130+0000 mon.c (mon.2) 816 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]: dispatch 2024-02-13T14:57:45.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:45 smithi062 bash[21479]: audit 2024-02-13T14:57:45.250122+0000 mon.a (mon.0) 2789 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]: dispatch 2024-02-13T14:57:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:45 smithi111 bash[23388]: cluster 2024-02-13T14:57:44.108215+0000 mgr.y (mgr.14613) 550 : cluster 0 pgmap v846: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 629 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T14:57:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:45 smithi111 bash[23388]: cluster 2024-02-13T14:57:44.231047+0000 mon.a (mon.0) 2785 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:45 smithi111 bash[23388]: audit 2024-02-13T14:57:44.273122+0000 mon.c (mon.2) 815 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:45 smithi111 bash[23388]: audit 2024-02-13T14:57:44.273840+0000 mon.a (mon.0) 2786 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:45 smithi111 bash[23388]: audit 2024-02-13T14:57:45.237358+0000 mon.a (mon.0) 2787 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:57:45.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:45 smithi111 bash[23388]: cluster 2024-02-13T14:57:45.246872+0000 mon.a (mon.0) 2788 : cluster 0 osdmap e518: 8 total, 8 up, 8 in 2024-02-13T14:57:45.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:45 smithi111 bash[23388]: audit 2024-02-13T14:57:45.249130+0000 mon.c (mon.2) 816 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]: dispatch 2024-02-13T14:57:45.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:45 smithi111 bash[23388]: audit 2024-02-13T14:57:45.250122+0000 mon.a (mon.0) 2789 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]: dispatch 2024-02-13T14:57:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:57:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:57:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[28859]: cluster 2024-02-13T14:57:46.237802+0000 mon.a (mon.0) 2790 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[28859]: audit 2024-02-13T14:57:46.240231+0000 mon.a (mon.0) 2791 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]': finished 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[28859]: cluster 2024-02-13T14:57:46.248689+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[28859]: audit 2024-02-13T14:57:46.251385+0000 mon.c (mon.2) 817 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[28859]: audit 2024-02-13T14:57:46.252352+0000 mon.a (mon.0) 2793 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[21479]: cluster 2024-02-13T14:57:46.237802+0000 mon.a (mon.0) 2790 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[21479]: audit 2024-02-13T14:57:46.240231+0000 mon.a (mon.0) 2791 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]': finished 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[21479]: cluster 2024-02-13T14:57:46.248689+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[21479]: audit 2024-02-13T14:57:46.251385+0000 mon.c (mon.2) 817 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:46 smithi062 bash[21479]: audit 2024-02-13T14:57:46.252352+0000 mon.a (mon.0) 2793 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:46.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:46 smithi111 bash[23388]: cluster 2024-02-13T14:57:46.237802+0000 mon.a (mon.0) 2790 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:57:46.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:46 smithi111 bash[23388]: audit 2024-02-13T14:57:46.240231+0000 mon.a (mon.0) 2791 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-98", "mode": "writeback"}]': finished 2024-02-13T14:57:46.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:46 smithi111 bash[23388]: cluster 2024-02-13T14:57:46.248689+0000 mon.a (mon.0) 2792 : cluster 0 osdmap e519: 8 total, 8 up, 8 in 2024-02-13T14:57:46.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:46 smithi111 bash[23388]: audit 2024-02-13T14:57:46.251385+0000 mon.c (mon.2) 817 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:46.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:46 smithi111 bash[23388]: audit 2024-02-13T14:57:46.252352+0000 mon.a (mon.0) 2793 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[21479]: cluster 2024-02-13T14:57:46.109193+0000 mgr.y (mgr.14613) 551 : cluster 0 pgmap v849: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-02-13T14:57:47.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[21479]: audit 2024-02-13T14:57:47.242842+0000 mon.a (mon.0) 2794 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]': finished 2024-02-13T14:57:47.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[21479]: cluster 2024-02-13T14:57:47.253100+0000 mon.a (mon.0) 2795 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-02-13T14:57:47.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[21479]: audit 2024-02-13T14:57:47.253483+0000 mon.c (mon.2) 818 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:57:47.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[21479]: audit 2024-02-13T14:57:47.259743+0000 mon.a (mon.0) 2796 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:57:47.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[28859]: cluster 2024-02-13T14:57:46.109193+0000 mgr.y (mgr.14613) 551 : cluster 0 pgmap v849: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-02-13T14:57:47.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[28859]: audit 2024-02-13T14:57:47.242842+0000 mon.a (mon.0) 2794 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]': finished 2024-02-13T14:57:47.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[28859]: cluster 2024-02-13T14:57:47.253100+0000 mon.a (mon.0) 2795 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-02-13T14:57:47.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[28859]: audit 2024-02-13T14:57:47.253483+0000 mon.c (mon.2) 818 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:57:47.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:47 smithi062 bash[28859]: audit 2024-02-13T14:57:47.259743+0000 mon.a (mon.0) 2796 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:57:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:47 smithi111 bash[23388]: cluster 2024-02-13T14:57:46.109193+0000 mgr.y (mgr.14613) 551 : cluster 0 pgmap v849: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 0 op/s 2024-02-13T14:57:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:47 smithi111 bash[23388]: audit 2024-02-13T14:57:47.242842+0000 mon.a (mon.0) 2794 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-98"}]': finished 2024-02-13T14:57:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:47 smithi111 bash[23388]: cluster 2024-02-13T14:57:47.253100+0000 mon.a (mon.0) 2795 : cluster 0 osdmap e520: 8 total, 8 up, 8 in 2024-02-13T14:57:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:47 smithi111 bash[23388]: audit 2024-02-13T14:57:47.253483+0000 mon.c (mon.2) 818 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:57:47.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:47 smithi111 bash[23388]: audit 2024-02-13T14:57:47.259743+0000 mon.a (mon.0) 2796 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T14:57:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[28859]: cluster 2024-02-13T14:57:48.243150+0000 mon.a (mon.0) 2797 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:57:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[28859]: audit 2024-02-13T14:57:48.245501+0000 mon.a (mon.0) 2798 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:57:48.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[28859]: cluster 2024-02-13T14:57:48.253839+0000 mon.a (mon.0) 2799 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-02-13T14:57:48.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[28859]: audit 2024-02-13T14:57:48.259197+0000 mon.c (mon.2) 819 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T14:57:48.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[28859]: audit 2024-02-13T14:57:48.261353+0000 mon.a (mon.0) 2800 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T14:57:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[21479]: cluster 2024-02-13T14:57:48.243150+0000 mon.a (mon.0) 2797 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:57:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[21479]: audit 2024-02-13T14:57:48.245501+0000 mon.a (mon.0) 2798 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:57:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[21479]: cluster 2024-02-13T14:57:48.253839+0000 mon.a (mon.0) 2799 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-02-13T14:57:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[21479]: audit 2024-02-13T14:57:48.259197+0000 mon.c (mon.2) 819 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T14:57:48.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:48 smithi062 bash[21479]: audit 2024-02-13T14:57:48.261353+0000 mon.a (mon.0) 2800 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T14:57:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:48 smithi111 bash[23388]: cluster 2024-02-13T14:57:48.243150+0000 mon.a (mon.0) 2797 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:57:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:48 smithi111 bash[23388]: audit 2024-02-13T14:57:48.245501+0000 mon.a (mon.0) 2798 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T14:57:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:48 smithi111 bash[23388]: cluster 2024-02-13T14:57:48.253839+0000 mon.a (mon.0) 2799 : cluster 0 osdmap e521: 8 total, 8 up, 8 in 2024-02-13T14:57:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:48 smithi111 bash[23388]: audit 2024-02-13T14:57:48.259197+0000 mon.c (mon.2) 819 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T14:57:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:48 smithi111 bash[23388]: audit 2024-02-13T14:57:48.261353+0000 mon.a (mon.0) 2800 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]: dispatch 2024-02-13T14:57:49.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[21479]: cluster 2024-02-13T14:57:48.110104+0000 mgr.y (mgr.14613) 552 : cluster 0 pgmap v852: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:57:49.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[21479]: audit 2024-02-13T14:57:48.875837+0000 mon.b (mon.1) 245 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[21479]: audit 2024-02-13T14:57:49.248092+0000 mon.a (mon.0) 2801 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]': finished 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[21479]: audit 2024-02-13T14:57:49.259341+0000 mon.c (mon.2) 820 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[21479]: cluster 2024-02-13T14:57:49.261122+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[21479]: audit 2024-02-13T14:57:49.263193+0000 mon.a (mon.0) 2803 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[28859]: cluster 2024-02-13T14:57:48.110104+0000 mgr.y (mgr.14613) 552 : cluster 0 pgmap v852: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[28859]: audit 2024-02-13T14:57:48.875837+0000 mon.b (mon.1) 245 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[28859]: audit 2024-02-13T14:57:49.248092+0000 mon.a (mon.0) 2801 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]': finished 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[28859]: audit 2024-02-13T14:57:49.259341+0000 mon.c (mon.2) 820 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[28859]: cluster 2024-02-13T14:57:49.261122+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-02-13T14:57:49.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:49 smithi062 bash[28859]: audit 2024-02-13T14:57:49.263193+0000 mon.a (mon.0) 2803 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:57:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:49 smithi111 bash[23388]: cluster 2024-02-13T14:57:48.110104+0000 mgr.y (mgr.14613) 552 : cluster 0 pgmap v852: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T14:57:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:49 smithi111 bash[23388]: audit 2024-02-13T14:57:48.875837+0000 mon.b (mon.1) 245 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:57:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:49 smithi111 bash[23388]: audit 2024-02-13T14:57:49.248092+0000 mon.a (mon.0) 2801 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_count","val": "1"}]': finished 2024-02-13T14:57:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:49 smithi111 bash[23388]: audit 2024-02-13T14:57:49.259341+0000 mon.c (mon.2) 820 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:57:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:49 smithi111 bash[23388]: cluster 2024-02-13T14:57:49.261122+0000 mon.a (mon.0) 2802 : cluster 0 osdmap e522: 8 total, 8 up, 8 in 2024-02-13T14:57:49.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:49 smithi111 bash[23388]: audit 2024-02-13T14:57:49.263193+0000 mon.a (mon.0) 2803 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:57:51.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:57:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:57:51.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[21479]: cluster 2024-02-13T14:57:50.112946+0000 mgr.y (mgr.14613) 553 : cluster 0 pgmap v855: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[21479]: audit 2024-02-13T14:57:50.250743+0000 mon.a (mon.0) 2804 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[21479]: cluster 2024-02-13T14:57:50.260204+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[21479]: audit 2024-02-13T14:57:50.262300+0000 mon.c (mon.2) 821 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[21479]: audit 2024-02-13T14:57:50.264927+0000 mon.a (mon.0) 2806 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[28859]: cluster 2024-02-13T14:57:50.112946+0000 mgr.y (mgr.14613) 553 : cluster 0 pgmap v855: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[28859]: audit 2024-02-13T14:57:50.250743+0000 mon.a (mon.0) 2804 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[28859]: cluster 2024-02-13T14:57:50.260204+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[28859]: audit 2024-02-13T14:57:50.262300+0000 mon.c (mon.2) 821 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T14:57:51.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:51 smithi062 bash[28859]: audit 2024-02-13T14:57:50.264927+0000 mon.a (mon.0) 2806 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T14:57:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:51 smithi111 bash[23388]: cluster 2024-02-13T14:57:50.112946+0000 mgr.y (mgr.14613) 553 : cluster 0 pgmap v855: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:51 smithi111 bash[23388]: audit 2024-02-13T14:57:50.250743+0000 mon.a (mon.0) 2804 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:57:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:51 smithi111 bash[23388]: cluster 2024-02-13T14:57:50.260204+0000 mon.a (mon.0) 2805 : cluster 0 osdmap e523: 8 total, 8 up, 8 in 2024-02-13T14:57:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:51 smithi111 bash[23388]: audit 2024-02-13T14:57:50.262300+0000 mon.c (mon.2) 821 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T14:57:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:51 smithi111 bash[23388]: audit 2024-02-13T14:57:50.264927+0000 mon.a (mon.0) 2806 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]: dispatch 2024-02-13T14:57:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[21479]: audit 2024-02-13T14:57:50.630483+0000 mgr.y (mgr.14613) 554 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[21479]: audit 2024-02-13T14:57:51.263286+0000 mon.a (mon.0) 2807 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]': finished 2024-02-13T14:57:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[21479]: cluster 2024-02-13T14:57:51.270857+0000 mon.a (mon.0) 2808 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-02-13T14:57:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[21479]: audit 2024-02-13T14:57:51.350506+0000 mon.c (mon.2) 822 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[21479]: audit 2024-02-13T14:57:51.351273+0000 mon.a (mon.0) 2809 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[28859]: audit 2024-02-13T14:57:50.630483+0000 mgr.y (mgr.14613) 554 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[28859]: audit 2024-02-13T14:57:51.263286+0000 mon.a (mon.0) 2807 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]': finished 2024-02-13T14:57:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[28859]: cluster 2024-02-13T14:57:51.270857+0000 mon.a (mon.0) 2808 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-02-13T14:57:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[28859]: audit 2024-02-13T14:57:51.350506+0000 mon.c (mon.2) 822 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:52.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:52 smithi062 bash[28859]: audit 2024-02-13T14:57:51.351273+0000 mon.a (mon.0) 2809 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:52 smithi111 bash[23388]: audit 2024-02-13T14:57:50.630483+0000 mgr.y (mgr.14613) 554 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:57:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:52 smithi111 bash[23388]: audit 2024-02-13T14:57:51.263286+0000 mon.a (mon.0) 2807 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-98","var": "target_max_objects","val": "250"}]': finished 2024-02-13T14:57:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:52 smithi111 bash[23388]: cluster 2024-02-13T14:57:51.270857+0000 mon.a (mon.0) 2808 : cluster 0 osdmap e524: 8 total, 8 up, 8 in 2024-02-13T14:57:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:52 smithi111 bash[23388]: audit 2024-02-13T14:57:51.350506+0000 mon.c (mon.2) 822 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:52 smithi111 bash[23388]: audit 2024-02-13T14:57:51.351273+0000 mon.a (mon.0) 2809 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:57:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[21479]: cluster 2024-02-13T14:57:52.113892+0000 mgr.y (mgr.14613) 555 : cluster 0 pgmap v858: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[21479]: audit 2024-02-13T14:57:52.265983+0000 mon.a (mon.0) 2810 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[21479]: cluster 2024-02-13T14:57:52.273413+0000 mon.a (mon.0) 2811 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[21479]: audit 2024-02-13T14:57:52.275381+0000 mon.c (mon.2) 823 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[21479]: audit 2024-02-13T14:57:52.276726+0000 mon.a (mon.0) 2812 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[21479]: cluster 2024-02-13T14:57:52.670730+0000 mon.a (mon.0) 2813 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[21479]: audit 2024-02-13T14:57:53.268598+0000 mon.a (mon.0) 2814 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]': finished 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[28859]: cluster 2024-02-13T14:57:52.113892+0000 mgr.y (mgr.14613) 555 : cluster 0 pgmap v858: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[28859]: audit 2024-02-13T14:57:52.265983+0000 mon.a (mon.0) 2810 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[28859]: cluster 2024-02-13T14:57:52.273413+0000 mon.a (mon.0) 2811 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[28859]: audit 2024-02-13T14:57:52.275381+0000 mon.c (mon.2) 823 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[28859]: audit 2024-02-13T14:57:52.276726+0000 mon.a (mon.0) 2812 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[28859]: cluster 2024-02-13T14:57:52.670730+0000 mon.a (mon.0) 2813 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:53.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:53 smithi062 bash[28859]: audit 2024-02-13T14:57:53.268598+0000 mon.a (mon.0) 2814 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]': finished 2024-02-13T14:57:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:53 smithi111 bash[23388]: cluster 2024-02-13T14:57:52.113892+0000 mgr.y (mgr.14613) 555 : cluster 0 pgmap v858: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:53 smithi111 bash[23388]: audit 2024-02-13T14:57:52.265983+0000 mon.a (mon.0) 2810 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:57:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:53 smithi111 bash[23388]: cluster 2024-02-13T14:57:52.273413+0000 mon.a (mon.0) 2811 : cluster 0 osdmap e525: 8 total, 8 up, 8 in 2024-02-13T14:57:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:53 smithi111 bash[23388]: audit 2024-02-13T14:57:52.275381+0000 mon.c (mon.2) 823 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:53 smithi111 bash[23388]: audit 2024-02-13T14:57:52.276726+0000 mon.a (mon.0) 2812 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]: dispatch 2024-02-13T14:57:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:53 smithi111 bash[23388]: cluster 2024-02-13T14:57:52.670730+0000 mon.a (mon.0) 2813 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:53.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:53 smithi111 bash[23388]: audit 2024-02-13T14:57:53.268598+0000 mon.a (mon.0) 2814 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-98"}]': finished 2024-02-13T14:57:54.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:54 smithi062 bash[21479]: cluster 2024-02-13T14:57:53.278664+0000 mon.a (mon.0) 2815 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-02-13T14:57:54.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:54 smithi062 bash[28859]: cluster 2024-02-13T14:57:53.278664+0000 mon.a (mon.0) 2815 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-02-13T14:57:54.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:54 smithi111 bash[23388]: cluster 2024-02-13T14:57:53.278664+0000 mon.a (mon.0) 2815 : cluster 0 osdmap e526: 8 total, 8 up, 8 in 2024-02-13T14:57:55.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:55 smithi062 bash[21479]: cluster 2024-02-13T14:57:54.114815+0000 mgr.y (mgr.14613) 556 : cluster 0 pgmap v861: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:55.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:55 smithi062 bash[21479]: cluster 2024-02-13T14:57:54.302837+0000 mon.a (mon.0) 2816 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-02-13T14:57:55.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:55 smithi062 bash[28859]: cluster 2024-02-13T14:57:54.114815+0000 mgr.y (mgr.14613) 556 : cluster 0 pgmap v861: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:55.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:55 smithi062 bash[28859]: cluster 2024-02-13T14:57:54.302837+0000 mon.a (mon.0) 2816 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-02-13T14:57:55.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:55 smithi111 bash[23388]: cluster 2024-02-13T14:57:54.114815+0000 mgr.y (mgr.14613) 556 : cluster 0 pgmap v861: 324 pgs: 324 active+clean; 8.4 MiB data, 634 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:57:55.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:55 smithi111 bash[23388]: cluster 2024-02-13T14:57:54.302837+0000 mon.a (mon.0) 2816 : cluster 0 osdmap e527: 8 total, 8 up, 8 in 2024-02-13T14:57:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:57:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:57:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:57:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:56 smithi062 bash[28859]: cluster 2024-02-13T14:57:55.319038+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-02-13T14:57:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:56 smithi062 bash[28859]: audit 2024-02-13T14:57:55.333918+0000 mon.c (mon.2) 824 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:56 smithi062 bash[28859]: audit 2024-02-13T14:57:55.336203+0000 mon.a (mon.0) 2818 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:56.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:56 smithi062 bash[21479]: cluster 2024-02-13T14:57:55.319038+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-02-13T14:57:56.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:56 smithi062 bash[21479]: audit 2024-02-13T14:57:55.333918+0000 mon.c (mon.2) 824 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:56.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:56 smithi062 bash[21479]: audit 2024-02-13T14:57:55.336203+0000 mon.a (mon.0) 2818 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:56 smithi111 bash[23388]: cluster 2024-02-13T14:57:55.319038+0000 mon.a (mon.0) 2817 : cluster 0 osdmap e528: 8 total, 8 up, 8 in 2024-02-13T14:57:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:56 smithi111 bash[23388]: audit 2024-02-13T14:57:55.333918+0000 mon.c (mon.2) 824 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:56 smithi111 bash[23388]: audit 2024-02-13T14:57:55.336203+0000 mon.a (mon.0) 2818 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:57:57.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[21479]: cluster 2024-02-13T14:57:56.115834+0000 mgr.y (mgr.14613) 557 : cluster 0 pgmap v864: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:57.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[21479]: audit 2024-02-13T14:57:56.313101+0000 mon.a (mon.0) 2819 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[21479]: cluster 2024-02-13T14:57:56.322121+0000 mon.a (mon.0) 2820 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-02-13T14:57:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[21479]: audit 2024-02-13T14:57:56.328482+0000 mon.c (mon.2) 825 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[21479]: audit 2024-02-13T14:57:56.348102+0000 mon.a (mon.0) 2821 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:57.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[28859]: cluster 2024-02-13T14:57:56.115834+0000 mgr.y (mgr.14613) 557 : cluster 0 pgmap v864: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:57.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[28859]: audit 2024-02-13T14:57:56.313101+0000 mon.a (mon.0) 2819 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:57.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[28859]: cluster 2024-02-13T14:57:56.322121+0000 mon.a (mon.0) 2820 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-02-13T14:57:57.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[28859]: audit 2024-02-13T14:57:56.328482+0000 mon.c (mon.2) 825 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:57.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:57 smithi062 bash[28859]: audit 2024-02-13T14:57:56.348102+0000 mon.a (mon.0) 2821 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:57.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:57 smithi111 bash[23388]: cluster 2024-02-13T14:57:56.115834+0000 mgr.y (mgr.14613) 557 : cluster 0 pgmap v864: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:57.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:57 smithi111 bash[23388]: audit 2024-02-13T14:57:56.313101+0000 mon.a (mon.0) 2819 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-100","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:57:57.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:57 smithi111 bash[23388]: cluster 2024-02-13T14:57:56.322121+0000 mon.a (mon.0) 2820 : cluster 0 osdmap e529: 8 total, 8 up, 8 in 2024-02-13T14:57:57.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:57 smithi111 bash[23388]: audit 2024-02-13T14:57:56.328482+0000 mon.c (mon.2) 825 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:57.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:57 smithi111 bash[23388]: audit 2024-02-13T14:57:56.348102+0000 mon.a (mon.0) 2821 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:57:58.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[28859]: audit 2024-02-13T14:57:57.331873+0000 mon.a (mon.0) 2822 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[28859]: cluster 2024-02-13T14:57:57.340414+0000 mon.a (mon.0) 2823 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[28859]: audit 2024-02-13T14:57:57.343847+0000 mon.c (mon.2) 826 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[28859]: audit 2024-02-13T14:57:57.359182+0000 mon.a (mon.0) 2824 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[28859]: cluster 2024-02-13T14:57:57.671930+0000 mon.a (mon.0) 2825 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[21479]: audit 2024-02-13T14:57:57.331873+0000 mon.a (mon.0) 2822 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[21479]: cluster 2024-02-13T14:57:57.340414+0000 mon.a (mon.0) 2823 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[21479]: audit 2024-02-13T14:57:57.343847+0000 mon.c (mon.2) 826 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[21479]: audit 2024-02-13T14:57:57.359182+0000 mon.a (mon.0) 2824 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:57:58.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:58 smithi062 bash[21479]: cluster 2024-02-13T14:57:57.671930+0000 mon.a (mon.0) 2825 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:58 smithi111 bash[23388]: audit 2024-02-13T14:57:57.331873+0000 mon.a (mon.0) 2822 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:57:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:58 smithi111 bash[23388]: cluster 2024-02-13T14:57:57.340414+0000 mon.a (mon.0) 2823 : cluster 0 osdmap e530: 8 total, 8 up, 8 in 2024-02-13T14:57:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:58 smithi111 bash[23388]: audit 2024-02-13T14:57:57.343847+0000 mon.c (mon.2) 826 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:57:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:58 smithi111 bash[23388]: audit 2024-02-13T14:57:57.359182+0000 mon.a (mon.0) 2824 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:57:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:58 smithi111 bash[23388]: cluster 2024-02-13T14:57:57.671930+0000 mon.a (mon.0) 2825 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:57:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[28859]: cluster 2024-02-13T14:57:58.116794+0000 mgr.y (mgr.14613) 558 : cluster 0 pgmap v867: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[28859]: audit 2024-02-13T14:57:58.360185+0000 mon.a (mon.0) 2826 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]': finished 2024-02-13T14:57:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[28859]: cluster 2024-02-13T14:57:58.369430+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-02-13T14:57:59.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[28859]: audit 2024-02-13T14:57:58.371815+0000 mon.c (mon.2) 827 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]: dispatch 2024-02-13T14:57:59.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[28859]: audit 2024-02-13T14:57:58.375728+0000 mon.a (mon.0) 2828 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]: dispatch 2024-02-13T14:57:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[21479]: cluster 2024-02-13T14:57:58.116794+0000 mgr.y (mgr.14613) 558 : cluster 0 pgmap v867: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[21479]: audit 2024-02-13T14:57:58.360185+0000 mon.a (mon.0) 2826 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]': finished 2024-02-13T14:57:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[21479]: cluster 2024-02-13T14:57:58.369430+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-02-13T14:57:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[21479]: audit 2024-02-13T14:57:58.371815+0000 mon.c (mon.2) 827 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]: dispatch 2024-02-13T14:57:59.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:57:59 smithi062 bash[21479]: audit 2024-02-13T14:57:58.375728+0000 mon.a (mon.0) 2828 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]: dispatch 2024-02-13T14:57:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:59 smithi111 bash[23388]: cluster 2024-02-13T14:57:58.116794+0000 mgr.y (mgr.14613) 558 : cluster 0 pgmap v867: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:57:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:59 smithi111 bash[23388]: audit 2024-02-13T14:57:58.360185+0000 mon.a (mon.0) 2826 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-6", "overlaypool": "test-rados-api-smithi062-64695-100"}]': finished 2024-02-13T14:57:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:59 smithi111 bash[23388]: cluster 2024-02-13T14:57:58.369430+0000 mon.a (mon.0) 2827 : cluster 0 osdmap e531: 8 total, 8 up, 8 in 2024-02-13T14:57:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:59 smithi111 bash[23388]: audit 2024-02-13T14:57:58.371815+0000 mon.c (mon.2) 827 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]: dispatch 2024-02-13T14:57:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:57:59 smithi111 bash[23388]: audit 2024-02-13T14:57:58.375728+0000 mon.a (mon.0) 2828 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]: dispatch 2024-02-13T14:58:00.637 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:00 smithi111 bash[23388]: cluster 2024-02-13T14:57:59.360616+0000 mon.a (mon.0) 2829 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:00.637 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:00 smithi111 bash[23388]: audit 2024-02-13T14:57:59.364912+0000 mon.a (mon.0) 2830 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]': finished 2024-02-13T14:58:00.638 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:00 smithi111 bash[23388]: cluster 2024-02-13T14:57:59.372590+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-02-13T14:58:00.638 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:00 smithi111 bash[23388]: audit 2024-02-13T14:57:59.377037+0000 mon.c (mon.2) 828 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:00.638 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:00 smithi111 bash[23388]: audit 2024-02-13T14:57:59.393643+0000 mon.a (mon.0) 2832 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[21479]: cluster 2024-02-13T14:57:59.360616+0000 mon.a (mon.0) 2829 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[21479]: audit 2024-02-13T14:57:59.364912+0000 mon.a (mon.0) 2830 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]': finished 2024-02-13T14:58:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[21479]: cluster 2024-02-13T14:57:59.372590+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-02-13T14:58:00.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[21479]: audit 2024-02-13T14:57:59.377037+0000 mon.c (mon.2) 828 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:00.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[21479]: audit 2024-02-13T14:57:59.393643+0000 mon.a (mon.0) 2832 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:00.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[28859]: cluster 2024-02-13T14:57:59.360616+0000 mon.a (mon.0) 2829 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:00.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[28859]: audit 2024-02-13T14:57:59.364912+0000 mon.a (mon.0) 2830 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-100", "mode": "writeback"}]': finished 2024-02-13T14:58:00.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[28859]: cluster 2024-02-13T14:57:59.372590+0000 mon.a (mon.0) 2831 : cluster 0 osdmap e532: 8 total, 8 up, 8 in 2024-02-13T14:58:00.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[28859]: audit 2024-02-13T14:57:59.377037+0000 mon.c (mon.2) 828 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:00.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:00 smithi062 bash[28859]: audit 2024-02-13T14:57:59.393643+0000 mon.a (mon.0) 2832 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:01.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:58:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:58:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[21479]: cluster 2024-02-13T14:58:00.118642+0000 mgr.y (mgr.14613) 559 : cluster 0 pgmap v870: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[21479]: audit 2024-02-13T14:58:00.396179+0000 mon.a (mon.0) 2833 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:58:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[21479]: audit 2024-02-13T14:58:00.404399+0000 mon.c (mon.2) 829 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[21479]: cluster 2024-02-13T14:58:00.407859+0000 mon.a (mon.0) 2834 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-02-13T14:58:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[21479]: audit 2024-02-13T14:58:00.416921+0000 mon.a (mon.0) 2835 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:01.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[28859]: cluster 2024-02-13T14:58:00.118642+0000 mgr.y (mgr.14613) 559 : cluster 0 pgmap v870: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:01.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[28859]: audit 2024-02-13T14:58:00.396179+0000 mon.a (mon.0) 2833 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:58:01.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[28859]: audit 2024-02-13T14:58:00.404399+0000 mon.c (mon.2) 829 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:01.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[28859]: cluster 2024-02-13T14:58:00.407859+0000 mon.a (mon.0) 2834 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-02-13T14:58:01.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:01 smithi062 bash[28859]: audit 2024-02-13T14:58:00.416921+0000 mon.a (mon.0) 2835 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:01 smithi111 bash[23388]: cluster 2024-02-13T14:58:00.118642+0000 mgr.y (mgr.14613) 559 : cluster 0 pgmap v870: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:01 smithi111 bash[23388]: audit 2024-02-13T14:58:00.396179+0000 mon.a (mon.0) 2833 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:58:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:01 smithi111 bash[23388]: audit 2024-02-13T14:58:00.404399+0000 mon.c (mon.2) 829 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:01 smithi111 bash[23388]: cluster 2024-02-13T14:58:00.407859+0000 mon.a (mon.0) 2834 : cluster 0 osdmap e533: 8 total, 8 up, 8 in 2024-02-13T14:58:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:01 smithi111 bash[23388]: audit 2024-02-13T14:58:00.416921+0000 mon.a (mon.0) 2835 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[21479]: audit 2024-02-13T14:58:00.636529+0000 mgr.y (mgr.14613) 560 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[21479]: audit 2024-02-13T14:58:01.411410+0000 mon.a (mon.0) 2836 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:58:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[21479]: cluster 2024-02-13T14:58:01.420522+0000 mon.a (mon.0) 2837 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-02-13T14:58:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[21479]: audit 2024-02-13T14:58:01.423585+0000 mon.c (mon.2) 830 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[21479]: audit 2024-02-13T14:58:01.424531+0000 mon.a (mon.0) 2838 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:02.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[28859]: audit 2024-02-13T14:58:00.636529+0000 mgr.y (mgr.14613) 560 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:02.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[28859]: audit 2024-02-13T14:58:01.411410+0000 mon.a (mon.0) 2836 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:58:02.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[28859]: cluster 2024-02-13T14:58:01.420522+0000 mon.a (mon.0) 2837 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-02-13T14:58:02.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[28859]: audit 2024-02-13T14:58:01.423585+0000 mon.c (mon.2) 830 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:02.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:02 smithi062 bash[28859]: audit 2024-02-13T14:58:01.424531+0000 mon.a (mon.0) 2838 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:02 smithi111 bash[23388]: audit 2024-02-13T14:58:00.636529+0000 mgr.y (mgr.14613) 560 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:02 smithi111 bash[23388]: audit 2024-02-13T14:58:01.411410+0000 mon.a (mon.0) 2836 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:58:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:02 smithi111 bash[23388]: cluster 2024-02-13T14:58:01.420522+0000 mon.a (mon.0) 2837 : cluster 0 osdmap e534: 8 total, 8 up, 8 in 2024-02-13T14:58:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:02 smithi111 bash[23388]: audit 2024-02-13T14:58:01.423585+0000 mon.c (mon.2) 830 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:02 smithi111 bash[23388]: audit 2024-02-13T14:58:01.424531+0000 mon.a (mon.0) 2838 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[21479]: cluster 2024-02-13T14:58:02.119543+0000 mgr.y (mgr.14613) 561 : cluster 0 pgmap v873: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[21479]: cluster 2024-02-13T14:58:02.412506+0000 mon.a (mon.0) 2839 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[21479]: audit 2024-02-13T14:58:02.420883+0000 mon.a (mon.0) 2840 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[21479]: cluster 2024-02-13T14:58:02.430151+0000 mon.a (mon.0) 2841 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[21479]: audit 2024-02-13T14:58:02.430875+0000 mon.c (mon.2) 831 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[21479]: audit 2024-02-13T14:58:02.432585+0000 mon.a (mon.0) 2842 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[21479]: cluster 2024-02-13T14:58:02.673657+0000 mon.a (mon.0) 2843 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[28859]: cluster 2024-02-13T14:58:02.119543+0000 mgr.y (mgr.14613) 561 : cluster 0 pgmap v873: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[28859]: cluster 2024-02-13T14:58:02.412506+0000 mon.a (mon.0) 2839 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[28859]: audit 2024-02-13T14:58:02.420883+0000 mon.a (mon.0) 2840 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[28859]: cluster 2024-02-13T14:58:02.430151+0000 mon.a (mon.0) 2841 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[28859]: audit 2024-02-13T14:58:02.430875+0000 mon.c (mon.2) 831 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[28859]: audit 2024-02-13T14:58:02.432585+0000 mon.a (mon.0) 2842 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T14:58:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:03 smithi062 bash[28859]: cluster 2024-02-13T14:58:02.673657+0000 mon.a (mon.0) 2843 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:03 smithi111 bash[23388]: cluster 2024-02-13T14:58:02.119543+0000 mgr.y (mgr.14613) 561 : cluster 0 pgmap v873: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:03 smithi111 bash[23388]: cluster 2024-02-13T14:58:02.412506+0000 mon.a (mon.0) 2839 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:03 smithi111 bash[23388]: audit 2024-02-13T14:58:02.420883+0000 mon.a (mon.0) 2840 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:58:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:03 smithi111 bash[23388]: cluster 2024-02-13T14:58:02.430151+0000 mon.a (mon.0) 2841 : cluster 0 osdmap e535: 8 total, 8 up, 8 in 2024-02-13T14:58:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:03 smithi111 bash[23388]: audit 2024-02-13T14:58:02.430875+0000 mon.c (mon.2) 831 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T14:58:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:03 smithi111 bash[23388]: audit 2024-02-13T14:58:02.432585+0000 mon.a (mon.0) 2842 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]: dispatch 2024-02-13T14:58:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:03 smithi111 bash[23388]: cluster 2024-02-13T14:58:02.673657+0000 mon.a (mon.0) 2843 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:04.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[28859]: audit 2024-02-13T14:58:03.432535+0000 mon.a (mon.0) 2844 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-13T14:58:04.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[28859]: cluster 2024-02-13T14:58:03.440613+0000 mon.a (mon.0) 2845 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[28859]: audit 2024-02-13T14:58:03.526389+0000 mon.c (mon.2) 832 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[28859]: audit 2024-02-13T14:58:03.527121+0000 mon.a (mon.0) 2846 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[28859]: audit 2024-02-13T14:58:03.912389+0000 mon.b (mon.1) 246 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[28859]: cluster 2024-02-13T14:58:04.120358+0000 mgr.y (mgr.14613) 562 : cluster 0 pgmap v876: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[21479]: audit 2024-02-13T14:58:03.432535+0000 mon.a (mon.0) 2844 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[21479]: cluster 2024-02-13T14:58:03.440613+0000 mon.a (mon.0) 2845 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[21479]: audit 2024-02-13T14:58:03.526389+0000 mon.c (mon.2) 832 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[21479]: audit 2024-02-13T14:58:03.527121+0000 mon.a (mon.0) 2846 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[21479]: audit 2024-02-13T14:58:03.912389+0000 mon.b (mon.1) 246 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:04.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:04 smithi062 bash[21479]: cluster 2024-02-13T14:58:04.120358+0000 mgr.y (mgr.14613) 562 : cluster 0 pgmap v876: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:04 smithi111 bash[23388]: audit 2024-02-13T14:58:03.432535+0000 mon.a (mon.0) 2844 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-100","var": "min_read_recency_for_promote","val": "10000"}]': finished 2024-02-13T14:58:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:04 smithi111 bash[23388]: cluster 2024-02-13T14:58:03.440613+0000 mon.a (mon.0) 2845 : cluster 0 osdmap e536: 8 total, 8 up, 8 in 2024-02-13T14:58:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:04 smithi111 bash[23388]: audit 2024-02-13T14:58:03.526389+0000 mon.c (mon.2) 832 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:04 smithi111 bash[23388]: audit 2024-02-13T14:58:03.527121+0000 mon.a (mon.0) 2846 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:04.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:04 smithi111 bash[23388]: audit 2024-02-13T14:58:03.912389+0000 mon.b (mon.1) 246 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:04.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:04 smithi111 bash[23388]: cluster 2024-02-13T14:58:04.120358+0000 mgr.y (mgr.14613) 562 : cluster 0 pgmap v876: 324 pgs: 324 active+clean; 8.4 MiB data, 635 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:05 smithi062 bash[21479]: audit 2024-02-13T14:58:04.443907+0000 mon.a (mon.0) 2847 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:58:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:05 smithi062 bash[21479]: cluster 2024-02-13T14:58:04.455506+0000 mon.a (mon.0) 2848 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-02-13T14:58:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:05 smithi062 bash[21479]: audit 2024-02-13T14:58:04.459173+0000 mon.c (mon.2) 833 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:58:05.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:05 smithi062 bash[21479]: audit 2024-02-13T14:58:04.460161+0000 mon.a (mon.0) 2849 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:58:05.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:05 smithi062 bash[28859]: audit 2024-02-13T14:58:04.443907+0000 mon.a (mon.0) 2847 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:58:05.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:05 smithi062 bash[28859]: cluster 2024-02-13T14:58:04.455506+0000 mon.a (mon.0) 2848 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-02-13T14:58:05.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:05 smithi062 bash[28859]: audit 2024-02-13T14:58:04.459173+0000 mon.c (mon.2) 833 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:58:05.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:05 smithi062 bash[28859]: audit 2024-02-13T14:58:04.460161+0000 mon.a (mon.0) 2849 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:58:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:05 smithi111 bash[23388]: audit 2024-02-13T14:58:04.443907+0000 mon.a (mon.0) 2847 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]': finished 2024-02-13T14:58:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:05 smithi111 bash[23388]: cluster 2024-02-13T14:58:04.455506+0000 mon.a (mon.0) 2848 : cluster 0 osdmap e537: 8 total, 8 up, 8 in 2024-02-13T14:58:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:05 smithi111 bash[23388]: audit 2024-02-13T14:58:04.459173+0000 mon.c (mon.2) 833 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:58:05.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:05 smithi111 bash[23388]: audit 2024-02-13T14:58:04.460161+0000 mon.a (mon.0) 2849 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]: dispatch 2024-02-13T14:58:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:58:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:58:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:58:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:06 smithi062 bash[21479]: audit 2024-02-13T14:58:05.454339+0000 mon.a (mon.0) 2850 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]': finished 2024-02-13T14:58:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:06 smithi062 bash[21479]: cluster 2024-02-13T14:58:05.462014+0000 mon.a (mon.0) 2851 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-02-13T14:58:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:06 smithi062 bash[21479]: cluster 2024-02-13T14:58:06.121257+0000 mgr.y (mgr.14613) 563 : cluster 0 pgmap v879: 324 pgs: 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T14:58:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:06 smithi062 bash[28859]: audit 2024-02-13T14:58:05.454339+0000 mon.a (mon.0) 2850 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]': finished 2024-02-13T14:58:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:06 smithi062 bash[28859]: cluster 2024-02-13T14:58:05.462014+0000 mon.a (mon.0) 2851 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-02-13T14:58:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:06 smithi062 bash[28859]: cluster 2024-02-13T14:58:06.121257+0000 mgr.y (mgr.14613) 563 : cluster 0 pgmap v879: 324 pgs: 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T14:58:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:06 smithi111 bash[23388]: audit 2024-02-13T14:58:05.454339+0000 mon.a (mon.0) 2850 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-100"}]': finished 2024-02-13T14:58:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:06 smithi111 bash[23388]: cluster 2024-02-13T14:58:05.462014+0000 mon.a (mon.0) 2851 : cluster 0 osdmap e538: 8 total, 8 up, 8 in 2024-02-13T14:58:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:06 smithi111 bash[23388]: cluster 2024-02-13T14:58:06.121257+0000 mgr.y (mgr.14613) 563 : cluster 0 pgmap v879: 324 pgs: 324 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 2 op/s 2024-02-13T14:58:07.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:07 smithi062 bash[21479]: cluster 2024-02-13T14:58:06.473230+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-02-13T14:58:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:07 smithi062 bash[28859]: cluster 2024-02-13T14:58:06.473230+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-02-13T14:58:07.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:07 smithi111 bash[23388]: cluster 2024-02-13T14:58:06.473230+0000 mon.a (mon.0) 2852 : cluster 0 osdmap e539: 8 total, 8 up, 8 in 2024-02-13T14:58:08.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[21479]: cluster 2024-02-13T14:58:07.479552+0000 mon.a (mon.0) 2853 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[21479]: audit 2024-02-13T14:58:07.482923+0000 mon.c (mon.2) 834 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[21479]: audit 2024-02-13T14:58:07.501934+0000 mon.a (mon.0) 2854 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[21479]: cluster 2024-02-13T14:58:08.122301+0000 mgr.y (mgr.14613) 564 : cluster 0 pgmap v882: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[21479]: audit 2024-02-13T14:58:08.470998+0000 mon.a (mon.0) 2855 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[21479]: cluster 2024-02-13T14:58:08.480246+0000 mon.a (mon.0) 2856 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[28859]: cluster 2024-02-13T14:58:07.479552+0000 mon.a (mon.0) 2853 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[28859]: audit 2024-02-13T14:58:07.482923+0000 mon.c (mon.2) 834 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[28859]: audit 2024-02-13T14:58:07.501934+0000 mon.a (mon.0) 2854 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[28859]: cluster 2024-02-13T14:58:08.122301+0000 mgr.y (mgr.14613) 564 : cluster 0 pgmap v882: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[28859]: audit 2024-02-13T14:58:08.470998+0000 mon.a (mon.0) 2855 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:08.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:08 smithi062 bash[28859]: cluster 2024-02-13T14:58:08.480246+0000 mon.a (mon.0) 2856 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-02-13T14:58:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:08 smithi111 bash[23388]: cluster 2024-02-13T14:58:07.479552+0000 mon.a (mon.0) 2853 : cluster 0 osdmap e540: 8 total, 8 up, 8 in 2024-02-13T14:58:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:08 smithi111 bash[23388]: audit 2024-02-13T14:58:07.482923+0000 mon.c (mon.2) 834 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:08 smithi111 bash[23388]: audit 2024-02-13T14:58:07.501934+0000 mon.a (mon.0) 2854 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:08 smithi111 bash[23388]: cluster 2024-02-13T14:58:08.122301+0000 mgr.y (mgr.14613) 564 : cluster 0 pgmap v882: 324 pgs: 32 unknown, 292 active+clean; 8.4 MiB data, 636 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:08 smithi111 bash[23388]: audit 2024-02-13T14:58:08.470998+0000 mon.a (mon.0) 2855 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-102","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:08 smithi111 bash[23388]: cluster 2024-02-13T14:58:08.480246+0000 mon.a (mon.0) 2856 : cluster 0 osdmap e541: 8 total, 8 up, 8 in 2024-02-13T14:58:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[21479]: audit 2024-02-13T14:58:08.496962+0000 mon.c (mon.2) 835 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:58:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[21479]: cluster 2024-02-13T14:58:08.531353+0000 mon.a (mon.0) 2857 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[21479]: audit 2024-02-13T14:58:08.542586+0000 mon.c (mon.2) 836 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[21479]: audit 2024-02-13T14:58:08.549695+0000 mon.a (mon.0) 2858 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[21479]: audit 2024-02-13T14:58:09.473766+0000 mon.a (mon.0) 2859 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[21479]: cluster 2024-02-13T14:58:09.481730+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[21479]: audit 2024-02-13T14:58:09.487636+0000 mon.c (mon.2) 837 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[21479]: audit 2024-02-13T14:58:09.489064+0000 mon.a (mon.0) 2861 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[28859]: audit 2024-02-13T14:58:08.496962+0000 mon.c (mon.2) 835 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[28859]: cluster 2024-02-13T14:58:08.531353+0000 mon.a (mon.0) 2857 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[28859]: audit 2024-02-13T14:58:08.542586+0000 mon.c (mon.2) 836 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[28859]: audit 2024-02-13T14:58:08.549695+0000 mon.a (mon.0) 2858 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:58:09.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[28859]: audit 2024-02-13T14:58:09.473766+0000 mon.a (mon.0) 2859 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:58:09.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[28859]: cluster 2024-02-13T14:58:09.481730+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-02-13T14:58:09.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[28859]: audit 2024-02-13T14:58:09.487636+0000 mon.c (mon.2) 837 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:58:09.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:09 smithi062 bash[28859]: audit 2024-02-13T14:58:09.489064+0000 mon.a (mon.0) 2861 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:58:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:09 smithi111 bash[23388]: audit 2024-02-13T14:58:08.496962+0000 mon.c (mon.2) 835 : audit 0 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd dump","format":"json"}]: dispatch 2024-02-13T14:58:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:09 smithi111 bash[23388]: cluster 2024-02-13T14:58:08.531353+0000 mon.a (mon.0) 2857 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:09 smithi111 bash[23388]: audit 2024-02-13T14:58:08.542586+0000 mon.c (mon.2) 836 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:58:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:09 smithi111 bash[23388]: audit 2024-02-13T14:58:08.549695+0000 mon.a (mon.0) 2858 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]: dispatch 2024-02-13T14:58:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:09 smithi111 bash[23388]: audit 2024-02-13T14:58:09.473766+0000 mon.a (mon.0) 2859 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "fingerprint_algorithm","val": "sha1"}]': finished 2024-02-13T14:58:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:09 smithi111 bash[23388]: cluster 2024-02-13T14:58:09.481730+0000 mon.a (mon.0) 2860 : cluster 0 osdmap e542: 8 total, 8 up, 8 in 2024-02-13T14:58:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:09 smithi111 bash[23388]: audit 2024-02-13T14:58:09.487636+0000 mon.c (mon.2) 837 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:58:09.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:09 smithi111 bash[23388]: audit 2024-02-13T14:58:09.489064+0000 mon.a (mon.0) 2861 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]: dispatch 2024-02-13T14:58:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[21479]: cluster 2024-02-13T14:58:10.125031+0000 mgr.y (mgr.14613) 565 : cluster 0 pgmap v885: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[21479]: audit 2024-02-13T14:58:10.476574+0000 mon.a (mon.0) 2862 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:58:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[21479]: cluster 2024-02-13T14:58:10.482579+0000 mon.a (mon.0) 2863 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-02-13T14:58:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[21479]: audit 2024-02-13T14:58:10.487657+0000 mon.c (mon.2) 838 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:58:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[21479]: audit 2024-02-13T14:58:10.489433+0000 mon.a (mon.0) 2864 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:58:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[28859]: cluster 2024-02-13T14:58:10.125031+0000 mgr.y (mgr.14613) 565 : cluster 0 pgmap v885: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[28859]: audit 2024-02-13T14:58:10.476574+0000 mon.a (mon.0) 2862 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:58:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[28859]: cluster 2024-02-13T14:58:10.482579+0000 mon.a (mon.0) 2863 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-02-13T14:58:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[28859]: audit 2024-02-13T14:58:10.487657+0000 mon.c (mon.2) 838 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:58:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:10 smithi062 bash[28859]: audit 2024-02-13T14:58:10.489433+0000 mon.a (mon.0) 2864 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:58:10.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:58:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:58:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:10 smithi111 bash[23388]: cluster 2024-02-13T14:58:10.125031+0000 mgr.y (mgr.14613) 565 : cluster 0 pgmap v885: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:10 smithi111 bash[23388]: audit 2024-02-13T14:58:10.476574+0000 mon.a (mon.0) 2862 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_chunk_algorithm","val": "fastcdc"}]': finished 2024-02-13T14:58:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:10 smithi111 bash[23388]: cluster 2024-02-13T14:58:10.482579+0000 mon.a (mon.0) 2863 : cluster 0 osdmap e543: 8 total, 8 up, 8 in 2024-02-13T14:58:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:10 smithi111 bash[23388]: audit 2024-02-13T14:58:10.487657+0000 mon.c (mon.2) 838 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:58:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:10 smithi111 bash[23388]: audit 2024-02-13T14:58:10.489433+0000 mon.a (mon.0) 2864 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]: dispatch 2024-02-13T14:58:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:11 smithi062 bash[21479]: audit 2024-02-13T14:58:10.645540+0000 mgr.y (mgr.14613) 566 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:11 smithi062 bash[21479]: audit 2024-02-13T14:58:11.479117+0000 mon.a (mon.0) 2865 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:58:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:11 smithi062 bash[21479]: cluster 2024-02-13T14:58:11.487634+0000 mon.a (mon.0) 2866 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-02-13T14:58:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:11 smithi062 bash[28859]: audit 2024-02-13T14:58:10.645540+0000 mgr.y (mgr.14613) 566 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:11 smithi062 bash[28859]: audit 2024-02-13T14:58:11.479117+0000 mon.a (mon.0) 2865 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:58:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:11 smithi062 bash[28859]: cluster 2024-02-13T14:58:11.487634+0000 mon.a (mon.0) 2866 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-02-13T14:58:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:11 smithi111 bash[23388]: audit 2024-02-13T14:58:10.645540+0000 mgr.y (mgr.14613) 566 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:11 smithi111 bash[23388]: audit 2024-02-13T14:58:11.479117+0000 mon.a (mon.0) 2865 : audit 1 from='client.26912 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-102","var": "dedup_cdc_chunk_size","val": "1024"}]': finished 2024-02-13T14:58:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:11 smithi111 bash[23388]: cluster 2024-02-13T14:58:11.487634+0000 mon.a (mon.0) 2866 : cluster 0 osdmap e544: 8 total, 8 up, 8 in 2024-02-13T14:58:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[21479]: audit 2024-02-13T14:58:11.581537+0000 mon.c (mon.2) 839 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[21479]: audit 2024-02-13T14:58:11.582308+0000 mon.a (mon.0) 2867 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[21479]: audit 2024-02-13T14:58:11.583652+0000 mon.c (mon.2) 840 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-102"}]: dispatch 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[21479]: audit 2024-02-13T14:58:11.584276+0000 mon.a (mon.0) 2868 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-102"}]: dispatch 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[21479]: cluster 2024-02-13T14:58:12.125944+0000 mgr.y (mgr.14613) 567 : cluster 0 pgmap v888: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[28859]: audit 2024-02-13T14:58:11.581537+0000 mon.c (mon.2) 839 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[28859]: audit 2024-02-13T14:58:11.582308+0000 mon.a (mon.0) 2867 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[28859]: audit 2024-02-13T14:58:11.583652+0000 mon.c (mon.2) 840 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-102"}]: dispatch 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[28859]: audit 2024-02-13T14:58:11.584276+0000 mon.a (mon.0) 2868 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-102"}]: dispatch 2024-02-13T14:58:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:12 smithi062 bash[28859]: cluster 2024-02-13T14:58:12.125944+0000 mgr.y (mgr.14613) 567 : cluster 0 pgmap v888: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:12 smithi111 bash[23388]: audit 2024-02-13T14:58:11.581537+0000 mon.c (mon.2) 839 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:12 smithi111 bash[23388]: audit 2024-02-13T14:58:11.582308+0000 mon.a (mon.0) 2867 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-6"}]: dispatch 2024-02-13T14:58:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:12 smithi111 bash[23388]: audit 2024-02-13T14:58:11.583652+0000 mon.c (mon.2) 840 : audit 1 from='client.? v1:172.21.15.62:0/3563152997' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-102"}]: dispatch 2024-02-13T14:58:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:12 smithi111 bash[23388]: audit 2024-02-13T14:58:11.584276+0000 mon.a (mon.0) 2868 : audit 1 from='client.26912 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-6", "tierpool": "test-rados-api-smithi062-64695-102"}]: dispatch 2024-02-13T14:58:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:12 smithi111 bash[23388]: cluster 2024-02-13T14:58:12.125944+0000 mgr.y (mgr.14613) 567 : cluster 0 pgmap v888: 324 pgs: 324 active+clean; 8.4 MiB data, 645 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:13.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:13 smithi111 bash[23388]: cluster 2024-02-13T14:58:12.554436+0000 mon.a (mon.0) 2869 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-02-13T14:58:14.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:13 smithi062 bash[21479]: cluster 2024-02-13T14:58:12.554436+0000 mon.a (mon.0) 2869 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-02-13T14:58:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:13 smithi062 bash[28859]: cluster 2024-02-13T14:58:12.554436+0000 mon.a (mon.0) 2869 : cluster 0 osdmap e545: 8 total, 8 up, 8 in 2024-02-13T14:58:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:14 smithi111 bash[23388]: cluster 2024-02-13T14:58:13.557140+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-02-13T14:58:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:14 smithi111 bash[23388]: audit 2024-02-13T14:58:13.611399+0000 mon.c (mon.2) 841 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:14 smithi111 bash[23388]: audit 2024-02-13T14:58:13.611748+0000 mon.a (mon.0) 2871 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:14 smithi111 bash[23388]: audit 2024-02-13T14:58:13.613192+0000 mon.c (mon.2) 842 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:14 smithi111 bash[23388]: audit 2024-02-13T14:58:13.613490+0000 mon.a (mon.0) 2872 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:14 smithi111 bash[23388]: audit 2024-02-13T14:58:13.613997+0000 mon.c (mon.2) 843 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:14 smithi111 bash[23388]: audit 2024-02-13T14:58:13.614259+0000 mon.a (mon.0) 2873 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:14.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:14 smithi111 bash[23388]: cluster 2024-02-13T14:58:14.126821+0000 mgr.y (mgr.14613) 568 : cluster 0 pgmap v891: 260 pgs: 260 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[21479]: cluster 2024-02-13T14:58:13.557140+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-02-13T14:58:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[21479]: audit 2024-02-13T14:58:13.611399+0000 mon.c (mon.2) 841 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[21479]: audit 2024-02-13T14:58:13.611748+0000 mon.a (mon.0) 2871 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[21479]: audit 2024-02-13T14:58:13.613192+0000 mon.c (mon.2) 842 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[21479]: audit 2024-02-13T14:58:13.613490+0000 mon.a (mon.0) 2872 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[21479]: audit 2024-02-13T14:58:13.613997+0000 mon.c (mon.2) 843 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:15.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[21479]: audit 2024-02-13T14:58:13.614259+0000 mon.a (mon.0) 2873 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:15.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[21479]: cluster 2024-02-13T14:58:14.126821+0000 mgr.y (mgr.14613) 568 : cluster 0 pgmap v891: 260 pgs: 260 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[28859]: cluster 2024-02-13T14:58:13.557140+0000 mon.a (mon.0) 2870 : cluster 0 osdmap e546: 8 total, 8 up, 8 in 2024-02-13T14:58:15.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[28859]: audit 2024-02-13T14:58:13.611399+0000 mon.c (mon.2) 841 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[28859]: audit 2024-02-13T14:58:13.611748+0000 mon.a (mon.0) 2871 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[28859]: audit 2024-02-13T14:58:13.613192+0000 mon.c (mon.2) 842 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[28859]: audit 2024-02-13T14:58:13.613490+0000 mon.a (mon.0) 2872 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[28859]: audit 2024-02-13T14:58:13.613997+0000 mon.c (mon.2) 843 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:15.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[28859]: audit 2024-02-13T14:58:13.614259+0000 mon.a (mon.0) 2873 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:15.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:14 smithi062 bash[28859]: cluster 2024-02-13T14:58:14.126821+0000 mgr.y (mgr.14613) 568 : cluster 0 pgmap v891: 260 pgs: 260 active+clean; 582 KiB data, 645 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:15 smithi111 bash[23388]: audit 2024-02-13T14:58:14.582654+0000 mon.a (mon.0) 2874 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:15 smithi111 bash[23388]: cluster 2024-02-13T14:58:14.595636+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-02-13T14:58:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:15 smithi111 bash[23388]: audit 2024-02-13T14:58:14.596374+0000 mon.c (mon.2) 844 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:15 smithi111 bash[23388]: audit 2024-02-13T14:58:14.598377+0000 mon.a (mon.0) 2876 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:15 smithi062 bash[28859]: audit 2024-02-13T14:58:14.582654+0000 mon.a (mon.0) 2874 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:15 smithi062 bash[28859]: cluster 2024-02-13T14:58:14.595636+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-02-13T14:58:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:15 smithi062 bash[28859]: audit 2024-02-13T14:58:14.596374+0000 mon.c (mon.2) 844 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:16.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:15 smithi062 bash[28859]: audit 2024-02-13T14:58:14.598377+0000 mon.a (mon.0) 2876 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:16.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:15 smithi062 bash[21479]: audit 2024-02-13T14:58:14.582654+0000 mon.a (mon.0) 2874 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:16.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:15 smithi062 bash[21479]: cluster 2024-02-13T14:58:14.595636+0000 mon.a (mon.0) 2875 : cluster 0 osdmap e547: 8 total, 8 up, 8 in 2024-02-13T14:58:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:15 smithi062 bash[21479]: audit 2024-02-13T14:58:14.596374+0000 mon.c (mon.2) 844 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:16.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:15 smithi062 bash[21479]: audit 2024-02-13T14:58:14.598377+0000 mon.a (mon.0) 2876 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:58:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:58:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:58:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:16 smithi062 bash[21479]: cluster 2024-02-13T14:58:16.057205+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-02-13T14:58:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:16 smithi062 bash[21479]: cluster 2024-02-13T14:58:16.127668+0000 mgr.y (mgr.14613) 569 : cluster 0 pgmap v894: 260 pgs: 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:17.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:16 smithi062 bash[28859]: cluster 2024-02-13T14:58:16.057205+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-02-13T14:58:17.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:16 smithi062 bash[28859]: cluster 2024-02-13T14:58:16.127668+0000 mgr.y (mgr.14613) 569 : cluster 0 pgmap v894: 260 pgs: 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:17.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:16 smithi111 bash[23388]: cluster 2024-02-13T14:58:16.057205+0000 mon.a (mon.0) 2877 : cluster 0 osdmap e548: 8 total, 8 up, 8 in 2024-02-13T14:58:17.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:16 smithi111 bash[23388]: cluster 2024-02-13T14:58:16.127668+0000 mgr.y (mgr.14613) 569 : cluster 0 pgmap v894: 260 pgs: 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:18.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:17 smithi062 bash[21479]: audit 2024-02-13T14:58:16.605522+0000 mon.a (mon.0) 2878 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:18.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:17 smithi062 bash[21479]: cluster 2024-02-13T14:58:16.611920+0000 mon.a (mon.0) 2879 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-02-13T14:58:18.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:17 smithi062 bash[28859]: audit 2024-02-13T14:58:16.605522+0000 mon.a (mon.0) 2878 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:18.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:17 smithi062 bash[28859]: cluster 2024-02-13T14:58:16.611920+0000 mon.a (mon.0) 2879 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-02-13T14:58:18.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:17 smithi111 bash[23388]: audit 2024-02-13T14:58:16.605522+0000 mon.a (mon.0) 2878 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "LibRadosTierECPP_smithi062-64695-104", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:18.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:17 smithi111 bash[23388]: cluster 2024-02-13T14:58:16.611920+0000 mon.a (mon.0) 2879 : cluster 0 osdmap e549: 8 total, 8 up, 8 in 2024-02-13T14:58:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:18 smithi062 bash[21479]: cluster 2024-02-13T14:58:17.618501+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-02-13T14:58:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:18 smithi062 bash[21479]: cluster 2024-02-13T14:58:17.677746+0000 mon.a (mon.0) 2881 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:18 smithi062 bash[21479]: cluster 2024-02-13T14:58:18.128600+0000 mgr.y (mgr.14613) 570 : cluster 0 pgmap v897: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:19.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:18 smithi062 bash[28859]: cluster 2024-02-13T14:58:17.618501+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-02-13T14:58:19.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:18 smithi062 bash[28859]: cluster 2024-02-13T14:58:17.677746+0000 mon.a (mon.0) 2881 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:19.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:18 smithi062 bash[28859]: cluster 2024-02-13T14:58:18.128600+0000 mgr.y (mgr.14613) 570 : cluster 0 pgmap v897: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:19.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:18 smithi111 bash[23388]: cluster 2024-02-13T14:58:17.618501+0000 mon.a (mon.0) 2880 : cluster 0 osdmap e550: 8 total, 8 up, 8 in 2024-02-13T14:58:19.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:18 smithi111 bash[23388]: cluster 2024-02-13T14:58:17.677746+0000 mon.a (mon.0) 2881 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:19.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:18 smithi111 bash[23388]: cluster 2024-02-13T14:58:18.128600+0000 mgr.y (mgr.14613) 570 : cluster 0 pgmap v897: 268 pgs: 8 unknown, 260 active+clean; 582 KiB data, 629 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:20.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:19 smithi062 bash[21479]: cluster 2024-02-13T14:58:18.649396+0000 mon.a (mon.0) 2882 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-02-13T14:58:20.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:19 smithi062 bash[21479]: audit 2024-02-13T14:58:18.652565+0000 mon.c (mon.2) 845 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:20.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:19 smithi062 bash[21479]: audit 2024-02-13T14:58:18.656287+0000 mon.a (mon.0) 2883 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:20.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:19 smithi062 bash[21479]: audit 2024-02-13T14:58:18.948148+0000 mon.b (mon.1) 247 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:20.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:19 smithi062 bash[28859]: cluster 2024-02-13T14:58:18.649396+0000 mon.a (mon.0) 2882 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-02-13T14:58:20.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:19 smithi062 bash[28859]: audit 2024-02-13T14:58:18.652565+0000 mon.c (mon.2) 845 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:20.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:19 smithi062 bash[28859]: audit 2024-02-13T14:58:18.656287+0000 mon.a (mon.0) 2883 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:20.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:19 smithi062 bash[28859]: audit 2024-02-13T14:58:18.948148+0000 mon.b (mon.1) 247 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:19 smithi111 bash[23388]: cluster 2024-02-13T14:58:18.649396+0000 mon.a (mon.0) 2882 : cluster 0 osdmap e551: 8 total, 8 up, 8 in 2024-02-13T14:58:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:19 smithi111 bash[23388]: audit 2024-02-13T14:58:18.652565+0000 mon.c (mon.2) 845 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:19 smithi111 bash[23388]: audit 2024-02-13T14:58:18.656287+0000 mon.a (mon.0) 2883 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:19 smithi111 bash[23388]: audit 2024-02-13T14:58:18.948148+0000 mon.b (mon.1) 247 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:20 smithi062 bash[21479]: audit 2024-02-13T14:58:19.641304+0000 mon.a (mon.0) 2884 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:20 smithi062 bash[21479]: cluster 2024-02-13T14:58:19.649413+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-02-13T14:58:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:20 smithi062 bash[21479]: cluster 2024-02-13T14:58:20.131296+0000 mgr.y (mgr.14613) 571 : cluster 0 pgmap v900: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:21.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:20 smithi062 bash[28859]: audit 2024-02-13T14:58:19.641304+0000 mon.a (mon.0) 2884 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:21.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:20 smithi062 bash[28859]: cluster 2024-02-13T14:58:19.649413+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-02-13T14:58:21.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:20 smithi062 bash[28859]: cluster 2024-02-13T14:58:20.131296+0000 mgr.y (mgr.14613) 571 : cluster 0 pgmap v900: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:21.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:58:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:58:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:20 smithi111 bash[23388]: audit 2024-02-13T14:58:19.641304+0000 mon.a (mon.0) 2884 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:20 smithi111 bash[23388]: cluster 2024-02-13T14:58:19.649413+0000 mon.a (mon.0) 2885 : cluster 0 osdmap e552: 8 total, 8 up, 8 in 2024-02-13T14:58:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:20 smithi111 bash[23388]: cluster 2024-02-13T14:58:20.131296+0000 mgr.y (mgr.14613) 571 : cluster 0 pgmap v900: 300 pgs: 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:22.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:21 smithi062 bash[21479]: audit 2024-02-13T14:58:20.654738+0000 mgr.y (mgr.14613) 572 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:22.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:21 smithi062 bash[21479]: cluster 2024-02-13T14:58:20.679300+0000 mon.a (mon.0) 2886 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-02-13T14:58:22.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:21 smithi062 bash[21479]: audit 2024-02-13T14:58:20.698059+0000 mon.c (mon.2) 846 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:22.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:21 smithi062 bash[21479]: audit 2024-02-13T14:58:20.699461+0000 mon.a (mon.0) 2887 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:22.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:21 smithi062 bash[28859]: audit 2024-02-13T14:58:20.654738+0000 mgr.y (mgr.14613) 572 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:22.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:21 smithi062 bash[28859]: cluster 2024-02-13T14:58:20.679300+0000 mon.a (mon.0) 2886 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-02-13T14:58:22.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:21 smithi062 bash[28859]: audit 2024-02-13T14:58:20.698059+0000 mon.c (mon.2) 846 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:22.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:21 smithi062 bash[28859]: audit 2024-02-13T14:58:20.699461+0000 mon.a (mon.0) 2887 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:22.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:21 smithi111 bash[23388]: audit 2024-02-13T14:58:20.654738+0000 mgr.y (mgr.14613) 572 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:22.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:21 smithi111 bash[23388]: cluster 2024-02-13T14:58:20.679300+0000 mon.a (mon.0) 2886 : cluster 0 osdmap e553: 8 total, 8 up, 8 in 2024-02-13T14:58:22.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:21 smithi111 bash[23388]: audit 2024-02-13T14:58:20.698059+0000 mon.c (mon.2) 846 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:22.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:21 smithi111 bash[23388]: audit 2024-02-13T14:58:20.699461+0000 mon.a (mon.0) 2887 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[21479]: audit 2024-02-13T14:58:21.671652+0000 mon.a (mon.0) 2888 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[21479]: cluster 2024-02-13T14:58:21.680082+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[21479]: audit 2024-02-13T14:58:21.682961+0000 mon.c (mon.2) 847 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[21479]: audit 2024-02-13T14:58:21.703839+0000 mon.a (mon.0) 2890 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[21479]: cluster 2024-02-13T14:58:22.132213+0000 mgr.y (mgr.14613) 573 : cluster 0 pgmap v903: 332 pgs: 32 unknown, 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[21479]: cluster 2024-02-13T14:58:22.678848+0000 mon.a (mon.0) 2891 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[28859]: audit 2024-02-13T14:58:21.671652+0000 mon.a (mon.0) 2888 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[28859]: cluster 2024-02-13T14:58:21.680082+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[28859]: audit 2024-02-13T14:58:21.682961+0000 mon.c (mon.2) 847 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[28859]: audit 2024-02-13T14:58:21.703839+0000 mon.a (mon.0) 2890 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[28859]: cluster 2024-02-13T14:58:22.132213+0000 mgr.y (mgr.14613) 573 : cluster 0 pgmap v903: 332 pgs: 32 unknown, 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:22 smithi062 bash[28859]: cluster 2024-02-13T14:58:22.678848+0000 mon.a (mon.0) 2891 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:22 smithi111 bash[23388]: audit 2024-02-13T14:58:21.671652+0000 mon.a (mon.0) 2888 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-107-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:22 smithi111 bash[23388]: cluster 2024-02-13T14:58:21.680082+0000 mon.a (mon.0) 2889 : cluster 0 osdmap e554: 8 total, 8 up, 8 in 2024-02-13T14:58:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:22 smithi111 bash[23388]: audit 2024-02-13T14:58:21.682961+0000 mon.c (mon.2) 847 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:22 smithi111 bash[23388]: audit 2024-02-13T14:58:21.703839+0000 mon.a (mon.0) 2890 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:22 smithi111 bash[23388]: cluster 2024-02-13T14:58:22.132213+0000 mgr.y (mgr.14613) 573 : cluster 0 pgmap v903: 332 pgs: 32 unknown, 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T14:58:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:22 smithi111 bash[23388]: cluster 2024-02-13T14:58:22.678848+0000 mon.a (mon.0) 2891 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:24.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:23 smithi062 bash[21479]: audit 2024-02-13T14:58:22.697598+0000 mon.a (mon.0) 2892 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:24.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:23 smithi062 bash[21479]: cluster 2024-02-13T14:58:22.706464+0000 mon.a (mon.0) 2893 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-02-13T14:58:24.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:23 smithi062 bash[21479]: audit 2024-02-13T14:58:22.710352+0000 mon.c (mon.2) 848 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:24.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:23 smithi062 bash[21479]: audit 2024-02-13T14:58:22.712234+0000 mon.a (mon.0) 2894 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:24.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:23 smithi062 bash[28859]: audit 2024-02-13T14:58:22.697598+0000 mon.a (mon.0) 2892 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:24.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:23 smithi062 bash[28859]: cluster 2024-02-13T14:58:22.706464+0000 mon.a (mon.0) 2893 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-02-13T14:58:24.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:23 smithi062 bash[28859]: audit 2024-02-13T14:58:22.710352+0000 mon.c (mon.2) 848 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:24.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:23 smithi062 bash[28859]: audit 2024-02-13T14:58:22.712234+0000 mon.a (mon.0) 2894 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:24.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:23 smithi111 bash[23388]: audit 2024-02-13T14:58:22.697598+0000 mon.a (mon.0) 2892 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:24.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:23 smithi111 bash[23388]: cluster 2024-02-13T14:58:22.706464+0000 mon.a (mon.0) 2893 : cluster 0 osdmap e555: 8 total, 8 up, 8 in 2024-02-13T14:58:24.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:23 smithi111 bash[23388]: audit 2024-02-13T14:58:22.710352+0000 mon.c (mon.2) 848 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:24.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:23 smithi111 bash[23388]: audit 2024-02-13T14:58:22.712234+0000 mon.a (mon.0) 2894 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:25.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[21479]: audit 2024-02-13T14:58:23.700477+0000 mon.a (mon.0) 2895 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:25.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[21479]: cluster 2024-02-13T14:58:23.709525+0000 mon.a (mon.0) 2896 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[21479]: audit 2024-02-13T14:58:23.711160+0000 mon.c (mon.2) 849 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[21479]: audit 2024-02-13T14:58:23.712440+0000 mon.a (mon.0) 2897 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[21479]: cluster 2024-02-13T14:58:24.133277+0000 mgr.y (mgr.14613) 574 : cluster 0 pgmap v906: 332 pgs: 32 unknown, 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[21479]: cluster 2024-02-13T14:58:24.700806+0000 mon.a (mon.0) 2898 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[21479]: audit 2024-02-13T14:58:24.703124+0000 mon.a (mon.0) 2899 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]': finished 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[21479]: cluster 2024-02-13T14:58:24.711299+0000 mon.a (mon.0) 2900 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[28859]: audit 2024-02-13T14:58:23.700477+0000 mon.a (mon.0) 2895 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[28859]: cluster 2024-02-13T14:58:23.709525+0000 mon.a (mon.0) 2896 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[28859]: audit 2024-02-13T14:58:23.711160+0000 mon.c (mon.2) 849 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[28859]: audit 2024-02-13T14:58:23.712440+0000 mon.a (mon.0) 2897 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:25.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[28859]: cluster 2024-02-13T14:58:24.133277+0000 mgr.y (mgr.14613) 574 : cluster 0 pgmap v906: 332 pgs: 32 unknown, 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:25.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[28859]: cluster 2024-02-13T14:58:24.700806+0000 mon.a (mon.0) 2898 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:25.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[28859]: audit 2024-02-13T14:58:24.703124+0000 mon.a (mon.0) 2899 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]': finished 2024-02-13T14:58:25.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:24 smithi062 bash[28859]: cluster 2024-02-13T14:58:24.711299+0000 mon.a (mon.0) 2900 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-02-13T14:58:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:24 smithi111 bash[23388]: audit 2024-02-13T14:58:23.700477+0000 mon.a (mon.0) 2895 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-107", "overlaypool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:24 smithi111 bash[23388]: cluster 2024-02-13T14:58:23.709525+0000 mon.a (mon.0) 2896 : cluster 0 osdmap e556: 8 total, 8 up, 8 in 2024-02-13T14:58:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:24 smithi111 bash[23388]: audit 2024-02-13T14:58:23.711160+0000 mon.c (mon.2) 849 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:24 smithi111 bash[23388]: audit 2024-02-13T14:58:23.712440+0000 mon.a (mon.0) 2897 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:24 smithi111 bash[23388]: cluster 2024-02-13T14:58:24.133277+0000 mgr.y (mgr.14613) 574 : cluster 0 pgmap v906: 332 pgs: 32 unknown, 300 active+clean; 582 KiB data, 621 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:24 smithi111 bash[23388]: cluster 2024-02-13T14:58:24.700806+0000 mon.a (mon.0) 2898 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:24 smithi111 bash[23388]: audit 2024-02-13T14:58:24.703124+0000 mon.a (mon.0) 2899 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-107-cache", "mode": "writeback"}]': finished 2024-02-13T14:58:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:24 smithi111 bash[23388]: cluster 2024-02-13T14:58:24.711299+0000 mon.a (mon.0) 2900 : cluster 0 osdmap e557: 8 total, 8 up, 8 in 2024-02-13T14:58:26.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:25 smithi062 bash[21479]: audit 2024-02-13T14:58:24.769742+0000 mon.c (mon.2) 850 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]: dispatch 2024-02-13T14:58:26.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:25 smithi062 bash[21479]: audit 2024-02-13T14:58:24.770601+0000 mon.a (mon.0) 2901 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]: dispatch 2024-02-13T14:58:26.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:25 smithi062 bash[28859]: audit 2024-02-13T14:58:24.769742+0000 mon.c (mon.2) 850 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]: dispatch 2024-02-13T14:58:26.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:25 smithi062 bash[28859]: audit 2024-02-13T14:58:24.770601+0000 mon.a (mon.0) 2901 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]: dispatch 2024-02-13T14:58:26.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:25 smithi111 bash[23388]: audit 2024-02-13T14:58:24.769742+0000 mon.c (mon.2) 850 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]: dispatch 2024-02-13T14:58:26.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:25 smithi111 bash[23388]: audit 2024-02-13T14:58:24.770601+0000 mon.a (mon.0) 2901 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]: dispatch 2024-02-13T14:58:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:58:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:58:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[21479]: audit 2024-02-13T14:58:25.741362+0000 mon.a (mon.0) 2902 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]': finished 2024-02-13T14:58:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[21479]: cluster 2024-02-13T14:58:25.749965+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-02-13T14:58:27.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[21479]: audit 2024-02-13T14:58:25.753223+0000 mon.c (mon.2) 851 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:27.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[21479]: audit 2024-02-13T14:58:25.754354+0000 mon.a (mon.0) 2904 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:27.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[21479]: cluster 2024-02-13T14:58:26.134274+0000 mgr.y (mgr.14613) 575 : cluster 0 pgmap v909: 332 pgs: 332 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:58:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[28859]: audit 2024-02-13T14:58:25.741362+0000 mon.a (mon.0) 2902 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]': finished 2024-02-13T14:58:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[28859]: cluster 2024-02-13T14:58:25.749965+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-02-13T14:58:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[28859]: audit 2024-02-13T14:58:25.753223+0000 mon.c (mon.2) 851 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[28859]: audit 2024-02-13T14:58:25.754354+0000 mon.a (mon.0) 2904 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:26 smithi062 bash[28859]: cluster 2024-02-13T14:58:26.134274+0000 mgr.y (mgr.14613) 575 : cluster 0 pgmap v909: 332 pgs: 332 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:58:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:26 smithi111 bash[23388]: audit 2024-02-13T14:58:25.741362+0000 mon.a (mon.0) 2902 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-107"}]': finished 2024-02-13T14:58:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:26 smithi111 bash[23388]: cluster 2024-02-13T14:58:25.749965+0000 mon.a (mon.0) 2903 : cluster 0 osdmap e558: 8 total, 8 up, 8 in 2024-02-13T14:58:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:26 smithi111 bash[23388]: audit 2024-02-13T14:58:25.753223+0000 mon.c (mon.2) 851 : audit 1 from='client.? v1:172.21.15.62:0/4287525696' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:26 smithi111 bash[23388]: audit 2024-02-13T14:58:25.754354+0000 mon.a (mon.0) 2904 : audit 1 from='client.47009 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]: dispatch 2024-02-13T14:58:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:26 smithi111 bash[23388]: cluster 2024-02-13T14:58:26.134274+0000 mgr.y (mgr.14613) 575 : cluster 0 pgmap v909: 332 pgs: 332 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:58:28.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:27 smithi062 bash[21479]: cluster 2024-02-13T14:58:26.742639+0000 mon.a (mon.0) 2905 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:28.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:27 smithi062 bash[21479]: audit 2024-02-13T14:58:26.750319+0000 mon.a (mon.0) 2906 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:28.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:27 smithi062 bash[21479]: cluster 2024-02-13T14:58:26.761021+0000 mon.a (mon.0) 2907 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-02-13T14:58:28.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:27 smithi062 bash[28859]: cluster 2024-02-13T14:58:26.742639+0000 mon.a (mon.0) 2905 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:28.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:27 smithi062 bash[28859]: audit 2024-02-13T14:58:26.750319+0000 mon.a (mon.0) 2906 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:28.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:27 smithi062 bash[28859]: cluster 2024-02-13T14:58:26.761021+0000 mon.a (mon.0) 2907 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-02-13T14:58:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:27 smithi111 bash[23388]: cluster 2024-02-13T14:58:26.742639+0000 mon.a (mon.0) 2905 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:27 smithi111 bash[23388]: audit 2024-02-13T14:58:26.750319+0000 mon.a (mon.0) 2906 : audit 1 from='client.47009 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-107", "tierpool": "test-rados-api-smithi062-64695-107-cache"}]': finished 2024-02-13T14:58:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:27 smithi111 bash[23388]: cluster 2024-02-13T14:58:26.761021+0000 mon.a (mon.0) 2907 : cluster 0 osdmap e559: 8 total, 8 up, 8 in 2024-02-13T14:58:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:28 smithi062 bash[28859]: cluster 2024-02-13T14:58:27.760017+0000 mon.a (mon.0) 2908 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-02-13T14:58:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:28 smithi062 bash[28859]: cluster 2024-02-13T14:58:28.134930+0000 mgr.y (mgr.14613) 576 : cluster 0 pgmap v912: 300 pgs: 300 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:58:29.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:28 smithi062 bash[21479]: cluster 2024-02-13T14:58:27.760017+0000 mon.a (mon.0) 2908 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-02-13T14:58:29.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:28 smithi062 bash[21479]: cluster 2024-02-13T14:58:28.134930+0000 mgr.y (mgr.14613) 576 : cluster 0 pgmap v912: 300 pgs: 300 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:58:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:28 smithi111 bash[23388]: cluster 2024-02-13T14:58:27.760017+0000 mon.a (mon.0) 2908 : cluster 0 osdmap e560: 8 total, 8 up, 8 in 2024-02-13T14:58:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:28 smithi111 bash[23388]: cluster 2024-02-13T14:58:28.134930+0000 mgr.y (mgr.14613) 576 : cluster 0 pgmap v912: 300 pgs: 300 active+clean; 582 KiB data, 625 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:58:30.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[21479]: cluster 2024-02-13T14:58:28.791475+0000 mon.a (mon.0) 2909 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[21479]: audit 2024-02-13T14:58:28.823169+0000 mon.c (mon.2) 852 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[21479]: audit 2024-02-13T14:58:28.823931+0000 mon.a (mon.0) 2910 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[21479]: audit 2024-02-13T14:58:28.824743+0000 mon.c (mon.2) 853 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[21479]: audit 2024-02-13T14:58:28.825029+0000 mon.a (mon.0) 2911 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[21479]: audit 2024-02-13T14:58:28.825488+0000 mon.c (mon.2) 854 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[21479]: audit 2024-02-13T14:58:28.825759+0000 mon.a (mon.0) 2912 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[28859]: cluster 2024-02-13T14:58:28.791475+0000 mon.a (mon.0) 2909 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[28859]: audit 2024-02-13T14:58:28.823169+0000 mon.c (mon.2) 852 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[28859]: audit 2024-02-13T14:58:28.823931+0000 mon.a (mon.0) 2910 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[28859]: audit 2024-02-13T14:58:28.824743+0000 mon.c (mon.2) 853 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[28859]: audit 2024-02-13T14:58:28.825029+0000 mon.a (mon.0) 2911 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[28859]: audit 2024-02-13T14:58:28.825488+0000 mon.c (mon.2) 854 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:30.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:29 smithi062 bash[28859]: audit 2024-02-13T14:58:28.825759+0000 mon.a (mon.0) 2912 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:29 smithi111 bash[23388]: cluster 2024-02-13T14:58:28.791475+0000 mon.a (mon.0) 2909 : cluster 0 osdmap e561: 8 total, 8 up, 8 in 2024-02-13T14:58:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:29 smithi111 bash[23388]: audit 2024-02-13T14:58:28.823169+0000 mon.c (mon.2) 852 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:29 smithi111 bash[23388]: audit 2024-02-13T14:58:28.823931+0000 mon.a (mon.0) 2910 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:29 smithi111 bash[23388]: audit 2024-02-13T14:58:28.824743+0000 mon.c (mon.2) 853 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:29 smithi111 bash[23388]: audit 2024-02-13T14:58:28.825029+0000 mon.a (mon.0) 2911 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:29 smithi111 bash[23388]: audit 2024-02-13T14:58:28.825488+0000 mon.c (mon.2) 854 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:29 smithi111 bash[23388]: audit 2024-02-13T14:58:28.825759+0000 mon.a (mon.0) 2912 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:31.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[21479]: audit 2024-02-13T14:58:29.787304+0000 mon.a (mon.0) 2913 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:31.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[21479]: cluster 2024-02-13T14:58:29.794903+0000 mon.a (mon.0) 2914 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-02-13T14:58:31.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[21479]: audit 2024-02-13T14:58:29.797129+0000 mon.c (mon.2) 855 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:31.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[21479]: audit 2024-02-13T14:58:29.805915+0000 mon.a (mon.0) 2915 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:31.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[21479]: cluster 2024-02-13T14:58:30.137450+0000 mgr.y (mgr.14613) 577 : cluster 0 pgmap v915: 268 pgs: 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:31.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[28859]: audit 2024-02-13T14:58:29.787304+0000 mon.a (mon.0) 2913 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:31.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[28859]: cluster 2024-02-13T14:58:29.794903+0000 mon.a (mon.0) 2914 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-02-13T14:58:31.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[28859]: audit 2024-02-13T14:58:29.797129+0000 mon.c (mon.2) 855 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:31.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[28859]: audit 2024-02-13T14:58:29.805915+0000 mon.a (mon.0) 2915 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:31.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:30 smithi062 bash[28859]: cluster 2024-02-13T14:58:30.137450+0000 mgr.y (mgr.14613) 577 : cluster 0 pgmap v915: 268 pgs: 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:31.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:58:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:58:31.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:30 smithi111 bash[23388]: audit 2024-02-13T14:58:29.787304+0000 mon.a (mon.0) 2913 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-109", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:31.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:30 smithi111 bash[23388]: cluster 2024-02-13T14:58:29.794903+0000 mon.a (mon.0) 2914 : cluster 0 osdmap e562: 8 total, 8 up, 8 in 2024-02-13T14:58:31.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:30 smithi111 bash[23388]: audit 2024-02-13T14:58:29.797129+0000 mon.c (mon.2) 855 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:31.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:30 smithi111 bash[23388]: audit 2024-02-13T14:58:29.805915+0000 mon.a (mon.0) 2915 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:31.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:30 smithi111 bash[23388]: cluster 2024-02-13T14:58:30.137450+0000 mgr.y (mgr.14613) 577 : cluster 0 pgmap v915: 268 pgs: 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:31 smithi111 bash[23388]: audit 2024-02-13T14:58:30.665590+0000 mgr.y (mgr.14613) 578 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:31 smithi111 bash[23388]: cluster 2024-02-13T14:58:31.281078+0000 mon.a (mon.0) 2916 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-02-13T14:58:32.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:31 smithi062 bash[21479]: audit 2024-02-13T14:58:30.665590+0000 mgr.y (mgr.14613) 578 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:32.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:31 smithi062 bash[21479]: cluster 2024-02-13T14:58:31.281078+0000 mon.a (mon.0) 2916 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-02-13T14:58:32.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:31 smithi062 bash[28859]: audit 2024-02-13T14:58:30.665590+0000 mgr.y (mgr.14613) 578 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:32.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:31 smithi062 bash[28859]: cluster 2024-02-13T14:58:31.281078+0000 mon.a (mon.0) 2916 : cluster 0 osdmap e563: 8 total, 8 up, 8 in 2024-02-13T14:58:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:32 smithi111 bash[23388]: audit 2024-02-13T14:58:31.822714+0000 mon.a (mon.0) 2917 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:32 smithi111 bash[23388]: cluster 2024-02-13T14:58:31.831131+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-02-13T14:58:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:32 smithi111 bash[23388]: cluster 2024-02-13T14:58:32.138427+0000 mgr.y (mgr.14613) 579 : cluster 0 pgmap v918: 276 pgs: 8 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:33.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:32 smithi062 bash[21479]: audit 2024-02-13T14:58:31.822714+0000 mon.a (mon.0) 2917 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:33.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:32 smithi062 bash[21479]: cluster 2024-02-13T14:58:31.831131+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-02-13T14:58:33.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:32 smithi062 bash[21479]: cluster 2024-02-13T14:58:32.138427+0000 mgr.y (mgr.14613) 579 : cluster 0 pgmap v918: 276 pgs: 8 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:33.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:32 smithi062 bash[28859]: audit 2024-02-13T14:58:31.822714+0000 mon.a (mon.0) 2917 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-109", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:33.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:32 smithi062 bash[28859]: cluster 2024-02-13T14:58:31.831131+0000 mon.a (mon.0) 2918 : cluster 0 osdmap e564: 8 total, 8 up, 8 in 2024-02-13T14:58:33.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:32 smithi062 bash[28859]: cluster 2024-02-13T14:58:32.138427+0000 mgr.y (mgr.14613) 579 : cluster 0 pgmap v918: 276 pgs: 8 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:34.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:33 smithi062 bash[21479]: cluster 2024-02-13T14:58:32.822680+0000 mon.a (mon.0) 2919 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:34.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:33 smithi062 bash[21479]: cluster 2024-02-13T14:58:32.845698+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-02-13T14:58:34.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:33 smithi062 bash[21479]: audit 2024-02-13T14:58:32.851747+0000 mon.c (mon.2) 856 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:34.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:33 smithi062 bash[21479]: audit 2024-02-13T14:58:32.852529+0000 mon.a (mon.0) 2921 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:34.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:33 smithi062 bash[28859]: cluster 2024-02-13T14:58:32.822680+0000 mon.a (mon.0) 2919 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:34.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:33 smithi062 bash[28859]: cluster 2024-02-13T14:58:32.845698+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-02-13T14:58:34.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:33 smithi062 bash[28859]: audit 2024-02-13T14:58:32.851747+0000 mon.c (mon.2) 856 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:34.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:33 smithi062 bash[28859]: audit 2024-02-13T14:58:32.852529+0000 mon.a (mon.0) 2921 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:34.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:33 smithi111 bash[23388]: cluster 2024-02-13T14:58:32.822680+0000 mon.a (mon.0) 2919 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:34.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:33 smithi111 bash[23388]: cluster 2024-02-13T14:58:32.845698+0000 mon.a (mon.0) 2920 : cluster 0 osdmap e565: 8 total, 8 up, 8 in 2024-02-13T14:58:34.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:33 smithi111 bash[23388]: audit 2024-02-13T14:58:32.851747+0000 mon.c (mon.2) 856 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:34.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:33 smithi111 bash[23388]: audit 2024-02-13T14:58:32.852529+0000 mon.a (mon.0) 2921 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:35.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[21479]: audit 2024-02-13T14:58:33.837018+0000 mon.a (mon.0) 2922 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[21479]: cluster 2024-02-13T14:58:33.847009+0000 mon.a (mon.0) 2923 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[21479]: audit 2024-02-13T14:58:33.852097+0000 mon.c (mon.2) 857 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[21479]: audit 2024-02-13T14:58:33.860969+0000 mon.a (mon.0) 2924 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[21479]: audit 2024-02-13T14:58:33.984880+0000 mon.b (mon.1) 248 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[21479]: cluster 2024-02-13T14:58:34.139400+0000 mgr.y (mgr.14613) 580 : cluster 0 pgmap v921: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[28859]: audit 2024-02-13T14:58:33.837018+0000 mon.a (mon.0) 2922 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[28859]: cluster 2024-02-13T14:58:33.847009+0000 mon.a (mon.0) 2923 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[28859]: audit 2024-02-13T14:58:33.852097+0000 mon.c (mon.2) 857 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[28859]: audit 2024-02-13T14:58:33.860969+0000 mon.a (mon.0) 2924 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[28859]: audit 2024-02-13T14:58:33.984880+0000 mon.b (mon.1) 248 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:34 smithi062 bash[28859]: cluster 2024-02-13T14:58:34.139400+0000 mgr.y (mgr.14613) 580 : cluster 0 pgmap v921: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:34 smithi111 bash[23388]: audit 2024-02-13T14:58:33.837018+0000 mon.a (mon.0) 2922 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-109-cache","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:34 smithi111 bash[23388]: cluster 2024-02-13T14:58:33.847009+0000 mon.a (mon.0) 2923 : cluster 0 osdmap e566: 8 total, 8 up, 8 in 2024-02-13T14:58:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:34 smithi111 bash[23388]: audit 2024-02-13T14:58:33.852097+0000 mon.c (mon.2) 857 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:34 smithi111 bash[23388]: audit 2024-02-13T14:58:33.860969+0000 mon.a (mon.0) 2924 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:34 smithi111 bash[23388]: audit 2024-02-13T14:58:33.984880+0000 mon.b (mon.1) 248 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:34 smithi111 bash[23388]: cluster 2024-02-13T14:58:34.139400+0000 mgr.y (mgr.14613) 580 : cluster 0 pgmap v921: 308 pgs: 40 unknown, 268 active+clean; 582 KiB data, 626 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:36.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:35 smithi062 bash[28859]: audit 2024-02-13T14:58:34.862831+0000 mon.a (mon.0) 2925 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:35 smithi062 bash[28859]: cluster 2024-02-13T14:58:34.877193+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-02-13T14:58:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:35 smithi062 bash[28859]: audit 2024-02-13T14:58:34.878167+0000 mon.c (mon.2) 858 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:35 smithi062 bash[28859]: audit 2024-02-13T14:58:34.879312+0000 mon.a (mon.0) 2927 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:36.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:35 smithi062 bash[21479]: audit 2024-02-13T14:58:34.862831+0000 mon.a (mon.0) 2925 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:36.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:35 smithi062 bash[21479]: cluster 2024-02-13T14:58:34.877193+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-02-13T14:58:36.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:35 smithi062 bash[21479]: audit 2024-02-13T14:58:34.878167+0000 mon.c (mon.2) 858 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:36.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:35 smithi062 bash[21479]: audit 2024-02-13T14:58:34.879312+0000 mon.a (mon.0) 2927 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:35 smithi111 bash[23388]: audit 2024-02-13T14:58:34.862831+0000 mon.a (mon.0) 2925 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:35 smithi111 bash[23388]: cluster 2024-02-13T14:58:34.877193+0000 mon.a (mon.0) 2926 : cluster 0 osdmap e567: 8 total, 8 up, 8 in 2024-02-13T14:58:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:35 smithi111 bash[23388]: audit 2024-02-13T14:58:34.878167+0000 mon.c (mon.2) 858 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:35 smithi111 bash[23388]: audit 2024-02-13T14:58:34.879312+0000 mon.a (mon.0) 2927 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:58:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:58:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[28859]: audit 2024-02-13T14:58:35.877566+0000 mon.a (mon.0) 2928 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[28859]: cluster 2024-02-13T14:58:35.886956+0000 mon.a (mon.0) 2929 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-02-13T14:58:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[28859]: audit 2024-02-13T14:58:35.889267+0000 mon.c (mon.2) 859 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[28859]: audit 2024-02-13T14:58:35.890335+0000 mon.a (mon.0) 2930 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:37.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[28859]: cluster 2024-02-13T14:58:36.140311+0000 mgr.y (mgr.14613) 581 : cluster 0 pgmap v924: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:37.315 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[21479]: audit 2024-02-13T14:58:35.877566+0000 mon.a (mon.0) 2928 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:37.315 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[21479]: cluster 2024-02-13T14:58:35.886956+0000 mon.a (mon.0) 2929 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-02-13T14:58:37.315 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[21479]: audit 2024-02-13T14:58:35.889267+0000 mon.c (mon.2) 859 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:37.315 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[21479]: audit 2024-02-13T14:58:35.890335+0000 mon.a (mon.0) 2930 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:37.315 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:36 smithi062 bash[21479]: cluster 2024-02-13T14:58:36.140311+0000 mgr.y (mgr.14613) 581 : cluster 0 pgmap v924: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:36 smithi111 bash[23388]: audit 2024-02-13T14:58:35.877566+0000 mon.a (mon.0) 2928 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-109", "overlaypool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:36 smithi111 bash[23388]: cluster 2024-02-13T14:58:35.886956+0000 mon.a (mon.0) 2929 : cluster 0 osdmap e568: 8 total, 8 up, 8 in 2024-02-13T14:58:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:36 smithi111 bash[23388]: audit 2024-02-13T14:58:35.889267+0000 mon.c (mon.2) 859 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:36 smithi111 bash[23388]: audit 2024-02-13T14:58:35.890335+0000 mon.a (mon.0) 2930 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]: dispatch 2024-02-13T14:58:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:36 smithi111 bash[23388]: cluster 2024-02-13T14:58:36.140311+0000 mgr.y (mgr.14613) 581 : cluster 0 pgmap v924: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[28859]: cluster 2024-02-13T14:58:36.878622+0000 mon.a (mon.0) 2931 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[28859]: audit 2024-02-13T14:58:36.891499+0000 mon.a (mon.0) 2932 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]': finished 2024-02-13T14:58:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[28859]: cluster 2024-02-13T14:58:36.901663+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-02-13T14:58:38.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[28859]: audit 2024-02-13T14:58:36.903539+0000 mon.c (mon.2) 860 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:38.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[28859]: audit 2024-02-13T14:58:36.904662+0000 mon.a (mon.0) 2934 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[21479]: cluster 2024-02-13T14:58:36.878622+0000 mon.a (mon.0) 2931 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[21479]: audit 2024-02-13T14:58:36.891499+0000 mon.a (mon.0) 2932 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]': finished 2024-02-13T14:58:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[21479]: cluster 2024-02-13T14:58:36.901663+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-02-13T14:58:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[21479]: audit 2024-02-13T14:58:36.903539+0000 mon.c (mon.2) 860 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:38.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:37 smithi062 bash[21479]: audit 2024-02-13T14:58:36.904662+0000 mon.a (mon.0) 2934 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:37 smithi111 bash[23388]: cluster 2024-02-13T14:58:36.878622+0000 mon.a (mon.0) 2931 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:58:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:37 smithi111 bash[23388]: audit 2024-02-13T14:58:36.891499+0000 mon.a (mon.0) 2932 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-109-cache", "mode": "writeback"}]': finished 2024-02-13T14:58:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:37 smithi111 bash[23388]: cluster 2024-02-13T14:58:36.901663+0000 mon.a (mon.0) 2933 : cluster 0 osdmap e569: 8 total, 8 up, 8 in 2024-02-13T14:58:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:37 smithi111 bash[23388]: audit 2024-02-13T14:58:36.903539+0000 mon.c (mon.2) 860 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:37 smithi111 bash[23388]: audit 2024-02-13T14:58:36.904662+0000 mon.a (mon.0) 2934 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T14:58:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: audit 2024-02-13T14:58:37.894292+0000 mon.a (mon.0) 2935 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:58:39.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: cluster 2024-02-13T14:58:37.904125+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: audit 2024-02-13T14:58:37.906485+0000 mon.c (mon.2) 861 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: audit 2024-02-13T14:58:37.908846+0000 mon.a (mon.0) 2937 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: cluster 2024-02-13T14:58:38.141274+0000 mgr.y (mgr.14613) 582 : cluster 0 pgmap v927: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: audit 2024-02-13T14:58:38.896871+0000 mon.a (mon.0) 2938 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: cluster 2024-02-13T14:58:38.904061+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: audit 2024-02-13T14:58:38.909153+0000 mon.c (mon.2) 862 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[28859]: audit 2024-02-13T14:58:38.911674+0000 mon.a (mon.0) 2940 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: audit 2024-02-13T14:58:37.894292+0000 mon.a (mon.0) 2935 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: cluster 2024-02-13T14:58:37.904125+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: audit 2024-02-13T14:58:37.906485+0000 mon.c (mon.2) 861 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:39.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: audit 2024-02-13T14:58:37.908846+0000 mon.a (mon.0) 2937 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:39.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: cluster 2024-02-13T14:58:38.141274+0000 mgr.y (mgr.14613) 582 : cluster 0 pgmap v927: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:39.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: audit 2024-02-13T14:58:38.896871+0000 mon.a (mon.0) 2938 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:58:39.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: cluster 2024-02-13T14:58:38.904061+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-02-13T14:58:39.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: audit 2024-02-13T14:58:38.909153+0000 mon.c (mon.2) 862 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:39.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:38 smithi062 bash[21479]: audit 2024-02-13T14:58:38.911674+0000 mon.a (mon.0) 2940 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: audit 2024-02-13T14:58:37.894292+0000 mon.a (mon.0) 2935 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_count","val": "2"}]': finished 2024-02-13T14:58:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: cluster 2024-02-13T14:58:37.904125+0000 mon.a (mon.0) 2936 : cluster 0 osdmap e570: 8 total, 8 up, 8 in 2024-02-13T14:58:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: audit 2024-02-13T14:58:37.906485+0000 mon.c (mon.2) 861 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: audit 2024-02-13T14:58:37.908846+0000 mon.a (mon.0) 2937 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T14:58:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: cluster 2024-02-13T14:58:38.141274+0000 mgr.y (mgr.14613) 582 : cluster 0 pgmap v927: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: audit 2024-02-13T14:58:38.896871+0000 mon.a (mon.0) 2938 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_period","val": "600"}]': finished 2024-02-13T14:58:39.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: cluster 2024-02-13T14:58:38.904061+0000 mon.a (mon.0) 2939 : cluster 0 osdmap e571: 8 total, 8 up, 8 in 2024-02-13T14:58:39.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: audit 2024-02-13T14:58:38.909153+0000 mon.c (mon.2) 862 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:39.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:38 smithi111 bash[23388]: audit 2024-02-13T14:58:38.911674+0000 mon.a (mon.0) 2940 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T14:58:40.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[21479]: cluster 2024-02-13T14:58:39.897459+0000 mon.a (mon.0) 2941 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:40.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[21479]: audit 2024-02-13T14:58:39.899758+0000 mon.a (mon.0) 2942 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:58:40.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[21479]: cluster 2024-02-13T14:58:39.906962+0000 mon.a (mon.0) 2943 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-02-13T14:58:40.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[21479]: audit 2024-02-13T14:58:39.911506+0000 mon.c (mon.2) 863 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T14:58:40.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[21479]: audit 2024-02-13T14:58:39.912434+0000 mon.a (mon.0) 2944 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T14:58:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[28859]: cluster 2024-02-13T14:58:39.897459+0000 mon.a (mon.0) 2941 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[28859]: audit 2024-02-13T14:58:39.899758+0000 mon.a (mon.0) 2942 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:58:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[28859]: cluster 2024-02-13T14:58:39.906962+0000 mon.a (mon.0) 2943 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-02-13T14:58:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[28859]: audit 2024-02-13T14:58:39.911506+0000 mon.c (mon.2) 863 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T14:58:40.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:39 smithi062 bash[28859]: audit 2024-02-13T14:58:39.912434+0000 mon.a (mon.0) 2944 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T14:58:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:39 smithi111 bash[23388]: cluster 2024-02-13T14:58:39.897459+0000 mon.a (mon.0) 2941 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:58:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:39 smithi111 bash[23388]: audit 2024-02-13T14:58:39.899758+0000 mon.a (mon.0) 2942 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T14:58:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:39 smithi111 bash[23388]: cluster 2024-02-13T14:58:39.906962+0000 mon.a (mon.0) 2943 : cluster 0 osdmap e572: 8 total, 8 up, 8 in 2024-02-13T14:58:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:39 smithi111 bash[23388]: audit 2024-02-13T14:58:39.911506+0000 mon.c (mon.2) 863 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T14:58:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:39 smithi111 bash[23388]: audit 2024-02-13T14:58:39.912434+0000 mon.a (mon.0) 2944 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]: dispatch 2024-02-13T14:58:40.937 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:58:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:58:41.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:40 smithi062 bash[21479]: cluster 2024-02-13T14:58:40.143403+0000 mgr.y (mgr.14613) 583 : cluster 0 pgmap v930: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:41.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:40 smithi062 bash[21479]: audit 2024-02-13T14:58:40.638682+0000 mon.b (mon.1) 249 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:58:41.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:40 smithi062 bash[21479]: audit 2024-02-13T14:58:40.902101+0000 mon.a (mon.0) 2945 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-13T14:58:41.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:40 smithi062 bash[21479]: cluster 2024-02-13T14:58:40.909514+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-02-13T14:58:41.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:40 smithi062 bash[28859]: cluster 2024-02-13T14:58:40.143403+0000 mgr.y (mgr.14613) 583 : cluster 0 pgmap v930: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:41.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:40 smithi062 bash[28859]: audit 2024-02-13T14:58:40.638682+0000 mon.b (mon.1) 249 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:58:41.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:40 smithi062 bash[28859]: audit 2024-02-13T14:58:40.902101+0000 mon.a (mon.0) 2945 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-13T14:58:41.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:40 smithi062 bash[28859]: cluster 2024-02-13T14:58:40.909514+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-02-13T14:58:41.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:40 smithi111 bash[23388]: cluster 2024-02-13T14:58:40.143403+0000 mgr.y (mgr.14613) 583 : cluster 0 pgmap v930: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:41.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:40 smithi111 bash[23388]: audit 2024-02-13T14:58:40.638682+0000 mon.b (mon.1) 249 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:58:41.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:40 smithi111 bash[23388]: audit 2024-02-13T14:58:40.902101+0000 mon.a (mon.0) 2945 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-109-cache","var": "min_read_recency_for_promote","val": "4"}]': finished 2024-02-13T14:58:41.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:40 smithi111 bash[23388]: cluster 2024-02-13T14:58:40.909514+0000 mon.a (mon.0) 2946 : cluster 0 osdmap e573: 8 total, 8 up, 8 in 2024-02-13T14:58:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[28859]: audit 2024-02-13T14:58:40.676914+0000 mgr.y (mgr.14613) 584 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[28859]: audit 2024-02-13T14:58:40.993075+0000 mon.c (mon.2) 864 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[28859]: audit 2024-02-13T14:58:40.993639+0000 mon.a (mon.0) 2947 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[28859]: audit 2024-02-13T14:58:41.423962+0000 mon.b (mon.1) 250 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[28859]: audit 2024-02-13T14:58:41.425864+0000 mon.b (mon.1) 251 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[28859]: audit 2024-02-13T14:58:41.434556+0000 mon.a (mon.0) 2948 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[21479]: audit 2024-02-13T14:58:40.676914+0000 mgr.y (mgr.14613) 584 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[21479]: audit 2024-02-13T14:58:40.993075+0000 mon.c (mon.2) 864 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[21479]: audit 2024-02-13T14:58:40.993639+0000 mon.a (mon.0) 2947 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[21479]: audit 2024-02-13T14:58:41.423962+0000 mon.b (mon.1) 250 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[21479]: audit 2024-02-13T14:58:41.425864+0000 mon.b (mon.1) 251 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:58:42.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:41 smithi062 bash[21479]: audit 2024-02-13T14:58:41.434556+0000 mon.a (mon.0) 2948 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:58:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:41 smithi111 bash[23388]: audit 2024-02-13T14:58:40.676914+0000 mgr.y (mgr.14613) 584 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:41 smithi111 bash[23388]: audit 2024-02-13T14:58:40.993075+0000 mon.c (mon.2) 864 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:41 smithi111 bash[23388]: audit 2024-02-13T14:58:40.993639+0000 mon.a (mon.0) 2947 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:41 smithi111 bash[23388]: audit 2024-02-13T14:58:41.423962+0000 mon.b (mon.1) 250 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:58:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:41 smithi111 bash[23388]: audit 2024-02-13T14:58:41.425864+0000 mon.b (mon.1) 251 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:58:42.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:41 smithi111 bash[23388]: audit 2024-02-13T14:58:41.434556+0000 mon.a (mon.0) 2948 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:58:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[28859]: audit 2024-02-13T14:58:41.948633+0000 mon.a (mon.0) 2949 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[28859]: cluster 2024-02-13T14:58:41.956546+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-02-13T14:58:43.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[28859]: audit 2024-02-13T14:58:41.960060+0000 mon.c (mon.2) 865 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:43.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[28859]: audit 2024-02-13T14:58:41.961578+0000 mon.a (mon.0) 2951 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:43.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[28859]: cluster 2024-02-13T14:58:42.144294+0000 mgr.y (mgr.14613) 585 : cluster 0 pgmap v933: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[21479]: audit 2024-02-13T14:58:41.948633+0000 mon.a (mon.0) 2949 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[21479]: cluster 2024-02-13T14:58:41.956546+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-02-13T14:58:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[21479]: audit 2024-02-13T14:58:41.960060+0000 mon.c (mon.2) 865 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[21479]: audit 2024-02-13T14:58:41.961578+0000 mon.a (mon.0) 2951 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:43.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:42 smithi062 bash[21479]: cluster 2024-02-13T14:58:42.144294+0000 mgr.y (mgr.14613) 585 : cluster 0 pgmap v933: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:42 smithi111 bash[23388]: audit 2024-02-13T14:58:41.948633+0000 mon.a (mon.0) 2949 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:42 smithi111 bash[23388]: cluster 2024-02-13T14:58:41.956546+0000 mon.a (mon.0) 2950 : cluster 0 osdmap e574: 8 total, 8 up, 8 in 2024-02-13T14:58:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:42 smithi111 bash[23388]: audit 2024-02-13T14:58:41.960060+0000 mon.c (mon.2) 865 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:42 smithi111 bash[23388]: audit 2024-02-13T14:58:41.961578+0000 mon.a (mon.0) 2951 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]: dispatch 2024-02-13T14:58:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:42 smithi111 bash[23388]: cluster 2024-02-13T14:58:42.144294+0000 mgr.y (mgr.14613) 585 : cluster 0 pgmap v933: 308 pgs: 308 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:43 smithi062 bash[21479]: audit 2024-02-13T14:58:42.951163+0000 mon.a (mon.0) 2952 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:43 smithi062 bash[21479]: cluster 2024-02-13T14:58:42.958307+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-02-13T14:58:44.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:43 smithi062 bash[28859]: audit 2024-02-13T14:58:42.951163+0000 mon.a (mon.0) 2952 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:44.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:43 smithi062 bash[28859]: cluster 2024-02-13T14:58:42.958307+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-02-13T14:58:44.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:43 smithi111 bash[23388]: audit 2024-02-13T14:58:42.951163+0000 mon.a (mon.0) 2952 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-109", "tierpool": "test-rados-api-smithi062-64695-109-cache"}]': finished 2024-02-13T14:58:44.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:43 smithi111 bash[23388]: cluster 2024-02-13T14:58:42.958307+0000 mon.a (mon.0) 2953 : cluster 0 osdmap e575: 8 total, 8 up, 8 in 2024-02-13T14:58:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:44 smithi062 bash[28859]: cluster 2024-02-13T14:58:43.975637+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-02-13T14:58:45.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:44 smithi062 bash[28859]: cluster 2024-02-13T14:58:44.145171+0000 mgr.y (mgr.14613) 586 : cluster 0 pgmap v936: 276 pgs: 276 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:45.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:44 smithi062 bash[21479]: cluster 2024-02-13T14:58:43.975637+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-02-13T14:58:45.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:44 smithi062 bash[21479]: cluster 2024-02-13T14:58:44.145171+0000 mgr.y (mgr.14613) 586 : cluster 0 pgmap v936: 276 pgs: 276 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:45.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:45 smithi111 bash[23388]: cluster 2024-02-13T14:58:43.975637+0000 mon.a (mon.0) 2954 : cluster 0 osdmap e576: 8 total, 8 up, 8 in 2024-02-13T14:58:45.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:45 smithi111 bash[23388]: cluster 2024-02-13T14:58:44.145171+0000 mgr.y (mgr.14613) 586 : cluster 0 pgmap v936: 276 pgs: 276 active+clean; 582 KiB data, 631 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:46.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:46 smithi062 bash[28859]: cluster 2024-02-13T14:58:45.006284+0000 mon.a (mon.0) 2955 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-02-13T14:58:46.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:46 smithi062 bash[28859]: audit 2024-02-13T14:58:45.007866+0000 mon.c (mon.2) 866 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:46.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:46 smithi062 bash[28859]: audit 2024-02-13T14:58:45.008821+0000 mon.a (mon.0) 2956 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:46.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:46 smithi062 bash[21479]: cluster 2024-02-13T14:58:45.006284+0000 mon.a (mon.0) 2955 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-02-13T14:58:46.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:46 smithi062 bash[21479]: audit 2024-02-13T14:58:45.007866+0000 mon.c (mon.2) 866 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:46.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:46 smithi062 bash[21479]: audit 2024-02-13T14:58:45.008821+0000 mon.a (mon.0) 2956 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:46.314 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:58:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:58:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:58:46.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:46 smithi111 bash[23388]: cluster 2024-02-13T14:58:45.006284+0000 mon.a (mon.0) 2955 : cluster 0 osdmap e577: 8 total, 8 up, 8 in 2024-02-13T14:58:46.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:46 smithi111 bash[23388]: audit 2024-02-13T14:58:45.007866+0000 mon.c (mon.2) 866 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:46.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:46 smithi111 bash[23388]: audit 2024-02-13T14:58:45.008821+0000 mon.a (mon.0) 2956 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:47.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[28859]: audit 2024-02-13T14:58:45.998858+0000 mon.a (mon.0) 2957 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[28859]: cluster 2024-02-13T14:58:46.006528+0000 mon.a (mon.0) 2958 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[28859]: audit 2024-02-13T14:58:46.008487+0000 mon.c (mon.2) 867 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[28859]: audit 2024-02-13T14:58:46.010623+0000 mon.a (mon.0) 2959 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[28859]: cluster 2024-02-13T14:58:46.146027+0000 mgr.y (mgr.14613) 587 : cluster 0 pgmap v939: 268 pgs: 268 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[28859]: audit 2024-02-13T14:58:47.002341+0000 mon.a (mon.0) 2960 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[28859]: cluster 2024-02-13T14:58:47.009907+0000 mon.a (mon.0) 2961 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[21479]: audit 2024-02-13T14:58:45.998858+0000 mon.a (mon.0) 2957 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[21479]: cluster 2024-02-13T14:58:46.006528+0000 mon.a (mon.0) 2958 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[21479]: audit 2024-02-13T14:58:46.008487+0000 mon.c (mon.2) 867 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[21479]: audit 2024-02-13T14:58:46.010623+0000 mon.a (mon.0) 2959 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:47.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[21479]: cluster 2024-02-13T14:58:46.146027+0000 mgr.y (mgr.14613) 587 : cluster 0 pgmap v939: 268 pgs: 268 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:47.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[21479]: audit 2024-02-13T14:58:47.002341+0000 mon.a (mon.0) 2960 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:47.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:47 smithi062 bash[21479]: cluster 2024-02-13T14:58:47.009907+0000 mon.a (mon.0) 2961 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-02-13T14:58:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:47 smithi111 bash[23388]: audit 2024-02-13T14:58:45.998858+0000 mon.a (mon.0) 2957 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:47 smithi111 bash[23388]: cluster 2024-02-13T14:58:46.006528+0000 mon.a (mon.0) 2958 : cluster 0 osdmap e578: 8 total, 8 up, 8 in 2024-02-13T14:58:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:47 smithi111 bash[23388]: audit 2024-02-13T14:58:46.008487+0000 mon.c (mon.2) 867 : audit 1 from='client.? v1:172.21.15.62:0/417812470' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:47 smithi111 bash[23388]: audit 2024-02-13T14:58:46.010623+0000 mon.a (mon.0) 2959 : audit 1 from='client.47015 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]: dispatch 2024-02-13T14:58:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:47 smithi111 bash[23388]: cluster 2024-02-13T14:58:46.146027+0000 mgr.y (mgr.14613) 587 : cluster 0 pgmap v939: 268 pgs: 268 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:47 smithi111 bash[23388]: audit 2024-02-13T14:58:47.002341+0000 mon.a (mon.0) 2960 : audit 1 from='client.47015 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-109"}]': finished 2024-02-13T14:58:47.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:47 smithi111 bash[23388]: cluster 2024-02-13T14:58:47.009907+0000 mon.a (mon.0) 2961 : cluster 0 osdmap e579: 8 total, 8 up, 8 in 2024-02-13T14:58:48.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:48 smithi062 bash[28859]: cluster 2024-02-13T14:58:47.013212+0000 mon.a (mon.0) 2962 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:48.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:48 smithi062 bash[21479]: cluster 2024-02-13T14:58:47.013212+0000 mon.a (mon.0) 2962 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:48.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:48 smithi111 bash[23388]: cluster 2024-02-13T14:58:47.013212+0000 mon.a (mon.0) 2962 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: cluster 2024-02-13T14:58:48.031265+0000 mon.a (mon.0) 2963 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-02-13T14:58:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: audit 2024-02-13T14:58:48.034485+0000 mon.c (mon.2) 868 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: audit 2024-02-13T14:58:48.038312+0000 mon.a (mon.0) 2964 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: cluster 2024-02-13T14:58:48.146924+0000 mgr.y (mgr.14613) 588 : cluster 0 pgmap v942: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: audit 2024-02-13T14:58:49.022209+0000 mon.b (mon.1) 252 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: audit 2024-02-13T14:58:49.023973+0000 mon.a (mon.0) 2965 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: cluster 2024-02-13T14:58:49.032375+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: audit 2024-02-13T14:58:49.034112+0000 mon.c (mon.2) 869 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[21479]: audit 2024-02-13T14:58:49.035854+0000 mon.a (mon.0) 2967 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: cluster 2024-02-13T14:58:48.031265+0000 mon.a (mon.0) 2963 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: audit 2024-02-13T14:58:48.034485+0000 mon.c (mon.2) 868 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: audit 2024-02-13T14:58:48.038312+0000 mon.a (mon.0) 2964 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: cluster 2024-02-13T14:58:48.146924+0000 mgr.y (mgr.14613) 588 : cluster 0 pgmap v942: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:58:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: audit 2024-02-13T14:58:49.022209+0000 mon.b (mon.1) 252 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:49.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: audit 2024-02-13T14:58:49.023973+0000 mon.a (mon.0) 2965 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:49.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: cluster 2024-02-13T14:58:49.032375+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-02-13T14:58:49.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: audit 2024-02-13T14:58:49.034112+0000 mon.c (mon.2) 869 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:49 smithi062 bash[28859]: audit 2024-02-13T14:58:49.035854+0000 mon.a (mon.0) 2967 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: cluster 2024-02-13T14:58:48.031265+0000 mon.a (mon.0) 2963 : cluster 0 osdmap e580: 8 total, 8 up, 8 in 2024-02-13T14:58:49.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: audit 2024-02-13T14:58:48.034485+0000 mon.c (mon.2) 868 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: audit 2024-02-13T14:58:48.038312+0000 mon.a (mon.0) 2964 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: cluster 2024-02-13T14:58:48.146924+0000 mgr.y (mgr.14613) 588 : cluster 0 pgmap v942: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:58:49.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: audit 2024-02-13T14:58:49.022209+0000 mon.b (mon.1) 252 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:58:49.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: audit 2024-02-13T14:58:49.023973+0000 mon.a (mon.0) 2965 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:49.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: cluster 2024-02-13T14:58:49.032375+0000 mon.a (mon.0) 2966 : cluster 0 osdmap e581: 8 total, 8 up, 8 in 2024-02-13T14:58:49.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: audit 2024-02-13T14:58:49.034112+0000 mon.c (mon.2) 869 : audit 1 from='client.? v1:172.21.15.62:0/3682621159' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:49.346 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:49 smithi111 bash[23388]: audit 2024-02-13T14:58:49.035854+0000 mon.a (mon.0) 2967 : audit 1 from='client.47003 ' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]: dispatch 2024-02-13T14:58:51.038 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:58:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:58:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[21479]: audit 2024-02-13T14:58:50.027696+0000 mon.a (mon.0) 2968 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[21479]: cluster 2024-02-13T14:58:50.035375+0000 mon.a (mon.0) 2969 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-02-13T14:58:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[21479]: audit 2024-02-13T14:58:50.082720+0000 mon.a (mon.0) 2970 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[21479]: audit 2024-02-13T14:58:50.084399+0000 mon.a (mon.0) 2971 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[21479]: audit 2024-02-13T14:58:50.084804+0000 mon.a (mon.0) 2972 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[21479]: cluster 2024-02-13T14:58:50.147761+0000 mgr.y (mgr.14613) 589 : cluster 0 pgmap v945: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[28859]: audit 2024-02-13T14:58:50.027696+0000 mon.a (mon.0) 2968 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[28859]: cluster 2024-02-13T14:58:50.035375+0000 mon.a (mon.0) 2969 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[28859]: audit 2024-02-13T14:58:50.082720+0000 mon.a (mon.0) 2970 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[28859]: audit 2024-02-13T14:58:50.084399+0000 mon.a (mon.0) 2971 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[28859]: audit 2024-02-13T14:58:50.084804+0000 mon.a (mon.0) 2972 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:51 smithi062 bash[28859]: cluster 2024-02-13T14:58:50.147761+0000 mgr.y (mgr.14613) 589 : cluster 0 pgmap v945: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:58:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:51 smithi111 bash[23388]: audit 2024-02-13T14:58:50.027696+0000 mon.a (mon.0) 2968 : audit 1 from='client.47003 ' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"LibRadosTierECPP_smithi062-64695-104"}]': finished 2024-02-13T14:58:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:51 smithi111 bash[23388]: cluster 2024-02-13T14:58:50.035375+0000 mon.a (mon.0) 2969 : cluster 0 osdmap e582: 8 total, 8 up, 8 in 2024-02-13T14:58:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:51 smithi111 bash[23388]: audit 2024-02-13T14:58:50.082720+0000 mon.a (mon.0) 2970 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:51 smithi111 bash[23388]: audit 2024-02-13T14:58:50.084399+0000 mon.a (mon.0) 2971 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:51 smithi111 bash[23388]: audit 2024-02-13T14:58:50.084804+0000 mon.a (mon.0) 2972 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2024-02-13T14:58:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:51 smithi111 bash[23388]: cluster 2024-02-13T14:58:50.147761+0000 mgr.y (mgr.14613) 589 : cluster 0 pgmap v945: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T14:58:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:52 smithi062 bash[21479]: audit 2024-02-13T14:58:50.686775+0000 mgr.y (mgr.14613) 590 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:52 smithi062 bash[21479]: audit 2024-02-13T14:58:51.036515+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:52 smithi062 bash[21479]: cluster 2024-02-13T14:58:51.047012+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-02-13T14:58:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:52 smithi062 bash[21479]: audit 2024-02-13T14:58:51.048371+0000 mon.a (mon.0) 2975 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:52 smithi062 bash[28859]: audit 2024-02-13T14:58:50.686775+0000 mgr.y (mgr.14613) 590 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:52 smithi062 bash[28859]: audit 2024-02-13T14:58:51.036515+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:52 smithi062 bash[28859]: cluster 2024-02-13T14:58:51.047012+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-02-13T14:58:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:52 smithi062 bash[28859]: audit 2024-02-13T14:58:51.048371+0000 mon.a (mon.0) 2975 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:52 smithi111 bash[23388]: audit 2024-02-13T14:58:50.686775+0000 mgr.y (mgr.14613) 590 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:58:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:52 smithi111 bash[23388]: audit 2024-02-13T14:58:51.036515+0000 mon.a (mon.0) 2973 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "testprofile-test-rados-api-smithi062-64695-111", "profile": [ "k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2024-02-13T14:58:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:52 smithi111 bash[23388]: cluster 2024-02-13T14:58:51.047012+0000 mon.a (mon.0) 2974 : cluster 0 osdmap e583: 8 total, 8 up, 8 in 2024-02-13T14:58:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:52 smithi111 bash[23388]: audit 2024-02-13T14:58:51.048371+0000 mon.a (mon.0) 2975 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:53.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:53 smithi062 bash[21479]: cluster 2024-02-13T14:58:52.148523+0000 mgr.y (mgr.14613) 591 : cluster 0 pgmap v948: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:53.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:53 smithi062 bash[21479]: cluster 2024-02-13T14:58:52.512625+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-02-13T14:58:53.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:53 smithi062 bash[21479]: cluster 2024-02-13T14:58:52.686241+0000 mon.a (mon.0) 2977 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:53.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:53 smithi062 bash[28859]: cluster 2024-02-13T14:58:52.148523+0000 mgr.y (mgr.14613) 591 : cluster 0 pgmap v948: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:53.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:53 smithi062 bash[28859]: cluster 2024-02-13T14:58:52.512625+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-02-13T14:58:53.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:53 smithi062 bash[28859]: cluster 2024-02-13T14:58:52.686241+0000 mon.a (mon.0) 2977 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:53.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:53 smithi111 bash[23388]: cluster 2024-02-13T14:58:52.148523+0000 mgr.y (mgr.14613) 591 : cluster 0 pgmap v948: 260 pgs: 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:53.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:53 smithi111 bash[23388]: cluster 2024-02-13T14:58:52.512625+0000 mon.a (mon.0) 2976 : cluster 0 osdmap e584: 8 total, 8 up, 8 in 2024-02-13T14:58:53.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:53 smithi111 bash[23388]: cluster 2024-02-13T14:58:52.686241+0000 mon.a (mon.0) 2977 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:54.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:54 smithi062 bash[28859]: audit 2024-02-13T14:58:53.057815+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:58:54.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:54 smithi062 bash[28859]: cluster 2024-02-13T14:58:53.068611+0000 mon.a (mon.0) 2979 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-02-13T14:58:54.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:54 smithi062 bash[21479]: audit 2024-02-13T14:58:53.057815+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:58:54.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:54 smithi062 bash[21479]: cluster 2024-02-13T14:58:53.068611+0000 mon.a (mon.0) 2979 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-02-13T14:58:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:54 smithi111 bash[23388]: audit 2024-02-13T14:58:53.057815+0000 mon.a (mon.0) 2978 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "test-rados-api-smithi062-64695-111", "pool_type":"erasure", "pg_num":8, "pgp_num":8, "erasure_code_profile":"testprofile-test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:58:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:54 smithi111 bash[23388]: cluster 2024-02-13T14:58:53.068611+0000 mon.a (mon.0) 2979 : cluster 0 osdmap e585: 8 total, 8 up, 8 in 2024-02-13T14:58:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:55 smithi111 bash[23388]: cluster 2024-02-13T14:58:54.078913+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-02-13T14:58:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:55 smithi111 bash[23388]: audit 2024-02-13T14:58:54.082833+0000 mon.a (mon.0) 2981 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:55 smithi111 bash[23388]: cluster 2024-02-13T14:58:54.149419+0000 mgr.y (mgr.14613) 592 : cluster 0 pgmap v951: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:55 smithi062 bash[28859]: cluster 2024-02-13T14:58:54.078913+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-02-13T14:58:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:55 smithi062 bash[28859]: audit 2024-02-13T14:58:54.082833+0000 mon.a (mon.0) 2981 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:55.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:55 smithi062 bash[28859]: cluster 2024-02-13T14:58:54.149419+0000 mgr.y (mgr.14613) 592 : cluster 0 pgmap v951: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:55.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:55 smithi062 bash[21479]: cluster 2024-02-13T14:58:54.078913+0000 mon.a (mon.0) 2980 : cluster 0 osdmap e586: 8 total, 8 up, 8 in 2024-02-13T14:58:55.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:55 smithi062 bash[21479]: audit 2024-02-13T14:58:54.082833+0000 mon.a (mon.0) 2981 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-112","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:58:55.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:55 smithi062 bash[21479]: cluster 2024-02-13T14:58:54.149419+0000 mgr.y (mgr.14613) 592 : cluster 0 pgmap v951: 300 pgs: 40 unknown, 260 active+clean; 582 KiB data, 632 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:58:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:58:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:58:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:58:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:56 smithi062 bash[21479]: audit 2024-02-13T14:58:55.080687+0000 mon.a (mon.0) 2982 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:56 smithi062 bash[21479]: cluster 2024-02-13T14:58:55.092303+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-02-13T14:58:56.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:56 smithi062 bash[21479]: audit 2024-02-13T14:58:55.134946+0000 mon.a (mon.0) 2984 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:58:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:56 smithi062 bash[28859]: audit 2024-02-13T14:58:55.080687+0000 mon.a (mon.0) 2982 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:56 smithi062 bash[28859]: cluster 2024-02-13T14:58:55.092303+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-02-13T14:58:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:56 smithi062 bash[28859]: audit 2024-02-13T14:58:55.134946+0000 mon.a (mon.0) 2984 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:58:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:56 smithi111 bash[23388]: audit 2024-02-13T14:58:55.080687+0000 mon.a (mon.0) 2982 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-112","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:58:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:56 smithi111 bash[23388]: cluster 2024-02-13T14:58:55.092303+0000 mon.a (mon.0) 2983 : cluster 0 osdmap e587: 8 total, 8 up, 8 in 2024-02-13T14:58:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:56 smithi111 bash[23388]: audit 2024-02-13T14:58:55.134946+0000 mon.a (mon.0) 2984 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:58:57.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[21479]: audit 2024-02-13T14:58:56.083835+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:58:57.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[21479]: cluster 2024-02-13T14:58:56.090818+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-02-13T14:58:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[21479]: audit 2024-02-13T14:58:56.092141+0000 mon.a (mon.0) 2987 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-112"}]: dispatch 2024-02-13T14:58:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[21479]: cluster 2024-02-13T14:58:56.150525+0000 mgr.y (mgr.14613) 593 : cluster 0 pgmap v954: 300 pgs: 1 creating+activating, 30 creating+peering, 269 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:57.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[21479]: audit 2024-02-13T14:58:57.086414+0000 mon.a (mon.0) 2988 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-112"}]': finished 2024-02-13T14:58:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[28859]: audit 2024-02-13T14:58:56.083835+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:58:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[28859]: cluster 2024-02-13T14:58:56.090818+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-02-13T14:58:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[28859]: audit 2024-02-13T14:58:56.092141+0000 mon.a (mon.0) 2987 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-112"}]: dispatch 2024-02-13T14:58:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[28859]: cluster 2024-02-13T14:58:56.150525+0000 mgr.y (mgr.14613) 593 : cluster 0 pgmap v954: 300 pgs: 1 creating+activating, 30 creating+peering, 269 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:57.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:57 smithi062 bash[28859]: audit 2024-02-13T14:58:57.086414+0000 mon.a (mon.0) 2988 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-112"}]': finished 2024-02-13T14:58:57.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:57 smithi111 bash[23388]: audit 2024-02-13T14:58:56.083835+0000 mon.a (mon.0) 2985 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:58:57.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:57 smithi111 bash[23388]: cluster 2024-02-13T14:58:56.090818+0000 mon.a (mon.0) 2986 : cluster 0 osdmap e588: 8 total, 8 up, 8 in 2024-02-13T14:58:57.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:57 smithi111 bash[23388]: audit 2024-02-13T14:58:56.092141+0000 mon.a (mon.0) 2987 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-112"}]: dispatch 2024-02-13T14:58:57.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:57 smithi111 bash[23388]: cluster 2024-02-13T14:58:56.150525+0000 mgr.y (mgr.14613) 593 : cluster 0 pgmap v954: 300 pgs: 1 creating+activating, 30 creating+peering, 269 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:57.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:57 smithi111 bash[23388]: audit 2024-02-13T14:58:57.086414+0000 mon.a (mon.0) 2988 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-112"}]': finished 2024-02-13T14:58:58.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:58 smithi062 bash[28859]: cluster 2024-02-13T14:58:57.096313+0000 mon.a (mon.0) 2989 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-02-13T14:58:58.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:58 smithi062 bash[28859]: audit 2024-02-13T14:58:57.182557+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:58.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:58 smithi062 bash[28859]: cluster 2024-02-13T14:58:57.688239+0000 mon.a (mon.0) 2991 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:58.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:58 smithi062 bash[21479]: cluster 2024-02-13T14:58:57.096313+0000 mon.a (mon.0) 2989 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-02-13T14:58:58.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:58 smithi062 bash[21479]: audit 2024-02-13T14:58:57.182557+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:58.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:58 smithi062 bash[21479]: cluster 2024-02-13T14:58:57.688239+0000 mon.a (mon.0) 2991 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:58.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:58 smithi111 bash[23388]: cluster 2024-02-13T14:58:57.096313+0000 mon.a (mon.0) 2989 : cluster 0 osdmap e589: 8 total, 8 up, 8 in 2024-02-13T14:58:58.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:58 smithi111 bash[23388]: audit 2024-02-13T14:58:57.182557+0000 mon.a (mon.0) 2990 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:58:58.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:58 smithi111 bash[23388]: cluster 2024-02-13T14:58:57.688239+0000 mon.a (mon.0) 2991 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:58:59.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[28859]: audit 2024-02-13T14:58:58.115731+0000 mon.a (mon.0) 2992 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:58:59.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[28859]: cluster 2024-02-13T14:58:58.122673+0000 mon.a (mon.0) 2993 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-02-13T14:58:59.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[28859]: audit 2024-02-13T14:58:58.126128+0000 mon.a (mon.0) 2994 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112"}]: dispatch 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[28859]: cluster 2024-02-13T14:58:58.151383+0000 mgr.y (mgr.14613) 594 : cluster 0 pgmap v957: 300 pgs: 1 creating+activating, 30 creating+peering, 269 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[28859]: audit 2024-02-13T14:58:59.118530+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112"}]': finished 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[28859]: cluster 2024-02-13T14:58:59.127751+0000 mon.a (mon.0) 2996 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[21479]: audit 2024-02-13T14:58:58.115731+0000 mon.a (mon.0) 2992 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[21479]: cluster 2024-02-13T14:58:58.122673+0000 mon.a (mon.0) 2993 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[21479]: audit 2024-02-13T14:58:58.126128+0000 mon.a (mon.0) 2994 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112"}]: dispatch 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[21479]: cluster 2024-02-13T14:58:58.151383+0000 mgr.y (mgr.14613) 594 : cluster 0 pgmap v957: 300 pgs: 1 creating+activating, 30 creating+peering, 269 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[21479]: audit 2024-02-13T14:58:59.118530+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112"}]': finished 2024-02-13T14:58:59.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:58:59 smithi062 bash[21479]: cluster 2024-02-13T14:58:59.127751+0000 mon.a (mon.0) 2996 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-02-13T14:58:59.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:59 smithi111 bash[23388]: audit 2024-02-13T14:58:58.115731+0000 mon.a (mon.0) 2992 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:58:59.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:59 smithi111 bash[23388]: cluster 2024-02-13T14:58:58.122673+0000 mon.a (mon.0) 2993 : cluster 0 osdmap e590: 8 total, 8 up, 8 in 2024-02-13T14:58:59.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:59 smithi111 bash[23388]: audit 2024-02-13T14:58:58.126128+0000 mon.a (mon.0) 2994 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112"}]: dispatch 2024-02-13T14:58:59.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:59 smithi111 bash[23388]: cluster 2024-02-13T14:58:58.151383+0000 mgr.y (mgr.14613) 594 : cluster 0 pgmap v957: 300 pgs: 1 creating+activating, 30 creating+peering, 269 active+clean; 582 KiB data, 633 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:58:59.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:59 smithi111 bash[23388]: audit 2024-02-13T14:58:59.118530+0000 mon.a (mon.0) 2995 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-112"}]': finished 2024-02-13T14:58:59.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:58:59 smithi111 bash[23388]: cluster 2024-02-13T14:58:59.127751+0000 mon.a (mon.0) 2996 : cluster 0 osdmap e591: 8 total, 8 up, 8 in 2024-02-13T14:59:01.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:59:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:59:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:01 smithi062 bash[21479]: cluster 2024-02-13T14:59:00.152900+0000 mgr.y (mgr.14613) 595 : cluster 0 pgmap v959: 300 pgs: 300 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 503 B/s wr, 2 op/s 2024-02-13T14:59:01.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:01 smithi062 bash[21479]: cluster 2024-02-13T14:59:00.167446+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-02-13T14:59:01.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:01 smithi062 bash[28859]: cluster 2024-02-13T14:59:00.152900+0000 mgr.y (mgr.14613) 595 : cluster 0 pgmap v959: 300 pgs: 300 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 503 B/s wr, 2 op/s 2024-02-13T14:59:01.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:01 smithi062 bash[28859]: cluster 2024-02-13T14:59:00.167446+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-02-13T14:59:01.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:01 smithi111 bash[23388]: cluster 2024-02-13T14:59:00.152900+0000 mgr.y (mgr.14613) 595 : cluster 0 pgmap v959: 300 pgs: 300 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 503 B/s wr, 2 op/s 2024-02-13T14:59:01.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:01 smithi111 bash[23388]: cluster 2024-02-13T14:59:00.167446+0000 mon.a (mon.0) 2997 : cluster 0 osdmap e592: 8 total, 8 up, 8 in 2024-02-13T14:59:02.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:02 smithi062 bash[21479]: audit 2024-02-13T14:59:00.697402+0000 mgr.y (mgr.14613) 596 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:02.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:02 smithi062 bash[21479]: cluster 2024-02-13T14:59:01.179175+0000 mon.a (mon.0) 2998 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-02-13T14:59:02.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:02 smithi062 bash[21479]: audit 2024-02-13T14:59:01.183217+0000 mon.a (mon.0) 2999 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:02.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:02 smithi062 bash[28859]: audit 2024-02-13T14:59:00.697402+0000 mgr.y (mgr.14613) 596 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:02.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:02 smithi062 bash[28859]: cluster 2024-02-13T14:59:01.179175+0000 mon.a (mon.0) 2998 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-02-13T14:59:02.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:02 smithi062 bash[28859]: audit 2024-02-13T14:59:01.183217+0000 mon.a (mon.0) 2999 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:02 smithi111 bash[23388]: audit 2024-02-13T14:59:00.697402+0000 mgr.y (mgr.14613) 596 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:02 smithi111 bash[23388]: cluster 2024-02-13T14:59:01.179175+0000 mon.a (mon.0) 2998 : cluster 0 osdmap e593: 8 total, 8 up, 8 in 2024-02-13T14:59:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:02 smithi111 bash[23388]: audit 2024-02-13T14:59:01.183217+0000 mon.a (mon.0) 2999 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-114","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:03.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[21479]: cluster 2024-02-13T14:59:02.153764+0000 mgr.y (mgr.14613) 597 : cluster 0 pgmap v962: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 253 B/s wr, 1 op/s 2024-02-13T14:59:03.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[21479]: audit 2024-02-13T14:59:02.181916+0000 mon.a (mon.0) 3000 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:03.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[21479]: cluster 2024-02-13T14:59:02.193512+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-02-13T14:59:03.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[21479]: audit 2024-02-13T14:59:02.248668+0000 mon.a (mon.0) 3002 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:03.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[21479]: cluster 2024-02-13T14:59:02.689467+0000 mon.a (mon.0) 3003 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:03.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[28859]: cluster 2024-02-13T14:59:02.153764+0000 mgr.y (mgr.14613) 597 : cluster 0 pgmap v962: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 253 B/s wr, 1 op/s 2024-02-13T14:59:03.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[28859]: audit 2024-02-13T14:59:02.181916+0000 mon.a (mon.0) 3000 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:03.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[28859]: cluster 2024-02-13T14:59:02.193512+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-02-13T14:59:03.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[28859]: audit 2024-02-13T14:59:02.248668+0000 mon.a (mon.0) 3002 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:03.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:03 smithi062 bash[28859]: cluster 2024-02-13T14:59:02.689467+0000 mon.a (mon.0) 3003 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:03 smithi111 bash[23388]: cluster 2024-02-13T14:59:02.153764+0000 mgr.y (mgr.14613) 597 : cluster 0 pgmap v962: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 253 B/s wr, 1 op/s 2024-02-13T14:59:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:03 smithi111 bash[23388]: audit 2024-02-13T14:59:02.181916+0000 mon.a (mon.0) 3000 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-114","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:03 smithi111 bash[23388]: cluster 2024-02-13T14:59:02.193512+0000 mon.a (mon.0) 3001 : cluster 0 osdmap e594: 8 total, 8 up, 8 in 2024-02-13T14:59:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:03 smithi111 bash[23388]: audit 2024-02-13T14:59:02.248668+0000 mon.a (mon.0) 3002 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:03 smithi111 bash[23388]: cluster 2024-02-13T14:59:02.689467+0000 mon.a (mon.0) 3003 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:04.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[28859]: audit 2024-02-13T14:59:03.184851+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[28859]: cluster 2024-02-13T14:59:03.193612+0000 mon.a (mon.0) 3005 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[28859]: audit 2024-02-13T14:59:03.198395+0000 mon.a (mon.0) 3006 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-114"}]: dispatch 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[28859]: audit 2024-02-13T14:59:04.071410+0000 mon.b (mon.1) 253 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[28859]: audit 2024-02-13T14:59:04.187459+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-114"}]': finished 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[28859]: cluster 2024-02-13T14:59:04.194713+0000 mon.a (mon.0) 3008 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[28859]: audit 2024-02-13T14:59:04.197913+0000 mon.a (mon.0) 3009 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-114", "mode": "writeback"}]: dispatch 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[21479]: audit 2024-02-13T14:59:03.184851+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[21479]: cluster 2024-02-13T14:59:03.193612+0000 mon.a (mon.0) 3005 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[21479]: audit 2024-02-13T14:59:03.198395+0000 mon.a (mon.0) 3006 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-114"}]: dispatch 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[21479]: audit 2024-02-13T14:59:04.071410+0000 mon.b (mon.1) 253 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:04.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[21479]: audit 2024-02-13T14:59:04.187459+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-114"}]': finished 2024-02-13T14:59:04.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[21479]: cluster 2024-02-13T14:59:04.194713+0000 mon.a (mon.0) 3008 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-02-13T14:59:04.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:04 smithi062 bash[21479]: audit 2024-02-13T14:59:04.197913+0000 mon.a (mon.0) 3009 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-114", "mode": "writeback"}]: dispatch 2024-02-13T14:59:04.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:04 smithi111 bash[23388]: audit 2024-02-13T14:59:03.184851+0000 mon.a (mon.0) 3004 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:04.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:04 smithi111 bash[23388]: cluster 2024-02-13T14:59:03.193612+0000 mon.a (mon.0) 3005 : cluster 0 osdmap e595: 8 total, 8 up, 8 in 2024-02-13T14:59:04.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:04 smithi111 bash[23388]: audit 2024-02-13T14:59:03.198395+0000 mon.a (mon.0) 3006 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-114"}]: dispatch 2024-02-13T14:59:04.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:04 smithi111 bash[23388]: audit 2024-02-13T14:59:04.071410+0000 mon.b (mon.1) 253 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:04.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:04 smithi111 bash[23388]: audit 2024-02-13T14:59:04.187459+0000 mon.a (mon.0) 3007 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-114"}]': finished 2024-02-13T14:59:04.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:04 smithi111 bash[23388]: cluster 2024-02-13T14:59:04.194713+0000 mon.a (mon.0) 3008 : cluster 0 osdmap e596: 8 total, 8 up, 8 in 2024-02-13T14:59:04.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:04 smithi111 bash[23388]: audit 2024-02-13T14:59:04.197913+0000 mon.a (mon.0) 3009 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-114", "mode": "writeback"}]: dispatch 2024-02-13T14:59:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:05 smithi062 bash[21479]: cluster 2024-02-13T14:59:04.154680+0000 mgr.y (mgr.14613) 598 : cluster 0 pgmap v965: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:05.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:05 smithi062 bash[21479]: cluster 2024-02-13T14:59:05.187916+0000 mon.a (mon.0) 3010 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:05.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:05 smithi062 bash[21479]: audit 2024-02-13T14:59:05.190313+0000 mon.a (mon.0) 3011 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-114", "mode": "writeback"}]': finished 2024-02-13T14:59:05.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:05 smithi062 bash[21479]: cluster 2024-02-13T14:59:05.198690+0000 mon.a (mon.0) 3012 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-02-13T14:59:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:05 smithi062 bash[28859]: cluster 2024-02-13T14:59:04.154680+0000 mgr.y (mgr.14613) 598 : cluster 0 pgmap v965: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:05 smithi062 bash[28859]: cluster 2024-02-13T14:59:05.187916+0000 mon.a (mon.0) 3010 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:05 smithi062 bash[28859]: audit 2024-02-13T14:59:05.190313+0000 mon.a (mon.0) 3011 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-114", "mode": "writeback"}]': finished 2024-02-13T14:59:05.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:05 smithi062 bash[28859]: cluster 2024-02-13T14:59:05.198690+0000 mon.a (mon.0) 3012 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-02-13T14:59:05.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:05 smithi111 bash[23388]: cluster 2024-02-13T14:59:04.154680+0000 mgr.y (mgr.14613) 598 : cluster 0 pgmap v965: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 638 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:05.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:05 smithi111 bash[23388]: cluster 2024-02-13T14:59:05.187916+0000 mon.a (mon.0) 3010 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:05.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:05 smithi111 bash[23388]: audit 2024-02-13T14:59:05.190313+0000 mon.a (mon.0) 3011 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-114", "mode": "writeback"}]': finished 2024-02-13T14:59:05.596 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:05 smithi111 bash[23388]: cluster 2024-02-13T14:59:05.198690+0000 mon.a (mon.0) 3012 : cluster 0 osdmap e597: 8 total, 8 up, 8 in 2024-02-13T14:59:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:59:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:59:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:59:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:06 smithi062 bash[28859]: audit 2024-02-13T14:59:05.315550+0000 mon.a (mon.0) 3013 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:06 smithi062 bash[21479]: audit 2024-02-13T14:59:05.315550+0000 mon.a (mon.0) 3013 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:06.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:06 smithi111 bash[23388]: audit 2024-02-13T14:59:05.315550+0000 mon.a (mon.0) 3013 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:07.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:07 smithi062 bash[28859]: cluster 2024-02-13T14:59:06.155564+0000 mgr.y (mgr.14613) 599 : cluster 0 pgmap v968: 300 pgs: 300 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:07.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:07 smithi062 bash[28859]: audit 2024-02-13T14:59:06.224452+0000 mon.a (mon.0) 3014 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:07.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:07 smithi062 bash[28859]: cluster 2024-02-13T14:59:06.232877+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-02-13T14:59:07.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:07 smithi062 bash[28859]: audit 2024-02-13T14:59:06.235300+0000 mon.a (mon.0) 3016 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114"}]: dispatch 2024-02-13T14:59:07.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:07 smithi062 bash[21479]: cluster 2024-02-13T14:59:06.155564+0000 mgr.y (mgr.14613) 599 : cluster 0 pgmap v968: 300 pgs: 300 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:07.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:07 smithi062 bash[21479]: audit 2024-02-13T14:59:06.224452+0000 mon.a (mon.0) 3014 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:07.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:07 smithi062 bash[21479]: cluster 2024-02-13T14:59:06.232877+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-02-13T14:59:07.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:07 smithi062 bash[21479]: audit 2024-02-13T14:59:06.235300+0000 mon.a (mon.0) 3016 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114"}]: dispatch 2024-02-13T14:59:07.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:07 smithi111 bash[23388]: cluster 2024-02-13T14:59:06.155564+0000 mgr.y (mgr.14613) 599 : cluster 0 pgmap v968: 300 pgs: 300 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:07.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:07 smithi111 bash[23388]: audit 2024-02-13T14:59:06.224452+0000 mon.a (mon.0) 3014 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:07.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:07 smithi111 bash[23388]: cluster 2024-02-13T14:59:06.232877+0000 mon.a (mon.0) 3015 : cluster 0 osdmap e598: 8 total, 8 up, 8 in 2024-02-13T14:59:07.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:07 smithi111 bash[23388]: audit 2024-02-13T14:59:06.235300+0000 mon.a (mon.0) 3016 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114"}]: dispatch 2024-02-13T14:59:08.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:08 smithi062 bash[21479]: cluster 2024-02-13T14:59:07.224706+0000 mon.a (mon.0) 3017 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:08.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:08 smithi062 bash[21479]: audit 2024-02-13T14:59:07.227131+0000 mon.a (mon.0) 3018 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114"}]': finished 2024-02-13T14:59:08.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:08 smithi062 bash[21479]: cluster 2024-02-13T14:59:07.234490+0000 mon.a (mon.0) 3019 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-02-13T14:59:08.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:08 smithi062 bash[21479]: cluster 2024-02-13T14:59:07.690739+0000 mon.a (mon.0) 3020 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:08.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:08 smithi062 bash[28859]: cluster 2024-02-13T14:59:07.224706+0000 mon.a (mon.0) 3017 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:08.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:08 smithi062 bash[28859]: audit 2024-02-13T14:59:07.227131+0000 mon.a (mon.0) 3018 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114"}]': finished 2024-02-13T14:59:08.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:08 smithi062 bash[28859]: cluster 2024-02-13T14:59:07.234490+0000 mon.a (mon.0) 3019 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-02-13T14:59:08.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:08 smithi062 bash[28859]: cluster 2024-02-13T14:59:07.690739+0000 mon.a (mon.0) 3020 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:08 smithi111 bash[23388]: cluster 2024-02-13T14:59:07.224706+0000 mon.a (mon.0) 3017 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:08 smithi111 bash[23388]: audit 2024-02-13T14:59:07.227131+0000 mon.a (mon.0) 3018 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-114"}]': finished 2024-02-13T14:59:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:08 smithi111 bash[23388]: cluster 2024-02-13T14:59:07.234490+0000 mon.a (mon.0) 3019 : cluster 0 osdmap e599: 8 total, 8 up, 8 in 2024-02-13T14:59:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:08 smithi111 bash[23388]: cluster 2024-02-13T14:59:07.690739+0000 mon.a (mon.0) 3020 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:09 smithi062 bash[21479]: cluster 2024-02-13T14:59:08.156508+0000 mgr.y (mgr.14613) 600 : cluster 0 pgmap v971: 300 pgs: 300 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:09 smithi062 bash[21479]: cluster 2024-02-13T14:59:08.259789+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-02-13T14:59:09.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:09 smithi062 bash[28859]: cluster 2024-02-13T14:59:08.156508+0000 mgr.y (mgr.14613) 600 : cluster 0 pgmap v971: 300 pgs: 300 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:09.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:09 smithi062 bash[28859]: cluster 2024-02-13T14:59:08.259789+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-02-13T14:59:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:09 smithi111 bash[23388]: cluster 2024-02-13T14:59:08.156508+0000 mgr.y (mgr.14613) 600 : cluster 0 pgmap v971: 300 pgs: 300 active+clean; 582 KiB data, 643 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:09 smithi111 bash[23388]: cluster 2024-02-13T14:59:08.259789+0000 mon.a (mon.0) 3021 : cluster 0 osdmap e600: 8 total, 8 up, 8 in 2024-02-13T14:59:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:10 smithi111 bash[23388]: cluster 2024-02-13T14:59:09.267781+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-02-13T14:59:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:10 smithi111 bash[23388]: audit 2024-02-13T14:59:09.270309+0000 mon.a (mon.0) 3023 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:10 smithi111 bash[23388]: audit 2024-02-13T14:59:10.259372+0000 mon.a (mon.0) 3024 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:10 smithi111 bash[23388]: cluster 2024-02-13T14:59:10.268567+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-02-13T14:59:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:10 smithi062 bash[21479]: cluster 2024-02-13T14:59:09.267781+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-02-13T14:59:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:10 smithi062 bash[21479]: audit 2024-02-13T14:59:09.270309+0000 mon.a (mon.0) 3023 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:10 smithi062 bash[21479]: audit 2024-02-13T14:59:10.259372+0000 mon.a (mon.0) 3024 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:10 smithi062 bash[21479]: cluster 2024-02-13T14:59:10.268567+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-02-13T14:59:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:10 smithi062 bash[28859]: cluster 2024-02-13T14:59:09.267781+0000 mon.a (mon.0) 3022 : cluster 0 osdmap e601: 8 total, 8 up, 8 in 2024-02-13T14:59:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:10 smithi062 bash[28859]: audit 2024-02-13T14:59:09.270309+0000 mon.a (mon.0) 3023 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-116","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:10 smithi062 bash[28859]: audit 2024-02-13T14:59:10.259372+0000 mon.a (mon.0) 3024 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-116","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:10 smithi062 bash[28859]: cluster 2024-02-13T14:59:10.268567+0000 mon.a (mon.0) 3025 : cluster 0 osdmap e602: 8 total, 8 up, 8 in 2024-02-13T14:59:11.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:59:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:59:11.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:11 smithi111 bash[23388]: cluster 2024-02-13T14:59:10.159249+0000 mgr.y (mgr.14613) 601 : cluster 0 pgmap v974: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:11.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:11 smithi111 bash[23388]: cluster 2024-02-13T14:59:11.274118+0000 mon.a (mon.0) 3026 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-02-13T14:59:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:11 smithi062 bash[21479]: cluster 2024-02-13T14:59:10.159249+0000 mgr.y (mgr.14613) 601 : cluster 0 pgmap v974: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:11 smithi062 bash[21479]: cluster 2024-02-13T14:59:11.274118+0000 mon.a (mon.0) 3026 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-02-13T14:59:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:11 smithi062 bash[28859]: cluster 2024-02-13T14:59:10.159249+0000 mgr.y (mgr.14613) 601 : cluster 0 pgmap v974: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:11 smithi062 bash[28859]: cluster 2024-02-13T14:59:11.274118+0000 mon.a (mon.0) 3026 : cluster 0 osdmap e603: 8 total, 8 up, 8 in 2024-02-13T14:59:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:12 smithi111 bash[23388]: audit 2024-02-13T14:59:10.708733+0000 mgr.y (mgr.14613) 602 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:12 smithi111 bash[23388]: audit 2024-02-13T14:59:11.323160+0000 mon.a (mon.0) 3027 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:12 smithi062 bash[21479]: audit 2024-02-13T14:59:10.708733+0000 mgr.y (mgr.14613) 602 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:12 smithi062 bash[21479]: audit 2024-02-13T14:59:11.323160+0000 mon.a (mon.0) 3027 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:12 smithi062 bash[28859]: audit 2024-02-13T14:59:10.708733+0000 mgr.y (mgr.14613) 602 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:12 smithi062 bash[28859]: audit 2024-02-13T14:59:11.323160+0000 mon.a (mon.0) 3027 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:13.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:13 smithi062 bash[21479]: cluster 2024-02-13T14:59:12.160163+0000 mgr.y (mgr.14613) 603 : cluster 0 pgmap v977: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:13.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:13 smithi062 bash[21479]: audit 2024-02-13T14:59:12.327903+0000 mon.a (mon.0) 3028 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:13.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:13 smithi062 bash[21479]: cluster 2024-02-13T14:59:12.335274+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-02-13T14:59:13.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:13 smithi062 bash[21479]: audit 2024-02-13T14:59:12.337514+0000 mon.a (mon.0) 3030 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-116"}]: dispatch 2024-02-13T14:59:13.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:13 smithi062 bash[28859]: cluster 2024-02-13T14:59:12.160163+0000 mgr.y (mgr.14613) 603 : cluster 0 pgmap v977: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:13.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:13 smithi062 bash[28859]: audit 2024-02-13T14:59:12.327903+0000 mon.a (mon.0) 3028 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:13.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:13 smithi062 bash[28859]: cluster 2024-02-13T14:59:12.335274+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-02-13T14:59:13.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:13 smithi062 bash[28859]: audit 2024-02-13T14:59:12.337514+0000 mon.a (mon.0) 3030 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-116"}]: dispatch 2024-02-13T14:59:13.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:13 smithi111 bash[23388]: cluster 2024-02-13T14:59:12.160163+0000 mgr.y (mgr.14613) 603 : cluster 0 pgmap v977: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:13.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:13 smithi111 bash[23388]: audit 2024-02-13T14:59:12.327903+0000 mon.a (mon.0) 3028 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:13.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:13 smithi111 bash[23388]: cluster 2024-02-13T14:59:12.335274+0000 mon.a (mon.0) 3029 : cluster 0 osdmap e604: 8 total, 8 up, 8 in 2024-02-13T14:59:13.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:13 smithi111 bash[23388]: audit 2024-02-13T14:59:12.337514+0000 mon.a (mon.0) 3030 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-116"}]: dispatch 2024-02-13T14:59:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[21479]: audit 2024-02-13T14:59:13.330425+0000 mon.a (mon.0) 3031 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-116"}]': finished 2024-02-13T14:59:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[21479]: cluster 2024-02-13T14:59:13.337656+0000 mon.a (mon.0) 3032 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-02-13T14:59:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[21479]: audit 2024-02-13T14:59:13.342570+0000 mon.a (mon.0) 3033 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-116", "mode": "writeback"}]: dispatch 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[21479]: cluster 2024-02-13T14:59:14.330767+0000 mon.a (mon.0) 3034 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[21479]: audit 2024-02-13T14:59:14.332939+0000 mon.a (mon.0) 3035 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-116", "mode": "writeback"}]': finished 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[21479]: cluster 2024-02-13T14:59:14.340384+0000 mon.a (mon.0) 3036 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[28859]: audit 2024-02-13T14:59:13.330425+0000 mon.a (mon.0) 3031 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-116"}]': finished 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[28859]: cluster 2024-02-13T14:59:13.337656+0000 mon.a (mon.0) 3032 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[28859]: audit 2024-02-13T14:59:13.342570+0000 mon.a (mon.0) 3033 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-116", "mode": "writeback"}]: dispatch 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[28859]: cluster 2024-02-13T14:59:14.330767+0000 mon.a (mon.0) 3034 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[28859]: audit 2024-02-13T14:59:14.332939+0000 mon.a (mon.0) 3035 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-116", "mode": "writeback"}]': finished 2024-02-13T14:59:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:14 smithi062 bash[28859]: cluster 2024-02-13T14:59:14.340384+0000 mon.a (mon.0) 3036 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-02-13T14:59:14.892 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:14 smithi111 bash[23388]: audit 2024-02-13T14:59:13.330425+0000 mon.a (mon.0) 3031 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-116"}]': finished 2024-02-13T14:59:14.892 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:14 smithi111 bash[23388]: cluster 2024-02-13T14:59:13.337656+0000 mon.a (mon.0) 3032 : cluster 0 osdmap e605: 8 total, 8 up, 8 in 2024-02-13T14:59:14.892 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:14 smithi111 bash[23388]: audit 2024-02-13T14:59:13.342570+0000 mon.a (mon.0) 3033 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-116", "mode": "writeback"}]: dispatch 2024-02-13T14:59:14.892 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:14 smithi111 bash[23388]: cluster 2024-02-13T14:59:14.330767+0000 mon.a (mon.0) 3034 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:14.892 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:14 smithi111 bash[23388]: audit 2024-02-13T14:59:14.332939+0000 mon.a (mon.0) 3035 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-116", "mode": "writeback"}]': finished 2024-02-13T14:59:14.893 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:14 smithi111 bash[23388]: cluster 2024-02-13T14:59:14.340384+0000 mon.a (mon.0) 3036 : cluster 0 osdmap e606: 8 total, 8 up, 8 in 2024-02-13T14:59:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:15 smithi062 bash[28859]: cluster 2024-02-13T14:59:14.161110+0000 mgr.y (mgr.14613) 604 : cluster 0 pgmap v980: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:15 smithi062 bash[28859]: audit 2024-02-13T14:59:14.383279+0000 mon.a (mon.0) 3037 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "306.2"}]: dispatch 2024-02-13T14:59:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:15 smithi062 bash[28859]: audit 2024-02-13T14:59:14.383661+0000 mgr.y (mgr.14613) 605 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "306.2"}]: dispatch 2024-02-13T14:59:15.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:15 smithi062 bash[21479]: cluster 2024-02-13T14:59:14.161110+0000 mgr.y (mgr.14613) 604 : cluster 0 pgmap v980: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:15.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:15 smithi062 bash[21479]: audit 2024-02-13T14:59:14.383279+0000 mon.a (mon.0) 3037 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "306.2"}]: dispatch 2024-02-13T14:59:15.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:15 smithi062 bash[21479]: audit 2024-02-13T14:59:14.383661+0000 mgr.y (mgr.14613) 605 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "306.2"}]: dispatch 2024-02-13T14:59:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:15 smithi111 bash[23388]: cluster 2024-02-13T14:59:14.161110+0000 mgr.y (mgr.14613) 604 : cluster 0 pgmap v980: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:15 smithi111 bash[23388]: audit 2024-02-13T14:59:14.383279+0000 mon.a (mon.0) 3037 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "pg scrub", "pgid": "306.2"}]: dispatch 2024-02-13T14:59:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:15 smithi111 bash[23388]: audit 2024-02-13T14:59:14.383661+0000 mgr.y (mgr.14613) 605 : audit 0 from='mon.0 v1:172.21.15.62:0/353774749' entity='mon.' cmd=[{"prefix": "pg scrub", "pgid": "306.2"}]: dispatch 2024-02-13T14:59:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:59:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:59:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:59:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:16 smithi062 bash[28859]: cluster 2024-02-13T14:59:15.348748+0000 osd.0 (osd.0) 21 : cluster 0 306.2 scrub starts 2024-02-13T14:59:16.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:16 smithi062 bash[28859]: cluster 2024-02-13T14:59:15.351312+0000 osd.0 (osd.0) 22 : cluster 0 306.2 scrub ok 2024-02-13T14:59:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:16 smithi062 bash[21479]: cluster 2024-02-13T14:59:15.348748+0000 osd.0 (osd.0) 21 : cluster 0 306.2 scrub starts 2024-02-13T14:59:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:16 smithi062 bash[21479]: cluster 2024-02-13T14:59:15.351312+0000 osd.0 (osd.0) 22 : cluster 0 306.2 scrub ok 2024-02-13T14:59:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:16 smithi111 bash[23388]: cluster 2024-02-13T14:59:15.348748+0000 osd.0 (osd.0) 21 : cluster 0 306.2 scrub starts 2024-02-13T14:59:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:16 smithi111 bash[23388]: cluster 2024-02-13T14:59:15.351312+0000 osd.0 (osd.0) 22 : cluster 0 306.2 scrub ok 2024-02-13T14:59:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:17 smithi062 bash[28859]: cluster 2024-02-13T14:59:16.164099+0000 mgr.y (mgr.14613) 606 : cluster 0 pgmap v982: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-13T14:59:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:17 smithi062 bash[21479]: cluster 2024-02-13T14:59:16.164099+0000 mgr.y (mgr.14613) 606 : cluster 0 pgmap v982: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-13T14:59:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:17 smithi111 bash[23388]: cluster 2024-02-13T14:59:16.164099+0000 mgr.y (mgr.14613) 606 : cluster 0 pgmap v982: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.4 KiB/s wr, 3 op/s 2024-02-13T14:59:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:19 smithi062 bash[21479]: cluster 2024-02-13T14:59:18.165185+0000 mgr.y (mgr.14613) 607 : cluster 0 pgmap v983: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:59:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:19 smithi062 bash[21479]: audit 2024-02-13T14:59:19.113326+0000 mon.a (mon.0) 3038 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:19 smithi062 bash[21479]: audit 2024-02-13T14:59:19.117751+0000 mon.b (mon.1) 254 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:19 smithi062 bash[28859]: cluster 2024-02-13T14:59:18.165185+0000 mgr.y (mgr.14613) 607 : cluster 0 pgmap v983: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:59:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:19 smithi062 bash[28859]: audit 2024-02-13T14:59:19.113326+0000 mon.a (mon.0) 3038 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:19 smithi062 bash[28859]: audit 2024-02-13T14:59:19.117751+0000 mon.b (mon.1) 254 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:19 smithi111 bash[23388]: cluster 2024-02-13T14:59:18.165185+0000 mgr.y (mgr.14613) 607 : cluster 0 pgmap v983: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T14:59:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:19 smithi111 bash[23388]: audit 2024-02-13T14:59:19.113326+0000 mon.a (mon.0) 3038 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:19 smithi111 bash[23388]: audit 2024-02-13T14:59:19.117751+0000 mon.b (mon.1) 254 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:21.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:59:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:59:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:21 smithi062 bash[21479]: cluster 2024-02-13T14:59:20.168034+0000 mgr.y (mgr.14613) 608 : cluster 0 pgmap v984: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 914 B/s wr, 2 op/s 2024-02-13T14:59:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:21 smithi062 bash[28859]: cluster 2024-02-13T14:59:20.168034+0000 mgr.y (mgr.14613) 608 : cluster 0 pgmap v984: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 914 B/s wr, 2 op/s 2024-02-13T14:59:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:21 smithi111 bash[23388]: cluster 2024-02-13T14:59:20.168034+0000 mgr.y (mgr.14613) 608 : cluster 0 pgmap v984: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 914 B/s wr, 2 op/s 2024-02-13T14:59:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:22 smithi062 bash[21479]: audit 2024-02-13T14:59:20.720138+0000 mgr.y (mgr.14613) 609 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:22 smithi062 bash[28859]: audit 2024-02-13T14:59:20.720138+0000 mgr.y (mgr.14613) 609 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:22 smithi111 bash[23388]: audit 2024-02-13T14:59:20.720138+0000 mgr.y (mgr.14613) 609 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:23 smithi062 bash[28859]: cluster 2024-02-13T14:59:22.169093+0000 mgr.y (mgr.14613) 610 : cluster 0 pgmap v985: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 811 B/s wr, 2 op/s 2024-02-13T14:59:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:23 smithi062 bash[21479]: cluster 2024-02-13T14:59:22.169093+0000 mgr.y (mgr.14613) 610 : cluster 0 pgmap v985: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 811 B/s wr, 2 op/s 2024-02-13T14:59:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:23 smithi111 bash[23388]: cluster 2024-02-13T14:59:22.169093+0000 mgr.y (mgr.14613) 610 : cluster 0 pgmap v985: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 811 B/s wr, 2 op/s 2024-02-13T14:59:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:25 smithi062 bash[28859]: cluster 2024-02-13T14:59:24.170178+0000 mgr.y (mgr.14613) 611 : cluster 0 pgmap v986: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2024-02-13T14:59:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:25 smithi062 bash[21479]: cluster 2024-02-13T14:59:24.170178+0000 mgr.y (mgr.14613) 611 : cluster 0 pgmap v986: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2024-02-13T14:59:25.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:25 smithi111 bash[23388]: cluster 2024-02-13T14:59:24.170178+0000 mgr.y (mgr.14613) 611 : cluster 0 pgmap v986: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 716 B/s wr, 2 op/s 2024-02-13T14:59:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:59:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:59:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:59:27.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:27 smithi062 bash[21479]: cluster 2024-02-13T14:59:26.173037+0000 mgr.y (mgr.14613) 612 : cluster 0 pgmap v987: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 605 B/s wr, 2 op/s 2024-02-13T14:59:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:27 smithi062 bash[28859]: cluster 2024-02-13T14:59:26.173037+0000 mgr.y (mgr.14613) 612 : cluster 0 pgmap v987: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 605 B/s wr, 2 op/s 2024-02-13T14:59:27.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:27 smithi111 bash[23388]: cluster 2024-02-13T14:59:26.173037+0000 mgr.y (mgr.14613) 612 : cluster 0 pgmap v987: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 605 B/s wr, 2 op/s 2024-02-13T14:59:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:29 smithi062 bash[21479]: cluster 2024-02-13T14:59:28.173956+0000 mgr.y (mgr.14613) 613 : cluster 0 pgmap v988: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:59:29.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:29 smithi062 bash[28859]: cluster 2024-02-13T14:59:28.173956+0000 mgr.y (mgr.14613) 613 : cluster 0 pgmap v988: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:59:29.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:29 smithi111 bash[23388]: cluster 2024-02-13T14:59:28.173956+0000 mgr.y (mgr.14613) 613 : cluster 0 pgmap v988: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T14:59:30.726 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:30 smithi111 bash[23388]: audit 2024-02-13T14:59:30.363808+0000 mon.a (mon.0) 3039 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]: dispatch 2024-02-13T14:59:30.726 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:30 smithi111 bash[23388]: audit 2024-02-13T14:59:30.364214+0000 mon.b (mon.1) 255 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]: dispatch 2024-02-13T14:59:30.726 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:30 smithi111 bash[23388]: audit 2024-02-13T14:59:30.364726+0000 mon.b (mon.1) 256 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]: dispatch 2024-02-13T14:59:30.726 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:30 smithi111 bash[23388]: audit 2024-02-13T14:59:30.364772+0000 mon.a (mon.0) 3040 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]: dispatch 2024-02-13T14:59:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:30 smithi062 bash[21479]: audit 2024-02-13T14:59:30.363808+0000 mon.a (mon.0) 3039 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]: dispatch 2024-02-13T14:59:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:30 smithi062 bash[21479]: audit 2024-02-13T14:59:30.364214+0000 mon.b (mon.1) 255 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]: dispatch 2024-02-13T14:59:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:30 smithi062 bash[21479]: audit 2024-02-13T14:59:30.364726+0000 mon.b (mon.1) 256 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]: dispatch 2024-02-13T14:59:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:30 smithi062 bash[21479]: audit 2024-02-13T14:59:30.364772+0000 mon.a (mon.0) 3040 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]: dispatch 2024-02-13T14:59:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:30 smithi062 bash[28859]: audit 2024-02-13T14:59:30.363808+0000 mon.a (mon.0) 3039 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]: dispatch 2024-02-13T14:59:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:30 smithi062 bash[28859]: audit 2024-02-13T14:59:30.364214+0000 mon.b (mon.1) 255 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]: dispatch 2024-02-13T14:59:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:30 smithi062 bash[28859]: audit 2024-02-13T14:59:30.364726+0000 mon.b (mon.1) 256 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]: dispatch 2024-02-13T14:59:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:30 smithi062 bash[28859]: audit 2024-02-13T14:59:30.364772+0000 mon.a (mon.0) 3040 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]: dispatch 2024-02-13T14:59:31.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:59:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:59:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:31 smithi062 bash[28859]: cluster 2024-02-13T14:59:30.176780+0000 mgr.y (mgr.14613) 614 : cluster 0 pgmap v989: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T14:59:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:31 smithi062 bash[28859]: audit 2024-02-13T14:59:30.417144+0000 mon.a (mon.0) 3041 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]': finished 2024-02-13T14:59:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:31 smithi062 bash[28859]: audit 2024-02-13T14:59:30.417408+0000 mon.a (mon.0) 3042 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]': finished 2024-02-13T14:59:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:31 smithi062 bash[28859]: cluster 2024-02-13T14:59:30.427968+0000 mon.a (mon.0) 3043 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-02-13T14:59:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:31 smithi062 bash[21479]: cluster 2024-02-13T14:59:30.176780+0000 mgr.y (mgr.14613) 614 : cluster 0 pgmap v989: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T14:59:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:31 smithi062 bash[21479]: audit 2024-02-13T14:59:30.417144+0000 mon.a (mon.0) 3041 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]': finished 2024-02-13T14:59:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:31 smithi062 bash[21479]: audit 2024-02-13T14:59:30.417408+0000 mon.a (mon.0) 3042 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]': finished 2024-02-13T14:59:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:31 smithi062 bash[21479]: cluster 2024-02-13T14:59:30.427968+0000 mon.a (mon.0) 3043 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-02-13T14:59:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:31 smithi111 bash[23388]: cluster 2024-02-13T14:59:30.176780+0000 mgr.y (mgr.14613) 614 : cluster 0 pgmap v989: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T14:59:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:31 smithi111 bash[23388]: audit 2024-02-13T14:59:30.417144+0000 mon.a (mon.0) 3041 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1", "id": [7, 5]}]': finished 2024-02-13T14:59:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:31 smithi111 bash[23388]: audit 2024-02-13T14:59:30.417408+0000 mon.a (mon.0) 3042 : audit 1 from='mgr.14613 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "306.1d", "id": [1, 2]}]': finished 2024-02-13T14:59:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:31 smithi111 bash[23388]: cluster 2024-02-13T14:59:30.427968+0000 mon.a (mon.0) 3043 : cluster 0 osdmap e607: 8 total, 8 up, 8 in 2024-02-13T14:59:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:32 smithi062 bash[28859]: audit 2024-02-13T14:59:30.725279+0000 mgr.y (mgr.14613) 615 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:32 smithi062 bash[28859]: cluster 2024-02-13T14:59:31.427436+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-02-13T14:59:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:32 smithi062 bash[28859]: audit 2024-02-13T14:59:31.499641+0000 mon.a (mon.0) 3045 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:32 smithi062 bash[21479]: audit 2024-02-13T14:59:30.725279+0000 mgr.y (mgr.14613) 615 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:32 smithi062 bash[21479]: cluster 2024-02-13T14:59:31.427436+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-02-13T14:59:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:32 smithi062 bash[21479]: audit 2024-02-13T14:59:31.499641+0000 mon.a (mon.0) 3045 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:32 smithi111 bash[23388]: audit 2024-02-13T14:59:30.725279+0000 mgr.y (mgr.14613) 615 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:32 smithi111 bash[23388]: cluster 2024-02-13T14:59:31.427436+0000 mon.a (mon.0) 3044 : cluster 0 osdmap e608: 8 total, 8 up, 8 in 2024-02-13T14:59:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:32 smithi111 bash[23388]: audit 2024-02-13T14:59:31.499641+0000 mon.a (mon.0) 3045 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:33 smithi062 bash[28859]: cluster 2024-02-13T14:59:32.177786+0000 mgr.y (mgr.14613) 616 : cluster 0 pgmap v992: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-02-13T14:59:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:33 smithi062 bash[28859]: audit 2024-02-13T14:59:32.443945+0000 mon.a (mon.0) 3046 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:33 smithi062 bash[28859]: cluster 2024-02-13T14:59:32.452957+0000 mon.a (mon.0) 3047 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-02-13T14:59:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:33 smithi062 bash[28859]: audit 2024-02-13T14:59:32.455052+0000 mon.a (mon.0) 3048 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116"}]: dispatch 2024-02-13T14:59:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:33 smithi062 bash[21479]: cluster 2024-02-13T14:59:32.177786+0000 mgr.y (mgr.14613) 616 : cluster 0 pgmap v992: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-02-13T14:59:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:33 smithi062 bash[21479]: audit 2024-02-13T14:59:32.443945+0000 mon.a (mon.0) 3046 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:33 smithi062 bash[21479]: cluster 2024-02-13T14:59:32.452957+0000 mon.a (mon.0) 3047 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-02-13T14:59:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:33 smithi062 bash[21479]: audit 2024-02-13T14:59:32.455052+0000 mon.a (mon.0) 3048 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116"}]: dispatch 2024-02-13T14:59:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:33 smithi111 bash[23388]: cluster 2024-02-13T14:59:32.177786+0000 mgr.y (mgr.14613) 616 : cluster 0 pgmap v992: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.9 KiB/s rd, 2 op/s 2024-02-13T14:59:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:33 smithi111 bash[23388]: audit 2024-02-13T14:59:32.443945+0000 mon.a (mon.0) 3046 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:33 smithi111 bash[23388]: cluster 2024-02-13T14:59:32.452957+0000 mon.a (mon.0) 3047 : cluster 0 osdmap e609: 8 total, 8 up, 8 in 2024-02-13T14:59:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:33 smithi111 bash[23388]: audit 2024-02-13T14:59:32.455052+0000 mon.a (mon.0) 3048 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116"}]: dispatch 2024-02-13T14:59:35.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[28859]: cluster 2024-02-13T14:59:33.444456+0000 mon.a (mon.0) 3049 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[28859]: audit 2024-02-13T14:59:33.447029+0000 mon.a (mon.0) 3050 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116"}]': finished 2024-02-13T14:59:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[28859]: cluster 2024-02-13T14:59:33.454915+0000 mon.a (mon.0) 3051 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-02-13T14:59:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[28859]: audit 2024-02-13T14:59:34.158848+0000 mon.a (mon.0) 3052 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[28859]: audit 2024-02-13T14:59:34.163409+0000 mon.b (mon.1) 257 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:35.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[28859]: cluster 2024-02-13T14:59:34.178712+0000 mgr.y (mgr.14613) 617 : cluster 0 pgmap v995: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:35.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[21479]: cluster 2024-02-13T14:59:33.444456+0000 mon.a (mon.0) 3049 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:35.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[21479]: audit 2024-02-13T14:59:33.447029+0000 mon.a (mon.0) 3050 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116"}]': finished 2024-02-13T14:59:35.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[21479]: cluster 2024-02-13T14:59:33.454915+0000 mon.a (mon.0) 3051 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-02-13T14:59:35.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[21479]: audit 2024-02-13T14:59:34.158848+0000 mon.a (mon.0) 3052 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:35.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[21479]: audit 2024-02-13T14:59:34.163409+0000 mon.b (mon.1) 257 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:35.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:34 smithi062 bash[21479]: cluster 2024-02-13T14:59:34.178712+0000 mgr.y (mgr.14613) 617 : cluster 0 pgmap v995: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:34 smithi111 bash[23388]: cluster 2024-02-13T14:59:33.444456+0000 mon.a (mon.0) 3049 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:34 smithi111 bash[23388]: audit 2024-02-13T14:59:33.447029+0000 mon.a (mon.0) 3050 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-116"}]': finished 2024-02-13T14:59:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:34 smithi111 bash[23388]: cluster 2024-02-13T14:59:33.454915+0000 mon.a (mon.0) 3051 : cluster 0 osdmap e610: 8 total, 8 up, 8 in 2024-02-13T14:59:35.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:34 smithi111 bash[23388]: audit 2024-02-13T14:59:34.158848+0000 mon.a (mon.0) 3052 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:34 smithi111 bash[23388]: audit 2024-02-13T14:59:34.163409+0000 mon.b (mon.1) 257 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:35.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:34 smithi111 bash[23388]: cluster 2024-02-13T14:59:34.178712+0000 mgr.y (mgr.14613) 617 : cluster 0 pgmap v995: 300 pgs: 300 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:35 smithi062 bash[21479]: cluster 2024-02-13T14:59:34.470564+0000 mon.a (mon.0) 3053 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-02-13T14:59:36.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:35 smithi062 bash[21479]: cluster 2024-02-13T14:59:35.154122+0000 mon.a (mon.0) 3054 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:36.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:35 smithi062 bash[21479]: cluster 2024-02-13T14:59:35.476378+0000 mon.a (mon.0) 3055 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-02-13T14:59:36.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:35 smithi062 bash[21479]: audit 2024-02-13T14:59:35.480138+0000 mon.a (mon.0) 3056 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:35 smithi062 bash[28859]: cluster 2024-02-13T14:59:34.470564+0000 mon.a (mon.0) 3053 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-02-13T14:59:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:35 smithi062 bash[28859]: cluster 2024-02-13T14:59:35.154122+0000 mon.a (mon.0) 3054 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:35 smithi062 bash[28859]: cluster 2024-02-13T14:59:35.476378+0000 mon.a (mon.0) 3055 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-02-13T14:59:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:35 smithi062 bash[28859]: audit 2024-02-13T14:59:35.480138+0000 mon.a (mon.0) 3056 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:35 smithi111 bash[23388]: cluster 2024-02-13T14:59:34.470564+0000 mon.a (mon.0) 3053 : cluster 0 osdmap e611: 8 total, 8 up, 8 in 2024-02-13T14:59:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:35 smithi111 bash[23388]: cluster 2024-02-13T14:59:35.154122+0000 mon.a (mon.0) 3054 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:35 smithi111 bash[23388]: cluster 2024-02-13T14:59:35.476378+0000 mon.a (mon.0) 3055 : cluster 0 osdmap e612: 8 total, 8 up, 8 in 2024-02-13T14:59:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:35 smithi111 bash[23388]: audit 2024-02-13T14:59:35.480138+0000 mon.a (mon.0) 3056 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-118","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:59:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:59:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:59:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:36 smithi062 bash[21479]: cluster 2024-02-13T14:59:36.179591+0000 mgr.y (mgr.14613) 618 : cluster 0 pgmap v998: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:36 smithi062 bash[21479]: audit 2024-02-13T14:59:36.470231+0000 mon.a (mon.0) 3057 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:37.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:36 smithi062 bash[21479]: cluster 2024-02-13T14:59:36.478987+0000 mon.a (mon.0) 3058 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-02-13T14:59:37.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:36 smithi062 bash[28859]: cluster 2024-02-13T14:59:36.179591+0000 mgr.y (mgr.14613) 618 : cluster 0 pgmap v998: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:37.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:36 smithi062 bash[28859]: audit 2024-02-13T14:59:36.470231+0000 mon.a (mon.0) 3057 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:37.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:36 smithi062 bash[28859]: cluster 2024-02-13T14:59:36.478987+0000 mon.a (mon.0) 3058 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-02-13T14:59:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:36 smithi111 bash[23388]: cluster 2024-02-13T14:59:36.179591+0000 mgr.y (mgr.14613) 618 : cluster 0 pgmap v998: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:36 smithi111 bash[23388]: audit 2024-02-13T14:59:36.470231+0000 mon.a (mon.0) 3057 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-118","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:36 smithi111 bash[23388]: cluster 2024-02-13T14:59:36.478987+0000 mon.a (mon.0) 3058 : cluster 0 osdmap e613: 8 total, 8 up, 8 in 2024-02-13T14:59:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[21479]: cluster 2024-02-13T14:59:37.481270+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-02-13T14:59:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[21479]: audit 2024-02-13T14:59:37.498842+0000 mon.a (mon.0) 3060 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[21479]: audit 2024-02-13T14:59:37.701377+0000 mon.a (mon.0) 3061 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[21479]: cluster 2024-02-13T14:59:37.708446+0000 mon.a (mon.0) 3062 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[21479]: audit 2024-02-13T14:59:37.709280+0000 mon.a (mon.0) 3063 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-118"}]: dispatch 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[21479]: cluster 2024-02-13T14:59:38.180587+0000 mgr.y (mgr.14613) 619 : cluster 0 pgmap v1002: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[28859]: cluster 2024-02-13T14:59:37.481270+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[28859]: audit 2024-02-13T14:59:37.498842+0000 mon.a (mon.0) 3060 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[28859]: audit 2024-02-13T14:59:37.701377+0000 mon.a (mon.0) 3061 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[28859]: cluster 2024-02-13T14:59:37.708446+0000 mon.a (mon.0) 3062 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[28859]: audit 2024-02-13T14:59:37.709280+0000 mon.a (mon.0) 3063 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-118"}]: dispatch 2024-02-13T14:59:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:38 smithi062 bash[28859]: cluster 2024-02-13T14:59:38.180587+0000 mgr.y (mgr.14613) 619 : cluster 0 pgmap v1002: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T14:59:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:38 smithi111 bash[23388]: cluster 2024-02-13T14:59:37.481270+0000 mon.a (mon.0) 3059 : cluster 0 osdmap e614: 8 total, 8 up, 8 in 2024-02-13T14:59:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:38 smithi111 bash[23388]: audit 2024-02-13T14:59:37.498842+0000 mon.a (mon.0) 3060 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:38 smithi111 bash[23388]: audit 2024-02-13T14:59:37.701377+0000 mon.a (mon.0) 3061 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:38 smithi111 bash[23388]: cluster 2024-02-13T14:59:37.708446+0000 mon.a (mon.0) 3062 : cluster 0 osdmap e615: 8 total, 8 up, 8 in 2024-02-13T14:59:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:38 smithi111 bash[23388]: audit 2024-02-13T14:59:37.709280+0000 mon.a (mon.0) 3063 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-118"}]: dispatch 2024-02-13T14:59:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:38 smithi111 bash[23388]: cluster 2024-02-13T14:59:38.180587+0000 mgr.y (mgr.14613) 619 : cluster 0 pgmap v1002: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 648 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-02-13T14:59:40.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:39 smithi062 bash[28859]: audit 2024-02-13T14:59:38.712064+0000 mon.a (mon.0) 3064 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-118"}]': finished 2024-02-13T14:59:40.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:39 smithi062 bash[28859]: cluster 2024-02-13T14:59:38.720950+0000 mon.a (mon.0) 3065 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-02-13T14:59:40.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:39 smithi062 bash[28859]: audit 2024-02-13T14:59:38.723609+0000 mon.a (mon.0) 3066 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-118", "mode": "writeback"}]: dispatch 2024-02-13T14:59:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:39 smithi062 bash[21479]: audit 2024-02-13T14:59:38.712064+0000 mon.a (mon.0) 3064 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-118"}]': finished 2024-02-13T14:59:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:39 smithi062 bash[21479]: cluster 2024-02-13T14:59:38.720950+0000 mon.a (mon.0) 3065 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-02-13T14:59:40.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:39 smithi062 bash[21479]: audit 2024-02-13T14:59:38.723609+0000 mon.a (mon.0) 3066 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-118", "mode": "writeback"}]: dispatch 2024-02-13T14:59:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:39 smithi111 bash[23388]: audit 2024-02-13T14:59:38.712064+0000 mon.a (mon.0) 3064 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-118"}]': finished 2024-02-13T14:59:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:39 smithi111 bash[23388]: cluster 2024-02-13T14:59:38.720950+0000 mon.a (mon.0) 3065 : cluster 0 osdmap e616: 8 total, 8 up, 8 in 2024-02-13T14:59:40.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:39 smithi111 bash[23388]: audit 2024-02-13T14:59:38.723609+0000 mon.a (mon.0) 3066 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-118", "mode": "writeback"}]: dispatch 2024-02-13T14:59:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[21479]: cluster 2024-02-13T14:59:39.712451+0000 mon.a (mon.0) 3067 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[21479]: audit 2024-02-13T14:59:39.715138+0000 mon.a (mon.0) 3068 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-118", "mode": "writeback"}]': finished 2024-02-13T14:59:41.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[21479]: cluster 2024-02-13T14:59:39.724129+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-02-13T14:59:41.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[21479]: cluster 2024-02-13T14:59:40.183360+0000 mgr.y (mgr.14613) 620 : cluster 0 pgmap v1005: 300 pgs: 300 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 552 B/s wr, 1 op/s 2024-02-13T14:59:41.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[21479]: cluster 2024-02-13T14:59:40.725642+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-02-13T14:59:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[28859]: cluster 2024-02-13T14:59:39.712451+0000 mon.a (mon.0) 3067 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[28859]: audit 2024-02-13T14:59:39.715138+0000 mon.a (mon.0) 3068 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-118", "mode": "writeback"}]': finished 2024-02-13T14:59:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[28859]: cluster 2024-02-13T14:59:39.724129+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-02-13T14:59:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[28859]: cluster 2024-02-13T14:59:40.183360+0000 mgr.y (mgr.14613) 620 : cluster 0 pgmap v1005: 300 pgs: 300 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 552 B/s wr, 1 op/s 2024-02-13T14:59:41.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:40 smithi062 bash[28859]: cluster 2024-02-13T14:59:40.725642+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-02-13T14:59:41.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:59:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:59:41.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:40 smithi111 bash[23388]: cluster 2024-02-13T14:59:39.712451+0000 mon.a (mon.0) 3067 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:41.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:40 smithi111 bash[23388]: audit 2024-02-13T14:59:39.715138+0000 mon.a (mon.0) 3068 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-118", "mode": "writeback"}]': finished 2024-02-13T14:59:41.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:40 smithi111 bash[23388]: cluster 2024-02-13T14:59:39.724129+0000 mon.a (mon.0) 3069 : cluster 0 osdmap e617: 8 total, 8 up, 8 in 2024-02-13T14:59:41.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:40 smithi111 bash[23388]: cluster 2024-02-13T14:59:40.183360+0000 mgr.y (mgr.14613) 620 : cluster 0 pgmap v1005: 300 pgs: 300 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 552 B/s wr, 1 op/s 2024-02-13T14:59:41.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:40 smithi111 bash[23388]: cluster 2024-02-13T14:59:40.725642+0000 mon.a (mon.0) 3070 : cluster 0 osdmap e618: 8 total, 8 up, 8 in 2024-02-13T14:59:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:41 smithi062 bash[28859]: audit 2024-02-13T14:59:40.733520+0000 mgr.y (mgr.14613) 621 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:42.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:41 smithi062 bash[28859]: audit 2024-02-13T14:59:40.821864+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:42.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:41 smithi062 bash[28859]: audit 2024-02-13T14:59:41.519566+0000 mon.b (mon.1) 258 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:59:42.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:41 smithi062 bash[21479]: audit 2024-02-13T14:59:40.733520+0000 mgr.y (mgr.14613) 621 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:42.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:41 smithi062 bash[21479]: audit 2024-02-13T14:59:40.821864+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:42.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:41 smithi062 bash[21479]: audit 2024-02-13T14:59:41.519566+0000 mon.b (mon.1) 258 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:59:42.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:41 smithi111 bash[23388]: audit 2024-02-13T14:59:40.733520+0000 mgr.y (mgr.14613) 621 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:42.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:41 smithi111 bash[23388]: audit 2024-02-13T14:59:40.821864+0000 mon.a (mon.0) 3071 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:42.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:41 smithi111 bash[23388]: audit 2024-02-13T14:59:41.519566+0000 mon.b (mon.1) 258 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T14:59:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[21479]: audit 2024-02-13T14:59:41.767772+0000 mon.a (mon.0) 3072 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[21479]: cluster 2024-02-13T14:59:41.777787+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-02-13T14:59:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[21479]: audit 2024-02-13T14:59:41.778847+0000 mon.a (mon.0) 3074 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118"}]: dispatch 2024-02-13T14:59:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[21479]: cluster 2024-02-13T14:59:42.184129+0000 mgr.y (mgr.14613) 622 : cluster 0 pgmap v1008: 300 pgs: 300 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:59:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[21479]: audit 2024-02-13T14:59:42.251384+0000 mon.b (mon.1) 259 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:59:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[21479]: audit 2024-02-13T14:59:42.253644+0000 mon.b (mon.1) 260 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:59:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[21479]: audit 2024-02-13T14:59:42.263266+0000 mon.a (mon.0) 3075 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:43.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[21479]: cluster 2024-02-13T14:59:42.700512+0000 mon.a (mon.0) 3076 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:43.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[28859]: audit 2024-02-13T14:59:41.767772+0000 mon.a (mon.0) 3072 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:43.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[28859]: cluster 2024-02-13T14:59:41.777787+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-02-13T14:59:43.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[28859]: audit 2024-02-13T14:59:41.778847+0000 mon.a (mon.0) 3074 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118"}]: dispatch 2024-02-13T14:59:43.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[28859]: cluster 2024-02-13T14:59:42.184129+0000 mgr.y (mgr.14613) 622 : cluster 0 pgmap v1008: 300 pgs: 300 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:59:43.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[28859]: audit 2024-02-13T14:59:42.251384+0000 mon.b (mon.1) 259 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:59:43.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[28859]: audit 2024-02-13T14:59:42.253644+0000 mon.b (mon.1) 260 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:59:43.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[28859]: audit 2024-02-13T14:59:42.263266+0000 mon.a (mon.0) 3075 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:43.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:42 smithi062 bash[28859]: cluster 2024-02-13T14:59:42.700512+0000 mon.a (mon.0) 3076 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:42 smithi111 bash[23388]: audit 2024-02-13T14:59:41.767772+0000 mon.a (mon.0) 3072 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:42 smithi111 bash[23388]: cluster 2024-02-13T14:59:41.777787+0000 mon.a (mon.0) 3073 : cluster 0 osdmap e619: 8 total, 8 up, 8 in 2024-02-13T14:59:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:42 smithi111 bash[23388]: audit 2024-02-13T14:59:41.778847+0000 mon.a (mon.0) 3074 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118"}]: dispatch 2024-02-13T14:59:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:42 smithi111 bash[23388]: cluster 2024-02-13T14:59:42.184129+0000 mgr.y (mgr.14613) 622 : cluster 0 pgmap v1008: 300 pgs: 300 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:59:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:42 smithi111 bash[23388]: audit 2024-02-13T14:59:42.251384+0000 mon.b (mon.1) 259 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T14:59:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:42 smithi111 bash[23388]: audit 2024-02-13T14:59:42.253644+0000 mon.b (mon.1) 260 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T14:59:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:42 smithi111 bash[23388]: audit 2024-02-13T14:59:42.263266+0000 mon.a (mon.0) 3075 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:43.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:42 smithi111 bash[23388]: cluster 2024-02-13T14:59:42.700512+0000 mon.a (mon.0) 3076 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T14:59:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:44 smithi062 bash[28859]: cluster 2024-02-13T14:59:42.768167+0000 mon.a (mon.0) 3077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:44 smithi062 bash[28859]: audit 2024-02-13T14:59:42.770396+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118"}]': finished 2024-02-13T14:59:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:44 smithi062 bash[28859]: cluster 2024-02-13T14:59:42.778744+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-02-13T14:59:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:44 smithi062 bash[21479]: cluster 2024-02-13T14:59:42.768167+0000 mon.a (mon.0) 3077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:44 smithi062 bash[21479]: audit 2024-02-13T14:59:42.770396+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118"}]': finished 2024-02-13T14:59:44.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:44 smithi062 bash[21479]: cluster 2024-02-13T14:59:42.778744+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-02-13T14:59:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:44 smithi111 bash[23388]: cluster 2024-02-13T14:59:42.768167+0000 mon.a (mon.0) 3077 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:44 smithi111 bash[23388]: audit 2024-02-13T14:59:42.770396+0000 mon.a (mon.0) 3078 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-118"}]': finished 2024-02-13T14:59:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:44 smithi111 bash[23388]: cluster 2024-02-13T14:59:42.778744+0000 mon.a (mon.0) 3079 : cluster 0 osdmap e620: 8 total, 8 up, 8 in 2024-02-13T14:59:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:45 smithi062 bash[28859]: cluster 2024-02-13T14:59:43.793740+0000 mon.a (mon.0) 3080 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-02-13T14:59:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:45 smithi062 bash[28859]: cluster 2024-02-13T14:59:44.184941+0000 mgr.y (mgr.14613) 623 : cluster 0 pgmap v1011: 268 pgs: 268 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:45 smithi062 bash[28859]: cluster 2024-02-13T14:59:44.803502+0000 mon.a (mon.0) 3081 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-02-13T14:59:45.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:45 smithi062 bash[28859]: audit 2024-02-13T14:59:44.818043+0000 mon.a (mon.0) 3082 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:45 smithi062 bash[21479]: cluster 2024-02-13T14:59:43.793740+0000 mon.a (mon.0) 3080 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-02-13T14:59:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:45 smithi062 bash[21479]: cluster 2024-02-13T14:59:44.184941+0000 mgr.y (mgr.14613) 623 : cluster 0 pgmap v1011: 268 pgs: 268 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:45 smithi062 bash[21479]: cluster 2024-02-13T14:59:44.803502+0000 mon.a (mon.0) 3081 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-02-13T14:59:45.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:45 smithi062 bash[21479]: audit 2024-02-13T14:59:44.818043+0000 mon.a (mon.0) 3082 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:45 smithi111 bash[23388]: cluster 2024-02-13T14:59:43.793740+0000 mon.a (mon.0) 3080 : cluster 0 osdmap e621: 8 total, 8 up, 8 in 2024-02-13T14:59:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:45 smithi111 bash[23388]: cluster 2024-02-13T14:59:44.184941+0000 mgr.y (mgr.14613) 623 : cluster 0 pgmap v1011: 268 pgs: 268 active+clean; 582 KiB data, 649 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:45 smithi111 bash[23388]: cluster 2024-02-13T14:59:44.803502+0000 mon.a (mon.0) 3081 : cluster 0 osdmap e622: 8 total, 8 up, 8 in 2024-02-13T14:59:45.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:45 smithi111 bash[23388]: audit 2024-02-13T14:59:44.818043+0000 mon.a (mon.0) 3082 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-120","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:59:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:59:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[21479]: audit 2024-02-13T14:59:45.793931+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:47.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[21479]: cluster 2024-02-13T14:59:45.803350+0000 mon.a (mon.0) 3084 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-02-13T14:59:47.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[21479]: audit 2024-02-13T14:59:45.858747+0000 mon.a (mon.0) 3085 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:47.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[21479]: cluster 2024-02-13T14:59:46.185866+0000 mgr.y (mgr.14613) 624 : cluster 0 pgmap v1014: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[28859]: audit 2024-02-13T14:59:45.793931+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[28859]: cluster 2024-02-13T14:59:45.803350+0000 mon.a (mon.0) 3084 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-02-13T14:59:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[28859]: audit 2024-02-13T14:59:45.858747+0000 mon.a (mon.0) 3085 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:46 smithi062 bash[28859]: cluster 2024-02-13T14:59:46.185866+0000 mgr.y (mgr.14613) 624 : cluster 0 pgmap v1014: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:47.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:46 smithi111 bash[23388]: audit 2024-02-13T14:59:45.793931+0000 mon.a (mon.0) 3083 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-120","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:47.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:46 smithi111 bash[23388]: cluster 2024-02-13T14:59:45.803350+0000 mon.a (mon.0) 3084 : cluster 0 osdmap e623: 8 total, 8 up, 8 in 2024-02-13T14:59:47.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:46 smithi111 bash[23388]: audit 2024-02-13T14:59:45.858747+0000 mon.a (mon.0) 3085 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:47.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:46 smithi111 bash[23388]: cluster 2024-02-13T14:59:46.185866+0000 mgr.y (mgr.14613) 624 : cluster 0 pgmap v1014: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:48.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[21479]: audit 2024-02-13T14:59:46.803035+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:48.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[21479]: cluster 2024-02-13T14:59:46.813634+0000 mon.a (mon.0) 3087 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[21479]: audit 2024-02-13T14:59:46.817996+0000 mon.a (mon.0) 3088 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-120"}]: dispatch 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[21479]: audit 2024-02-13T14:59:47.705148+0000 mon.a (mon.0) 3089 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-120"}]': finished 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[21479]: cluster 2024-02-13T14:59:47.711727+0000 mon.a (mon.0) 3090 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[21479]: audit 2024-02-13T14:59:47.712976+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-120", "mode": "writeback"}]: dispatch 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[28859]: audit 2024-02-13T14:59:46.803035+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[28859]: cluster 2024-02-13T14:59:46.813634+0000 mon.a (mon.0) 3087 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[28859]: audit 2024-02-13T14:59:46.817996+0000 mon.a (mon.0) 3088 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-120"}]: dispatch 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[28859]: audit 2024-02-13T14:59:47.705148+0000 mon.a (mon.0) 3089 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-120"}]': finished 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[28859]: cluster 2024-02-13T14:59:47.711727+0000 mon.a (mon.0) 3090 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-02-13T14:59:48.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:47 smithi062 bash[28859]: audit 2024-02-13T14:59:47.712976+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-120", "mode": "writeback"}]: dispatch 2024-02-13T14:59:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:47 smithi111 bash[23388]: audit 2024-02-13T14:59:46.803035+0000 mon.a (mon.0) 3086 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:47 smithi111 bash[23388]: cluster 2024-02-13T14:59:46.813634+0000 mon.a (mon.0) 3087 : cluster 0 osdmap e624: 8 total, 8 up, 8 in 2024-02-13T14:59:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:47 smithi111 bash[23388]: audit 2024-02-13T14:59:46.817996+0000 mon.a (mon.0) 3088 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-120"}]: dispatch 2024-02-13T14:59:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:47 smithi111 bash[23388]: audit 2024-02-13T14:59:47.705148+0000 mon.a (mon.0) 3089 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-120"}]': finished 2024-02-13T14:59:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:47 smithi111 bash[23388]: cluster 2024-02-13T14:59:47.711727+0000 mon.a (mon.0) 3090 : cluster 0 osdmap e625: 8 total, 8 up, 8 in 2024-02-13T14:59:48.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:47 smithi111 bash[23388]: audit 2024-02-13T14:59:47.712976+0000 mon.a (mon.0) 3091 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-120", "mode": "writeback"}]: dispatch 2024-02-13T14:59:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:48 smithi111 bash[23388]: cluster 2024-02-13T14:59:48.186942+0000 mgr.y (mgr.14613) 625 : cluster 0 pgmap v1017: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:48 smithi111 bash[23388]: cluster 2024-02-13T14:59:48.705431+0000 mon.a (mon.0) 3092 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:48 smithi111 bash[23388]: audit 2024-02-13T14:59:48.707781+0000 mon.a (mon.0) 3093 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-120", "mode": "writeback"}]': finished 2024-02-13T14:59:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:48 smithi111 bash[23388]: cluster 2024-02-13T14:59:48.716764+0000 mon.a (mon.0) 3094 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-02-13T14:59:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:48 smithi062 bash[21479]: cluster 2024-02-13T14:59:48.186942+0000 mgr.y (mgr.14613) 625 : cluster 0 pgmap v1017: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:48 smithi062 bash[21479]: cluster 2024-02-13T14:59:48.705431+0000 mon.a (mon.0) 3092 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:48 smithi062 bash[21479]: audit 2024-02-13T14:59:48.707781+0000 mon.a (mon.0) 3093 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-120", "mode": "writeback"}]': finished 2024-02-13T14:59:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:48 smithi062 bash[21479]: cluster 2024-02-13T14:59:48.716764+0000 mon.a (mon.0) 3094 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-02-13T14:59:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:48 smithi062 bash[28859]: cluster 2024-02-13T14:59:48.186942+0000 mgr.y (mgr.14613) 625 : cluster 0 pgmap v1017: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T14:59:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:48 smithi062 bash[28859]: cluster 2024-02-13T14:59:48.705431+0000 mon.a (mon.0) 3092 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:48 smithi062 bash[28859]: audit 2024-02-13T14:59:48.707781+0000 mon.a (mon.0) 3093 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-120", "mode": "writeback"}]': finished 2024-02-13T14:59:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:48 smithi062 bash[28859]: cluster 2024-02-13T14:59:48.716764+0000 mon.a (mon.0) 3094 : cluster 0 osdmap e626: 8 total, 8 up, 8 in 2024-02-13T14:59:50.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:49 smithi111 bash[23388]: audit 2024-02-13T14:59:48.865228+0000 mon.a (mon.0) 3095 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:50.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:49 smithi111 bash[23388]: audit 2024-02-13T14:59:49.205762+0000 mon.a (mon.0) 3096 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:50.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:49 smithi111 bash[23388]: audit 2024-02-13T14:59:49.210376+0000 mon.b (mon.1) 261 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:50.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:49 smithi062 bash[28859]: audit 2024-02-13T14:59:48.865228+0000 mon.a (mon.0) 3095 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:50.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:49 smithi062 bash[28859]: audit 2024-02-13T14:59:49.205762+0000 mon.a (mon.0) 3096 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:50.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:49 smithi062 bash[28859]: audit 2024-02-13T14:59:49.210376+0000 mon.b (mon.1) 261 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:50.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:49 smithi062 bash[21479]: audit 2024-02-13T14:59:48.865228+0000 mon.a (mon.0) 3095 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:50.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:49 smithi062 bash[21479]: audit 2024-02-13T14:59:49.205762+0000 mon.a (mon.0) 3096 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T14:59:50.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:49 smithi062 bash[21479]: audit 2024-02-13T14:59:49.210376+0000 mon.b (mon.1) 261 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T14:59:51.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 14:59:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T14:59:51.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:50 smithi111 bash[23388]: audit 2024-02-13T14:59:49.826634+0000 mon.a (mon.0) 3097 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:51.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:50 smithi111 bash[23388]: cluster 2024-02-13T14:59:49.833604+0000 mon.a (mon.0) 3098 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-02-13T14:59:51.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:50 smithi111 bash[23388]: audit 2024-02-13T14:59:49.836580+0000 mon.a (mon.0) 3099 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120"}]: dispatch 2024-02-13T14:59:51.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:50 smithi111 bash[23388]: cluster 2024-02-13T14:59:50.189906+0000 mgr.y (mgr.14613) 626 : cluster 0 pgmap v1020: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-13T14:59:51.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:50 smithi062 bash[28859]: audit 2024-02-13T14:59:49.826634+0000 mon.a (mon.0) 3097 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:51.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:50 smithi062 bash[28859]: cluster 2024-02-13T14:59:49.833604+0000 mon.a (mon.0) 3098 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-02-13T14:59:51.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:50 smithi062 bash[28859]: audit 2024-02-13T14:59:49.836580+0000 mon.a (mon.0) 3099 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120"}]: dispatch 2024-02-13T14:59:51.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:50 smithi062 bash[28859]: cluster 2024-02-13T14:59:50.189906+0000 mgr.y (mgr.14613) 626 : cluster 0 pgmap v1020: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-13T14:59:51.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:50 smithi062 bash[21479]: audit 2024-02-13T14:59:49.826634+0000 mon.a (mon.0) 3097 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:51.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:50 smithi062 bash[21479]: cluster 2024-02-13T14:59:49.833604+0000 mon.a (mon.0) 3098 : cluster 0 osdmap e627: 8 total, 8 up, 8 in 2024-02-13T14:59:51.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:50 smithi062 bash[21479]: audit 2024-02-13T14:59:49.836580+0000 mon.a (mon.0) 3099 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120"}]: dispatch 2024-02-13T14:59:51.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:50 smithi062 bash[21479]: cluster 2024-02-13T14:59:50.189906+0000 mgr.y (mgr.14613) 626 : cluster 0 pgmap v1020: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 767 B/s wr, 3 op/s 2024-02-13T14:59:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:51 smithi111 bash[23388]: audit 2024-02-13T14:59:50.736797+0000 mgr.y (mgr.14613) 627 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:51 smithi111 bash[23388]: cluster 2024-02-13T14:59:50.827743+0000 mon.a (mon.0) 3100 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:51 smithi111 bash[23388]: audit 2024-02-13T14:59:50.838330+0000 mon.a (mon.0) 3101 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120"}]': finished 2024-02-13T14:59:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:51 smithi111 bash[23388]: cluster 2024-02-13T14:59:50.851275+0000 mon.a (mon.0) 3102 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-02-13T14:59:52.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:51 smithi062 bash[28859]: audit 2024-02-13T14:59:50.736797+0000 mgr.y (mgr.14613) 627 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:52.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:51 smithi062 bash[28859]: cluster 2024-02-13T14:59:50.827743+0000 mon.a (mon.0) 3100 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:52.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:51 smithi062 bash[28859]: audit 2024-02-13T14:59:50.838330+0000 mon.a (mon.0) 3101 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120"}]': finished 2024-02-13T14:59:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:51 smithi062 bash[28859]: cluster 2024-02-13T14:59:50.851275+0000 mon.a (mon.0) 3102 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-02-13T14:59:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:51 smithi062 bash[21479]: audit 2024-02-13T14:59:50.736797+0000 mgr.y (mgr.14613) 627 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T14:59:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:51 smithi062 bash[21479]: cluster 2024-02-13T14:59:50.827743+0000 mon.a (mon.0) 3100 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T14:59:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:51 smithi062 bash[21479]: audit 2024-02-13T14:59:50.838330+0000 mon.a (mon.0) 3101 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-120"}]': finished 2024-02-13T14:59:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:51 smithi062 bash[21479]: cluster 2024-02-13T14:59:50.851275+0000 mon.a (mon.0) 3102 : cluster 0 osdmap e628: 8 total, 8 up, 8 in 2024-02-13T14:59:53.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:52 smithi062 bash[28859]: cluster 2024-02-13T14:59:51.860613+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-02-13T14:59:53.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:52 smithi062 bash[28859]: cluster 2024-02-13T14:59:52.190842+0000 mgr.y (mgr.14613) 628 : cluster 0 pgmap v1023: 268 pgs: 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:59:53.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:52 smithi062 bash[21479]: cluster 2024-02-13T14:59:51.860613+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-02-13T14:59:53.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:52 smithi062 bash[21479]: cluster 2024-02-13T14:59:52.190842+0000 mgr.y (mgr.14613) 628 : cluster 0 pgmap v1023: 268 pgs: 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:59:53.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:52 smithi111 bash[23388]: cluster 2024-02-13T14:59:51.860613+0000 mon.a (mon.0) 3103 : cluster 0 osdmap e629: 8 total, 8 up, 8 in 2024-02-13T14:59:53.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:52 smithi111 bash[23388]: cluster 2024-02-13T14:59:52.190842+0000 mgr.y (mgr.14613) 628 : cluster 0 pgmap v1023: 268 pgs: 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T14:59:54.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:53 smithi062 bash[28859]: cluster 2024-02-13T14:59:52.877830+0000 mon.a (mon.0) 3104 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-02-13T14:59:54.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:53 smithi062 bash[28859]: audit 2024-02-13T14:59:52.883049+0000 mon.a (mon.0) 3105 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:54.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:53 smithi062 bash[21479]: cluster 2024-02-13T14:59:52.877830+0000 mon.a (mon.0) 3104 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-02-13T14:59:54.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:53 smithi062 bash[21479]: audit 2024-02-13T14:59:52.883049+0000 mon.a (mon.0) 3105 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:54.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:53 smithi111 bash[23388]: cluster 2024-02-13T14:59:52.877830+0000 mon.a (mon.0) 3104 : cluster 0 osdmap e630: 8 total, 8 up, 8 in 2024-02-13T14:59:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:53 smithi111 bash[23388]: audit 2024-02-13T14:59:52.883049+0000 mon.a (mon.0) 3105 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-122","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T14:59:55.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:54 smithi062 bash[21479]: audit 2024-02-13T14:59:53.869985+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:54 smithi062 bash[21479]: cluster 2024-02-13T14:59:53.877841+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-02-13T14:59:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:54 smithi062 bash[21479]: audit 2024-02-13T14:59:53.930135+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:55.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:54 smithi062 bash[21479]: cluster 2024-02-13T14:59:54.191802+0000 mgr.y (mgr.14613) 629 : cluster 0 pgmap v1026: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:55.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:54 smithi062 bash[28859]: audit 2024-02-13T14:59:53.869985+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:55.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:54 smithi062 bash[28859]: cluster 2024-02-13T14:59:53.877841+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-02-13T14:59:55.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:54 smithi062 bash[28859]: audit 2024-02-13T14:59:53.930135+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:55.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:54 smithi062 bash[28859]: cluster 2024-02-13T14:59:54.191802+0000 mgr.y (mgr.14613) 629 : cluster 0 pgmap v1026: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:55.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:54 smithi111 bash[23388]: audit 2024-02-13T14:59:53.869985+0000 mon.a (mon.0) 3106 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-122","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T14:59:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:54 smithi111 bash[23388]: cluster 2024-02-13T14:59:53.877841+0000 mon.a (mon.0) 3107 : cluster 0 osdmap e631: 8 total, 8 up, 8 in 2024-02-13T14:59:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:54 smithi111 bash[23388]: audit 2024-02-13T14:59:53.930135+0000 mon.a (mon.0) 3108 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T14:59:55.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:54 smithi111 bash[23388]: cluster 2024-02-13T14:59:54.191802+0000 mgr.y (mgr.14613) 629 : cluster 0 pgmap v1026: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-13T14:59:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:55 smithi062 bash[28859]: audit 2024-02-13T14:59:54.893950+0000 mon.a (mon.0) 3109 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:55 smithi062 bash[28859]: cluster 2024-02-13T14:59:54.904969+0000 mon.a (mon.0) 3110 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-02-13T14:59:56.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:55 smithi062 bash[28859]: audit 2024-02-13T14:59:54.906490+0000 mon.a (mon.0) 3111 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-122"}]: dispatch 2024-02-13T14:59:56.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:55 smithi062 bash[21479]: audit 2024-02-13T14:59:54.893950+0000 mon.a (mon.0) 3109 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:56.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:55 smithi062 bash[21479]: cluster 2024-02-13T14:59:54.904969+0000 mon.a (mon.0) 3110 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-02-13T14:59:56.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:55 smithi062 bash[21479]: audit 2024-02-13T14:59:54.906490+0000 mon.a (mon.0) 3111 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-122"}]: dispatch 2024-02-13T14:59:56.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:55 smithi111 bash[23388]: audit 2024-02-13T14:59:54.893950+0000 mon.a (mon.0) 3109 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T14:59:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:55 smithi111 bash[23388]: cluster 2024-02-13T14:59:54.904969+0000 mon.a (mon.0) 3110 : cluster 0 osdmap e632: 8 total, 8 up, 8 in 2024-02-13T14:59:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:55 smithi111 bash[23388]: audit 2024-02-13T14:59:54.906490+0000 mon.a (mon.0) 3111 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-122"}]: dispatch 2024-02-13T14:59:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:14:59:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T14:59:57.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[21479]: audit 2024-02-13T14:59:55.896728+0000 mon.a (mon.0) 3112 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-122"}]': finished 2024-02-13T14:59:57.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[21479]: cluster 2024-02-13T14:59:55.905276+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-02-13T14:59:57.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[21479]: audit 2024-02-13T14:59:55.907183+0000 mon.a (mon.0) 3114 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-122", "mode": "writeback"}]: dispatch 2024-02-13T14:59:57.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[21479]: cluster 2024-02-13T14:59:56.192679+0000 mgr.y (mgr.14613) 630 : cluster 0 pgmap v1029: 300 pgs: 300 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:57.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[21479]: cluster 2024-02-13T14:59:56.896928+0000 mon.a (mon.0) 3115 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:57.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[21479]: audit 2024-02-13T14:59:56.899269+0000 mon.a (mon.0) 3116 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-122", "mode": "writeback"}]': finished 2024-02-13T14:59:57.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[28859]: audit 2024-02-13T14:59:55.896728+0000 mon.a (mon.0) 3112 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-122"}]': finished 2024-02-13T14:59:57.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[28859]: cluster 2024-02-13T14:59:55.905276+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-02-13T14:59:57.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[28859]: audit 2024-02-13T14:59:55.907183+0000 mon.a (mon.0) 3114 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-122", "mode": "writeback"}]: dispatch 2024-02-13T14:59:57.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[28859]: cluster 2024-02-13T14:59:56.192679+0000 mgr.y (mgr.14613) 630 : cluster 0 pgmap v1029: 300 pgs: 300 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:57.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[28859]: cluster 2024-02-13T14:59:56.896928+0000 mon.a (mon.0) 3115 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:57.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:56 smithi062 bash[28859]: audit 2024-02-13T14:59:56.899269+0000 mon.a (mon.0) 3116 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-122", "mode": "writeback"}]': finished 2024-02-13T14:59:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:56 smithi111 bash[23388]: audit 2024-02-13T14:59:55.896728+0000 mon.a (mon.0) 3112 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-122"}]': finished 2024-02-13T14:59:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:56 smithi111 bash[23388]: cluster 2024-02-13T14:59:55.905276+0000 mon.a (mon.0) 3113 : cluster 0 osdmap e633: 8 total, 8 up, 8 in 2024-02-13T14:59:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:56 smithi111 bash[23388]: audit 2024-02-13T14:59:55.907183+0000 mon.a (mon.0) 3114 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-122", "mode": "writeback"}]: dispatch 2024-02-13T14:59:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:56 smithi111 bash[23388]: cluster 2024-02-13T14:59:56.192679+0000 mgr.y (mgr.14613) 630 : cluster 0 pgmap v1029: 300 pgs: 300 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:56 smithi111 bash[23388]: cluster 2024-02-13T14:59:56.896928+0000 mon.a (mon.0) 3115 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T14:59:57.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:56 smithi111 bash[23388]: audit 2024-02-13T14:59:56.899269+0000 mon.a (mon.0) 3116 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-122", "mode": "writeback"}]': finished 2024-02-13T14:59:58.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:57 smithi062 bash[21479]: cluster 2024-02-13T14:59:56.906122+0000 mon.a (mon.0) 3117 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-02-13T14:59:58.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:57 smithi062 bash[21479]: audit 2024-02-13T14:59:57.035760+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:58.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:57 smithi062 bash[28859]: cluster 2024-02-13T14:59:56.906122+0000 mon.a (mon.0) 3117 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-02-13T14:59:58.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:57 smithi062 bash[28859]: audit 2024-02-13T14:59:57.035760+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:57 smithi111 bash[23388]: cluster 2024-02-13T14:59:56.906122+0000 mon.a (mon.0) 3117 : cluster 0 osdmap e634: 8 total, 8 up, 8 in 2024-02-13T14:59:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:57 smithi111 bash[23388]: audit 2024-02-13T14:59:57.035760+0000 mon.a (mon.0) 3118 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T14:59:59.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:58 smithi062 bash[21479]: audit 2024-02-13T14:59:57.933457+0000 mon.a (mon.0) 3119 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:59.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:58 smithi062 bash[21479]: cluster 2024-02-13T14:59:57.940698+0000 mon.a (mon.0) 3120 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-02-13T14:59:59.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:58 smithi062 bash[21479]: audit 2024-02-13T14:59:57.941647+0000 mon.a (mon.0) 3121 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122"}]: dispatch 2024-02-13T14:59:59.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 14:59:58 smithi062 bash[21479]: cluster 2024-02-13T14:59:58.193579+0000 mgr.y (mgr.14613) 631 : cluster 0 pgmap v1032: 300 pgs: 300 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:59.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:58 smithi062 bash[28859]: audit 2024-02-13T14:59:57.933457+0000 mon.a (mon.0) 3119 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:59.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:58 smithi062 bash[28859]: cluster 2024-02-13T14:59:57.940698+0000 mon.a (mon.0) 3120 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-02-13T14:59:59.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:58 smithi062 bash[28859]: audit 2024-02-13T14:59:57.941647+0000 mon.a (mon.0) 3121 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122"}]: dispatch 2024-02-13T14:59:59.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 14:59:58 smithi062 bash[28859]: cluster 2024-02-13T14:59:58.193579+0000 mgr.y (mgr.14613) 631 : cluster 0 pgmap v1032: 300 pgs: 300 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T14:59:59.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:58 smithi111 bash[23388]: audit 2024-02-13T14:59:57.933457+0000 mon.a (mon.0) 3119 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T14:59:59.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:58 smithi111 bash[23388]: cluster 2024-02-13T14:59:57.940698+0000 mon.a (mon.0) 3120 : cluster 0 osdmap e635: 8 total, 8 up, 8 in 2024-02-13T14:59:59.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:58 smithi111 bash[23388]: audit 2024-02-13T14:59:57.941647+0000 mon.a (mon.0) 3121 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122"}]: dispatch 2024-02-13T14:59:59.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 14:59:58 smithi111 bash[23388]: cluster 2024-02-13T14:59:58.193579+0000 mgr.y (mgr.14613) 631 : cluster 0 pgmap v1032: 300 pgs: 300 active+clean; 582 KiB data, 655 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:00.751 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:00 smithi111 bash[23388]: cluster 2024-02-13T14:59:58.934705+0000 mon.a (mon.0) 3122 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:00.752 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:00 smithi111 bash[23388]: audit 2024-02-13T14:59:58.943126+0000 mon.a (mon.0) 3123 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122"}]': finished 2024-02-13T15:00:00.752 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:00 smithi111 bash[23388]: cluster 2024-02-13T14:59:58.952870+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-02-13T15:00:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:00 smithi062 bash[21479]: cluster 2024-02-13T14:59:58.934705+0000 mon.a (mon.0) 3122 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:00 smithi062 bash[21479]: audit 2024-02-13T14:59:58.943126+0000 mon.a (mon.0) 3123 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122"}]': finished 2024-02-13T15:00:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:00 smithi062 bash[21479]: cluster 2024-02-13T14:59:58.952870+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-02-13T15:00:00.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:00 smithi062 bash[28859]: cluster 2024-02-13T14:59:58.934705+0000 mon.a (mon.0) 3122 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:00.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:00 smithi062 bash[28859]: audit 2024-02-13T14:59:58.943126+0000 mon.a (mon.0) 3123 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-122"}]': finished 2024-02-13T15:00:00.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:00 smithi062 bash[28859]: cluster 2024-02-13T14:59:58.952870+0000 mon.a (mon.0) 3124 : cluster 0 osdmap e636: 8 total, 8 up, 8 in 2024-02-13T15:00:01.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:00:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:00:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T14:59:59.952828+0000 mon.a (mon.0) 3125 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.195351+0000 mgr.y (mgr.14613) 632 : cluster 0 pgmap v1035: 268 pgs: 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.441931+0000 mon.a (mon.0) 3126 : cluster 3 Health detail: HEALTH_WARN 5 pool(s) do not have an application enabled 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.441960+0000 mon.a (mon.0) 3127 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.441973+0000 mon.a (mon.0) 3128 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.441983+0000 mon.a (mon.0) 3129 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.441995+0000 mon.a (mon.0) 3130 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.442023+0000 mon.a (mon.0) 3131 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.442037+0000 mon.a (mon.0) 3132 : cluster 3 application not enabled on pool 'test-rados-api-smithi062-64695-111' 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.442048+0000 mon.a (mon.0) 3133 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: cluster 2024-02-13T15:00:00.956557+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-02-13T15:00:01.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[21479]: audit 2024-02-13T15:00:00.959982+0000 mon.a (mon.0) 3135 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T14:59:59.952828+0000 mon.a (mon.0) 3125 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.195351+0000 mgr.y (mgr.14613) 632 : cluster 0 pgmap v1035: 268 pgs: 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.441931+0000 mon.a (mon.0) 3126 : cluster 3 Health detail: HEALTH_WARN 5 pool(s) do not have an application enabled 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.441960+0000 mon.a (mon.0) 3127 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.441973+0000 mon.a (mon.0) 3128 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.441983+0000 mon.a (mon.0) 3129 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.441995+0000 mon.a (mon.0) 3130 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.442023+0000 mon.a (mon.0) 3131 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.442037+0000 mon.a (mon.0) 3132 : cluster 3 application not enabled on pool 'test-rados-api-smithi062-64695-111' 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.442048+0000 mon.a (mon.0) 3133 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: cluster 2024-02-13T15:00:00.956557+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-02-13T15:00:01.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:01 smithi062 bash[28859]: audit 2024-02-13T15:00:00.959982+0000 mon.a (mon.0) 3135 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T14:59:59.952828+0000 mon.a (mon.0) 3125 : cluster 0 osdmap e637: 8 total, 8 up, 8 in 2024-02-13T15:00:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.195351+0000 mgr.y (mgr.14613) 632 : cluster 0 pgmap v1035: 268 pgs: 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.441931+0000 mon.a (mon.0) 3126 : cluster 3 Health detail: HEALTH_WARN 5 pool(s) do not have an application enabled 2024-02-13T15:00:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.441960+0000 mon.a (mon.0) 3127 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 5 pool(s) do not have an application enabled 2024-02-13T15:00:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.441973+0000 mon.a (mon.0) 3128 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:00:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.441983+0000 mon.a (mon.0) 3129 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T15:00:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.441995+0000 mon.a (mon.0) 3130 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T15:00:01.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.442023+0000 mon.a (mon.0) 3131 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T15:00:01.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.442037+0000 mon.a (mon.0) 3132 : cluster 3 application not enabled on pool 'test-rados-api-smithi062-64695-111' 2024-02-13T15:00:01.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.442048+0000 mon.a (mon.0) 3133 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:00:01.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: cluster 2024-02-13T15:00:00.956557+0000 mon.a (mon.0) 3134 : cluster 0 osdmap e638: 8 total, 8 up, 8 in 2024-02-13T15:00:01.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:01 smithi111 bash[23388]: audit 2024-02-13T15:00:00.959982+0000 mon.a (mon.0) 3135 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-124","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:02 smithi062 bash[28859]: audit 2024-02-13T15:00:00.748142+0000 mgr.y (mgr.14613) 633 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:02 smithi062 bash[28859]: audit 2024-02-13T15:00:01.952439+0000 mon.a (mon.0) 3136 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:02 smithi062 bash[28859]: cluster 2024-02-13T15:00:01.965542+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-02-13T15:00:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:02 smithi062 bash[21479]: audit 2024-02-13T15:00:00.748142+0000 mgr.y (mgr.14613) 633 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:02 smithi062 bash[21479]: audit 2024-02-13T15:00:01.952439+0000 mon.a (mon.0) 3136 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:02 smithi062 bash[21479]: cluster 2024-02-13T15:00:01.965542+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-02-13T15:00:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:02 smithi111 bash[23388]: audit 2024-02-13T15:00:00.748142+0000 mgr.y (mgr.14613) 633 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:02 smithi111 bash[23388]: audit 2024-02-13T15:00:01.952439+0000 mon.a (mon.0) 3136 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-124","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:02 smithi111 bash[23388]: cluster 2024-02-13T15:00:01.965542+0000 mon.a (mon.0) 3137 : cluster 0 osdmap e639: 8 total, 8 up, 8 in 2024-02-13T15:00:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:03 smithi062 bash[21479]: cluster 2024-02-13T15:00:02.196286+0000 mgr.y (mgr.14613) 634 : cluster 0 pgmap v1038: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:03 smithi062 bash[21479]: cluster 2024-02-13T15:00:02.968217+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-02-13T15:00:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:03 smithi062 bash[21479]: audit 2024-02-13T15:00:03.018027+0000 mon.a (mon.0) 3139 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:03 smithi062 bash[28859]: cluster 2024-02-13T15:00:02.196286+0000 mgr.y (mgr.14613) 634 : cluster 0 pgmap v1038: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:03 smithi062 bash[28859]: cluster 2024-02-13T15:00:02.968217+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-02-13T15:00:03.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:03 smithi062 bash[28859]: audit 2024-02-13T15:00:03.018027+0000 mon.a (mon.0) 3139 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:03 smithi111 bash[23388]: cluster 2024-02-13T15:00:02.196286+0000 mgr.y (mgr.14613) 634 : cluster 0 pgmap v1038: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:03 smithi111 bash[23388]: cluster 2024-02-13T15:00:02.968217+0000 mon.a (mon.0) 3138 : cluster 0 osdmap e640: 8 total, 8 up, 8 in 2024-02-13T15:00:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:03 smithi111 bash[23388]: audit 2024-02-13T15:00:03.018027+0000 mon.a (mon.0) 3139 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:05.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[28859]: audit 2024-02-13T15:00:03.964459+0000 mon.a (mon.0) 3140 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:05.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[28859]: cluster 2024-02-13T15:00:03.974619+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[28859]: audit 2024-02-13T15:00:03.977935+0000 mon.a (mon.0) 3142 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-124"}]: dispatch 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[28859]: cluster 2024-02-13T15:00:04.197212+0000 mgr.y (mgr.14613) 635 : cluster 0 pgmap v1041: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[28859]: audit 2024-02-13T15:00:04.254178+0000 mon.a (mon.0) 3143 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[28859]: audit 2024-02-13T15:00:04.258767+0000 mon.b (mon.1) 262 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[21479]: audit 2024-02-13T15:00:03.964459+0000 mon.a (mon.0) 3140 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[21479]: cluster 2024-02-13T15:00:03.974619+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[21479]: audit 2024-02-13T15:00:03.977935+0000 mon.a (mon.0) 3142 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-124"}]: dispatch 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[21479]: cluster 2024-02-13T15:00:04.197212+0000 mgr.y (mgr.14613) 635 : cluster 0 pgmap v1041: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[21479]: audit 2024-02-13T15:00:04.254178+0000 mon.a (mon.0) 3143 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:04 smithi062 bash[21479]: audit 2024-02-13T15:00:04.258767+0000 mon.b (mon.1) 262 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:04 smithi111 bash[23388]: audit 2024-02-13T15:00:03.964459+0000 mon.a (mon.0) 3140 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:04 smithi111 bash[23388]: cluster 2024-02-13T15:00:03.974619+0000 mon.a (mon.0) 3141 : cluster 0 osdmap e641: 8 total, 8 up, 8 in 2024-02-13T15:00:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:04 smithi111 bash[23388]: audit 2024-02-13T15:00:03.977935+0000 mon.a (mon.0) 3142 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-124"}]: dispatch 2024-02-13T15:00:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:04 smithi111 bash[23388]: cluster 2024-02-13T15:00:04.197212+0000 mgr.y (mgr.14613) 635 : cluster 0 pgmap v1041: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:04 smithi111 bash[23388]: audit 2024-02-13T15:00:04.254178+0000 mon.a (mon.0) 3143 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:04 smithi111 bash[23388]: audit 2024-02-13T15:00:04.258767+0000 mon.b (mon.1) 262 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:06.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:00:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:00:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:00:06.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:05 smithi062 bash[28859]: audit 2024-02-13T15:00:04.973594+0000 mon.a (mon.0) 3144 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-124"}]': finished 2024-02-13T15:00:06.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:05 smithi062 bash[28859]: cluster 2024-02-13T15:00:04.982318+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-02-13T15:00:06.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:05 smithi062 bash[28859]: audit 2024-02-13T15:00:04.983851+0000 mon.a (mon.0) 3146 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-124", "mode": "writeback"}]: dispatch 2024-02-13T15:00:06.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:05 smithi062 bash[21479]: audit 2024-02-13T15:00:04.973594+0000 mon.a (mon.0) 3144 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-124"}]': finished 2024-02-13T15:00:06.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:05 smithi062 bash[21479]: cluster 2024-02-13T15:00:04.982318+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-02-13T15:00:06.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:05 smithi062 bash[21479]: audit 2024-02-13T15:00:04.983851+0000 mon.a (mon.0) 3146 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-124", "mode": "writeback"}]: dispatch 2024-02-13T15:00:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:05 smithi111 bash[23388]: audit 2024-02-13T15:00:04.973594+0000 mon.a (mon.0) 3144 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-124"}]': finished 2024-02-13T15:00:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:05 smithi111 bash[23388]: cluster 2024-02-13T15:00:04.982318+0000 mon.a (mon.0) 3145 : cluster 0 osdmap e642: 8 total, 8 up, 8 in 2024-02-13T15:00:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:05 smithi111 bash[23388]: audit 2024-02-13T15:00:04.983851+0000 mon.a (mon.0) 3146 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-124", "mode": "writeback"}]: dispatch 2024-02-13T15:00:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:07 smithi062 bash[28859]: cluster 2024-02-13T15:00:05.974001+0000 mon.a (mon.0) 3147 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:07 smithi062 bash[28859]: audit 2024-02-13T15:00:05.976460+0000 mon.a (mon.0) 3148 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-124", "mode": "writeback"}]': finished 2024-02-13T15:00:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:07 smithi062 bash[28859]: cluster 2024-02-13T15:00:05.986185+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-02-13T15:00:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:07 smithi062 bash[28859]: cluster 2024-02-13T15:00:06.198183+0000 mgr.y (mgr.14613) 636 : cluster 0 pgmap v1044: 300 pgs: 300 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T15:00:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:07 smithi062 bash[21479]: cluster 2024-02-13T15:00:05.974001+0000 mon.a (mon.0) 3147 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:07 smithi062 bash[21479]: audit 2024-02-13T15:00:05.976460+0000 mon.a (mon.0) 3148 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-124", "mode": "writeback"}]': finished 2024-02-13T15:00:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:07 smithi062 bash[21479]: cluster 2024-02-13T15:00:05.986185+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-02-13T15:00:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:07 smithi062 bash[21479]: cluster 2024-02-13T15:00:06.198183+0000 mgr.y (mgr.14613) 636 : cluster 0 pgmap v1044: 300 pgs: 300 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T15:00:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:07 smithi111 bash[23388]: cluster 2024-02-13T15:00:05.974001+0000 mon.a (mon.0) 3147 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:07 smithi111 bash[23388]: audit 2024-02-13T15:00:05.976460+0000 mon.a (mon.0) 3148 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-124", "mode": "writeback"}]': finished 2024-02-13T15:00:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:07 smithi111 bash[23388]: cluster 2024-02-13T15:00:05.986185+0000 mon.a (mon.0) 3149 : cluster 0 osdmap e643: 8 total, 8 up, 8 in 2024-02-13T15:00:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:07 smithi111 bash[23388]: cluster 2024-02-13T15:00:06.198183+0000 mgr.y (mgr.14613) 636 : cluster 0 pgmap v1044: 300 pgs: 300 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T15:00:08.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:08 smithi062 bash[28859]: cluster 2024-02-13T15:00:07.013103+0000 mon.a (mon.0) 3150 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-02-13T15:00:08.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:08 smithi062 bash[28859]: audit 2024-02-13T15:00:07.096220+0000 mon.a (mon.0) 3151 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:08.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:08 smithi062 bash[21479]: cluster 2024-02-13T15:00:07.013103+0000 mon.a (mon.0) 3150 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-02-13T15:00:08.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:08 smithi062 bash[21479]: audit 2024-02-13T15:00:07.096220+0000 mon.a (mon.0) 3151 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:08.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:08 smithi111 bash[23388]: cluster 2024-02-13T15:00:07.013103+0000 mon.a (mon.0) 3150 : cluster 0 osdmap e644: 8 total, 8 up, 8 in 2024-02-13T15:00:08.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:08 smithi111 bash[23388]: audit 2024-02-13T15:00:07.096220+0000 mon.a (mon.0) 3151 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:09.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[21479]: audit 2024-02-13T15:00:08.003955+0000 mon.a (mon.0) 3152 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:09.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[21479]: cluster 2024-02-13T15:00:08.012708+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-02-13T15:00:09.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[21479]: audit 2024-02-13T15:00:08.014301+0000 mon.a (mon.0) 3154 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124"}]: dispatch 2024-02-13T15:00:09.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[21479]: cluster 2024-02-13T15:00:08.199167+0000 mgr.y (mgr.14613) 637 : cluster 0 pgmap v1047: 300 pgs: 300 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T15:00:09.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[21479]: cluster 2024-02-13T15:00:09.004312+0000 mon.a (mon.0) 3155 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:09.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[21479]: audit 2024-02-13T15:00:09.006686+0000 mon.a (mon.0) 3156 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124"}]': finished 2024-02-13T15:00:09.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[28859]: audit 2024-02-13T15:00:08.003955+0000 mon.a (mon.0) 3152 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:09.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[28859]: cluster 2024-02-13T15:00:08.012708+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-02-13T15:00:09.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[28859]: audit 2024-02-13T15:00:08.014301+0000 mon.a (mon.0) 3154 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124"}]: dispatch 2024-02-13T15:00:09.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[28859]: cluster 2024-02-13T15:00:08.199167+0000 mgr.y (mgr.14613) 637 : cluster 0 pgmap v1047: 300 pgs: 300 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T15:00:09.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[28859]: cluster 2024-02-13T15:00:09.004312+0000 mon.a (mon.0) 3155 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:09.315 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:09 smithi062 bash[28859]: audit 2024-02-13T15:00:09.006686+0000 mon.a (mon.0) 3156 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124"}]': finished 2024-02-13T15:00:09.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:09 smithi111 bash[23388]: audit 2024-02-13T15:00:08.003955+0000 mon.a (mon.0) 3152 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:09.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:09 smithi111 bash[23388]: cluster 2024-02-13T15:00:08.012708+0000 mon.a (mon.0) 3153 : cluster 0 osdmap e645: 8 total, 8 up, 8 in 2024-02-13T15:00:09.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:09 smithi111 bash[23388]: audit 2024-02-13T15:00:08.014301+0000 mon.a (mon.0) 3154 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124"}]: dispatch 2024-02-13T15:00:09.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:09 smithi111 bash[23388]: cluster 2024-02-13T15:00:08.199167+0000 mgr.y (mgr.14613) 637 : cluster 0 pgmap v1047: 300 pgs: 300 active+clean; 582 KiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2024-02-13T15:00:09.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:09 smithi111 bash[23388]: cluster 2024-02-13T15:00:09.004312+0000 mon.a (mon.0) 3155 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:09.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:09 smithi111 bash[23388]: audit 2024-02-13T15:00:09.006686+0000 mon.a (mon.0) 3156 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-124"}]': finished 2024-02-13T15:00:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:10 smithi062 bash[28859]: cluster 2024-02-13T15:00:09.014520+0000 mon.a (mon.0) 3157 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-02-13T15:00:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:10 smithi062 bash[21479]: cluster 2024-02-13T15:00:09.014520+0000 mon.a (mon.0) 3157 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-02-13T15:00:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:10 smithi111 bash[23388]: cluster 2024-02-13T15:00:09.014520+0000 mon.a (mon.0) 3157 : cluster 0 osdmap e646: 8 total, 8 up, 8 in 2024-02-13T15:00:10.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:00:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:00:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[21479]: cluster 2024-02-13T15:00:10.053252+0000 mon.a (mon.0) 3158 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-02-13T15:00:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[21479]: cluster 2024-02-13T15:00:10.200677+0000 mgr.y (mgr.14613) 638 : cluster 0 pgmap v1050: 268 pgs: 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:11.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[21479]: audit 2024-02-13T15:00:10.752567+0000 mgr.y (mgr.14613) 639 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:11.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[21479]: cluster 2024-02-13T15:00:11.055708+0000 mon.a (mon.0) 3159 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-02-13T15:00:11.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[21479]: audit 2024-02-13T15:00:11.070248+0000 mon.a (mon.0) 3160 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[28859]: cluster 2024-02-13T15:00:10.053252+0000 mon.a (mon.0) 3158 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-02-13T15:00:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[28859]: cluster 2024-02-13T15:00:10.200677+0000 mgr.y (mgr.14613) 638 : cluster 0 pgmap v1050: 268 pgs: 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[28859]: audit 2024-02-13T15:00:10.752567+0000 mgr.y (mgr.14613) 639 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[28859]: cluster 2024-02-13T15:00:11.055708+0000 mon.a (mon.0) 3159 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-02-13T15:00:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:11 smithi062 bash[28859]: audit 2024-02-13T15:00:11.070248+0000 mon.a (mon.0) 3160 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:11 smithi111 bash[23388]: cluster 2024-02-13T15:00:10.053252+0000 mon.a (mon.0) 3158 : cluster 0 osdmap e647: 8 total, 8 up, 8 in 2024-02-13T15:00:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:11 smithi111 bash[23388]: cluster 2024-02-13T15:00:10.200677+0000 mgr.y (mgr.14613) 638 : cluster 0 pgmap v1050: 268 pgs: 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:11 smithi111 bash[23388]: audit 2024-02-13T15:00:10.752567+0000 mgr.y (mgr.14613) 639 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:11 smithi111 bash[23388]: cluster 2024-02-13T15:00:11.055708+0000 mon.a (mon.0) 3159 : cluster 0 osdmap e648: 8 total, 8 up, 8 in 2024-02-13T15:00:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:11 smithi111 bash[23388]: audit 2024-02-13T15:00:11.070248+0000 mon.a (mon.0) 3160 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-126","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:13 smithi111 bash[23388]: audit 2024-02-13T15:00:12.051328+0000 mon.a (mon.0) 3161 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:13 smithi111 bash[23388]: cluster 2024-02-13T15:00:12.059695+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-02-13T15:00:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:13 smithi111 bash[23388]: audit 2024-02-13T15:00:12.062183+0000 mon.a (mon.0) 3163 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:13 smithi111 bash[23388]: cluster 2024-02-13T15:00:12.201656+0000 mgr.y (mgr.14613) 640 : cluster 0 pgmap v1053: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:13 smithi111 bash[23388]: audit 2024-02-13T15:00:12.713295+0000 mon.a (mon.0) 3164 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:13 smithi111 bash[23388]: cluster 2024-02-13T15:00:12.720945+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-02-13T15:00:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:13 smithi111 bash[23388]: audit 2024-02-13T15:00:12.721935+0000 mon.a (mon.0) 3166 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-126"}]: dispatch 2024-02-13T15:00:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[21479]: audit 2024-02-13T15:00:12.051328+0000 mon.a (mon.0) 3161 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[21479]: cluster 2024-02-13T15:00:12.059695+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[21479]: audit 2024-02-13T15:00:12.062183+0000 mon.a (mon.0) 3163 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[21479]: cluster 2024-02-13T15:00:12.201656+0000 mgr.y (mgr.14613) 640 : cluster 0 pgmap v1053: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[21479]: audit 2024-02-13T15:00:12.713295+0000 mon.a (mon.0) 3164 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[21479]: cluster 2024-02-13T15:00:12.720945+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[21479]: audit 2024-02-13T15:00:12.721935+0000 mon.a (mon.0) 3166 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-126"}]: dispatch 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[28859]: audit 2024-02-13T15:00:12.051328+0000 mon.a (mon.0) 3161 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-126","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[28859]: cluster 2024-02-13T15:00:12.059695+0000 mon.a (mon.0) 3162 : cluster 0 osdmap e649: 8 total, 8 up, 8 in 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[28859]: audit 2024-02-13T15:00:12.062183+0000 mon.a (mon.0) 3163 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[28859]: cluster 2024-02-13T15:00:12.201656+0000 mgr.y (mgr.14613) 640 : cluster 0 pgmap v1053: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[28859]: audit 2024-02-13T15:00:12.713295+0000 mon.a (mon.0) 3164 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:13.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[28859]: cluster 2024-02-13T15:00:12.720945+0000 mon.a (mon.0) 3165 : cluster 0 osdmap e650: 8 total, 8 up, 8 in 2024-02-13T15:00:13.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:13 smithi062 bash[28859]: audit 2024-02-13T15:00:12.721935+0000 mon.a (mon.0) 3166 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-126"}]: dispatch 2024-02-13T15:00:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:14 smithi062 bash[21479]: audit 2024-02-13T15:00:13.715859+0000 mon.a (mon.0) 3167 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-126"}]': finished 2024-02-13T15:00:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:14 smithi062 bash[21479]: cluster 2024-02-13T15:00:13.724586+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-02-13T15:00:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:14 smithi062 bash[21479]: audit 2024-02-13T15:00:13.726108+0000 mon.a (mon.0) 3169 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-126", "mode": "writeback"}]: dispatch 2024-02-13T15:00:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:14 smithi062 bash[21479]: cluster 2024-02-13T15:00:14.202618+0000 mgr.y (mgr.14613) 641 : cluster 0 pgmap v1056: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:14 smithi062 bash[28859]: audit 2024-02-13T15:00:13.715859+0000 mon.a (mon.0) 3167 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-126"}]': finished 2024-02-13T15:00:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:14 smithi062 bash[28859]: cluster 2024-02-13T15:00:13.724586+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-02-13T15:00:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:14 smithi062 bash[28859]: audit 2024-02-13T15:00:13.726108+0000 mon.a (mon.0) 3169 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-126", "mode": "writeback"}]: dispatch 2024-02-13T15:00:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:14 smithi062 bash[28859]: cluster 2024-02-13T15:00:14.202618+0000 mgr.y (mgr.14613) 641 : cluster 0 pgmap v1056: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:14 smithi111 bash[23388]: audit 2024-02-13T15:00:13.715859+0000 mon.a (mon.0) 3167 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-126"}]': finished 2024-02-13T15:00:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:14 smithi111 bash[23388]: cluster 2024-02-13T15:00:13.724586+0000 mon.a (mon.0) 3168 : cluster 0 osdmap e651: 8 total, 8 up, 8 in 2024-02-13T15:00:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:14 smithi111 bash[23388]: audit 2024-02-13T15:00:13.726108+0000 mon.a (mon.0) 3169 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-126", "mode": "writeback"}]: dispatch 2024-02-13T15:00:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:14 smithi111 bash[23388]: cluster 2024-02-13T15:00:14.202618+0000 mgr.y (mgr.14613) 641 : cluster 0 pgmap v1056: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 641 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:16.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:15 smithi062 bash[21479]: cluster 2024-02-13T15:00:14.716949+0000 mon.a (mon.0) 3170 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:16.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:15 smithi062 bash[21479]: audit 2024-02-13T15:00:14.727061+0000 mon.a (mon.0) 3171 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-126", "mode": "writeback"}]': finished 2024-02-13T15:00:16.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:15 smithi062 bash[21479]: cluster 2024-02-13T15:00:14.738327+0000 mon.a (mon.0) 3172 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-02-13T15:00:16.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:15 smithi062 bash[21479]: audit 2024-02-13T15:00:14.899653+0000 mon.a (mon.0) 3173 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:16.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:15 smithi062 bash[28859]: cluster 2024-02-13T15:00:14.716949+0000 mon.a (mon.0) 3170 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:16.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:15 smithi062 bash[28859]: audit 2024-02-13T15:00:14.727061+0000 mon.a (mon.0) 3171 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-126", "mode": "writeback"}]': finished 2024-02-13T15:00:16.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:15 smithi062 bash[28859]: cluster 2024-02-13T15:00:14.738327+0000 mon.a (mon.0) 3172 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-02-13T15:00:16.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:15 smithi062 bash[28859]: audit 2024-02-13T15:00:14.899653+0000 mon.a (mon.0) 3173 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:15 smithi111 bash[23388]: cluster 2024-02-13T15:00:14.716949+0000 mon.a (mon.0) 3170 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:15 smithi111 bash[23388]: audit 2024-02-13T15:00:14.727061+0000 mon.a (mon.0) 3171 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-126", "mode": "writeback"}]': finished 2024-02-13T15:00:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:15 smithi111 bash[23388]: cluster 2024-02-13T15:00:14.738327+0000 mon.a (mon.0) 3172 : cluster 0 osdmap e652: 8 total, 8 up, 8 in 2024-02-13T15:00:16.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:15 smithi111 bash[23388]: audit 2024-02-13T15:00:14.899653+0000 mon.a (mon.0) 3173 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:00:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:00:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[21479]: audit 2024-02-13T15:00:15.729739+0000 mon.a (mon.0) 3174 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[21479]: cluster 2024-02-13T15:00:15.737426+0000 mon.a (mon.0) 3175 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-02-13T15:00:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[21479]: audit 2024-02-13T15:00:15.740183+0000 mon.a (mon.0) 3176 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126"}]: dispatch 2024-02-13T15:00:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[21479]: cluster 2024-02-13T15:00:16.203560+0000 mgr.y (mgr.14613) 642 : cluster 0 pgmap v1059: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T15:00:17.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[21479]: cluster 2024-02-13T15:00:16.730117+0000 mon.a (mon.0) 3177 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:17.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[21479]: audit 2024-02-13T15:00:16.732441+0000 mon.a (mon.0) 3178 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126"}]': finished 2024-02-13T15:00:17.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[28859]: audit 2024-02-13T15:00:15.729739+0000 mon.a (mon.0) 3174 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:17.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[28859]: cluster 2024-02-13T15:00:15.737426+0000 mon.a (mon.0) 3175 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-02-13T15:00:17.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[28859]: audit 2024-02-13T15:00:15.740183+0000 mon.a (mon.0) 3176 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126"}]: dispatch 2024-02-13T15:00:17.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[28859]: cluster 2024-02-13T15:00:16.203560+0000 mgr.y (mgr.14613) 642 : cluster 0 pgmap v1059: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T15:00:17.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[28859]: cluster 2024-02-13T15:00:16.730117+0000 mon.a (mon.0) 3177 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:17.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:16 smithi062 bash[28859]: audit 2024-02-13T15:00:16.732441+0000 mon.a (mon.0) 3178 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126"}]': finished 2024-02-13T15:00:17.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:16 smithi111 bash[23388]: audit 2024-02-13T15:00:15.729739+0000 mon.a (mon.0) 3174 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:17.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:16 smithi111 bash[23388]: cluster 2024-02-13T15:00:15.737426+0000 mon.a (mon.0) 3175 : cluster 0 osdmap e653: 8 total, 8 up, 8 in 2024-02-13T15:00:17.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:16 smithi111 bash[23388]: audit 2024-02-13T15:00:15.740183+0000 mon.a (mon.0) 3176 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126"}]: dispatch 2024-02-13T15:00:17.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:16 smithi111 bash[23388]: cluster 2024-02-13T15:00:16.203560+0000 mgr.y (mgr.14613) 642 : cluster 0 pgmap v1059: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T15:00:17.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:16 smithi111 bash[23388]: cluster 2024-02-13T15:00:16.730117+0000 mon.a (mon.0) 3177 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:17.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:16 smithi111 bash[23388]: audit 2024-02-13T15:00:16.732441+0000 mon.a (mon.0) 3178 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-126"}]': finished 2024-02-13T15:00:17.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T15:00:17.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringFlush (9141 ms) 2024-02-13T15:00:17.778 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestSnapHasChunk 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestSnapHasChunk (6070 ms) 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollback 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollback (5064 ms) 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestRollbackRefcount 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestRollbackRefcount (25380 ms) 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.ManifestEvictRollback 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.ManifestEvictRollback (13798 ms) 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.PropagateBaseTierError 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.PropagateBaseTierError (12096 ms) 2024-02-13T15:00:17.779 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.HelloWriteReturn 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 00000000 79 6f 75 20 6d 69 67 68 74 20 73 65 65 20 74 68 |you might see th| 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 00000010 69 73 |is| 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 00000012 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.HelloWriteReturn (12170 ms) 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: require_osd_release = squid 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsPP.TierFlushDuringUnsetDedupTier (6084 ms) 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 48 tests from LibRadosTwoPoolsPP (565534 ms total) 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.Dirty 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.Dirty (1037 ms) 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.FlushWriteRaces 2024-02-13T15:00:17.780 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.FlushWriteRaces (11137 ms) 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.CallForcesPromote 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.CallForcesPromote (18221 ms) 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTierECPP.HitSetNone 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTierECPP.HitSetNone (5 ms) 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 4 tests from LibRadosTierECPP (30400 ms total) 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Overlay 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Overlay (7098 ms) 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Promote 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Promote (8090 ms) 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnap 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: waiting for scrub... 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: done waiting 2024-02-13T15:00:17.781 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnap (26211 ms) 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteSnapTrimRace (9327 ms) 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Whiteout 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Whiteout (8062 ms) 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Evict 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Evict (8097 ms) 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.EvictSnap 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.EvictSnap (10100 ms) 2024-02-13T15:00:17.782 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlush 2024-02-13T15:00:18.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:17 smithi062 bash[21479]: cluster 2024-02-13T15:00:16.739552+0000 mon.a (mon.0) 3179 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-02-13T15:00:18.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:17 smithi062 bash[28859]: cluster 2024-02-13T15:00:16.739552+0000 mon.a (mon.0) 3179 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-02-13T15:00:18.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:17 smithi111 bash[23388]: cluster 2024-02-13T15:00:16.739552+0000 mon.a (mon.0) 3179 : cluster 0 osdmap e654: 8 total, 8 up, 8 in 2024-02-13T15:00:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:18 smithi062 bash[28859]: cluster 2024-02-13T15:00:17.776565+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-02-13T15:00:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:18 smithi062 bash[28859]: cluster 2024-02-13T15:00:18.204438+0000 mgr.y (mgr.14613) 643 : cluster 0 pgmap v1062: 268 pgs: 268 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:18 smithi062 bash[21479]: cluster 2024-02-13T15:00:17.776565+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-02-13T15:00:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:18 smithi062 bash[21479]: cluster 2024-02-13T15:00:18.204438+0000 mgr.y (mgr.14613) 643 : cluster 0 pgmap v1062: 268 pgs: 268 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:19.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:18 smithi111 bash[23388]: cluster 2024-02-13T15:00:17.776565+0000 mon.a (mon.0) 3180 : cluster 0 osdmap e655: 8 total, 8 up, 8 in 2024-02-13T15:00:19.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:18 smithi111 bash[23388]: cluster 2024-02-13T15:00:18.204438+0000 mgr.y (mgr.14613) 643 : cluster 0 pgmap v1062: 268 pgs: 268 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:19 smithi062 bash[28859]: cluster 2024-02-13T15:00:18.791964+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-02-13T15:00:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:19 smithi062 bash[28859]: audit 2024-02-13T15:00:18.793953+0000 mon.a (mon.0) 3182 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:20.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:19 smithi062 bash[28859]: audit 2024-02-13T15:00:19.293785+0000 mon.b (mon.1) 263 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:20.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:19 smithi062 bash[21479]: cluster 2024-02-13T15:00:18.791964+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-02-13T15:00:20.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:19 smithi062 bash[21479]: audit 2024-02-13T15:00:18.793953+0000 mon.a (mon.0) 3182 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:20.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:19 smithi062 bash[21479]: audit 2024-02-13T15:00:19.293785+0000 mon.b (mon.1) 263 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:19 smithi111 bash[23388]: cluster 2024-02-13T15:00:18.791964+0000 mon.a (mon.0) 3181 : cluster 0 osdmap e656: 8 total, 8 up, 8 in 2024-02-13T15:00:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:19 smithi111 bash[23388]: audit 2024-02-13T15:00:18.793953+0000 mon.a (mon.0) 3182 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-128","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:20.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:19 smithi111 bash[23388]: audit 2024-02-13T15:00:19.293785+0000 mon.b (mon.1) 263 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:21.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:00:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:00:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:20 smithi111 bash[23388]: audit 2024-02-13T15:00:19.785390+0000 mon.a (mon.0) 3183 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:20 smithi111 bash[23388]: cluster 2024-02-13T15:00:19.793505+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-02-13T15:00:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:20 smithi111 bash[23388]: audit 2024-02-13T15:00:19.801231+0000 mon.a (mon.0) 3185 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:20 smithi111 bash[23388]: cluster 2024-02-13T15:00:20.207148+0000 mgr.y (mgr.14613) 644 : cluster 0 pgmap v1065: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T15:00:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:20 smithi111 bash[23388]: audit 2024-02-13T15:00:20.787905+0000 mon.a (mon.0) 3186 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:20 smithi111 bash[23388]: cluster 2024-02-13T15:00:20.796941+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-02-13T15:00:21.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:20 smithi111 bash[23388]: audit 2024-02-13T15:00:20.800632+0000 mon.a (mon.0) 3188 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-128"}]: dispatch 2024-02-13T15:00:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[28859]: audit 2024-02-13T15:00:19.785390+0000 mon.a (mon.0) 3183 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[28859]: cluster 2024-02-13T15:00:19.793505+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-02-13T15:00:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[28859]: audit 2024-02-13T15:00:19.801231+0000 mon.a (mon.0) 3185 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[28859]: cluster 2024-02-13T15:00:20.207148+0000 mgr.y (mgr.14613) 644 : cluster 0 pgmap v1065: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[28859]: audit 2024-02-13T15:00:20.787905+0000 mon.a (mon.0) 3186 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[28859]: cluster 2024-02-13T15:00:20.796941+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[28859]: audit 2024-02-13T15:00:20.800632+0000 mon.a (mon.0) 3188 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-128"}]: dispatch 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[21479]: audit 2024-02-13T15:00:19.785390+0000 mon.a (mon.0) 3183 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-128","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[21479]: cluster 2024-02-13T15:00:19.793505+0000 mon.a (mon.0) 3184 : cluster 0 osdmap e657: 8 total, 8 up, 8 in 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[21479]: audit 2024-02-13T15:00:19.801231+0000 mon.a (mon.0) 3185 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[21479]: cluster 2024-02-13T15:00:20.207148+0000 mgr.y (mgr.14613) 644 : cluster 0 pgmap v1065: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[21479]: audit 2024-02-13T15:00:20.787905+0000 mon.a (mon.0) 3186 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[21479]: cluster 2024-02-13T15:00:20.796941+0000 mon.a (mon.0) 3187 : cluster 0 osdmap e658: 8 total, 8 up, 8 in 2024-02-13T15:00:21.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:20 smithi062 bash[21479]: audit 2024-02-13T15:00:20.800632+0000 mon.a (mon.0) 3188 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-128"}]: dispatch 2024-02-13T15:00:22.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:21 smithi111 bash[23388]: audit 2024-02-13T15:00:20.764091+0000 mgr.y (mgr.14613) 645 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:22.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:21 smithi111 bash[23388]: audit 2024-02-13T15:00:21.790694+0000 mon.a (mon.0) 3189 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-128"}]': finished 2024-02-13T15:00:22.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:21 smithi111 bash[23388]: cluster 2024-02-13T15:00:21.797595+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-02-13T15:00:22.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:21 smithi111 bash[23388]: audit 2024-02-13T15:00:21.798897+0000 mon.a (mon.0) 3191 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-128", "mode": "writeback"}]: dispatch 2024-02-13T15:00:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:21 smithi062 bash[21479]: audit 2024-02-13T15:00:20.764091+0000 mgr.y (mgr.14613) 645 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:21 smithi062 bash[21479]: audit 2024-02-13T15:00:21.790694+0000 mon.a (mon.0) 3189 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-128"}]': finished 2024-02-13T15:00:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:21 smithi062 bash[21479]: cluster 2024-02-13T15:00:21.797595+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-02-13T15:00:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:21 smithi062 bash[21479]: audit 2024-02-13T15:00:21.798897+0000 mon.a (mon.0) 3191 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-128", "mode": "writeback"}]: dispatch 2024-02-13T15:00:22.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:21 smithi062 bash[28859]: audit 2024-02-13T15:00:20.764091+0000 mgr.y (mgr.14613) 645 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:22.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:21 smithi062 bash[28859]: audit 2024-02-13T15:00:21.790694+0000 mon.a (mon.0) 3189 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-128"}]': finished 2024-02-13T15:00:22.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:21 smithi062 bash[28859]: cluster 2024-02-13T15:00:21.797595+0000 mon.a (mon.0) 3190 : cluster 0 osdmap e659: 8 total, 8 up, 8 in 2024-02-13T15:00:22.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:21 smithi062 bash[28859]: audit 2024-02-13T15:00:21.798897+0000 mon.a (mon.0) 3191 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-128", "mode": "writeback"}]: dispatch 2024-02-13T15:00:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:22 smithi111 bash[23388]: cluster 2024-02-13T15:00:22.208058+0000 mgr.y (mgr.14613) 646 : cluster 0 pgmap v1068: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:22 smithi111 bash[23388]: cluster 2024-02-13T15:00:22.791001+0000 mon.a (mon.0) 3192 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:22 smithi111 bash[23388]: audit 2024-02-13T15:00:22.807163+0000 mon.a (mon.0) 3193 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-128", "mode": "writeback"}]': finished 2024-02-13T15:00:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:22 smithi111 bash[23388]: cluster 2024-02-13T15:00:22.810588+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-02-13T15:00:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:22 smithi062 bash[28859]: cluster 2024-02-13T15:00:22.208058+0000 mgr.y (mgr.14613) 646 : cluster 0 pgmap v1068: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:22 smithi062 bash[28859]: cluster 2024-02-13T15:00:22.791001+0000 mon.a (mon.0) 3192 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:23.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:22 smithi062 bash[28859]: audit 2024-02-13T15:00:22.807163+0000 mon.a (mon.0) 3193 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-128", "mode": "writeback"}]': finished 2024-02-13T15:00:23.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:22 smithi062 bash[28859]: cluster 2024-02-13T15:00:22.810588+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-02-13T15:00:23.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:22 smithi062 bash[21479]: cluster 2024-02-13T15:00:22.208058+0000 mgr.y (mgr.14613) 646 : cluster 0 pgmap v1068: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:23.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:22 smithi062 bash[21479]: cluster 2024-02-13T15:00:22.791001+0000 mon.a (mon.0) 3192 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:23.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:22 smithi062 bash[21479]: audit 2024-02-13T15:00:22.807163+0000 mon.a (mon.0) 3193 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-128", "mode": "writeback"}]': finished 2024-02-13T15:00:23.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:22 smithi062 bash[21479]: cluster 2024-02-13T15:00:22.810588+0000 mon.a (mon.0) 3194 : cluster 0 osdmap e660: 8 total, 8 up, 8 in 2024-02-13T15:00:25.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:25 smithi062 bash[21479]: cluster 2024-02-13T15:00:24.209090+0000 mgr.y (mgr.14613) 647 : cluster 0 pgmap v1070: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T15:00:25.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:25 smithi062 bash[28859]: cluster 2024-02-13T15:00:24.209090+0000 mgr.y (mgr.14613) 647 : cluster 0 pgmap v1070: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T15:00:25.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:25 smithi111 bash[23388]: cluster 2024-02-13T15:00:24.209090+0000 mgr.y (mgr.14613) 647 : cluster 0 pgmap v1070: 300 pgs: 300 active+clean; 582 KiB data, 650 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-02-13T15:00:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:00:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:00:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:00:27.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:27 smithi062 bash[21479]: cluster 2024-02-13T15:00:26.211996+0000 mgr.y (mgr.14613) 648 : cluster 0 pgmap v1071: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-02-13T15:00:27.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:27 smithi062 bash[28859]: cluster 2024-02-13T15:00:26.211996+0000 mgr.y (mgr.14613) 648 : cluster 0 pgmap v1071: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-02-13T15:00:27.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:27 smithi111 bash[23388]: cluster 2024-02-13T15:00:26.211996+0000 mgr.y (mgr.14613) 648 : cluster 0 pgmap v1071: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 341 B/s wr, 1 op/s 2024-02-13T15:00:28.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:28 smithi062 bash[28859]: audit 2024-02-13T15:00:27.968074+0000 mon.a (mon.0) 3195 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:28 smithi062 bash[21479]: audit 2024-02-13T15:00:27.968074+0000 mon.a (mon.0) 3195 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:28.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:28 smithi111 bash[23388]: audit 2024-02-13T15:00:27.968074+0000 mon.a (mon.0) 3195 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:29.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:29 smithi062 bash[28859]: cluster 2024-02-13T15:00:28.212968+0000 mgr.y (mgr.14613) 649 : cluster 0 pgmap v1072: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 275 B/s wr, 1 op/s 2024-02-13T15:00:29.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:29 smithi062 bash[28859]: audit 2024-02-13T15:00:28.280969+0000 mon.a (mon.0) 3196 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:29.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:29 smithi062 bash[28859]: cluster 2024-02-13T15:00:28.288192+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-02-13T15:00:29.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:29 smithi062 bash[28859]: audit 2024-02-13T15:00:28.290906+0000 mon.a (mon.0) 3198 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128"}]: dispatch 2024-02-13T15:00:29.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:29 smithi062 bash[21479]: cluster 2024-02-13T15:00:28.212968+0000 mgr.y (mgr.14613) 649 : cluster 0 pgmap v1072: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 275 B/s wr, 1 op/s 2024-02-13T15:00:29.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:29 smithi062 bash[21479]: audit 2024-02-13T15:00:28.280969+0000 mon.a (mon.0) 3196 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:29.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:29 smithi062 bash[21479]: cluster 2024-02-13T15:00:28.288192+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-02-13T15:00:29.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:29 smithi062 bash[21479]: audit 2024-02-13T15:00:28.290906+0000 mon.a (mon.0) 3198 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128"}]: dispatch 2024-02-13T15:00:29.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:29 smithi111 bash[23388]: cluster 2024-02-13T15:00:28.212968+0000 mgr.y (mgr.14613) 649 : cluster 0 pgmap v1072: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 827 B/s rd, 275 B/s wr, 1 op/s 2024-02-13T15:00:29.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:29 smithi111 bash[23388]: audit 2024-02-13T15:00:28.280969+0000 mon.a (mon.0) 3196 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:29.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:29 smithi111 bash[23388]: cluster 2024-02-13T15:00:28.288192+0000 mon.a (mon.0) 3197 : cluster 0 osdmap e661: 8 total, 8 up, 8 in 2024-02-13T15:00:29.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:29 smithi111 bash[23388]: audit 2024-02-13T15:00:28.290906+0000 mon.a (mon.0) 3198 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128"}]: dispatch 2024-02-13T15:00:30.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:30 smithi111 bash[23388]: cluster 2024-02-13T15:00:29.281218+0000 mon.a (mon.0) 3199 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:30.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:30 smithi111 bash[23388]: audit 2024-02-13T15:00:29.283477+0000 mon.a (mon.0) 3200 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128"}]': finished 2024-02-13T15:00:30.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:30 smithi111 bash[23388]: cluster 2024-02-13T15:00:29.293299+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-02-13T15:00:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:30 smithi062 bash[21479]: cluster 2024-02-13T15:00:29.281218+0000 mon.a (mon.0) 3199 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:30 smithi062 bash[21479]: audit 2024-02-13T15:00:29.283477+0000 mon.a (mon.0) 3200 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128"}]': finished 2024-02-13T15:00:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:30 smithi062 bash[21479]: cluster 2024-02-13T15:00:29.293299+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-02-13T15:00:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:30 smithi062 bash[28859]: cluster 2024-02-13T15:00:29.281218+0000 mon.a (mon.0) 3199 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:30 smithi062 bash[28859]: audit 2024-02-13T15:00:29.283477+0000 mon.a (mon.0) 3200 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-128"}]': finished 2024-02-13T15:00:30.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:30 smithi062 bash[28859]: cluster 2024-02-13T15:00:29.293299+0000 mon.a (mon.0) 3201 : cluster 0 osdmap e662: 8 total, 8 up, 8 in 2024-02-13T15:00:31.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:00:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:00:31.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:31 smithi111 bash[23388]: cluster 2024-02-13T15:00:30.215711+0000 mgr.y (mgr.14613) 650 : cluster 0 pgmap v1075: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 276 B/s wr, 2 op/s 2024-02-13T15:00:31.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:31 smithi111 bash[23388]: cluster 2024-02-13T15:00:30.302685+0000 mon.a (mon.0) 3202 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:00:31.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:31 smithi111 bash[23388]: cluster 2024-02-13T15:00:30.325337+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-02-13T15:00:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:31 smithi062 bash[21479]: cluster 2024-02-13T15:00:30.215711+0000 mgr.y (mgr.14613) 650 : cluster 0 pgmap v1075: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 276 B/s wr, 2 op/s 2024-02-13T15:00:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:31 smithi062 bash[21479]: cluster 2024-02-13T15:00:30.302685+0000 mon.a (mon.0) 3202 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:00:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:31 smithi062 bash[21479]: cluster 2024-02-13T15:00:30.325337+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-02-13T15:00:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:31 smithi062 bash[28859]: cluster 2024-02-13T15:00:30.215711+0000 mgr.y (mgr.14613) 650 : cluster 0 pgmap v1075: 300 pgs: 300 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 276 B/s wr, 2 op/s 2024-02-13T15:00:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:31 smithi062 bash[28859]: cluster 2024-02-13T15:00:30.302685+0000 mon.a (mon.0) 3202 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:00:31.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:31 smithi062 bash[28859]: cluster 2024-02-13T15:00:30.325337+0000 mon.a (mon.0) 3203 : cluster 0 osdmap e663: 8 total, 8 up, 8 in 2024-02-13T15:00:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:32 smithi111 bash[23388]: audit 2024-02-13T15:00:30.773390+0000 mgr.y (mgr.14613) 651 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:32 smithi111 bash[23388]: cluster 2024-02-13T15:00:31.335151+0000 mon.a (mon.0) 3204 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-02-13T15:00:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:32 smithi111 bash[23388]: audit 2024-02-13T15:00:31.338132+0000 mon.a (mon.0) 3205 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:32 smithi062 bash[21479]: audit 2024-02-13T15:00:30.773390+0000 mgr.y (mgr.14613) 651 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:32 smithi062 bash[21479]: cluster 2024-02-13T15:00:31.335151+0000 mon.a (mon.0) 3204 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-02-13T15:00:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:32 smithi062 bash[21479]: audit 2024-02-13T15:00:31.338132+0000 mon.a (mon.0) 3205 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:32 smithi062 bash[28859]: audit 2024-02-13T15:00:30.773390+0000 mgr.y (mgr.14613) 651 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:32 smithi062 bash[28859]: cluster 2024-02-13T15:00:31.335151+0000 mon.a (mon.0) 3204 : cluster 0 osdmap e664: 8 total, 8 up, 8 in 2024-02-13T15:00:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:32 smithi062 bash[28859]: audit 2024-02-13T15:00:31.338132+0000 mon.a (mon.0) 3205 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-130","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:33 smithi062 bash[21479]: cluster 2024-02-13T15:00:32.216829+0000 mgr.y (mgr.14613) 652 : cluster 0 pgmap v1078: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:00:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:33 smithi062 bash[21479]: audit 2024-02-13T15:00:32.336469+0000 mon.a (mon.0) 3206 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:33 smithi062 bash[21479]: cluster 2024-02-13T15:00:32.345997+0000 mon.a (mon.0) 3207 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-02-13T15:00:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:33 smithi062 bash[21479]: audit 2024-02-13T15:00:32.349297+0000 mon.a (mon.0) 3208 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:33 smithi062 bash[28859]: cluster 2024-02-13T15:00:32.216829+0000 mgr.y (mgr.14613) 652 : cluster 0 pgmap v1078: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:00:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:33 smithi062 bash[28859]: audit 2024-02-13T15:00:32.336469+0000 mon.a (mon.0) 3206 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:33 smithi062 bash[28859]: cluster 2024-02-13T15:00:32.345997+0000 mon.a (mon.0) 3207 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-02-13T15:00:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:33 smithi062 bash[28859]: audit 2024-02-13T15:00:32.349297+0000 mon.a (mon.0) 3208 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:33 smithi111 bash[23388]: cluster 2024-02-13T15:00:32.216829+0000 mgr.y (mgr.14613) 652 : cluster 0 pgmap v1078: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:00:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:33 smithi111 bash[23388]: audit 2024-02-13T15:00:32.336469+0000 mon.a (mon.0) 3206 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-130","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:33 smithi111 bash[23388]: cluster 2024-02-13T15:00:32.345997+0000 mon.a (mon.0) 3207 : cluster 0 osdmap e665: 8 total, 8 up, 8 in 2024-02-13T15:00:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:33 smithi111 bash[23388]: audit 2024-02-13T15:00:32.349297+0000 mon.a (mon.0) 3208 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[21479]: audit 2024-02-13T15:00:33.339227+0000 mon.a (mon.0) 3209 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[21479]: cluster 2024-02-13T15:00:33.348599+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-02-13T15:00:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[21479]: audit 2024-02-13T15:00:33.353001+0000 mon.a (mon.0) 3211 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-130"}]: dispatch 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[21479]: audit 2024-02-13T15:00:34.328970+0000 mon.b (mon.1) 264 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[21479]: audit 2024-02-13T15:00:34.341749+0000 mon.a (mon.0) 3212 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-130"}]': finished 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[21479]: cluster 2024-02-13T15:00:34.348755+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[21479]: audit 2024-02-13T15:00:34.352203+0000 mon.a (mon.0) 3214 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-130", "mode": "writeback"}]: dispatch 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[28859]: audit 2024-02-13T15:00:33.339227+0000 mon.a (mon.0) 3209 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[28859]: cluster 2024-02-13T15:00:33.348599+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[28859]: audit 2024-02-13T15:00:33.353001+0000 mon.a (mon.0) 3211 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-130"}]: dispatch 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[28859]: audit 2024-02-13T15:00:34.328970+0000 mon.b (mon.1) 264 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[28859]: audit 2024-02-13T15:00:34.341749+0000 mon.a (mon.0) 3212 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-130"}]': finished 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[28859]: cluster 2024-02-13T15:00:34.348755+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-02-13T15:00:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:34 smithi062 bash[28859]: audit 2024-02-13T15:00:34.352203+0000 mon.a (mon.0) 3214 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-130", "mode": "writeback"}]: dispatch 2024-02-13T15:00:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:34 smithi111 bash[23388]: audit 2024-02-13T15:00:33.339227+0000 mon.a (mon.0) 3209 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:34 smithi111 bash[23388]: cluster 2024-02-13T15:00:33.348599+0000 mon.a (mon.0) 3210 : cluster 0 osdmap e666: 8 total, 8 up, 8 in 2024-02-13T15:00:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:34 smithi111 bash[23388]: audit 2024-02-13T15:00:33.353001+0000 mon.a (mon.0) 3211 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-130"}]: dispatch 2024-02-13T15:00:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:34 smithi111 bash[23388]: audit 2024-02-13T15:00:34.328970+0000 mon.b (mon.1) 264 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:34 smithi111 bash[23388]: audit 2024-02-13T15:00:34.341749+0000 mon.a (mon.0) 3212 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-130"}]': finished 2024-02-13T15:00:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:34 smithi111 bash[23388]: cluster 2024-02-13T15:00:34.348755+0000 mon.a (mon.0) 3213 : cluster 0 osdmap e667: 8 total, 8 up, 8 in 2024-02-13T15:00:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:34 smithi111 bash[23388]: audit 2024-02-13T15:00:34.352203+0000 mon.a (mon.0) 3214 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-130", "mode": "writeback"}]: dispatch 2024-02-13T15:00:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:35 smithi062 bash[21479]: cluster 2024-02-13T15:00:34.217937+0000 mgr.y (mgr.14613) 653 : cluster 0 pgmap v1081: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:35 smithi062 bash[21479]: cluster 2024-02-13T15:00:35.342098+0000 mon.a (mon.0) 3215 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:35 smithi062 bash[21479]: audit 2024-02-13T15:00:35.344573+0000 mon.a (mon.0) 3216 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-130", "mode": "writeback"}]': finished 2024-02-13T15:00:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:35 smithi062 bash[21479]: cluster 2024-02-13T15:00:35.352194+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-02-13T15:00:35.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:35 smithi062 bash[28859]: cluster 2024-02-13T15:00:34.217937+0000 mgr.y (mgr.14613) 653 : cluster 0 pgmap v1081: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:35.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:35 smithi062 bash[28859]: cluster 2024-02-13T15:00:35.342098+0000 mon.a (mon.0) 3215 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:35.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:35 smithi062 bash[28859]: audit 2024-02-13T15:00:35.344573+0000 mon.a (mon.0) 3216 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-130", "mode": "writeback"}]': finished 2024-02-13T15:00:35.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:35 smithi062 bash[28859]: cluster 2024-02-13T15:00:35.352194+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-02-13T15:00:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:35 smithi111 bash[23388]: cluster 2024-02-13T15:00:34.217937+0000 mgr.y (mgr.14613) 653 : cluster 0 pgmap v1081: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 651 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:35 smithi111 bash[23388]: cluster 2024-02-13T15:00:35.342098+0000 mon.a (mon.0) 3215 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:35 smithi111 bash[23388]: audit 2024-02-13T15:00:35.344573+0000 mon.a (mon.0) 3216 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-130", "mode": "writeback"}]': finished 2024-02-13T15:00:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:35 smithi111 bash[23388]: cluster 2024-02-13T15:00:35.352194+0000 mon.a (mon.0) 3217 : cluster 0 osdmap e668: 8 total, 8 up, 8 in 2024-02-13T15:00:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:36 smithi062 bash[21479]: audit 2024-02-13T15:00:35.567969+0000 mon.a (mon.0) 3218 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:00:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:00:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:00:36.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:36 smithi062 bash[28859]: audit 2024-02-13T15:00:35.567969+0000 mon.a (mon.0) 3218 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:36 smithi111 bash[23388]: audit 2024-02-13T15:00:35.567969+0000 mon.a (mon.0) 3218 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:37 smithi062 bash[21479]: cluster 2024-02-13T15:00:36.218855+0000 mgr.y (mgr.14613) 654 : cluster 0 pgmap v1084: 300 pgs: 300 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:37 smithi062 bash[21479]: audit 2024-02-13T15:00:36.383004+0000 mon.a (mon.0) 3219 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:37 smithi062 bash[21479]: cluster 2024-02-13T15:00:36.390963+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-02-13T15:00:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:37 smithi062 bash[21479]: audit 2024-02-13T15:00:36.391920+0000 mon.a (mon.0) 3221 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130"}]: dispatch 2024-02-13T15:00:37.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:37 smithi062 bash[28859]: cluster 2024-02-13T15:00:36.218855+0000 mgr.y (mgr.14613) 654 : cluster 0 pgmap v1084: 300 pgs: 300 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:37.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:37 smithi062 bash[28859]: audit 2024-02-13T15:00:36.383004+0000 mon.a (mon.0) 3219 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:37.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:37 smithi062 bash[28859]: cluster 2024-02-13T15:00:36.390963+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-02-13T15:00:37.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:37 smithi062 bash[28859]: audit 2024-02-13T15:00:36.391920+0000 mon.a (mon.0) 3221 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130"}]: dispatch 2024-02-13T15:00:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:37 smithi111 bash[23388]: cluster 2024-02-13T15:00:36.218855+0000 mgr.y (mgr.14613) 654 : cluster 0 pgmap v1084: 300 pgs: 300 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:37 smithi111 bash[23388]: audit 2024-02-13T15:00:36.383004+0000 mon.a (mon.0) 3219 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:37 smithi111 bash[23388]: cluster 2024-02-13T15:00:36.390963+0000 mon.a (mon.0) 3220 : cluster 0 osdmap e669: 8 total, 8 up, 8 in 2024-02-13T15:00:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:37 smithi111 bash[23388]: audit 2024-02-13T15:00:36.391920+0000 mon.a (mon.0) 3221 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130"}]: dispatch 2024-02-13T15:00:38.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:38 smithi062 bash[21479]: cluster 2024-02-13T15:00:37.383279+0000 mon.a (mon.0) 3222 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:38.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:38 smithi062 bash[21479]: audit 2024-02-13T15:00:37.385569+0000 mon.a (mon.0) 3223 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130"}]': finished 2024-02-13T15:00:38.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:38 smithi062 bash[21479]: cluster 2024-02-13T15:00:37.393423+0000 mon.a (mon.0) 3224 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-02-13T15:00:38.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:38 smithi062 bash[21479]: cluster 2024-02-13T15:00:37.728266+0000 mon.a (mon.0) 3225 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:00:38.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:38 smithi062 bash[28859]: cluster 2024-02-13T15:00:37.383279+0000 mon.a (mon.0) 3222 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:38.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:38 smithi062 bash[28859]: audit 2024-02-13T15:00:37.385569+0000 mon.a (mon.0) 3223 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130"}]': finished 2024-02-13T15:00:38.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:38 smithi062 bash[28859]: cluster 2024-02-13T15:00:37.393423+0000 mon.a (mon.0) 3224 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-02-13T15:00:38.816 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:38 smithi062 bash[28859]: cluster 2024-02-13T15:00:37.728266+0000 mon.a (mon.0) 3225 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:00:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:38 smithi111 bash[23388]: cluster 2024-02-13T15:00:37.383279+0000 mon.a (mon.0) 3222 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:38 smithi111 bash[23388]: audit 2024-02-13T15:00:37.385569+0000 mon.a (mon.0) 3223 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-130"}]': finished 2024-02-13T15:00:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:38 smithi111 bash[23388]: cluster 2024-02-13T15:00:37.393423+0000 mon.a (mon.0) 3224 : cluster 0 osdmap e670: 8 total, 8 up, 8 in 2024-02-13T15:00:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:38 smithi111 bash[23388]: cluster 2024-02-13T15:00:37.728266+0000 mon.a (mon.0) 3225 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:00:39.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:39 smithi062 bash[28859]: cluster 2024-02-13T15:00:38.219764+0000 mgr.y (mgr.14613) 655 : cluster 0 pgmap v1087: 300 pgs: 300 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:39.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:39 smithi062 bash[28859]: cluster 2024-02-13T15:00:38.413163+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-02-13T15:00:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:39 smithi062 bash[21479]: cluster 2024-02-13T15:00:38.219764+0000 mgr.y (mgr.14613) 655 : cluster 0 pgmap v1087: 300 pgs: 300 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:39.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:39 smithi062 bash[21479]: cluster 2024-02-13T15:00:38.413163+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-02-13T15:00:39.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:39 smithi111 bash[23388]: cluster 2024-02-13T15:00:38.219764+0000 mgr.y (mgr.14613) 655 : cluster 0 pgmap v1087: 300 pgs: 300 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:39.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:39 smithi111 bash[23388]: cluster 2024-02-13T15:00:38.413163+0000 mon.a (mon.0) 3226 : cluster 0 osdmap e671: 8 total, 8 up, 8 in 2024-02-13T15:00:40.785 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:40 smithi111 bash[23388]: cluster 2024-02-13T15:00:39.420682+0000 mon.a (mon.0) 3227 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-02-13T15:00:40.786 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:40 smithi111 bash[23388]: audit 2024-02-13T15:00:39.427608+0000 mon.a (mon.0) 3228 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:40.786 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:40 smithi111 bash[23388]: audit 2024-02-13T15:00:40.414590+0000 mon.a (mon.0) 3229 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:40.786 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:40 smithi111 bash[23388]: cluster 2024-02-13T15:00:40.422263+0000 mon.a (mon.0) 3230 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-02-13T15:00:40.786 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:40 smithi111 bash[23388]: audit 2024-02-13T15:00:40.424904+0000 mon.a (mon.0) 3231 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[21479]: cluster 2024-02-13T15:00:39.420682+0000 mon.a (mon.0) 3227 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-02-13T15:00:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[21479]: audit 2024-02-13T15:00:39.427608+0000 mon.a (mon.0) 3228 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[21479]: audit 2024-02-13T15:00:40.414590+0000 mon.a (mon.0) 3229 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[21479]: cluster 2024-02-13T15:00:40.422263+0000 mon.a (mon.0) 3230 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-02-13T15:00:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[21479]: audit 2024-02-13T15:00:40.424904+0000 mon.a (mon.0) 3231 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[28859]: cluster 2024-02-13T15:00:39.420682+0000 mon.a (mon.0) 3227 : cluster 0 osdmap e672: 8 total, 8 up, 8 in 2024-02-13T15:00:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[28859]: audit 2024-02-13T15:00:39.427608+0000 mon.a (mon.0) 3228 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-132","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[28859]: audit 2024-02-13T15:00:40.414590+0000 mon.a (mon.0) 3229 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-132","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[28859]: cluster 2024-02-13T15:00:40.422263+0000 mon.a (mon.0) 3230 : cluster 0 osdmap e673: 8 total, 8 up, 8 in 2024-02-13T15:00:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:40 smithi062 bash[28859]: audit 2024-02-13T15:00:40.424904+0000 mon.a (mon.0) 3231 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:41.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:00:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:00:41.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:41 smithi062 bash[28859]: cluster 2024-02-13T15:00:40.222409+0000 mgr.y (mgr.14613) 656 : cluster 0 pgmap v1090: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:41.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:41 smithi062 bash[28859]: audit 2024-02-13T15:00:41.417547+0000 mon.a (mon.0) 3232 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:41.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:41 smithi062 bash[28859]: cluster 2024-02-13T15:00:41.427001+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-02-13T15:00:41.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:41 smithi062 bash[28859]: audit 2024-02-13T15:00:41.430026+0000 mon.a (mon.0) 3234 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:41.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:41 smithi062 bash[21479]: cluster 2024-02-13T15:00:40.222409+0000 mgr.y (mgr.14613) 656 : cluster 0 pgmap v1090: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:41.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:41 smithi062 bash[21479]: audit 2024-02-13T15:00:41.417547+0000 mon.a (mon.0) 3232 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:41.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:41 smithi062 bash[21479]: cluster 2024-02-13T15:00:41.427001+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-02-13T15:00:41.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:41 smithi062 bash[21479]: audit 2024-02-13T15:00:41.430026+0000 mon.a (mon.0) 3234 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:41.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:41 smithi111 bash[23388]: cluster 2024-02-13T15:00:40.222409+0000 mgr.y (mgr.14613) 656 : cluster 0 pgmap v1090: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:41 smithi111 bash[23388]: audit 2024-02-13T15:00:41.417547+0000 mon.a (mon.0) 3232 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:41 smithi111 bash[23388]: cluster 2024-02-13T15:00:41.427001+0000 mon.a (mon.0) 3233 : cluster 0 osdmap e674: 8 total, 8 up, 8 in 2024-02-13T15:00:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:41 smithi111 bash[23388]: audit 2024-02-13T15:00:41.430026+0000 mon.a (mon.0) 3234 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[21479]: audit 2024-02-13T15:00:40.784595+0000 mgr.y (mgr.14613) 657 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[21479]: cluster 2024-02-13T15:00:42.223363+0000 mgr.y (mgr.14613) 658 : cluster 0 pgmap v1093: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[21479]: audit 2024-02-13T15:00:42.357560+0000 mon.b (mon.1) 265 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[21479]: audit 2024-02-13T15:00:42.420178+0000 mon.a (mon.0) 3235 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[21479]: cluster 2024-02-13T15:00:42.425270+0000 mon.a (mon.0) 3236 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[21479]: audit 2024-02-13T15:00:42.430502+0000 mon.a (mon.0) 3237 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-132", "mode": "writeback"}]: dispatch 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[28859]: audit 2024-02-13T15:00:40.784595+0000 mgr.y (mgr.14613) 657 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[28859]: cluster 2024-02-13T15:00:42.223363+0000 mgr.y (mgr.14613) 658 : cluster 0 pgmap v1093: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[28859]: audit 2024-02-13T15:00:42.357560+0000 mon.b (mon.1) 265 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:00:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[28859]: audit 2024-02-13T15:00:42.420178+0000 mon.a (mon.0) 3235 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:42.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[28859]: cluster 2024-02-13T15:00:42.425270+0000 mon.a (mon.0) 3236 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-02-13T15:00:42.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:42 smithi062 bash[28859]: audit 2024-02-13T15:00:42.430502+0000 mon.a (mon.0) 3237 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-132", "mode": "writeback"}]: dispatch 2024-02-13T15:00:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:42 smithi111 bash[23388]: audit 2024-02-13T15:00:40.784595+0000 mgr.y (mgr.14613) 657 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:42 smithi111 bash[23388]: cluster 2024-02-13T15:00:42.223363+0000 mgr.y (mgr.14613) 658 : cluster 0 pgmap v1093: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 1 op/s 2024-02-13T15:00:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:42 smithi111 bash[23388]: audit 2024-02-13T15:00:42.357560+0000 mon.b (mon.1) 265 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:00:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:42 smithi111 bash[23388]: audit 2024-02-13T15:00:42.420178+0000 mon.a (mon.0) 3235 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:42 smithi111 bash[23388]: cluster 2024-02-13T15:00:42.425270+0000 mon.a (mon.0) 3236 : cluster 0 osdmap e675: 8 total, 8 up, 8 in 2024-02-13T15:00:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:42 smithi111 bash[23388]: audit 2024-02-13T15:00:42.430502+0000 mon.a (mon.0) 3237 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-132", "mode": "writeback"}]: dispatch 2024-02-13T15:00:43.594 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:00:43 smithi111 bash[50603]: logger=sqlstore.transactions t=2024-02-13T15:00:43.277775846Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-02-13T15:00:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:43 smithi111 bash[23388]: audit 2024-02-13T15:00:43.142402+0000 mon.b (mon.1) 266 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:00:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:43 smithi111 bash[23388]: audit 2024-02-13T15:00:43.144712+0000 mon.b (mon.1) 267 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:00:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:43 smithi111 bash[23388]: audit 2024-02-13T15:00:43.154159+0000 mon.a (mon.0) 3238 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:43 smithi111 bash[23388]: cluster 2024-02-13T15:00:43.420511+0000 mon.a (mon.0) 3239 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:43 smithi111 bash[23388]: audit 2024-02-13T15:00:43.423004+0000 mon.a (mon.0) 3240 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-132", "mode": "writeback"}]': finished 2024-02-13T15:00:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:43 smithi111 bash[23388]: cluster 2024-02-13T15:00:43.430228+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-02-13T15:00:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[21479]: audit 2024-02-13T15:00:43.142402+0000 mon.b (mon.1) 266 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:00:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[21479]: audit 2024-02-13T15:00:43.144712+0000 mon.b (mon.1) 267 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:00:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[21479]: audit 2024-02-13T15:00:43.154159+0000 mon.a (mon.0) 3238 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[21479]: cluster 2024-02-13T15:00:43.420511+0000 mon.a (mon.0) 3239 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[21479]: audit 2024-02-13T15:00:43.423004+0000 mon.a (mon.0) 3240 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-132", "mode": "writeback"}]': finished 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[21479]: cluster 2024-02-13T15:00:43.430228+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[28859]: audit 2024-02-13T15:00:43.142402+0000 mon.b (mon.1) 266 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[28859]: audit 2024-02-13T15:00:43.144712+0000 mon.b (mon.1) 267 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[28859]: audit 2024-02-13T15:00:43.154159+0000 mon.a (mon.0) 3238 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[28859]: cluster 2024-02-13T15:00:43.420511+0000 mon.a (mon.0) 3239 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[28859]: audit 2024-02-13T15:00:43.423004+0000 mon.a (mon.0) 3240 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-132", "mode": "writeback"}]': finished 2024-02-13T15:00:43.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:43 smithi062 bash[28859]: cluster 2024-02-13T15:00:43.430228+0000 mon.a (mon.0) 3241 : cluster 0 osdmap e676: 8 total, 8 up, 8 in 2024-02-13T15:00:45.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:45 smithi062 bash[28859]: cluster 2024-02-13T15:00:44.224272+0000 mgr.y (mgr.14613) 659 : cluster 0 pgmap v1096: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:45.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:45 smithi062 bash[28859]: cluster 2024-02-13T15:00:44.433243+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-02-13T15:00:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:45 smithi062 bash[21479]: cluster 2024-02-13T15:00:44.224272+0000 mgr.y (mgr.14613) 659 : cluster 0 pgmap v1096: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:45 smithi062 bash[21479]: cluster 2024-02-13T15:00:44.433243+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-02-13T15:00:45.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:45 smithi111 bash[23388]: cluster 2024-02-13T15:00:44.224272+0000 mgr.y (mgr.14613) 659 : cluster 0 pgmap v1096: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 656 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:45 smithi111 bash[23388]: cluster 2024-02-13T15:00:44.433243+0000 mon.a (mon.0) 3242 : cluster 0 osdmap e677: 8 total, 8 up, 8 in 2024-02-13T15:00:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:46 smithi062 bash[28859]: cluster 2024-02-13T15:00:45.445075+0000 mon.a (mon.0) 3243 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-02-13T15:00:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:46 smithi062 bash[28859]: audit 2024-02-13T15:00:45.555187+0000 mon.a (mon.0) 3244 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:46.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:00:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:00:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:00:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:46 smithi062 bash[21479]: cluster 2024-02-13T15:00:45.445075+0000 mon.a (mon.0) 3243 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-02-13T15:00:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:46 smithi062 bash[21479]: audit 2024-02-13T15:00:45.555187+0000 mon.a (mon.0) 3244 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:46.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:46 smithi111 bash[23388]: cluster 2024-02-13T15:00:45.445075+0000 mon.a (mon.0) 3243 : cluster 0 osdmap e678: 8 total, 8 up, 8 in 2024-02-13T15:00:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:46 smithi111 bash[23388]: audit 2024-02-13T15:00:45.555187+0000 mon.a (mon.0) 3244 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:47 smithi062 bash[28859]: cluster 2024-02-13T15:00:46.225184+0000 mgr.y (mgr.14613) 660 : cluster 0 pgmap v1099: 300 pgs: 300 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:00:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:47 smithi062 bash[28859]: audit 2024-02-13T15:00:46.446322+0000 mon.a (mon.0) 3245 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:47 smithi062 bash[28859]: cluster 2024-02-13T15:00:46.456170+0000 mon.a (mon.0) 3246 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-02-13T15:00:47.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:47 smithi062 bash[28859]: audit 2024-02-13T15:00:46.488018+0000 mon.a (mon.0) 3247 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:47.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:47 smithi062 bash[21479]: cluster 2024-02-13T15:00:46.225184+0000 mgr.y (mgr.14613) 660 : cluster 0 pgmap v1099: 300 pgs: 300 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:00:47.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:47 smithi062 bash[21479]: audit 2024-02-13T15:00:46.446322+0000 mon.a (mon.0) 3245 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:47.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:47 smithi062 bash[21479]: cluster 2024-02-13T15:00:46.456170+0000 mon.a (mon.0) 3246 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-02-13T15:00:47.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:47 smithi062 bash[21479]: audit 2024-02-13T15:00:46.488018+0000 mon.a (mon.0) 3247 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:47 smithi111 bash[23388]: cluster 2024-02-13T15:00:46.225184+0000 mgr.y (mgr.14613) 660 : cluster 0 pgmap v1099: 300 pgs: 300 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:00:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:47 smithi111 bash[23388]: audit 2024-02-13T15:00:46.446322+0000 mon.a (mon.0) 3245 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:47 smithi111 bash[23388]: cluster 2024-02-13T15:00:46.456170+0000 mon.a (mon.0) 3246 : cluster 0 osdmap e679: 8 total, 8 up, 8 in 2024-02-13T15:00:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:47 smithi111 bash[23388]: audit 2024-02-13T15:00:46.488018+0000 mon.a (mon.0) 3247 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:48 smithi062 bash[28859]: audit 2024-02-13T15:00:47.449037+0000 mon.a (mon.0) 3248 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:48 smithi062 bash[28859]: cluster 2024-02-13T15:00:47.458454+0000 mon.a (mon.0) 3249 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-02-13T15:00:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:48 smithi062 bash[21479]: audit 2024-02-13T15:00:47.449037+0000 mon.a (mon.0) 3248 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:48.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:48 smithi062 bash[21479]: cluster 2024-02-13T15:00:47.458454+0000 mon.a (mon.0) 3249 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-02-13T15:00:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:48 smithi111 bash[23388]: audit 2024-02-13T15:00:47.449037+0000 mon.a (mon.0) 3248 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:48 smithi111 bash[23388]: cluster 2024-02-13T15:00:47.458454+0000 mon.a (mon.0) 3249 : cluster 0 osdmap e680: 8 total, 8 up, 8 in 2024-02-13T15:00:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[21479]: cluster 2024-02-13T15:00:48.226227+0000 mgr.y (mgr.14613) 661 : cluster 0 pgmap v1102: 300 pgs: 300 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:00:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[21479]: cluster 2024-02-13T15:00:48.463360+0000 mon.a (mon.0) 3250 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-02-13T15:00:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[21479]: audit 2024-02-13T15:00:48.548114+0000 mon.a (mon.0) 3251 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[21479]: audit 2024-02-13T15:00:49.389624+0000 mon.a (mon.0) 3252 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[21479]: audit 2024-02-13T15:00:49.394180+0000 mon.b (mon.1) 268 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:49.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[28859]: cluster 2024-02-13T15:00:48.226227+0000 mgr.y (mgr.14613) 661 : cluster 0 pgmap v1102: 300 pgs: 300 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:00:49.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[28859]: cluster 2024-02-13T15:00:48.463360+0000 mon.a (mon.0) 3250 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-02-13T15:00:49.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[28859]: audit 2024-02-13T15:00:48.548114+0000 mon.a (mon.0) 3251 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:49.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[28859]: audit 2024-02-13T15:00:49.389624+0000 mon.a (mon.0) 3252 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:49.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:49 smithi062 bash[28859]: audit 2024-02-13T15:00:49.394180+0000 mon.b (mon.1) 268 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:49.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:49 smithi111 bash[23388]: cluster 2024-02-13T15:00:48.226227+0000 mgr.y (mgr.14613) 661 : cluster 0 pgmap v1102: 300 pgs: 300 active+clean; 582 KiB data, 661 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:00:49.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:49 smithi111 bash[23388]: cluster 2024-02-13T15:00:48.463360+0000 mon.a (mon.0) 3250 : cluster 0 osdmap e681: 8 total, 8 up, 8 in 2024-02-13T15:00:49.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:49 smithi111 bash[23388]: audit 2024-02-13T15:00:48.548114+0000 mon.a (mon.0) 3251 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:49.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:49 smithi111 bash[23388]: audit 2024-02-13T15:00:49.389624+0000 mon.a (mon.0) 3252 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:00:49.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:49 smithi111 bash[23388]: audit 2024-02-13T15:00:49.394180+0000 mon.b (mon.1) 268 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:00:50.788 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:50 smithi111 bash[23388]: audit 2024-02-13T15:00:49.487760+0000 mon.a (mon.0) 3253 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:50.788 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:50 smithi111 bash[23388]: cluster 2024-02-13T15:00:49.496520+0000 mon.a (mon.0) 3254 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-02-13T15:00:50.789 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:50 smithi111 bash[23388]: audit 2024-02-13T15:00:49.499334+0000 mon.a (mon.0) 3255 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:50.789 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:50 smithi111 bash[23388]: cluster 2024-02-13T15:00:50.229064+0000 mgr.y (mgr.14613) 662 : cluster 0 pgmap v1105: 300 pgs: 300 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T15:00:50.789 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:50 smithi111 bash[23388]: cluster 2024-02-13T15:00:50.488164+0000 mon.a (mon.0) 3256 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:50.789 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:50 smithi111 bash[23388]: audit 2024-02-13T15:00:50.490426+0000 mon.a (mon.0) 3257 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:50.789 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:50 smithi111 bash[23388]: cluster 2024-02-13T15:00:50.498234+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-02-13T15:00:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[28859]: audit 2024-02-13T15:00:49.487760+0000 mon.a (mon.0) 3253 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[28859]: cluster 2024-02-13T15:00:49.496520+0000 mon.a (mon.0) 3254 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-02-13T15:00:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[28859]: audit 2024-02-13T15:00:49.499334+0000 mon.a (mon.0) 3255 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[28859]: cluster 2024-02-13T15:00:50.229064+0000 mgr.y (mgr.14613) 662 : cluster 0 pgmap v1105: 300 pgs: 300 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[28859]: cluster 2024-02-13T15:00:50.488164+0000 mon.a (mon.0) 3256 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[28859]: audit 2024-02-13T15:00:50.490426+0000 mon.a (mon.0) 3257 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[28859]: cluster 2024-02-13T15:00:50.498234+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[21479]: audit 2024-02-13T15:00:49.487760+0000 mon.a (mon.0) 3253 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[21479]: cluster 2024-02-13T15:00:49.496520+0000 mon.a (mon.0) 3254 : cluster 0 osdmap e682: 8 total, 8 up, 8 in 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[21479]: audit 2024-02-13T15:00:49.499334+0000 mon.a (mon.0) 3255 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132"}]: dispatch 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[21479]: cluster 2024-02-13T15:00:50.229064+0000 mgr.y (mgr.14613) 662 : cluster 0 pgmap v1105: 300 pgs: 300 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 1023 B/s wr, 3 op/s 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[21479]: cluster 2024-02-13T15:00:50.488164+0000 mon.a (mon.0) 3256 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[21479]: audit 2024-02-13T15:00:50.490426+0000 mon.a (mon.0) 3257 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-132"}]': finished 2024-02-13T15:00:50.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:50 smithi062 bash[21479]: cluster 2024-02-13T15:00:50.498234+0000 mon.a (mon.0) 3258 : cluster 0 osdmap e683: 8 total, 8 up, 8 in 2024-02-13T15:00:51.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:00:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:00:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:51 smithi062 bash[28859]: audit 2024-02-13T15:00:50.787254+0000 mgr.y (mgr.14613) 663 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:51 smithi062 bash[21479]: audit 2024-02-13T15:00:50.787254+0000 mgr.y (mgr.14613) 663 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:51.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:51 smithi111 bash[23388]: audit 2024-02-13T15:00:50.787254+0000 mgr.y (mgr.14613) 663 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:00:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:52 smithi062 bash[21479]: cluster 2024-02-13T15:00:51.533653+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-02-13T15:00:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:52 smithi062 bash[21479]: cluster 2024-02-13T15:00:52.229968+0000 mgr.y (mgr.14613) 664 : cluster 0 pgmap v1108: 268 pgs: 268 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:00:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:52 smithi062 bash[28859]: cluster 2024-02-13T15:00:51.533653+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-02-13T15:00:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:52 smithi062 bash[28859]: cluster 2024-02-13T15:00:52.229968+0000 mgr.y (mgr.14613) 664 : cluster 0 pgmap v1108: 268 pgs: 268 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:00:52.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:52 smithi111 bash[23388]: cluster 2024-02-13T15:00:51.533653+0000 mon.a (mon.0) 3259 : cluster 0 osdmap e684: 8 total, 8 up, 8 in 2024-02-13T15:00:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:52 smithi111 bash[23388]: cluster 2024-02-13T15:00:52.229968+0000 mgr.y (mgr.14613) 664 : cluster 0 pgmap v1108: 268 pgs: 268 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:00:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[21479]: cluster 2024-02-13T15:00:52.553676+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-02-13T15:00:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[21479]: audit 2024-02-13T15:00:52.559851+0000 mon.a (mon.0) 3261 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[21479]: audit 2024-02-13T15:00:52.736971+0000 mon.a (mon.0) 3262 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:53.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[21479]: cluster 2024-02-13T15:00:52.744412+0000 mon.a (mon.0) 3263 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-02-13T15:00:53.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[21479]: audit 2024-02-13T15:00:52.748798+0000 mon.a (mon.0) 3264 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:53.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[28859]: cluster 2024-02-13T15:00:52.553676+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-02-13T15:00:53.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[28859]: audit 2024-02-13T15:00:52.559851+0000 mon.a (mon.0) 3261 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:53.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[28859]: audit 2024-02-13T15:00:52.736971+0000 mon.a (mon.0) 3262 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:53.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[28859]: cluster 2024-02-13T15:00:52.744412+0000 mon.a (mon.0) 3263 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-02-13T15:00:53.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:53 smithi062 bash[28859]: audit 2024-02-13T15:00:52.748798+0000 mon.a (mon.0) 3264 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:53 smithi111 bash[23388]: cluster 2024-02-13T15:00:52.553676+0000 mon.a (mon.0) 3260 : cluster 0 osdmap e685: 8 total, 8 up, 8 in 2024-02-13T15:00:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:53 smithi111 bash[23388]: audit 2024-02-13T15:00:52.559851+0000 mon.a (mon.0) 3261 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-134","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:00:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:53 smithi111 bash[23388]: audit 2024-02-13T15:00:52.736971+0000 mon.a (mon.0) 3262 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-134","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:00:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:53 smithi111 bash[23388]: cluster 2024-02-13T15:00:52.744412+0000 mon.a (mon.0) 3263 : cluster 0 osdmap e686: 8 total, 8 up, 8 in 2024-02-13T15:00:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:53 smithi111 bash[23388]: audit 2024-02-13T15:00:52.748798+0000 mon.a (mon.0) 3264 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:00:55.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:54 smithi062 bash[28859]: audit 2024-02-13T15:00:53.739989+0000 mon.a (mon.0) 3265 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:55.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:54 smithi062 bash[28859]: cluster 2024-02-13T15:00:53.747243+0000 mon.a (mon.0) 3266 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-02-13T15:00:55.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:54 smithi062 bash[28859]: audit 2024-02-13T15:00:53.748713+0000 mon.a (mon.0) 3267 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-134"}]: dispatch 2024-02-13T15:00:55.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:54 smithi062 bash[28859]: cluster 2024-02-13T15:00:54.230910+0000 mgr.y (mgr.14613) 665 : cluster 0 pgmap v1112: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:55.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:54 smithi062 bash[21479]: audit 2024-02-13T15:00:53.739989+0000 mon.a (mon.0) 3265 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:55.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:54 smithi062 bash[21479]: cluster 2024-02-13T15:00:53.747243+0000 mon.a (mon.0) 3266 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-02-13T15:00:55.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:54 smithi062 bash[21479]: audit 2024-02-13T15:00:53.748713+0000 mon.a (mon.0) 3267 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-134"}]: dispatch 2024-02-13T15:00:55.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:54 smithi062 bash[21479]: cluster 2024-02-13T15:00:54.230910+0000 mgr.y (mgr.14613) 665 : cluster 0 pgmap v1112: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:55.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:54 smithi111 bash[23388]: audit 2024-02-13T15:00:53.739989+0000 mon.a (mon.0) 3265 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:00:55.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:54 smithi111 bash[23388]: cluster 2024-02-13T15:00:53.747243+0000 mon.a (mon.0) 3266 : cluster 0 osdmap e687: 8 total, 8 up, 8 in 2024-02-13T15:00:55.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:54 smithi111 bash[23388]: audit 2024-02-13T15:00:53.748713+0000 mon.a (mon.0) 3267 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-134"}]: dispatch 2024-02-13T15:00:55.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:54 smithi111 bash[23388]: cluster 2024-02-13T15:00:54.230910+0000 mgr.y (mgr.14613) 665 : cluster 0 pgmap v1112: 300 pgs: 32 unknown, 268 active+clean; 582 KiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:00:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:55 smithi062 bash[28859]: audit 2024-02-13T15:00:54.751080+0000 mon.a (mon.0) 3268 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-134"}]': finished 2024-02-13T15:00:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:55 smithi062 bash[28859]: cluster 2024-02-13T15:00:54.760657+0000 mon.a (mon.0) 3269 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-02-13T15:00:56.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:55 smithi062 bash[28859]: audit 2024-02-13T15:00:54.763121+0000 mon.a (mon.0) 3270 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-134", "mode": "writeback"}]: dispatch 2024-02-13T15:00:56.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:55 smithi062 bash[21479]: audit 2024-02-13T15:00:54.751080+0000 mon.a (mon.0) 3268 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-134"}]': finished 2024-02-13T15:00:56.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:55 smithi062 bash[21479]: cluster 2024-02-13T15:00:54.760657+0000 mon.a (mon.0) 3269 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-02-13T15:00:56.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:55 smithi062 bash[21479]: audit 2024-02-13T15:00:54.763121+0000 mon.a (mon.0) 3270 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-134", "mode": "writeback"}]: dispatch 2024-02-13T15:00:56.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:55 smithi111 bash[23388]: audit 2024-02-13T15:00:54.751080+0000 mon.a (mon.0) 3268 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-134"}]': finished 2024-02-13T15:00:56.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:55 smithi111 bash[23388]: cluster 2024-02-13T15:00:54.760657+0000 mon.a (mon.0) 3269 : cluster 0 osdmap e688: 8 total, 8 up, 8 in 2024-02-13T15:00:56.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:55 smithi111 bash[23388]: audit 2024-02-13T15:00:54.763121+0000 mon.a (mon.0) 3270 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-134", "mode": "writeback"}]: dispatch 2024-02-13T15:00:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:00:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:00:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[28859]: cluster 2024-02-13T15:00:55.752013+0000 mon.a (mon.0) 3271 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[28859]: audit 2024-02-13T15:00:55.764372+0000 mon.a (mon.0) 3272 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-134", "mode": "writeback"}]': finished 2024-02-13T15:00:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[28859]: cluster 2024-02-13T15:00:55.770132+0000 mon.a (mon.0) 3273 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-02-13T15:00:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[28859]: audit 2024-02-13T15:00:55.881649+0000 mon.a (mon.0) 3274 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:57.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[28859]: cluster 2024-02-13T15:00:56.231796+0000 mgr.y (mgr.14613) 666 : cluster 0 pgmap v1115: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T15:00:57.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[21479]: cluster 2024-02-13T15:00:55.752013+0000 mon.a (mon.0) 3271 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:57.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[21479]: audit 2024-02-13T15:00:55.764372+0000 mon.a (mon.0) 3272 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-134", "mode": "writeback"}]': finished 2024-02-13T15:00:57.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[21479]: cluster 2024-02-13T15:00:55.770132+0000 mon.a (mon.0) 3273 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-02-13T15:00:57.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[21479]: audit 2024-02-13T15:00:55.881649+0000 mon.a (mon.0) 3274 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:57.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:56 smithi062 bash[21479]: cluster 2024-02-13T15:00:56.231796+0000 mgr.y (mgr.14613) 666 : cluster 0 pgmap v1115: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T15:00:57.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:56 smithi111 bash[23388]: cluster 2024-02-13T15:00:55.752013+0000 mon.a (mon.0) 3271 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:00:57.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:56 smithi111 bash[23388]: audit 2024-02-13T15:00:55.764372+0000 mon.a (mon.0) 3272 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-134", "mode": "writeback"}]': finished 2024-02-13T15:00:57.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:56 smithi111 bash[23388]: cluster 2024-02-13T15:00:55.770132+0000 mon.a (mon.0) 3273 : cluster 0 osdmap e689: 8 total, 8 up, 8 in 2024-02-13T15:00:57.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:56 smithi111 bash[23388]: audit 2024-02-13T15:00:55.881649+0000 mon.a (mon.0) 3274 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:00:57.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:56 smithi111 bash[23388]: cluster 2024-02-13T15:00:56.231796+0000 mgr.y (mgr.14613) 666 : cluster 0 pgmap v1115: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T15:00:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:57 smithi062 bash[21479]: audit 2024-02-13T15:00:56.776266+0000 mon.a (mon.0) 3275 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:57 smithi062 bash[21479]: cluster 2024-02-13T15:00:56.781913+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-02-13T15:00:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:57 smithi062 bash[21479]: audit 2024-02-13T15:00:56.784857+0000 mon.a (mon.0) 3277 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134"}]: dispatch 2024-02-13T15:00:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:57 smithi062 bash[28859]: audit 2024-02-13T15:00:56.776266+0000 mon.a (mon.0) 3275 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:57 smithi062 bash[28859]: cluster 2024-02-13T15:00:56.781913+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-02-13T15:00:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:57 smithi062 bash[28859]: audit 2024-02-13T15:00:56.784857+0000 mon.a (mon.0) 3277 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134"}]: dispatch 2024-02-13T15:00:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:57 smithi111 bash[23388]: audit 2024-02-13T15:00:56.776266+0000 mon.a (mon.0) 3275 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:00:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:57 smithi111 bash[23388]: cluster 2024-02-13T15:00:56.781913+0000 mon.a (mon.0) 3276 : cluster 0 osdmap e690: 8 total, 8 up, 8 in 2024-02-13T15:00:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:57 smithi111 bash[23388]: audit 2024-02-13T15:00:56.784857+0000 mon.a (mon.0) 3277 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134"}]: dispatch 2024-02-13T15:00:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:58 smithi062 bash[28859]: cluster 2024-02-13T15:00:57.776599+0000 mon.a (mon.0) 3278 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:58 smithi062 bash[28859]: audit 2024-02-13T15:00:57.781102+0000 mon.a (mon.0) 3279 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134"}]': finished 2024-02-13T15:00:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:58 smithi062 bash[28859]: cluster 2024-02-13T15:00:57.788166+0000 mon.a (mon.0) 3280 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-02-13T15:00:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:58 smithi062 bash[28859]: cluster 2024-02-13T15:00:58.232733+0000 mgr.y (mgr.14613) 667 : cluster 0 pgmap v1118: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:59.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:58 smithi062 bash[21479]: cluster 2024-02-13T15:00:57.776599+0000 mon.a (mon.0) 3278 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:59.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:58 smithi062 bash[21479]: audit 2024-02-13T15:00:57.781102+0000 mon.a (mon.0) 3279 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134"}]': finished 2024-02-13T15:00:59.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:58 smithi062 bash[21479]: cluster 2024-02-13T15:00:57.788166+0000 mon.a (mon.0) 3280 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-02-13T15:00:59.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:58 smithi062 bash[21479]: cluster 2024-02-13T15:00:58.232733+0000 mgr.y (mgr.14613) 667 : cluster 0 pgmap v1118: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:00:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:58 smithi111 bash[23388]: cluster 2024-02-13T15:00:57.776599+0000 mon.a (mon.0) 3278 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:00:59.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:58 smithi111 bash[23388]: audit 2024-02-13T15:00:57.781102+0000 mon.a (mon.0) 3279 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-134"}]': finished 2024-02-13T15:00:59.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:58 smithi111 bash[23388]: cluster 2024-02-13T15:00:57.788166+0000 mon.a (mon.0) 3280 : cluster 0 osdmap e691: 8 total, 8 up, 8 in 2024-02-13T15:00:59.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:58 smithi111 bash[23388]: cluster 2024-02-13T15:00:58.232733+0000 mgr.y (mgr.14613) 667 : cluster 0 pgmap v1118: 300 pgs: 300 active+clean; 582 KiB data, 646 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:00.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:59 smithi062 bash[21479]: cluster 2024-02-13T15:00:58.794017+0000 mon.a (mon.0) 3281 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:00.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:00:59 smithi062 bash[21479]: cluster 2024-02-13T15:00:58.816630+0000 mon.a (mon.0) 3282 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-02-13T15:01:00.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:59 smithi062 bash[28859]: cluster 2024-02-13T15:00:58.794017+0000 mon.a (mon.0) 3281 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:00.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:00:59 smithi062 bash[28859]: cluster 2024-02-13T15:00:58.816630+0000 mon.a (mon.0) 3282 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-02-13T15:01:00.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:59 smithi111 bash[23388]: cluster 2024-02-13T15:00:58.794017+0000 mon.a (mon.0) 3281 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:00.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:00:59 smithi111 bash[23388]: cluster 2024-02-13T15:00:58.816630+0000 mon.a (mon.0) 3282 : cluster 0 osdmap e692: 8 total, 8 up, 8 in 2024-02-13T15:01:01.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:01:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:01:01.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:00 smithi111 bash[23388]: cluster 2024-02-13T15:00:59.826391+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-02-13T15:01:01.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:00 smithi111 bash[23388]: audit 2024-02-13T15:00:59.837162+0000 mon.a (mon.0) 3284 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:01.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:00 smithi111 bash[23388]: cluster 2024-02-13T15:01:00.235457+0000 mgr.y (mgr.14613) 668 : cluster 0 pgmap v1121: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T15:01:01.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:00 smithi062 bash[21479]: cluster 2024-02-13T15:00:59.826391+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-02-13T15:01:01.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:00 smithi062 bash[21479]: audit 2024-02-13T15:00:59.837162+0000 mon.a (mon.0) 3284 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:01.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:00 smithi062 bash[21479]: cluster 2024-02-13T15:01:00.235457+0000 mgr.y (mgr.14613) 668 : cluster 0 pgmap v1121: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T15:01:01.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:00 smithi062 bash[28859]: cluster 2024-02-13T15:00:59.826391+0000 mon.a (mon.0) 3283 : cluster 0 osdmap e693: 8 total, 8 up, 8 in 2024-02-13T15:01:01.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:00 smithi062 bash[28859]: audit 2024-02-13T15:00:59.837162+0000 mon.a (mon.0) 3284 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-136","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:01.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:00 smithi062 bash[28859]: cluster 2024-02-13T15:01:00.235457+0000 mgr.y (mgr.14613) 668 : cluster 0 pgmap v1121: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T15:01:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:01 smithi062 bash[28859]: audit 2024-02-13T15:01:00.797455+0000 mgr.y (mgr.14613) 669 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:01 smithi062 bash[28859]: audit 2024-02-13T15:01:00.827478+0000 mon.a (mon.0) 3285 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:01 smithi062 bash[28859]: cluster 2024-02-13T15:01:00.842061+0000 mon.a (mon.0) 3286 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-02-13T15:01:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:01 smithi062 bash[28859]: audit 2024-02-13T15:01:00.846694+0000 mon.a (mon.0) 3287 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:01 smithi062 bash[21479]: audit 2024-02-13T15:01:00.797455+0000 mgr.y (mgr.14613) 669 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:02.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:01 smithi062 bash[21479]: audit 2024-02-13T15:01:00.827478+0000 mon.a (mon.0) 3285 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:02.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:01 smithi062 bash[21479]: cluster 2024-02-13T15:01:00.842061+0000 mon.a (mon.0) 3286 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-02-13T15:01:02.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:01 smithi062 bash[21479]: audit 2024-02-13T15:01:00.846694+0000 mon.a (mon.0) 3287 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:01 smithi111 bash[23388]: audit 2024-02-13T15:01:00.797455+0000 mgr.y (mgr.14613) 669 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:01 smithi111 bash[23388]: audit 2024-02-13T15:01:00.827478+0000 mon.a (mon.0) 3285 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-136","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:01 smithi111 bash[23388]: cluster 2024-02-13T15:01:00.842061+0000 mon.a (mon.0) 3286 : cluster 0 osdmap e694: 8 total, 8 up, 8 in 2024-02-13T15:01:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:01 smithi111 bash[23388]: audit 2024-02-13T15:01:00.846694+0000 mon.a (mon.0) 3287 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:03.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[21479]: audit 2024-02-13T15:01:01.830202+0000 mon.a (mon.0) 3288 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:03.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[21479]: cluster 2024-02-13T15:01:01.838879+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[21479]: audit 2024-02-13T15:01:01.841558+0000 mon.a (mon.0) 3290 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-136"}]: dispatch 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[21479]: cluster 2024-02-13T15:01:02.236366+0000 mgr.y (mgr.14613) 670 : cluster 0 pgmap v1124: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[21479]: audit 2024-02-13T15:01:02.832918+0000 mon.a (mon.0) 3291 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-136"}]': finished 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[21479]: cluster 2024-02-13T15:01:02.840153+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[21479]: audit 2024-02-13T15:01:02.841787+0000 mon.a (mon.0) 3293 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-136", "mode": "writeback"}]: dispatch 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[28859]: audit 2024-02-13T15:01:01.830202+0000 mon.a (mon.0) 3288 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[28859]: cluster 2024-02-13T15:01:01.838879+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[28859]: audit 2024-02-13T15:01:01.841558+0000 mon.a (mon.0) 3290 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-136"}]: dispatch 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[28859]: cluster 2024-02-13T15:01:02.236366+0000 mgr.y (mgr.14613) 670 : cluster 0 pgmap v1124: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[28859]: audit 2024-02-13T15:01:02.832918+0000 mon.a (mon.0) 3291 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-136"}]': finished 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[28859]: cluster 2024-02-13T15:01:02.840153+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-02-13T15:01:03.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:02 smithi062 bash[28859]: audit 2024-02-13T15:01:02.841787+0000 mon.a (mon.0) 3293 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-136", "mode": "writeback"}]: dispatch 2024-02-13T15:01:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:02 smithi111 bash[23388]: audit 2024-02-13T15:01:01.830202+0000 mon.a (mon.0) 3288 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:02 smithi111 bash[23388]: cluster 2024-02-13T15:01:01.838879+0000 mon.a (mon.0) 3289 : cluster 0 osdmap e695: 8 total, 8 up, 8 in 2024-02-13T15:01:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:02 smithi111 bash[23388]: audit 2024-02-13T15:01:01.841558+0000 mon.a (mon.0) 3290 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-136"}]: dispatch 2024-02-13T15:01:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:02 smithi111 bash[23388]: cluster 2024-02-13T15:01:02.236366+0000 mgr.y (mgr.14613) 670 : cluster 0 pgmap v1124: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-02-13T15:01:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:02 smithi111 bash[23388]: audit 2024-02-13T15:01:02.832918+0000 mon.a (mon.0) 3291 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-136"}]': finished 2024-02-13T15:01:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:02 smithi111 bash[23388]: cluster 2024-02-13T15:01:02.840153+0000 mon.a (mon.0) 3292 : cluster 0 osdmap e696: 8 total, 8 up, 8 in 2024-02-13T15:01:03.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:02 smithi111 bash[23388]: audit 2024-02-13T15:01:02.841787+0000 mon.a (mon.0) 3293 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-136", "mode": "writeback"}]: dispatch 2024-02-13T15:01:04.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:03 smithi062 bash[28859]: cluster 2024-02-13T15:01:03.833337+0000 mon.a (mon.0) 3294 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:04.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:03 smithi062 bash[28859]: audit 2024-02-13T15:01:03.835896+0000 mon.a (mon.0) 3295 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-136", "mode": "writeback"}]': finished 2024-02-13T15:01:04.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:03 smithi062 bash[28859]: cluster 2024-02-13T15:01:03.844063+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-02-13T15:01:04.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:03 smithi062 bash[21479]: cluster 2024-02-13T15:01:03.833337+0000 mon.a (mon.0) 3294 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:04.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:03 smithi062 bash[21479]: audit 2024-02-13T15:01:03.835896+0000 mon.a (mon.0) 3295 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-136", "mode": "writeback"}]': finished 2024-02-13T15:01:04.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:03 smithi062 bash[21479]: cluster 2024-02-13T15:01:03.844063+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-02-13T15:01:04.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:03 smithi111 bash[23388]: cluster 2024-02-13T15:01:03.833337+0000 mon.a (mon.0) 3294 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:04.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:03 smithi111 bash[23388]: audit 2024-02-13T15:01:03.835896+0000 mon.a (mon.0) 3295 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-136", "mode": "writeback"}]': finished 2024-02-13T15:01:04.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:03 smithi111 bash[23388]: cluster 2024-02-13T15:01:03.844063+0000 mon.a (mon.0) 3296 : cluster 0 osdmap e697: 8 total, 8 up, 8 in 2024-02-13T15:01:05.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:04 smithi062 bash[28859]: audit 2024-02-13T15:01:03.971969+0000 mon.a (mon.0) 3297 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:05.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:04 smithi062 bash[28859]: cluster 2024-02-13T15:01:04.237306+0000 mgr.y (mgr.14613) 671 : cluster 0 pgmap v1127: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:05.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:04 smithi062 bash[28859]: audit 2024-02-13T15:01:04.431441+0000 mon.b (mon.1) 269 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:05.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:04 smithi062 bash[21479]: audit 2024-02-13T15:01:03.971969+0000 mon.a (mon.0) 3297 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:04 smithi062 bash[21479]: cluster 2024-02-13T15:01:04.237306+0000 mgr.y (mgr.14613) 671 : cluster 0 pgmap v1127: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:05.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:04 smithi062 bash[21479]: audit 2024-02-13T15:01:04.431441+0000 mon.b (mon.1) 269 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:05.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:04 smithi111 bash[23388]: audit 2024-02-13T15:01:03.971969+0000 mon.a (mon.0) 3297 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:04 smithi111 bash[23388]: cluster 2024-02-13T15:01:04.237306+0000 mgr.y (mgr.14613) 671 : cluster 0 pgmap v1127: 300 pgs: 32 creating+peering, 268 active+clean; 582 KiB data, 647 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:05.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:04 smithi111 bash[23388]: audit 2024-02-13T15:01:04.431441+0000 mon.b (mon.1) 269 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:05 smithi062 bash[21479]: audit 2024-02-13T15:01:04.876663+0000 mon.a (mon.0) 3298 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:01:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:05 smithi062 bash[21479]: cluster 2024-02-13T15:01:04.883455+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-02-13T15:01:06.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:05 smithi062 bash[21479]: audit 2024-02-13T15:01:04.884874+0000 mon.a (mon.0) 3300 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136"}]: dispatch 2024-02-13T15:01:06.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:05 smithi062 bash[28859]: audit 2024-02-13T15:01:04.876663+0000 mon.a (mon.0) 3298 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:01:06.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:05 smithi062 bash[28859]: cluster 2024-02-13T15:01:04.883455+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-02-13T15:01:06.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:05 smithi062 bash[28859]: audit 2024-02-13T15:01:04.884874+0000 mon.a (mon.0) 3300 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136"}]: dispatch 2024-02-13T15:01:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:05 smithi111 bash[23388]: audit 2024-02-13T15:01:04.876663+0000 mon.a (mon.0) 3298 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:01:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:05 smithi111 bash[23388]: cluster 2024-02-13T15:01:04.883455+0000 mon.a (mon.0) 3299 : cluster 0 osdmap e698: 8 total, 8 up, 8 in 2024-02-13T15:01:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:05 smithi111 bash[23388]: audit 2024-02-13T15:01:04.884874+0000 mon.a (mon.0) 3300 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136"}]: dispatch 2024-02-13T15:01:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:01:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:01:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[28859]: cluster 2024-02-13T15:01:05.876997+0000 mon.a (mon.0) 3301 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:01:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[28859]: audit 2024-02-13T15:01:05.879379+0000 mon.a (mon.0) 3302 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136"}]': finished 2024-02-13T15:01:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[28859]: cluster 2024-02-13T15:01:05.887955+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-02-13T15:01:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[28859]: cluster 2024-02-13T15:01:06.238266+0000 mgr.y (mgr.14613) 672 : cluster 0 pgmap v1130: 300 pgs: 300 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-02-13T15:01:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[21479]: cluster 2024-02-13T15:01:05.876997+0000 mon.a (mon.0) 3301 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:01:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[21479]: audit 2024-02-13T15:01:05.879379+0000 mon.a (mon.0) 3302 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136"}]': finished 2024-02-13T15:01:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[21479]: cluster 2024-02-13T15:01:05.887955+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-02-13T15:01:07.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:06 smithi062 bash[21479]: cluster 2024-02-13T15:01:06.238266+0000 mgr.y (mgr.14613) 672 : cluster 0 pgmap v1130: 300 pgs: 300 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-02-13T15:01:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:06 smithi111 bash[23388]: cluster 2024-02-13T15:01:05.876997+0000 mon.a (mon.0) 3301 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:01:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:06 smithi111 bash[23388]: audit 2024-02-13T15:01:05.879379+0000 mon.a (mon.0) 3302 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-136"}]': finished 2024-02-13T15:01:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:06 smithi111 bash[23388]: cluster 2024-02-13T15:01:05.887955+0000 mon.a (mon.0) 3303 : cluster 0 osdmap e699: 8 total, 8 up, 8 in 2024-02-13T15:01:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:06 smithi111 bash[23388]: cluster 2024-02-13T15:01:06.238266+0000 mgr.y (mgr.14613) 672 : cluster 0 pgmap v1130: 300 pgs: 300 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.9 MiB/s wr, 1 op/s 2024-02-13T15:01:08.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:07 smithi062 bash[28859]: cluster 2024-02-13T15:01:06.896394+0000 mon.a (mon.0) 3304 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:08.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:07 smithi062 bash[28859]: cluster 2024-02-13T15:01:06.916529+0000 mon.a (mon.0) 3305 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-02-13T15:01:08.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:07 smithi062 bash[21479]: cluster 2024-02-13T15:01:06.896394+0000 mon.a (mon.0) 3304 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:08.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:07 smithi062 bash[21479]: cluster 2024-02-13T15:01:06.916529+0000 mon.a (mon.0) 3305 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-02-13T15:01:08.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:07 smithi111 bash[23388]: cluster 2024-02-13T15:01:06.896394+0000 mon.a (mon.0) 3304 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:08.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:07 smithi111 bash[23388]: cluster 2024-02-13T15:01:06.916529+0000 mon.a (mon.0) 3305 : cluster 0 osdmap e700: 8 total, 8 up, 8 in 2024-02-13T15:01:09.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:08 smithi062 bash[28859]: cluster 2024-02-13T15:01:07.920485+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-02-13T15:01:09.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:08 smithi062 bash[28859]: audit 2024-02-13T15:01:07.927532+0000 mon.a (mon.0) 3307 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:09.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:08 smithi062 bash[28859]: cluster 2024-02-13T15:01:08.239205+0000 mgr.y (mgr.14613) 673 : cluster 0 pgmap v1133: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T15:01:09.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:08 smithi062 bash[21479]: cluster 2024-02-13T15:01:07.920485+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-02-13T15:01:09.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:08 smithi062 bash[21479]: audit 2024-02-13T15:01:07.927532+0000 mon.a (mon.0) 3307 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:09.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:08 smithi062 bash[21479]: cluster 2024-02-13T15:01:08.239205+0000 mgr.y (mgr.14613) 673 : cluster 0 pgmap v1133: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T15:01:09.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:08 smithi111 bash[23388]: cluster 2024-02-13T15:01:07.920485+0000 mon.a (mon.0) 3306 : cluster 0 osdmap e701: 8 total, 8 up, 8 in 2024-02-13T15:01:09.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:08 smithi111 bash[23388]: audit 2024-02-13T15:01:07.927532+0000 mon.a (mon.0) 3307 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-138","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:09.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:08 smithi111 bash[23388]: cluster 2024-02-13T15:01:08.239205+0000 mgr.y (mgr.14613) 673 : cluster 0 pgmap v1133: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 657 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 976 KiB/s wr, 1 op/s 2024-02-13T15:01:10.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:09 smithi062 bash[28859]: audit 2024-02-13T15:01:08.922594+0000 mon.a (mon.0) 3308 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:10.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:09 smithi062 bash[28859]: cluster 2024-02-13T15:01:08.932666+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-02-13T15:01:10.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:09 smithi062 bash[28859]: audit 2024-02-13T15:01:08.945589+0000 mon.a (mon.0) 3310 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:09 smithi062 bash[21479]: audit 2024-02-13T15:01:08.922594+0000 mon.a (mon.0) 3308 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:10.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:09 smithi062 bash[21479]: cluster 2024-02-13T15:01:08.932666+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-02-13T15:01:10.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:09 smithi062 bash[21479]: audit 2024-02-13T15:01:08.945589+0000 mon.a (mon.0) 3310 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:10.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:09 smithi111 bash[23388]: audit 2024-02-13T15:01:08.922594+0000 mon.a (mon.0) 3308 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-138","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:10.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:09 smithi111 bash[23388]: cluster 2024-02-13T15:01:08.932666+0000 mon.a (mon.0) 3309 : cluster 0 osdmap e702: 8 total, 8 up, 8 in 2024-02-13T15:01:10.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:09 smithi111 bash[23388]: audit 2024-02-13T15:01:08.945589+0000 mon.a (mon.0) 3310 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:11.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:01:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:01:11.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:10 smithi111 bash[23388]: audit 2024-02-13T15:01:09.925754+0000 mon.a (mon.0) 3311 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:11.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:10 smithi111 bash[23388]: cluster 2024-02-13T15:01:09.935826+0000 mon.a (mon.0) 3312 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-02-13T15:01:11.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:10 smithi111 bash[23388]: audit 2024-02-13T15:01:09.938147+0000 mon.a (mon.0) 3313 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:01:11.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:10 smithi111 bash[23388]: cluster 2024-02-13T15:01:10.241233+0000 mgr.y (mgr.14613) 674 : cluster 0 pgmap v1136: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:11.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:10 smithi111 bash[23388]: audit 2024-02-13T15:01:10.928625+0000 mon.a (mon.0) 3314 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:01:11.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:10 smithi111 bash[23388]: cluster 2024-02-13T15:01:10.935852+0000 mon.a (mon.0) 3315 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-02-13T15:01:11.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:10 smithi111 bash[23388]: audit 2024-02-13T15:01:10.937338+0000 mon.a (mon.0) 3316 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:01:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[28859]: audit 2024-02-13T15:01:09.925754+0000 mon.a (mon.0) 3311 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[28859]: cluster 2024-02-13T15:01:09.935826+0000 mon.a (mon.0) 3312 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-02-13T15:01:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[28859]: audit 2024-02-13T15:01:09.938147+0000 mon.a (mon.0) 3313 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[28859]: cluster 2024-02-13T15:01:10.241233+0000 mgr.y (mgr.14613) 674 : cluster 0 pgmap v1136: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[28859]: audit 2024-02-13T15:01:10.928625+0000 mon.a (mon.0) 3314 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[28859]: cluster 2024-02-13T15:01:10.935852+0000 mon.a (mon.0) 3315 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[28859]: audit 2024-02-13T15:01:10.937338+0000 mon.a (mon.0) 3316 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[21479]: audit 2024-02-13T15:01:09.925754+0000 mon.a (mon.0) 3311 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[21479]: cluster 2024-02-13T15:01:09.935826+0000 mon.a (mon.0) 3312 : cluster 0 osdmap e703: 8 total, 8 up, 8 in 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[21479]: audit 2024-02-13T15:01:09.938147+0000 mon.a (mon.0) 3313 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[21479]: cluster 2024-02-13T15:01:10.241233+0000 mgr.y (mgr.14613) 674 : cluster 0 pgmap v1136: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[21479]: audit 2024-02-13T15:01:10.928625+0000 mon.a (mon.0) 3314 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[21479]: cluster 2024-02-13T15:01:10.935852+0000 mon.a (mon.0) 3315 : cluster 0 osdmap e704: 8 total, 8 up, 8 in 2024-02-13T15:01:11.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:10 smithi062 bash[21479]: audit 2024-02-13T15:01:10.937338+0000 mon.a (mon.0) 3316 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:01:12.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:11 smithi062 bash[21479]: audit 2024-02-13T15:01:10.805453+0000 mgr.y (mgr.14613) 675 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:12.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:11 smithi062 bash[21479]: audit 2024-02-13T15:01:11.931190+0000 mon.a (mon.0) 3317 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:01:12.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:11 smithi062 bash[21479]: cluster 2024-02-13T15:01:11.938295+0000 mon.a (mon.0) 3318 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-02-13T15:01:12.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:11 smithi062 bash[21479]: audit 2024-02-13T15:01:11.940581+0000 mon.a (mon.0) 3319 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T15:01:12.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:11 smithi062 bash[28859]: audit 2024-02-13T15:01:10.805453+0000 mgr.y (mgr.14613) 675 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:12.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:11 smithi062 bash[28859]: audit 2024-02-13T15:01:11.931190+0000 mon.a (mon.0) 3317 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:01:12.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:11 smithi062 bash[28859]: cluster 2024-02-13T15:01:11.938295+0000 mon.a (mon.0) 3318 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-02-13T15:01:12.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:11 smithi062 bash[28859]: audit 2024-02-13T15:01:11.940581+0000 mon.a (mon.0) 3319 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T15:01:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:11 smithi111 bash[23388]: audit 2024-02-13T15:01:10.805453+0000 mgr.y (mgr.14613) 675 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:11 smithi111 bash[23388]: audit 2024-02-13T15:01:11.931190+0000 mon.a (mon.0) 3317 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:01:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:11 smithi111 bash[23388]: cluster 2024-02-13T15:01:11.938295+0000 mon.a (mon.0) 3318 : cluster 0 osdmap e705: 8 total, 8 up, 8 in 2024-02-13T15:01:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:11 smithi111 bash[23388]: audit 2024-02-13T15:01:11.940581+0000 mon.a (mon.0) 3319 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_type","val": "explicit_object"}]: dispatch 2024-02-13T15:01:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:12 smithi062 bash[21479]: cluster 2024-02-13T15:01:12.242261+0000 mgr.y (mgr.14613) 676 : cluster 0 pgmap v1139: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:12 smithi062 bash[21479]: cluster 2024-02-13T15:01:12.738239+0000 mon.a (mon.0) 3320 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:13.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:12 smithi062 bash[21479]: audit 2024-02-13T15:01:12.933978+0000 mon.a (mon.0) 3321 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T15:01:13.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:12 smithi062 bash[21479]: cluster 2024-02-13T15:01:12.941152+0000 mon.a (mon.0) 3322 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-02-13T15:01:13.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:12 smithi062 bash[28859]: cluster 2024-02-13T15:01:12.242261+0000 mgr.y (mgr.14613) 676 : cluster 0 pgmap v1139: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:13.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:12 smithi062 bash[28859]: cluster 2024-02-13T15:01:12.738239+0000 mon.a (mon.0) 3320 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:13.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:12 smithi062 bash[28859]: audit 2024-02-13T15:01:12.933978+0000 mon.a (mon.0) 3321 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T15:01:13.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:12 smithi062 bash[28859]: cluster 2024-02-13T15:01:12.941152+0000 mon.a (mon.0) 3322 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-02-13T15:01:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:12 smithi111 bash[23388]: cluster 2024-02-13T15:01:12.242261+0000 mgr.y (mgr.14613) 676 : cluster 0 pgmap v1139: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:12 smithi111 bash[23388]: cluster 2024-02-13T15:01:12.738239+0000 mon.a (mon.0) 3320 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:12 smithi111 bash[23388]: audit 2024-02-13T15:01:12.933978+0000 mon.a (mon.0) 3321 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-138","var": "hit_set_type","val": "explicit_object"}]': finished 2024-02-13T15:01:13.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:12 smithi111 bash[23388]: cluster 2024-02-13T15:01:12.941152+0000 mon.a (mon.0) 3322 : cluster 0 osdmap e706: 8 total, 8 up, 8 in 2024-02-13T15:01:14.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:14 smithi062 bash[21479]: audit 2024-02-13T15:01:14.004675+0000 mon.a (mon.0) 3323 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:14.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:14 smithi062 bash[21479]: audit 2024-02-13T15:01:14.005879+0000 mon.a (mon.0) 3324 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138"}]: dispatch 2024-02-13T15:01:14.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:14 smithi062 bash[28859]: audit 2024-02-13T15:01:14.004675+0000 mon.a (mon.0) 3323 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:14.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:14 smithi062 bash[28859]: audit 2024-02-13T15:01:14.005879+0000 mon.a (mon.0) 3324 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138"}]: dispatch 2024-02-13T15:01:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:14 smithi111 bash[23388]: audit 2024-02-13T15:01:14.004675+0000 mon.a (mon.0) 3323 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:14.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:14 smithi111 bash[23388]: audit 2024-02-13T15:01:14.005879+0000 mon.a (mon.0) 3324 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138"}]: dispatch 2024-02-13T15:01:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:15 smithi062 bash[28859]: audit 2024-02-13T15:01:14.066314+0000 mon.a (mon.0) 3325 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138"}]': finished 2024-02-13T15:01:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:15 smithi062 bash[28859]: cluster 2024-02-13T15:01:14.073891+0000 mon.a (mon.0) 3326 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-02-13T15:01:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:15 smithi062 bash[28859]: cluster 2024-02-13T15:01:14.243196+0000 mgr.y (mgr.14613) 677 : cluster 0 pgmap v1142: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:15.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:15 smithi062 bash[21479]: audit 2024-02-13T15:01:14.066314+0000 mon.a (mon.0) 3325 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138"}]': finished 2024-02-13T15:01:15.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:15 smithi062 bash[21479]: cluster 2024-02-13T15:01:14.073891+0000 mon.a (mon.0) 3326 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-02-13T15:01:15.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:15 smithi062 bash[21479]: cluster 2024-02-13T15:01:14.243196+0000 mgr.y (mgr.14613) 677 : cluster 0 pgmap v1142: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:15.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:15 smithi111 bash[23388]: audit 2024-02-13T15:01:14.066314+0000 mon.a (mon.0) 3325 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-138"}]': finished 2024-02-13T15:01:15.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:15 smithi111 bash[23388]: cluster 2024-02-13T15:01:14.073891+0000 mon.a (mon.0) 3326 : cluster 0 osdmap e707: 8 total, 8 up, 8 in 2024-02-13T15:01:15.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:15 smithi111 bash[23388]: cluster 2024-02-13T15:01:14.243196+0000 mgr.y (mgr.14613) 677 : cluster 0 pgmap v1142: 300 pgs: 300 active+clean; 4.4 MiB data, 662 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:16.546 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:01:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:01:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[21479]: cluster 2024-02-13T15:01:15.075947+0000 mon.a (mon.0) 3327 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-02-13T15:01:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[21479]: cluster 2024-02-13T15:01:16.080882+0000 mon.a (mon.0) 3328 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-02-13T15:01:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[21479]: audit 2024-02-13T15:01:16.085547+0000 mon.a (mon.0) 3329 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[21479]: cluster 2024-02-13T15:01:16.244219+0000 mgr.y (mgr.14613) 678 : cluster 0 pgmap v1145: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[28859]: cluster 2024-02-13T15:01:15.075947+0000 mon.a (mon.0) 3327 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-02-13T15:01:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[28859]: cluster 2024-02-13T15:01:16.080882+0000 mon.a (mon.0) 3328 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-02-13T15:01:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[28859]: audit 2024-02-13T15:01:16.085547+0000 mon.a (mon.0) 3329 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:16 smithi062 bash[28859]: cluster 2024-02-13T15:01:16.244219+0000 mgr.y (mgr.14613) 678 : cluster 0 pgmap v1145: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:16.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:16 smithi111 bash[23388]: cluster 2024-02-13T15:01:15.075947+0000 mon.a (mon.0) 3327 : cluster 0 osdmap e708: 8 total, 8 up, 8 in 2024-02-13T15:01:16.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:16 smithi111 bash[23388]: cluster 2024-02-13T15:01:16.080882+0000 mon.a (mon.0) 3328 : cluster 0 osdmap e709: 8 total, 8 up, 8 in 2024-02-13T15:01:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:16 smithi111 bash[23388]: audit 2024-02-13T15:01:16.085547+0000 mon.a (mon.0) 3329 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-140","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:16 smithi111 bash[23388]: cluster 2024-02-13T15:01:16.244219+0000 mgr.y (mgr.14613) 678 : cluster 0 pgmap v1145: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:18.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:18 smithi111 bash[23388]: audit 2024-02-13T15:01:17.081883+0000 mon.a (mon.0) 3330 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:18.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:18 smithi111 bash[23388]: cluster 2024-02-13T15:01:17.089390+0000 mon.a (mon.0) 3331 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-02-13T15:01:18.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:18 smithi111 bash[23388]: audit 2024-02-13T15:01:17.096349+0000 mon.a (mon.0) 3332 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:18.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:18 smithi111 bash[23388]: cluster 2024-02-13T15:01:17.739488+0000 mon.a (mon.0) 3333 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:18 smithi062 bash[21479]: audit 2024-02-13T15:01:17.081883+0000 mon.a (mon.0) 3330 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:18 smithi062 bash[21479]: cluster 2024-02-13T15:01:17.089390+0000 mon.a (mon.0) 3331 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-02-13T15:01:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:18 smithi062 bash[21479]: audit 2024-02-13T15:01:17.096349+0000 mon.a (mon.0) 3332 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:18 smithi062 bash[21479]: cluster 2024-02-13T15:01:17.739488+0000 mon.a (mon.0) 3333 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:18 smithi062 bash[28859]: audit 2024-02-13T15:01:17.081883+0000 mon.a (mon.0) 3330 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-140","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:18.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:18 smithi062 bash[28859]: cluster 2024-02-13T15:01:17.089390+0000 mon.a (mon.0) 3331 : cluster 0 osdmap e710: 8 total, 8 up, 8 in 2024-02-13T15:01:18.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:18 smithi062 bash[28859]: audit 2024-02-13T15:01:17.096349+0000 mon.a (mon.0) 3332 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:18.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:18 smithi062 bash[28859]: cluster 2024-02-13T15:01:17.739488+0000 mon.a (mon.0) 3333 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:19 smithi062 bash[28859]: audit 2024-02-13T15:01:18.092802+0000 mon.a (mon.0) 3334 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:19 smithi062 bash[28859]: cluster 2024-02-13T15:01:18.100596+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-02-13T15:01:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:19 smithi062 bash[28859]: audit 2024-02-13T15:01:18.101703+0000 mon.a (mon.0) 3336 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T15:01:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:19 smithi062 bash[28859]: cluster 2024-02-13T15:01:18.245120+0000 mgr.y (mgr.14613) 679 : cluster 0 pgmap v1148: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:19 smithi062 bash[21479]: audit 2024-02-13T15:01:18.092802+0000 mon.a (mon.0) 3334 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:19 smithi062 bash[21479]: cluster 2024-02-13T15:01:18.100596+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-02-13T15:01:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:19 smithi062 bash[21479]: audit 2024-02-13T15:01:18.101703+0000 mon.a (mon.0) 3336 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T15:01:19.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:19 smithi062 bash[21479]: cluster 2024-02-13T15:01:18.245120+0000 mgr.y (mgr.14613) 679 : cluster 0 pgmap v1148: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:19 smithi111 bash[23388]: audit 2024-02-13T15:01:18.092802+0000 mon.a (mon.0) 3334 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:19 smithi111 bash[23388]: cluster 2024-02-13T15:01:18.100596+0000 mon.a (mon.0) 3335 : cluster 0 osdmap e711: 8 total, 8 up, 8 in 2024-02-13T15:01:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:19 smithi111 bash[23388]: audit 2024-02-13T15:01:18.101703+0000 mon.a (mon.0) 3336 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_count","val": "3"}]: dispatch 2024-02-13T15:01:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:19 smithi111 bash[23388]: cluster 2024-02-13T15:01:18.245120+0000 mgr.y (mgr.14613) 679 : cluster 0 pgmap v1148: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 663 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[28859]: audit 2024-02-13T15:01:19.102020+0000 mon.a (mon.0) 3337 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_count","val": "3"}]': finished 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[28859]: cluster 2024-02-13T15:01:19.111876+0000 mon.a (mon.0) 3338 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[28859]: audit 2024-02-13T15:01:19.112745+0000 mon.a (mon.0) 3339 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[28859]: audit 2024-02-13T15:01:19.472072+0000 mon.a (mon.0) 3340 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[28859]: audit 2024-02-13T15:01:19.477280+0000 mon.b (mon.1) 270 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[21479]: audit 2024-02-13T15:01:19.102020+0000 mon.a (mon.0) 3337 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_count","val": "3"}]': finished 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[21479]: cluster 2024-02-13T15:01:19.111876+0000 mon.a (mon.0) 3338 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[21479]: audit 2024-02-13T15:01:19.112745+0000 mon.a (mon.0) 3339 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[21479]: audit 2024-02-13T15:01:19.472072+0000 mon.a (mon.0) 3340 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:01:20.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:20 smithi062 bash[21479]: audit 2024-02-13T15:01:19.477280+0000 mon.b (mon.1) 270 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:20 smithi111 bash[23388]: audit 2024-02-13T15:01:19.102020+0000 mon.a (mon.0) 3337 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_count","val": "3"}]': finished 2024-02-13T15:01:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:20 smithi111 bash[23388]: cluster 2024-02-13T15:01:19.111876+0000 mon.a (mon.0) 3338 : cluster 0 osdmap e712: 8 total, 8 up, 8 in 2024-02-13T15:01:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:20 smithi111 bash[23388]: audit 2024-02-13T15:01:19.112745+0000 mon.a (mon.0) 3339 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_period","val": "3"}]: dispatch 2024-02-13T15:01:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:20 smithi111 bash[23388]: audit 2024-02-13T15:01:19.472072+0000 mon.a (mon.0) 3340 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:01:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:20 smithi111 bash[23388]: audit 2024-02-13T15:01:19.477280+0000 mon.b (mon.1) 270 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:21.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:01:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:01:21.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:21 smithi062 bash[21479]: audit 2024-02-13T15:01:20.114716+0000 mon.a (mon.0) 3341 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_period","val": "3"}]': finished 2024-02-13T15:01:21.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:21 smithi062 bash[21479]: cluster 2024-02-13T15:01:20.120799+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-02-13T15:01:21.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:21 smithi062 bash[21479]: audit 2024-02-13T15:01:20.122740+0000 mon.a (mon.0) 3343 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:01:21.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:21 smithi062 bash[21479]: cluster 2024-02-13T15:01:20.246416+0000 mgr.y (mgr.14613) 680 : cluster 0 pgmap v1151: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:21.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:21 smithi062 bash[28859]: audit 2024-02-13T15:01:20.114716+0000 mon.a (mon.0) 3341 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_period","val": "3"}]': finished 2024-02-13T15:01:21.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:21 smithi062 bash[28859]: cluster 2024-02-13T15:01:20.120799+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-02-13T15:01:21.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:21 smithi062 bash[28859]: audit 2024-02-13T15:01:20.122740+0000 mon.a (mon.0) 3343 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:01:21.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:21 smithi062 bash[28859]: cluster 2024-02-13T15:01:20.246416+0000 mgr.y (mgr.14613) 680 : cluster 0 pgmap v1151: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:21.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:21 smithi111 bash[23388]: audit 2024-02-13T15:01:20.114716+0000 mon.a (mon.0) 3341 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_period","val": "3"}]': finished 2024-02-13T15:01:21.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:21 smithi111 bash[23388]: cluster 2024-02-13T15:01:20.120799+0000 mon.a (mon.0) 3342 : cluster 0 osdmap e713: 8 total, 8 up, 8 in 2024-02-13T15:01:21.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:21 smithi111 bash[23388]: audit 2024-02-13T15:01:20.122740+0000 mon.a (mon.0) 3343 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:01:21.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:21 smithi111 bash[23388]: cluster 2024-02-13T15:01:20.246416+0000 mgr.y (mgr.14613) 680 : cluster 0 pgmap v1151: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[21479]: audit 2024-02-13T15:01:20.813444+0000 mgr.y (mgr.14613) 681 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[21479]: audit 2024-02-13T15:01:21.117339+0000 mon.a (mon.0) 3344 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[21479]: cluster 2024-02-13T15:01:21.125314+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[21479]: audit 2024-02-13T15:01:21.128996+0000 mon.a (mon.0) 3346 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[21479]: audit 2024-02-13T15:01:22.120149+0000 mon.a (mon.0) 3347 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[21479]: cluster 2024-02-13T15:01:22.127288+0000 mon.a (mon.0) 3348 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[28859]: audit 2024-02-13T15:01:20.813444+0000 mgr.y (mgr.14613) 681 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[28859]: audit 2024-02-13T15:01:21.117339+0000 mon.a (mon.0) 3344 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[28859]: cluster 2024-02-13T15:01:21.125314+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[28859]: audit 2024-02-13T15:01:21.128996+0000 mon.a (mon.0) 3346 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T15:01:22.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[28859]: audit 2024-02-13T15:01:22.120149+0000 mon.a (mon.0) 3347 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T15:01:22.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:22 smithi062 bash[28859]: cluster 2024-02-13T15:01:22.127288+0000 mon.a (mon.0) 3348 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-02-13T15:01:22.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:22 smithi111 bash[23388]: audit 2024-02-13T15:01:20.813444+0000 mgr.y (mgr.14613) 681 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:22 smithi111 bash[23388]: audit 2024-02-13T15:01:21.117339+0000 mon.a (mon.0) 3344 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:01:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:22 smithi111 bash[23388]: cluster 2024-02-13T15:01:21.125314+0000 mon.a (mon.0) 3345 : cluster 0 osdmap e714: 8 total, 8 up, 8 in 2024-02-13T15:01:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:22 smithi111 bash[23388]: audit 2024-02-13T15:01:21.128996+0000 mon.a (mon.0) 3346 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_fpp","val": ".01"}]: dispatch 2024-02-13T15:01:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:22 smithi111 bash[23388]: audit 2024-02-13T15:01:22.120149+0000 mon.a (mon.0) 3347 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-140","var": "hit_set_fpp","val": ".01"}]': finished 2024-02-13T15:01:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:22 smithi111 bash[23388]: cluster 2024-02-13T15:01:22.127288+0000 mon.a (mon.0) 3348 : cluster 0 osdmap e715: 8 total, 8 up, 8 in 2024-02-13T15:01:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:23 smithi062 bash[28859]: cluster 2024-02-13T15:01:22.247423+0000 mgr.y (mgr.14613) 682 : cluster 0 pgmap v1154: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:23.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:23 smithi062 bash[28859]: cluster 2024-02-13T15:01:22.742978+0000 mon.a (mon.0) 3349 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:23.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:23 smithi062 bash[21479]: cluster 2024-02-13T15:01:22.247423+0000 mgr.y (mgr.14613) 682 : cluster 0 pgmap v1154: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:23.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:23 smithi062 bash[21479]: cluster 2024-02-13T15:01:22.742978+0000 mon.a (mon.0) 3349 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:23.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:23 smithi111 bash[23388]: cluster 2024-02-13T15:01:22.247423+0000 mgr.y (mgr.14613) 682 : cluster 0 pgmap v1154: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:23.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:23 smithi111 bash[23388]: cluster 2024-02-13T15:01:22.742978+0000 mon.a (mon.0) 3349 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:01:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:25 smithi062 bash[21479]: cluster 2024-02-13T15:01:24.248351+0000 mgr.y (mgr.14613) 683 : cluster 0 pgmap v1155: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 0 op/s 2024-02-13T15:01:25.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:25 smithi062 bash[28859]: cluster 2024-02-13T15:01:24.248351+0000 mgr.y (mgr.14613) 683 : cluster 0 pgmap v1155: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 0 op/s 2024-02-13T15:01:25.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:25 smithi111 bash[23388]: cluster 2024-02-13T15:01:24.248351+0000 mgr.y (mgr.14613) 683 : cluster 0 pgmap v1155: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 995 B/s rd, 0 op/s 2024-02-13T15:01:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:01:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:01:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:01:27.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:27 smithi062 bash[28859]: cluster 2024-02-13T15:01:26.251258+0000 mgr.y (mgr.14613) 684 : cluster 0 pgmap v1156: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 3.9 KiB/s wr, 1 op/s 2024-02-13T15:01:27.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:27 smithi062 bash[21479]: cluster 2024-02-13T15:01:26.251258+0000 mgr.y (mgr.14613) 684 : cluster 0 pgmap v1156: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 3.9 KiB/s wr, 1 op/s 2024-02-13T15:01:27.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:27 smithi111 bash[23388]: cluster 2024-02-13T15:01:26.251258+0000 mgr.y (mgr.14613) 684 : cluster 0 pgmap v1156: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 834 B/s rd, 3.9 KiB/s wr, 1 op/s 2024-02-13T15:01:29.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:29 smithi111 bash[23388]: cluster 2024-02-13T15:01:28.252184+0000 mgr.y (mgr.14613) 685 : cluster 0 pgmap v1157: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-02-13T15:01:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:29 smithi062 bash[21479]: cluster 2024-02-13T15:01:28.252184+0000 mgr.y (mgr.14613) 685 : cluster 0 pgmap v1157: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-02-13T15:01:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:29 smithi062 bash[28859]: cluster 2024-02-13T15:01:28.252184+0000 mgr.y (mgr.14613) 685 : cluster 0 pgmap v1157: 300 pgs: 300 active+clean; 4.4 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 3.0 KiB/s wr, 0 op/s 2024-02-13T15:01:31.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:01:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:01:31.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:31 smithi111 bash[23388]: cluster 2024-02-13T15:01:30.254965+0000 mgr.y (mgr.14613) 686 : cluster 0 pgmap v1158: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 7.2 KiB/s wr, 2 op/s 2024-02-13T15:01:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:31 smithi062 bash[21479]: cluster 2024-02-13T15:01:30.254965+0000 mgr.y (mgr.14613) 686 : cluster 0 pgmap v1158: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 7.2 KiB/s wr, 2 op/s 2024-02-13T15:01:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:31 smithi062 bash[28859]: cluster 2024-02-13T15:01:30.254965+0000 mgr.y (mgr.14613) 686 : cluster 0 pgmap v1158: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 7.2 KiB/s wr, 2 op/s 2024-02-13T15:01:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:32 smithi111 bash[23388]: audit 2024-02-13T15:01:30.824813+0000 mgr.y (mgr.14613) 687 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:32 smithi062 bash[21479]: audit 2024-02-13T15:01:30.824813+0000 mgr.y (mgr.14613) 687 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:32 smithi062 bash[28859]: audit 2024-02-13T15:01:30.824813+0000 mgr.y (mgr.14613) 687 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:33.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:33 smithi111 bash[23388]: cluster 2024-02-13T15:01:32.255877+0000 mgr.y (mgr.14613) 688 : cluster 0 pgmap v1159: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 6.5 KiB/s wr, 1 op/s 2024-02-13T15:01:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:33 smithi062 bash[21479]: cluster 2024-02-13T15:01:32.255877+0000 mgr.y (mgr.14613) 688 : cluster 0 pgmap v1159: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 6.5 KiB/s wr, 1 op/s 2024-02-13T15:01:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:33 smithi062 bash[28859]: cluster 2024-02-13T15:01:32.255877+0000 mgr.y (mgr.14613) 688 : cluster 0 pgmap v1159: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 6.5 KiB/s wr, 1 op/s 2024-02-13T15:01:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:34 smithi062 bash[21479]: audit 2024-02-13T15:01:34.234800+0000 mon.a (mon.0) 3350 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:34 smithi062 bash[21479]: audit 2024-02-13T15:01:34.235684+0000 mon.a (mon.0) 3351 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140"}]: dispatch 2024-02-13T15:01:34.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:34 smithi062 bash[28859]: audit 2024-02-13T15:01:34.234800+0000 mon.a (mon.0) 3350 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:34.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:34 smithi062 bash[28859]: audit 2024-02-13T15:01:34.235684+0000 mon.a (mon.0) 3351 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140"}]: dispatch 2024-02-13T15:01:34.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:34 smithi111 bash[23388]: audit 2024-02-13T15:01:34.234800+0000 mon.a (mon.0) 3350 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:34.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:34 smithi111 bash[23388]: audit 2024-02-13T15:01:34.235684+0000 mon.a (mon.0) 3351 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140"}]: dispatch 2024-02-13T15:01:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:35 smithi111 bash[23388]: cluster 2024-02-13T15:01:34.256810+0000 mgr.y (mgr.14613) 689 : cluster 0 pgmap v1160: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 5.5 KiB/s wr, 1 op/s 2024-02-13T15:01:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:35 smithi111 bash[23388]: audit 2024-02-13T15:01:34.335218+0000 mon.a (mon.0) 3352 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140"}]': finished 2024-02-13T15:01:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:35 smithi111 bash[23388]: cluster 2024-02-13T15:01:34.343905+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-02-13T15:01:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:35 smithi111 bash[23388]: audit 2024-02-13T15:01:34.513465+0000 mon.b (mon.1) 271 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:35 smithi062 bash[21479]: cluster 2024-02-13T15:01:34.256810+0000 mgr.y (mgr.14613) 689 : cluster 0 pgmap v1160: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 5.5 KiB/s wr, 1 op/s 2024-02-13T15:01:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:35 smithi062 bash[21479]: audit 2024-02-13T15:01:34.335218+0000 mon.a (mon.0) 3352 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140"}]': finished 2024-02-13T15:01:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:35 smithi062 bash[21479]: cluster 2024-02-13T15:01:34.343905+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-02-13T15:01:36.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:35 smithi062 bash[21479]: audit 2024-02-13T15:01:34.513465+0000 mon.b (mon.1) 271 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:36.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:35 smithi062 bash[28859]: cluster 2024-02-13T15:01:34.256810+0000 mgr.y (mgr.14613) 689 : cluster 0 pgmap v1160: 300 pgs: 300 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 5.5 KiB/s wr, 1 op/s 2024-02-13T15:01:36.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:35 smithi062 bash[28859]: audit 2024-02-13T15:01:34.335218+0000 mon.a (mon.0) 3352 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-140"}]': finished 2024-02-13T15:01:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:35 smithi062 bash[28859]: cluster 2024-02-13T15:01:34.343905+0000 mon.a (mon.0) 3353 : cluster 0 osdmap e716: 8 total, 8 up, 8 in 2024-02-13T15:01:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:35 smithi062 bash[28859]: audit 2024-02-13T15:01:34.513465+0000 mon.b (mon.1) 271 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:01:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:01:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:36 smithi111 bash[23388]: cluster 2024-02-13T15:01:35.361879+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-02-13T15:01:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:36 smithi111 bash[23388]: cluster 2024-02-13T15:01:36.257717+0000 mgr.y (mgr.14613) 690 : cluster 0 pgmap v1163: 268 pgs: 268 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:36 smithi111 bash[23388]: cluster 2024-02-13T15:01:36.370576+0000 mon.a (mon.0) 3355 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-02-13T15:01:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:36 smithi111 bash[23388]: audit 2024-02-13T15:01:36.381077+0000 mon.a (mon.0) 3356 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[21479]: cluster 2024-02-13T15:01:35.361879+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-02-13T15:01:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[21479]: cluster 2024-02-13T15:01:36.257717+0000 mgr.y (mgr.14613) 690 : cluster 0 pgmap v1163: 268 pgs: 268 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[21479]: cluster 2024-02-13T15:01:36.370576+0000 mon.a (mon.0) 3355 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-02-13T15:01:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[21479]: audit 2024-02-13T15:01:36.381077+0000 mon.a (mon.0) 3356 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:37.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[28859]: cluster 2024-02-13T15:01:35.361879+0000 mon.a (mon.0) 3354 : cluster 0 osdmap e717: 8 total, 8 up, 8 in 2024-02-13T15:01:37.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[28859]: cluster 2024-02-13T15:01:36.257717+0000 mgr.y (mgr.14613) 690 : cluster 0 pgmap v1163: 268 pgs: 268 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:37.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[28859]: cluster 2024-02-13T15:01:36.370576+0000 mon.a (mon.0) 3355 : cluster 0 osdmap e718: 8 total, 8 up, 8 in 2024-02-13T15:01:37.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:36 smithi062 bash[28859]: audit 2024-02-13T15:01:36.381077+0000 mon.a (mon.0) 3356 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-142","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:38 smithi062 bash[21479]: audit 2024-02-13T15:01:37.362622+0000 mon.a (mon.0) 3357 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:38 smithi062 bash[21479]: cluster 2024-02-13T15:01:37.371645+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-02-13T15:01:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:38 smithi062 bash[21479]: audit 2024-02-13T15:01:37.471309+0000 mon.a (mon.0) 3359 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:38 smithi062 bash[28859]: audit 2024-02-13T15:01:37.362622+0000 mon.a (mon.0) 3357 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:38 smithi062 bash[28859]: cluster 2024-02-13T15:01:37.371645+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-02-13T15:01:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:38 smithi062 bash[28859]: audit 2024-02-13T15:01:37.471309+0000 mon.a (mon.0) 3359 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:38 smithi111 bash[23388]: audit 2024-02-13T15:01:37.362622+0000 mon.a (mon.0) 3357 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-142","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:38 smithi111 bash[23388]: cluster 2024-02-13T15:01:37.371645+0000 mon.a (mon.0) 3358 : cluster 0 osdmap e719: 8 total, 8 up, 8 in 2024-02-13T15:01:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:38 smithi111 bash[23388]: audit 2024-02-13T15:01:37.471309+0000 mon.a (mon.0) 3359 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:39 smithi062 bash[21479]: cluster 2024-02-13T15:01:38.258604+0000 mgr.y (mgr.14613) 691 : cluster 0 pgmap v1166: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:39 smithi062 bash[21479]: audit 2024-02-13T15:01:38.374245+0000 mon.a (mon.0) 3360 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:39 smithi062 bash[21479]: cluster 2024-02-13T15:01:38.385628+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-02-13T15:01:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:39 smithi062 bash[21479]: audit 2024-02-13T15:01:38.387389+0000 mon.a (mon.0) 3362 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:39.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:39 smithi062 bash[28859]: cluster 2024-02-13T15:01:38.258604+0000 mgr.y (mgr.14613) 691 : cluster 0 pgmap v1166: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:39.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:39 smithi062 bash[28859]: audit 2024-02-13T15:01:38.374245+0000 mon.a (mon.0) 3360 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:39.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:39 smithi062 bash[28859]: cluster 2024-02-13T15:01:38.385628+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-02-13T15:01:39.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:39 smithi062 bash[28859]: audit 2024-02-13T15:01:38.387389+0000 mon.a (mon.0) 3362 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:39.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:39 smithi111 bash[23388]: cluster 2024-02-13T15:01:38.258604+0000 mgr.y (mgr.14613) 691 : cluster 0 pgmap v1166: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:39.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:39 smithi111 bash[23388]: audit 2024-02-13T15:01:38.374245+0000 mon.a (mon.0) 3360 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:39.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:39 smithi111 bash[23388]: cluster 2024-02-13T15:01:38.385628+0000 mon.a (mon.0) 3361 : cluster 0 osdmap e720: 8 total, 8 up, 8 in 2024-02-13T15:01:39.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:39 smithi111 bash[23388]: audit 2024-02-13T15:01:38.387389+0000 mon.a (mon.0) 3362 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[21479]: audit 2024-02-13T15:01:39.376689+0000 mon.a (mon.0) 3363 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-142"}]': finished 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[21479]: cluster 2024-02-13T15:01:39.386610+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[21479]: audit 2024-02-13T15:01:39.394212+0000 mon.a (mon.0) 3365 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-142", "mode": "writeback"}]: dispatch 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[21479]: cluster 2024-02-13T15:01:40.377201+0000 mon.a (mon.0) 3366 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[21479]: audit 2024-02-13T15:01:40.379480+0000 mon.a (mon.0) 3367 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-142", "mode": "writeback"}]': finished 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[21479]: cluster 2024-02-13T15:01:40.387760+0000 mon.a (mon.0) 3368 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[21479]: audit 2024-02-13T15:01:40.389624+0000 mon.a (mon.0) 3369 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[28859]: audit 2024-02-13T15:01:39.376689+0000 mon.a (mon.0) 3363 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-142"}]': finished 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[28859]: cluster 2024-02-13T15:01:39.386610+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[28859]: audit 2024-02-13T15:01:39.394212+0000 mon.a (mon.0) 3365 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-142", "mode": "writeback"}]: dispatch 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[28859]: cluster 2024-02-13T15:01:40.377201+0000 mon.a (mon.0) 3366 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[28859]: audit 2024-02-13T15:01:40.379480+0000 mon.a (mon.0) 3367 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-142", "mode": "writeback"}]': finished 2024-02-13T15:01:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[28859]: cluster 2024-02-13T15:01:40.387760+0000 mon.a (mon.0) 3368 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-02-13T15:01:40.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:40 smithi062 bash[28859]: audit 2024-02-13T15:01:40.389624+0000 mon.a (mon.0) 3369 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:01:40.837 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:40 smithi111 bash[23388]: audit 2024-02-13T15:01:39.376689+0000 mon.a (mon.0) 3363 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-142"}]': finished 2024-02-13T15:01:40.837 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:40 smithi111 bash[23388]: cluster 2024-02-13T15:01:39.386610+0000 mon.a (mon.0) 3364 : cluster 0 osdmap e721: 8 total, 8 up, 8 in 2024-02-13T15:01:40.837 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:40 smithi111 bash[23388]: audit 2024-02-13T15:01:39.394212+0000 mon.a (mon.0) 3365 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-142", "mode": "writeback"}]: dispatch 2024-02-13T15:01:40.837 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:40 smithi111 bash[23388]: cluster 2024-02-13T15:01:40.377201+0000 mon.a (mon.0) 3366 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:40.837 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:40 smithi111 bash[23388]: audit 2024-02-13T15:01:40.379480+0000 mon.a (mon.0) 3367 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-142", "mode": "writeback"}]': finished 2024-02-13T15:01:40.837 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:40 smithi111 bash[23388]: cluster 2024-02-13T15:01:40.387760+0000 mon.a (mon.0) 3368 : cluster 0 osdmap e722: 8 total, 8 up, 8 in 2024-02-13T15:01:40.837 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:40 smithi111 bash[23388]: audit 2024-02-13T15:01:40.389624+0000 mon.a (mon.0) 3369 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:01:41.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:01:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:01:41.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:41 smithi062 bash[21479]: cluster 2024-02-13T15:01:40.261175+0000 mgr.y (mgr.14613) 692 : cluster 0 pgmap v1169: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T15:01:41.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:41 smithi062 bash[21479]: audit 2024-02-13T15:01:41.382286+0000 mon.a (mon.0) 3370 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:01:41.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:41 smithi062 bash[21479]: cluster 2024-02-13T15:01:41.389516+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-02-13T15:01:41.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:41 smithi062 bash[21479]: audit 2024-02-13T15:01:41.391901+0000 mon.a (mon.0) 3372 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:01:41.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:41 smithi062 bash[28859]: cluster 2024-02-13T15:01:40.261175+0000 mgr.y (mgr.14613) 692 : cluster 0 pgmap v1169: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T15:01:41.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:41 smithi062 bash[28859]: audit 2024-02-13T15:01:41.382286+0000 mon.a (mon.0) 3370 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:01:41.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:41 smithi062 bash[28859]: cluster 2024-02-13T15:01:41.389516+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-02-13T15:01:41.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:41 smithi062 bash[28859]: audit 2024-02-13T15:01:41.391901+0000 mon.a (mon.0) 3372 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:01:41.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:41 smithi111 bash[23388]: cluster 2024-02-13T15:01:40.261175+0000 mgr.y (mgr.14613) 692 : cluster 0 pgmap v1169: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T15:01:41.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:41 smithi111 bash[23388]: audit 2024-02-13T15:01:41.382286+0000 mon.a (mon.0) 3370 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:01:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:41 smithi111 bash[23388]: cluster 2024-02-13T15:01:41.389516+0000 mon.a (mon.0) 3371 : cluster 0 osdmap e723: 8 total, 8 up, 8 in 2024-02-13T15:01:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:41 smithi111 bash[23388]: audit 2024-02-13T15:01:41.391901+0000 mon.a (mon.0) 3372 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:01:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:42 smithi062 bash[28859]: audit 2024-02-13T15:01:40.836171+0000 mgr.y (mgr.14613) 693 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:42 smithi062 bash[28859]: audit 2024-02-13T15:01:42.385322+0000 mon.a (mon.0) 3373 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:01:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:42 smithi062 bash[28859]: cluster 2024-02-13T15:01:42.392414+0000 mon.a (mon.0) 3374 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-02-13T15:01:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:42 smithi062 bash[28859]: audit 2024-02-13T15:01:42.394617+0000 mon.a (mon.0) 3375 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:01:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:42 smithi062 bash[21479]: audit 2024-02-13T15:01:40.836171+0000 mgr.y (mgr.14613) 693 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:42 smithi062 bash[21479]: audit 2024-02-13T15:01:42.385322+0000 mon.a (mon.0) 3373 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:01:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:42 smithi062 bash[21479]: cluster 2024-02-13T15:01:42.392414+0000 mon.a (mon.0) 3374 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-02-13T15:01:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:42 smithi062 bash[21479]: audit 2024-02-13T15:01:42.394617+0000 mon.a (mon.0) 3375 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:01:42.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:42 smithi111 bash[23388]: audit 2024-02-13T15:01:40.836171+0000 mgr.y (mgr.14613) 693 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:42 smithi111 bash[23388]: audit 2024-02-13T15:01:42.385322+0000 mon.a (mon.0) 3373 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:01:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:42 smithi111 bash[23388]: cluster 2024-02-13T15:01:42.392414+0000 mon.a (mon.0) 3374 : cluster 0 osdmap e724: 8 total, 8 up, 8 in 2024-02-13T15:01:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:42 smithi111 bash[23388]: audit 2024-02-13T15:01:42.394617+0000 mon.a (mon.0) 3375 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:01:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[28859]: cluster 2024-02-13T15:01:42.262104+0000 mgr.y (mgr.14613) 694 : cluster 0 pgmap v1172: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T15:01:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[28859]: audit 2024-02-13T15:01:43.238870+0000 mon.b (mon.1) 272 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:01:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[28859]: cluster 2024-02-13T15:01:43.385521+0000 mon.a (mon.0) 3376 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:01:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[28859]: audit 2024-02-13T15:01:43.387539+0000 mon.a (mon.0) 3377 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:01:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[28859]: cluster 2024-02-13T15:01:43.391417+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-02-13T15:01:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[28859]: audit 2024-02-13T15:01:43.392032+0000 mon.a (mon.0) 3379 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T15:01:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[21479]: cluster 2024-02-13T15:01:42.262104+0000 mgr.y (mgr.14613) 694 : cluster 0 pgmap v1172: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T15:01:43.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[21479]: audit 2024-02-13T15:01:43.238870+0000 mon.b (mon.1) 272 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:01:43.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[21479]: cluster 2024-02-13T15:01:43.385521+0000 mon.a (mon.0) 3376 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:01:43.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[21479]: audit 2024-02-13T15:01:43.387539+0000 mon.a (mon.0) 3377 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:01:43.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[21479]: cluster 2024-02-13T15:01:43.391417+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-02-13T15:01:43.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:43 smithi062 bash[21479]: audit 2024-02-13T15:01:43.392032+0000 mon.a (mon.0) 3379 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T15:01:43.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:43 smithi111 bash[23388]: cluster 2024-02-13T15:01:42.262104+0000 mgr.y (mgr.14613) 694 : cluster 0 pgmap v1172: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 5.0 KiB/s wr, 6 op/s 2024-02-13T15:01:43.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:43 smithi111 bash[23388]: audit 2024-02-13T15:01:43.238870+0000 mon.b (mon.1) 272 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:01:43.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:43 smithi111 bash[23388]: cluster 2024-02-13T15:01:43.385521+0000 mon.a (mon.0) 3376 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:01:43.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:43 smithi111 bash[23388]: audit 2024-02-13T15:01:43.387539+0000 mon.a (mon.0) 3377 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:01:43.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:43 smithi111 bash[23388]: cluster 2024-02-13T15:01:43.391417+0000 mon.a (mon.0) 3378 : cluster 0 osdmap e725: 8 total, 8 up, 8 in 2024-02-13T15:01:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:43 smithi111 bash[23388]: audit 2024-02-13T15:01:43.392032+0000 mon.a (mon.0) 3379 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T15:01:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[21479]: audit 2024-02-13T15:01:43.972322+0000 mon.b (mon.1) 273 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:01:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[21479]: audit 2024-02-13T15:01:43.974476+0000 mon.b (mon.1) 274 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:01:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[21479]: audit 2024-02-13T15:01:43.984234+0000 mon.a (mon.0) 3380 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:01:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[21479]: audit 2024-02-13T15:01:44.390272+0000 mon.a (mon.0) 3381 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T15:01:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[21479]: cluster 2024-02-13T15:01:44.397971+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-02-13T15:01:44.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[21479]: audit 2024-02-13T15:01:44.400380+0000 mon.a (mon.0) 3383 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T15:01:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[28859]: audit 2024-02-13T15:01:43.972322+0000 mon.b (mon.1) 273 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:01:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[28859]: audit 2024-02-13T15:01:43.974476+0000 mon.b (mon.1) 274 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:01:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[28859]: audit 2024-02-13T15:01:43.984234+0000 mon.a (mon.0) 3380 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:01:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[28859]: audit 2024-02-13T15:01:44.390272+0000 mon.a (mon.0) 3381 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T15:01:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[28859]: cluster 2024-02-13T15:01:44.397971+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-02-13T15:01:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:44 smithi062 bash[28859]: audit 2024-02-13T15:01:44.400380+0000 mon.a (mon.0) 3383 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T15:01:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:44 smithi111 bash[23388]: audit 2024-02-13T15:01:43.972322+0000 mon.b (mon.1) 273 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:01:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:44 smithi111 bash[23388]: audit 2024-02-13T15:01:43.974476+0000 mon.b (mon.1) 274 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:01:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:44 smithi111 bash[23388]: audit 2024-02-13T15:01:43.984234+0000 mon.a (mon.0) 3380 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:01:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:44 smithi111 bash[23388]: audit 2024-02-13T15:01:44.390272+0000 mon.a (mon.0) 3381 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T15:01:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:44 smithi111 bash[23388]: cluster 2024-02-13T15:01:44.397971+0000 mon.a (mon.0) 3382 : cluster 0 osdmap e726: 8 total, 8 up, 8 in 2024-02-13T15:01:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:44 smithi111 bash[23388]: audit 2024-02-13T15:01:44.400380+0000 mon.a (mon.0) 3383 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_grade_decay_rate","val": "20"}]: dispatch 2024-02-13T15:01:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:45 smithi062 bash[21479]: cluster 2024-02-13T15:01:44.263043+0000 mgr.y (mgr.14613) 695 : cluster 0 pgmap v1175: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:45 smithi062 bash[21479]: audit 2024-02-13T15:01:45.394683+0000 mon.a (mon.0) 3384 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T15:01:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:45 smithi062 bash[21479]: cluster 2024-02-13T15:01:45.401178+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-02-13T15:01:45.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:45 smithi062 bash[21479]: audit 2024-02-13T15:01:45.402372+0000 mon.a (mon.0) 3386 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T15:01:45.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:45 smithi062 bash[28859]: cluster 2024-02-13T15:01:44.263043+0000 mgr.y (mgr.14613) 695 : cluster 0 pgmap v1175: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:45.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:45 smithi062 bash[28859]: audit 2024-02-13T15:01:45.394683+0000 mon.a (mon.0) 3384 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T15:01:45.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:45 smithi062 bash[28859]: cluster 2024-02-13T15:01:45.401178+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-02-13T15:01:45.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:45 smithi062 bash[28859]: audit 2024-02-13T15:01:45.402372+0000 mon.a (mon.0) 3386 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T15:01:45.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:45 smithi111 bash[23388]: cluster 2024-02-13T15:01:44.263043+0000 mgr.y (mgr.14613) 695 : cluster 0 pgmap v1175: 300 pgs: 300 active+clean; 4.4 MiB data, 674 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:45 smithi111 bash[23388]: audit 2024-02-13T15:01:45.394683+0000 mon.a (mon.0) 3384 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_grade_decay_rate","val": "20"}]': finished 2024-02-13T15:01:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:45 smithi111 bash[23388]: cluster 2024-02-13T15:01:45.401178+0000 mon.a (mon.0) 3385 : cluster 0 osdmap e727: 8 total, 8 up, 8 in 2024-02-13T15:01:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:45 smithi111 bash[23388]: audit 2024-02-13T15:01:45.402372+0000 mon.a (mon.0) 3386 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_search_last_n","val": "1"}]: dispatch 2024-02-13T15:01:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:01:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:01:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:01:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:47 smithi062 bash[21479]: cluster 2024-02-13T15:01:46.264025+0000 mgr.y (mgr.14613) 696 : cluster 0 pgmap v1178: 300 pgs: 300 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:47 smithi062 bash[21479]: audit 2024-02-13T15:01:46.397239+0000 mon.a (mon.0) 3387 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T15:01:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:47 smithi062 bash[21479]: cluster 2024-02-13T15:01:46.404514+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-02-13T15:01:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:47 smithi062 bash[21479]: audit 2024-02-13T15:01:46.518162+0000 mon.a (mon.0) 3389 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:47.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:47 smithi062 bash[28859]: cluster 2024-02-13T15:01:46.264025+0000 mgr.y (mgr.14613) 696 : cluster 0 pgmap v1178: 300 pgs: 300 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:47.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:47 smithi062 bash[28859]: audit 2024-02-13T15:01:46.397239+0000 mon.a (mon.0) 3387 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T15:01:47.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:47 smithi062 bash[28859]: cluster 2024-02-13T15:01:46.404514+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-02-13T15:01:47.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:47 smithi062 bash[28859]: audit 2024-02-13T15:01:46.518162+0000 mon.a (mon.0) 3389 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:47 smithi111 bash[23388]: cluster 2024-02-13T15:01:46.264025+0000 mgr.y (mgr.14613) 696 : cluster 0 pgmap v1178: 300 pgs: 300 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:47 smithi111 bash[23388]: audit 2024-02-13T15:01:46.397239+0000 mon.a (mon.0) 3387 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-142","var": "hit_set_search_last_n","val": "1"}]': finished 2024-02-13T15:01:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:47 smithi111 bash[23388]: cluster 2024-02-13T15:01:46.404514+0000 mon.a (mon.0) 3388 : cluster 0 osdmap e728: 8 total, 8 up, 8 in 2024-02-13T15:01:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:47 smithi111 bash[23388]: audit 2024-02-13T15:01:46.518162+0000 mon.a (mon.0) 3389 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:48 smithi062 bash[21479]: audit 2024-02-13T15:01:47.441904+0000 mon.a (mon.0) 3390 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:01:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:48 smithi062 bash[21479]: cluster 2024-02-13T15:01:47.448243+0000 mon.a (mon.0) 3391 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-02-13T15:01:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:48 smithi062 bash[21479]: audit 2024-02-13T15:01:47.457236+0000 mon.a (mon.0) 3392 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:48 smithi062 bash[28859]: audit 2024-02-13T15:01:47.441904+0000 mon.a (mon.0) 3390 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:01:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:48 smithi062 bash[28859]: cluster 2024-02-13T15:01:47.448243+0000 mon.a (mon.0) 3391 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-02-13T15:01:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:48 smithi062 bash[28859]: audit 2024-02-13T15:01:47.457236+0000 mon.a (mon.0) 3392 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:48 smithi111 bash[23388]: audit 2024-02-13T15:01:47.441904+0000 mon.a (mon.0) 3390 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:01:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:48 smithi111 bash[23388]: cluster 2024-02-13T15:01:47.448243+0000 mon.a (mon.0) 3391 : cluster 0 osdmap e729: 8 total, 8 up, 8 in 2024-02-13T15:01:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:48 smithi111 bash[23388]: audit 2024-02-13T15:01:47.457236+0000 mon.a (mon.0) 3392 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[21479]: cluster 2024-02-13T15:01:48.264974+0000 mgr.y (mgr.14613) 697 : cluster 0 pgmap v1181: 300 pgs: 300 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[21479]: audit 2024-02-13T15:01:48.458092+0000 mon.a (mon.0) 3393 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]': finished 2024-02-13T15:01:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[21479]: cluster 2024-02-13T15:01:48.470051+0000 mon.a (mon.0) 3394 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-02-13T15:01:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[21479]: audit 2024-02-13T15:01:48.544273+0000 mon.a (mon.0) 3395 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:50.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[21479]: audit 2024-02-13T15:01:48.545148+0000 mon.a (mon.0) 3396 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[28859]: cluster 2024-02-13T15:01:48.264974+0000 mgr.y (mgr.14613) 697 : cluster 0 pgmap v1181: 300 pgs: 300 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[28859]: audit 2024-02-13T15:01:48.458092+0000 mon.a (mon.0) 3393 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]': finished 2024-02-13T15:01:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[28859]: cluster 2024-02-13T15:01:48.470051+0000 mon.a (mon.0) 3394 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-02-13T15:01:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[28859]: audit 2024-02-13T15:01:48.544273+0000 mon.a (mon.0) 3395 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:49 smithi062 bash[28859]: audit 2024-02-13T15:01:48.545148+0000 mon.a (mon.0) 3396 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:50.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:49 smithi111 bash[23388]: cluster 2024-02-13T15:01:48.264974+0000 mgr.y (mgr.14613) 697 : cluster 0 pgmap v1181: 300 pgs: 300 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:01:50.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:49 smithi111 bash[23388]: audit 2024-02-13T15:01:48.458092+0000 mon.a (mon.0) 3393 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]': finished 2024-02-13T15:01:50.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:49 smithi111 bash[23388]: cluster 2024-02-13T15:01:48.470051+0000 mon.a (mon.0) 3394 : cluster 0 osdmap e730: 8 total, 8 up, 8 in 2024-02-13T15:01:50.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:49 smithi111 bash[23388]: audit 2024-02-13T15:01:48.544273+0000 mon.a (mon.0) 3395 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:01:50.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:49 smithi111 bash[23388]: audit 2024-02-13T15:01:48.545148+0000 mon.a (mon.0) 3396 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-142"}]: dispatch 2024-02-13T15:01:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[21479]: cluster 2024-02-13T15:01:49.470355+0000 mon.a (mon.0) 3397 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-02-13T15:01:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[21479]: audit 2024-02-13T15:01:49.549501+0000 mon.b (mon.1) 275 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[21479]: cluster 2024-02-13T15:01:50.267565+0000 mgr.y (mgr.14613) 698 : cluster 0 pgmap v1184: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T15:01:51.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[21479]: cluster 2024-02-13T15:01:50.477134+0000 mon.a (mon.0) 3398 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-02-13T15:01:51.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[21479]: audit 2024-02-13T15:01:50.481451+0000 mon.a (mon.0) 3399 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[28859]: cluster 2024-02-13T15:01:49.470355+0000 mon.a (mon.0) 3397 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-02-13T15:01:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[28859]: audit 2024-02-13T15:01:49.549501+0000 mon.b (mon.1) 275 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[28859]: cluster 2024-02-13T15:01:50.267565+0000 mgr.y (mgr.14613) 698 : cluster 0 pgmap v1184: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T15:01:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[28859]: cluster 2024-02-13T15:01:50.477134+0000 mon.a (mon.0) 3398 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-02-13T15:01:51.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:50 smithi062 bash[28859]: audit 2024-02-13T15:01:50.481451+0000 mon.a (mon.0) 3399 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:51.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:01:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:01:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:50 smithi111 bash[23388]: cluster 2024-02-13T15:01:49.470355+0000 mon.a (mon.0) 3397 : cluster 0 osdmap e731: 8 total, 8 up, 8 in 2024-02-13T15:01:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:50 smithi111 bash[23388]: audit 2024-02-13T15:01:49.549501+0000 mon.b (mon.1) 275 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:01:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:50 smithi111 bash[23388]: cluster 2024-02-13T15:01:50.267565+0000 mgr.y (mgr.14613) 698 : cluster 0 pgmap v1184: 268 pgs: 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T15:01:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:50 smithi111 bash[23388]: cluster 2024-02-13T15:01:50.477134+0000 mon.a (mon.0) 3398 : cluster 0 osdmap e732: 8 total, 8 up, 8 in 2024-02-13T15:01:51.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:50 smithi111 bash[23388]: audit 2024-02-13T15:01:50.481451+0000 mon.a (mon.0) 3399 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-144","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:01:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:52 smithi062 bash[21479]: audit 2024-02-13T15:01:50.842992+0000 mgr.y (mgr.14613) 699 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:52 smithi062 bash[21479]: audit 2024-02-13T15:01:51.467329+0000 mon.a (mon.0) 3400 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:52 smithi062 bash[21479]: cluster 2024-02-13T15:01:51.474344+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-02-13T15:01:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:52 smithi062 bash[21479]: audit 2024-02-13T15:01:51.527686+0000 mon.a (mon.0) 3402 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:52 smithi062 bash[28859]: audit 2024-02-13T15:01:50.842992+0000 mgr.y (mgr.14613) 699 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:52 smithi062 bash[28859]: audit 2024-02-13T15:01:51.467329+0000 mon.a (mon.0) 3400 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:52 smithi062 bash[28859]: cluster 2024-02-13T15:01:51.474344+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-02-13T15:01:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:52 smithi062 bash[28859]: audit 2024-02-13T15:01:51.527686+0000 mon.a (mon.0) 3402 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:52.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:52 smithi111 bash[23388]: audit 2024-02-13T15:01:50.842992+0000 mgr.y (mgr.14613) 699 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:01:52.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:52 smithi111 bash[23388]: audit 2024-02-13T15:01:51.467329+0000 mon.a (mon.0) 3400 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-144","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:01:52.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:52 smithi111 bash[23388]: cluster 2024-02-13T15:01:51.474344+0000 mon.a (mon.0) 3401 : cluster 0 osdmap e733: 8 total, 8 up, 8 in 2024-02-13T15:01:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:52 smithi111 bash[23388]: audit 2024-02-13T15:01:51.527686+0000 mon.a (mon.0) 3402 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:01:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:53 smithi062 bash[28859]: cluster 2024-02-13T15:01:52.268518+0000 mgr.y (mgr.14613) 700 : cluster 0 pgmap v1187: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T15:01:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:53 smithi062 bash[28859]: audit 2024-02-13T15:01:52.478229+0000 mon.a (mon.0) 3403 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:53 smithi062 bash[28859]: cluster 2024-02-13T15:01:52.487628+0000 mon.a (mon.0) 3404 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-02-13T15:01:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:53 smithi062 bash[28859]: audit 2024-02-13T15:01:52.491387+0000 mon.a (mon.0) 3405 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:01:53.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:53 smithi062 bash[21479]: cluster 2024-02-13T15:01:52.268518+0000 mgr.y (mgr.14613) 700 : cluster 0 pgmap v1187: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T15:01:53.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:53 smithi062 bash[21479]: audit 2024-02-13T15:01:52.478229+0000 mon.a (mon.0) 3403 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:53.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:53 smithi062 bash[21479]: cluster 2024-02-13T15:01:52.487628+0000 mon.a (mon.0) 3404 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-02-13T15:01:53.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:53 smithi062 bash[21479]: audit 2024-02-13T15:01:52.491387+0000 mon.a (mon.0) 3405 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:01:53.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:53 smithi111 bash[23388]: cluster 2024-02-13T15:01:52.268518+0000 mgr.y (mgr.14613) 700 : cluster 0 pgmap v1187: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-02-13T15:01:53.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:53 smithi111 bash[23388]: audit 2024-02-13T15:01:52.478229+0000 mon.a (mon.0) 3403 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:01:53.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:53 smithi111 bash[23388]: cluster 2024-02-13T15:01:52.487628+0000 mon.a (mon.0) 3404 : cluster 0 osdmap e734: 8 total, 8 up, 8 in 2024-02-13T15:01:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:53 smithi111 bash[23388]: audit 2024-02-13T15:01:52.491387+0000 mon.a (mon.0) 3405 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:01:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:54 smithi062 bash[28859]: audit 2024-02-13T15:01:53.489907+0000 mon.a (mon.0) 3406 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-144"}]': finished 2024-02-13T15:01:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:54 smithi062 bash[28859]: cluster 2024-02-13T15:01:53.497016+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-02-13T15:01:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:54 smithi062 bash[28859]: audit 2024-02-13T15:01:53.497957+0000 mon.a (mon.0) 3408 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-144", "mode": "readproxy"}]: dispatch 2024-02-13T15:01:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:54 smithi062 bash[28859]: cluster 2024-02-13T15:01:54.269431+0000 mgr.y (mgr.14613) 701 : cluster 0 pgmap v1190: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:54 smithi062 bash[21479]: audit 2024-02-13T15:01:53.489907+0000 mon.a (mon.0) 3406 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-144"}]': finished 2024-02-13T15:01:54.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:54 smithi062 bash[21479]: cluster 2024-02-13T15:01:53.497016+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-02-13T15:01:54.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:54 smithi062 bash[21479]: audit 2024-02-13T15:01:53.497957+0000 mon.a (mon.0) 3408 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-144", "mode": "readproxy"}]: dispatch 2024-02-13T15:01:54.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:54 smithi062 bash[21479]: cluster 2024-02-13T15:01:54.269431+0000 mgr.y (mgr.14613) 701 : cluster 0 pgmap v1190: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:54 smithi111 bash[23388]: audit 2024-02-13T15:01:53.489907+0000 mon.a (mon.0) 3406 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-144"}]': finished 2024-02-13T15:01:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:54 smithi111 bash[23388]: cluster 2024-02-13T15:01:53.497016+0000 mon.a (mon.0) 3407 : cluster 0 osdmap e735: 8 total, 8 up, 8 in 2024-02-13T15:01:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:54 smithi111 bash[23388]: audit 2024-02-13T15:01:53.497957+0000 mon.a (mon.0) 3408 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-144", "mode": "readproxy"}]: dispatch 2024-02-13T15:01:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:54 smithi111 bash[23388]: cluster 2024-02-13T15:01:54.269431+0000 mgr.y (mgr.14613) 701 : cluster 0 pgmap v1190: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 675 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:01:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:55 smithi062 bash[28859]: cluster 2024-02-13T15:01:54.490319+0000 mon.a (mon.0) 3409 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:55 smithi062 bash[28859]: audit 2024-02-13T15:01:54.492745+0000 mon.a (mon.0) 3410 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-144", "mode": "readproxy"}]': finished 2024-02-13T15:01:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:55 smithi062 bash[28859]: cluster 2024-02-13T15:01:54.500418+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-02-13T15:01:55.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:55 smithi062 bash[21479]: cluster 2024-02-13T15:01:54.490319+0000 mon.a (mon.0) 3409 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:55.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:55 smithi062 bash[21479]: audit 2024-02-13T15:01:54.492745+0000 mon.a (mon.0) 3410 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-144", "mode": "readproxy"}]': finished 2024-02-13T15:01:55.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:55 smithi062 bash[21479]: cluster 2024-02-13T15:01:54.500418+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-02-13T15:01:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:55 smithi111 bash[23388]: cluster 2024-02-13T15:01:54.490319+0000 mon.a (mon.0) 3409 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:01:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:55 smithi111 bash[23388]: audit 2024-02-13T15:01:54.492745+0000 mon.a (mon.0) 3410 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-144", "mode": "readproxy"}]': finished 2024-02-13T15:01:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:55 smithi111 bash[23388]: cluster 2024-02-13T15:01:54.500418+0000 mon.a (mon.0) 3411 : cluster 0 osdmap e736: 8 total, 8 up, 8 in 2024-02-13T15:01:56.518 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:01:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:01:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:01:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:56 smithi062 bash[21479]: cluster 2024-02-13T15:01:56.272388+0000 mgr.y (mgr.14613) 702 : cluster 0 pgmap v1192: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 213 B/s wr, 1 op/s 2024-02-13T15:01:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:56 smithi062 bash[28859]: cluster 2024-02-13T15:01:56.272388+0000 mgr.y (mgr.14613) 702 : cluster 0 pgmap v1192: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 213 B/s wr, 1 op/s 2024-02-13T15:01:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:56 smithi111 bash[23388]: cluster 2024-02-13T15:01:56.272388+0000 mgr.y (mgr.14613) 702 : cluster 0 pgmap v1192: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 213 B/s wr, 1 op/s 2024-02-13T15:01:59.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:01:59 smithi111 bash[23388]: cluster 2024-02-13T15:01:58.273423+0000 mgr.y (mgr.14613) 703 : cluster 0 pgmap v1193: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-02-13T15:01:59.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:01:59 smithi062 bash[21479]: cluster 2024-02-13T15:01:58.273423+0000 mgr.y (mgr.14613) 703 : cluster 0 pgmap v1193: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-02-13T15:01:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:01:59 smithi062 bash[28859]: cluster 2024-02-13T15:01:58.273423+0000 mgr.y (mgr.14613) 703 : cluster 0 pgmap v1193: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-02-13T15:02:01.338 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:02:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:02:01.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:01 smithi111 bash[23388]: cluster 2024-02-13T15:02:00.276330+0000 mgr.y (mgr.14613) 704 : cluster 0 pgmap v1194: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 131 B/s wr, 1 op/s 2024-02-13T15:02:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:01 smithi062 bash[21479]: cluster 2024-02-13T15:02:00.276330+0000 mgr.y (mgr.14613) 704 : cluster 0 pgmap v1194: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 131 B/s wr, 1 op/s 2024-02-13T15:02:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:01 smithi062 bash[28859]: cluster 2024-02-13T15:02:00.276330+0000 mgr.y (mgr.14613) 704 : cluster 0 pgmap v1194: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 131 B/s wr, 1 op/s 2024-02-13T15:02:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:02 smithi062 bash[21479]: audit 2024-02-13T15:02:00.854396+0000 mgr.y (mgr.14613) 705 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:02 smithi062 bash[28859]: audit 2024-02-13T15:02:00.854396+0000 mgr.y (mgr.14613) 705 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:02.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:02 smithi111 bash[23388]: audit 2024-02-13T15:02:00.854396+0000 mgr.y (mgr.14613) 705 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:03 smithi062 bash[21479]: cluster 2024-02-13T15:02:02.277347+0000 mgr.y (mgr.14613) 706 : cluster 0 pgmap v1195: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 116 B/s wr, 1 op/s 2024-02-13T15:02:03.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:03 smithi062 bash[28859]: cluster 2024-02-13T15:02:02.277347+0000 mgr.y (mgr.14613) 706 : cluster 0 pgmap v1195: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 116 B/s wr, 1 op/s 2024-02-13T15:02:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:03 smithi111 bash[23388]: cluster 2024-02-13T15:02:02.277347+0000 mgr.y (mgr.14613) 706 : cluster 0 pgmap v1195: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 116 B/s wr, 1 op/s 2024-02-13T15:02:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:05 smithi062 bash[21479]: cluster 2024-02-13T15:02:04.278269+0000 mgr.y (mgr.14613) 707 : cluster 0 pgmap v1196: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-02-13T15:02:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:05 smithi062 bash[21479]: audit 2024-02-13T15:02:04.822531+0000 mon.a (mon.0) 3412 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:05 smithi062 bash[21479]: audit 2024-02-13T15:02:04.988419+0000 mon.a (mon.0) 3413 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:05 smithi062 bash[21479]: audit 2024-02-13T15:02:04.993472+0000 mon.b (mon.1) 276 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:05 smithi062 bash[28859]: cluster 2024-02-13T15:02:04.278269+0000 mgr.y (mgr.14613) 707 : cluster 0 pgmap v1196: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-02-13T15:02:05.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:05 smithi062 bash[28859]: audit 2024-02-13T15:02:04.822531+0000 mon.a (mon.0) 3412 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:05.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:05 smithi062 bash[28859]: audit 2024-02-13T15:02:04.988419+0000 mon.a (mon.0) 3413 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:05.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:05 smithi062 bash[28859]: audit 2024-02-13T15:02:04.993472+0000 mon.b (mon.1) 276 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:05 smithi111 bash[23388]: cluster 2024-02-13T15:02:04.278269+0000 mgr.y (mgr.14613) 707 : cluster 0 pgmap v1196: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 102 B/s wr, 1 op/s 2024-02-13T15:02:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:05 smithi111 bash[23388]: audit 2024-02-13T15:02:04.822531+0000 mon.a (mon.0) 3412 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:05 smithi111 bash[23388]: audit 2024-02-13T15:02:04.988419+0000 mon.a (mon.0) 3413 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:05.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:05 smithi111 bash[23388]: audit 2024-02-13T15:02:04.993472+0000 mon.b (mon.1) 276 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:02:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:02:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[21479]: audit 2024-02-13T15:02:05.355442+0000 mon.a (mon.0) 3414 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[21479]: cluster 2024-02-13T15:02:05.363884+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[21479]: audit 2024-02-13T15:02:05.367353+0000 mon.a (mon.0) 3416 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[21479]: cluster 2024-02-13T15:02:06.355847+0000 mon.a (mon.0) 3417 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[21479]: audit 2024-02-13T15:02:06.358283+0000 mon.a (mon.0) 3418 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]': finished 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[21479]: cluster 2024-02-13T15:02:06.366390+0000 mon.a (mon.0) 3419 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[28859]: audit 2024-02-13T15:02:05.355442+0000 mon.a (mon.0) 3414 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[28859]: cluster 2024-02-13T15:02:05.363884+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[28859]: audit 2024-02-13T15:02:05.367353+0000 mon.a (mon.0) 3416 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[28859]: cluster 2024-02-13T15:02:06.355847+0000 mon.a (mon.0) 3417 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[28859]: audit 2024-02-13T15:02:06.358283+0000 mon.a (mon.0) 3418 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]': finished 2024-02-13T15:02:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:06 smithi062 bash[28859]: cluster 2024-02-13T15:02:06.366390+0000 mon.a (mon.0) 3419 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-02-13T15:02:06.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:06 smithi111 bash[23388]: audit 2024-02-13T15:02:05.355442+0000 mon.a (mon.0) 3414 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:06 smithi111 bash[23388]: cluster 2024-02-13T15:02:05.363884+0000 mon.a (mon.0) 3415 : cluster 0 osdmap e737: 8 total, 8 up, 8 in 2024-02-13T15:02:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:06 smithi111 bash[23388]: audit 2024-02-13T15:02:05.367353+0000 mon.a (mon.0) 3416 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:02:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:06 smithi111 bash[23388]: cluster 2024-02-13T15:02:06.355847+0000 mon.a (mon.0) 3417 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:02:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:06 smithi111 bash[23388]: audit 2024-02-13T15:02:06.358283+0000 mon.a (mon.0) 3418 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]': finished 2024-02-13T15:02:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:06 smithi111 bash[23388]: cluster 2024-02-13T15:02:06.366390+0000 mon.a (mon.0) 3419 : cluster 0 osdmap e738: 8 total, 8 up, 8 in 2024-02-13T15:02:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:07 smithi062 bash[28859]: cluster 2024-02-13T15:02:06.279200+0000 mgr.y (mgr.14613) 708 : cluster 0 pgmap v1198: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:02:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:07 smithi062 bash[28859]: audit 2024-02-13T15:02:06.449587+0000 mon.a (mon.0) 3420 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:07 smithi062 bash[28859]: audit 2024-02-13T15:02:06.450487+0000 mon.a (mon.0) 3421 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:02:07.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:07 smithi062 bash[21479]: cluster 2024-02-13T15:02:06.279200+0000 mgr.y (mgr.14613) 708 : cluster 0 pgmap v1198: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:02:07.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:07 smithi062 bash[21479]: audit 2024-02-13T15:02:06.449587+0000 mon.a (mon.0) 3420 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:07.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:07 smithi062 bash[21479]: audit 2024-02-13T15:02:06.450487+0000 mon.a (mon.0) 3421 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:02:07.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:07 smithi111 bash[23388]: cluster 2024-02-13T15:02:06.279200+0000 mgr.y (mgr.14613) 708 : cluster 0 pgmap v1198: 300 pgs: 300 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:02:07.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:07 smithi111 bash[23388]: audit 2024-02-13T15:02:06.449587+0000 mon.a (mon.0) 3420 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:07.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:07 smithi111 bash[23388]: audit 2024-02-13T15:02:06.450487+0000 mon.a (mon.0) 3421 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-144"}]: dispatch 2024-02-13T15:02:08.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:08 smithi062 bash[21479]: cluster 2024-02-13T15:02:07.400260+0000 mon.a (mon.0) 3422 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-02-13T15:02:08.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:08 smithi062 bash[28859]: cluster 2024-02-13T15:02:07.400260+0000 mon.a (mon.0) 3422 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-02-13T15:02:08.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:08 smithi111 bash[23388]: cluster 2024-02-13T15:02:07.400260+0000 mon.a (mon.0) 3422 : cluster 0 osdmap e739: 8 total, 8 up, 8 in 2024-02-13T15:02:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:09 smithi062 bash[28859]: cluster 2024-02-13T15:02:08.280098+0000 mgr.y (mgr.14613) 709 : cluster 0 pgmap v1201: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:02:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:09 smithi062 bash[28859]: cluster 2024-02-13T15:02:08.414925+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-02-13T15:02:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:09 smithi062 bash[28859]: audit 2024-02-13T15:02:08.426642+0000 mon.a (mon.0) 3424 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:09 smithi062 bash[21479]: cluster 2024-02-13T15:02:08.280098+0000 mgr.y (mgr.14613) 709 : cluster 0 pgmap v1201: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:02:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:09 smithi062 bash[21479]: cluster 2024-02-13T15:02:08.414925+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-02-13T15:02:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:09 smithi062 bash[21479]: audit 2024-02-13T15:02:08.426642+0000 mon.a (mon.0) 3424 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:09.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:09 smithi111 bash[23388]: cluster 2024-02-13T15:02:08.280098+0000 mgr.y (mgr.14613) 709 : cluster 0 pgmap v1201: 268 pgs: 268 active+clean; 4.4 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:02:09.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:09 smithi111 bash[23388]: cluster 2024-02-13T15:02:08.414925+0000 mon.a (mon.0) 3423 : cluster 0 osdmap e740: 8 total, 8 up, 8 in 2024-02-13T15:02:09.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:09 smithi111 bash[23388]: audit 2024-02-13T15:02:08.426642+0000 mon.a (mon.0) 3424 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-146","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:10 smithi062 bash[21479]: audit 2024-02-13T15:02:09.412433+0000 mon.a (mon.0) 3425 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:10 smithi062 bash[21479]: cluster 2024-02-13T15:02:09.419558+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-02-13T15:02:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:10 smithi062 bash[21479]: audit 2024-02-13T15:02:09.483160+0000 mon.a (mon.0) 3427 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:02:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:10 smithi062 bash[28859]: audit 2024-02-13T15:02:09.412433+0000 mon.a (mon.0) 3425 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:10 smithi062 bash[28859]: cluster 2024-02-13T15:02:09.419558+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-02-13T15:02:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:10 smithi062 bash[28859]: audit 2024-02-13T15:02:09.483160+0000 mon.a (mon.0) 3427 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:02:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:10 smithi111 bash[23388]: audit 2024-02-13T15:02:09.412433+0000 mon.a (mon.0) 3425 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-146","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:10 smithi111 bash[23388]: cluster 2024-02-13T15:02:09.419558+0000 mon.a (mon.0) 3426 : cluster 0 osdmap e741: 8 total, 8 up, 8 in 2024-02-13T15:02:10.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:10 smithi111 bash[23388]: audit 2024-02-13T15:02:09.483160+0000 mon.a (mon.0) 3427 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:02:11.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:02:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:02:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:11 smithi062 bash[21479]: cluster 2024-02-13T15:02:10.282764+0000 mgr.y (mgr.14613) 710 : cluster 0 pgmap v1204: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T15:02:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:11 smithi062 bash[21479]: audit 2024-02-13T15:02:10.440519+0000 mon.a (mon.0) 3428 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:02:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:11 smithi062 bash[21479]: cluster 2024-02-13T15:02:10.450194+0000 mon.a (mon.0) 3429 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-02-13T15:02:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:11 smithi062 bash[21479]: audit 2024-02-13T15:02:10.452026+0000 mon.a (mon.0) 3430 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:11 smithi062 bash[28859]: cluster 2024-02-13T15:02:10.282764+0000 mgr.y (mgr.14613) 710 : cluster 0 pgmap v1204: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T15:02:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:11 smithi062 bash[28859]: audit 2024-02-13T15:02:10.440519+0000 mon.a (mon.0) 3428 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:02:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:11 smithi062 bash[28859]: cluster 2024-02-13T15:02:10.450194+0000 mon.a (mon.0) 3429 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-02-13T15:02:11.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:11 smithi062 bash[28859]: audit 2024-02-13T15:02:10.452026+0000 mon.a (mon.0) 3430 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:11.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:11 smithi111 bash[23388]: cluster 2024-02-13T15:02:10.282764+0000 mgr.y (mgr.14613) 710 : cluster 0 pgmap v1204: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T15:02:11.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:11 smithi111 bash[23388]: audit 2024-02-13T15:02:10.440519+0000 mon.a (mon.0) 3428 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:02:11.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:11 smithi111 bash[23388]: cluster 2024-02-13T15:02:10.450194+0000 mon.a (mon.0) 3429 : cluster 0 osdmap e742: 8 total, 8 up, 8 in 2024-02-13T15:02:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:11 smithi111 bash[23388]: audit 2024-02-13T15:02:10.452026+0000 mon.a (mon.0) 3430 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[21479]: audit 2024-02-13T15:02:10.865368+0000 mgr.y (mgr.14613) 711 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[21479]: audit 2024-02-13T15:02:11.443333+0000 mon.a (mon.0) 3431 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-146"}]': finished 2024-02-13T15:02:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[21479]: cluster 2024-02-13T15:02:11.450856+0000 mon.a (mon.0) 3432 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-02-13T15:02:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[21479]: audit 2024-02-13T15:02:11.452295+0000 mon.a (mon.0) 3433 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-146", "mode": "writeback"}]: dispatch 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[21479]: cluster 2024-02-13T15:02:12.443632+0000 mon.a (mon.0) 3434 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[21479]: audit 2024-02-13T15:02:12.446066+0000 mon.a (mon.0) 3435 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-146", "mode": "writeback"}]': finished 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[21479]: cluster 2024-02-13T15:02:12.453730+0000 mon.a (mon.0) 3436 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[28859]: audit 2024-02-13T15:02:10.865368+0000 mgr.y (mgr.14613) 711 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[28859]: audit 2024-02-13T15:02:11.443333+0000 mon.a (mon.0) 3431 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-146"}]': finished 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[28859]: cluster 2024-02-13T15:02:11.450856+0000 mon.a (mon.0) 3432 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[28859]: audit 2024-02-13T15:02:11.452295+0000 mon.a (mon.0) 3433 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-146", "mode": "writeback"}]: dispatch 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[28859]: cluster 2024-02-13T15:02:12.443632+0000 mon.a (mon.0) 3434 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[28859]: audit 2024-02-13T15:02:12.446066+0000 mon.a (mon.0) 3435 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-146", "mode": "writeback"}]': finished 2024-02-13T15:02:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:12 smithi062 bash[28859]: cluster 2024-02-13T15:02:12.453730+0000 mon.a (mon.0) 3436 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-02-13T15:02:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:12 smithi111 bash[23388]: audit 2024-02-13T15:02:10.865368+0000 mgr.y (mgr.14613) 711 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:12 smithi111 bash[23388]: audit 2024-02-13T15:02:11.443333+0000 mon.a (mon.0) 3431 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier set-overlay", "pool": "test-rados-api-smithi062-64695-111", "overlaypool": "test-rados-api-smithi062-64695-146"}]': finished 2024-02-13T15:02:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:12 smithi111 bash[23388]: cluster 2024-02-13T15:02:11.450856+0000 mon.a (mon.0) 3432 : cluster 0 osdmap e743: 8 total, 8 up, 8 in 2024-02-13T15:02:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:12 smithi111 bash[23388]: audit 2024-02-13T15:02:11.452295+0000 mon.a (mon.0) 3433 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-146", "mode": "writeback"}]: dispatch 2024-02-13T15:02:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:12 smithi111 bash[23388]: cluster 2024-02-13T15:02:12.443632+0000 mon.a (mon.0) 3434 : cluster 3 Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET) 2024-02-13T15:02:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:12 smithi111 bash[23388]: audit 2024-02-13T15:02:12.446066+0000 mon.a (mon.0) 3435 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier cache-mode", "pool": "test-rados-api-smithi062-64695-146", "mode": "writeback"}]': finished 2024-02-13T15:02:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:12 smithi111 bash[23388]: cluster 2024-02-13T15:02:12.453730+0000 mon.a (mon.0) 3436 : cluster 0 osdmap e744: 8 total, 8 up, 8 in 2024-02-13T15:02:13.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:13 smithi062 bash[21479]: cluster 2024-02-13T15:02:12.283607+0000 mgr.y (mgr.14613) 712 : cluster 0 pgmap v1207: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T15:02:13.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:13 smithi062 bash[21479]: audit 2024-02-13T15:02:12.592540+0000 mon.a (mon.0) 3437 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:02:13.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:13 smithi062 bash[28859]: cluster 2024-02-13T15:02:12.283607+0000 mgr.y (mgr.14613) 712 : cluster 0 pgmap v1207: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T15:02:13.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:13 smithi062 bash[28859]: audit 2024-02-13T15:02:12.592540+0000 mon.a (mon.0) 3437 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:02:13.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:13 smithi111 bash[23388]: cluster 2024-02-13T15:02:12.283607+0000 mgr.y (mgr.14613) 712 : cluster 0 pgmap v1207: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 2 op/s 2024-02-13T15:02:13.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:13 smithi111 bash[23388]: audit 2024-02-13T15:02:12.592540+0000 mon.a (mon.0) 3437 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_count","val": "2"}]: dispatch 2024-02-13T15:02:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:14 smithi062 bash[21479]: audit 2024-02-13T15:02:13.493433+0000 mon.a (mon.0) 3438 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:02:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:14 smithi062 bash[21479]: cluster 2024-02-13T15:02:13.500788+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-02-13T15:02:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:14 smithi062 bash[21479]: audit 2024-02-13T15:02:13.501610+0000 mon.a (mon.0) 3440 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:02:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:14 smithi062 bash[21479]: cluster 2024-02-13T15:02:14.284487+0000 mgr.y (mgr.14613) 713 : cluster 0 pgmap v1210: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:14 smithi062 bash[28859]: audit 2024-02-13T15:02:13.493433+0000 mon.a (mon.0) 3438 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:02:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:14 smithi062 bash[28859]: cluster 2024-02-13T15:02:13.500788+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-02-13T15:02:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:14 smithi062 bash[28859]: audit 2024-02-13T15:02:13.501610+0000 mon.a (mon.0) 3440 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:02:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:14 smithi062 bash[28859]: cluster 2024-02-13T15:02:14.284487+0000 mgr.y (mgr.14613) 713 : cluster 0 pgmap v1210: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:14.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:14 smithi111 bash[23388]: audit 2024-02-13T15:02:13.493433+0000 mon.a (mon.0) 3438 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_count","val": "2"}]': finished 2024-02-13T15:02:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:14 smithi111 bash[23388]: cluster 2024-02-13T15:02:13.500788+0000 mon.a (mon.0) 3439 : cluster 0 osdmap e745: 8 total, 8 up, 8 in 2024-02-13T15:02:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:14 smithi111 bash[23388]: audit 2024-02-13T15:02:13.501610+0000 mon.a (mon.0) 3440 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_period","val": "600"}]: dispatch 2024-02-13T15:02:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:14 smithi111 bash[23388]: cluster 2024-02-13T15:02:14.284487+0000 mgr.y (mgr.14613) 713 : cluster 0 pgmap v1210: 300 pgs: 300 active+clean; 4.4 MiB data, 694 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:15.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:15 smithi062 bash[21479]: audit 2024-02-13T15:02:14.502008+0000 mon.a (mon.0) 3441 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:02:15.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:15 smithi062 bash[21479]: cluster 2024-02-13T15:02:14.511171+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-02-13T15:02:15.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:15 smithi062 bash[21479]: audit 2024-02-13T15:02:14.512774+0000 mon.a (mon.0) 3443 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:02:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:15 smithi062 bash[28859]: audit 2024-02-13T15:02:14.502008+0000 mon.a (mon.0) 3441 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:02:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:15 smithi062 bash[28859]: cluster 2024-02-13T15:02:14.511171+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-02-13T15:02:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:15 smithi062 bash[28859]: audit 2024-02-13T15:02:14.512774+0000 mon.a (mon.0) 3443 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:02:15.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:15 smithi111 bash[23388]: audit 2024-02-13T15:02:14.502008+0000 mon.a (mon.0) 3441 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_period","val": "600"}]': finished 2024-02-13T15:02:15.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:15 smithi111 bash[23388]: cluster 2024-02-13T15:02:14.511171+0000 mon.a (mon.0) 3442 : cluster 0 osdmap e746: 8 total, 8 up, 8 in 2024-02-13T15:02:15.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:15 smithi111 bash[23388]: audit 2024-02-13T15:02:14.512774+0000 mon.a (mon.0) 3443 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_type","val": "bloom"}]: dispatch 2024-02-13T15:02:16.535 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:02:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:02:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21479]: cluster 2024-02-13T15:02:15.502391+0000 mon.a (mon.0) 3444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:02:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21479]: audit 2024-02-13T15:02:15.504829+0000 mon.a (mon.0) 3445 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:02:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21479]: cluster 2024-02-13T15:02:15.513070+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-02-13T15:02:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21479]: audit 2024-02-13T15:02:15.518993+0000 mon.a (mon.0) 3447 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T15:02:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21479]: cluster 2024-02-13T15:02:16.285387+0000 mgr.y (mgr.14613) 714 : cluster 0 pgmap v1213: 300 pgs: 300 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21479]: audit 2024-02-13T15:02:16.507349+0000 mon.a (mon.0) 3448 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21479]: cluster 2024-02-13T15:02:16.515674+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[21479]: audit 2024-02-13T15:02:16.516907+0000 mon.a (mon.0) 3450 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[28859]: cluster 2024-02-13T15:02:15.502391+0000 mon.a (mon.0) 3444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[28859]: audit 2024-02-13T15:02:15.504829+0000 mon.a (mon.0) 3445 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[28859]: cluster 2024-02-13T15:02:15.513070+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[28859]: audit 2024-02-13T15:02:15.518993+0000 mon.a (mon.0) 3447 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[28859]: cluster 2024-02-13T15:02:16.285387+0000 mgr.y (mgr.14613) 714 : cluster 0 pgmap v1213: 300 pgs: 300 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[28859]: audit 2024-02-13T15:02:16.507349+0000 mon.a (mon.0) 3448 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[28859]: cluster 2024-02-13T15:02:16.515674+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-02-13T15:02:16.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:16 smithi062 bash[28859]: audit 2024-02-13T15:02:16.516907+0000 mon.a (mon.0) 3450 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T15:02:16.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:16 smithi111 bash[23388]: cluster 2024-02-13T15:02:15.502391+0000 mon.a (mon.0) 3444 : cluster 1 Health check cleared: CACHE_POOL_NO_HIT_SET (was: 1 cache pools are missing hit_sets) 2024-02-13T15:02:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:16 smithi111 bash[23388]: audit 2024-02-13T15:02:15.504829+0000 mon.a (mon.0) 3445 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "hit_set_type","val": "bloom"}]': finished 2024-02-13T15:02:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:16 smithi111 bash[23388]: cluster 2024-02-13T15:02:15.513070+0000 mon.a (mon.0) 3446 : cluster 0 osdmap e747: 8 total, 8 up, 8 in 2024-02-13T15:02:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:16 smithi111 bash[23388]: audit 2024-02-13T15:02:15.518993+0000 mon.a (mon.0) 3447 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "min_read_recency_for_promote","val": "1"}]: dispatch 2024-02-13T15:02:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:16 smithi111 bash[23388]: cluster 2024-02-13T15:02:16.285387+0000 mgr.y (mgr.14613) 714 : cluster 0 pgmap v1213: 300 pgs: 300 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:16 smithi111 bash[23388]: audit 2024-02-13T15:02:16.507349+0000 mon.a (mon.0) 3448 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "min_read_recency_for_promote","val": "1"}]': finished 2024-02-13T15:02:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:16 smithi111 bash[23388]: cluster 2024-02-13T15:02:16.515674+0000 mon.a (mon.0) 3449 : cluster 0 osdmap e748: 8 total, 8 up, 8 in 2024-02-13T15:02:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:16 smithi111 bash[23388]: audit 2024-02-13T15:02:16.516907+0000 mon.a (mon.0) 3450 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "target_max_objects","val": "1"}]: dispatch 2024-02-13T15:02:18.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:18 smithi062 bash[28859]: audit 2024-02-13T15:02:17.509926+0000 mon.a (mon.0) 3451 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "target_max_objects","val": "1"}]': finished 2024-02-13T15:02:18.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:18 smithi062 bash[28859]: cluster 2024-02-13T15:02:17.518114+0000 mon.a (mon.0) 3452 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-02-13T15:02:18.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:18 smithi062 bash[28859]: cluster 2024-02-13T15:02:18.286331+0000 mgr.y (mgr.14613) 715 : cluster 0 pgmap v1216: 300 pgs: 300 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:18 smithi062 bash[21479]: audit 2024-02-13T15:02:17.509926+0000 mon.a (mon.0) 3451 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "target_max_objects","val": "1"}]': finished 2024-02-13T15:02:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:18 smithi062 bash[21479]: cluster 2024-02-13T15:02:17.518114+0000 mon.a (mon.0) 3452 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-02-13T15:02:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:18 smithi062 bash[21479]: cluster 2024-02-13T15:02:18.286331+0000 mgr.y (mgr.14613) 715 : cluster 0 pgmap v1216: 300 pgs: 300 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:18.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:18 smithi111 bash[23388]: audit 2024-02-13T15:02:17.509926+0000 mon.a (mon.0) 3451 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-146","var": "target_max_objects","val": "1"}]': finished 2024-02-13T15:02:18.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:18 smithi111 bash[23388]: cluster 2024-02-13T15:02:17.518114+0000 mon.a (mon.0) 3452 : cluster 0 osdmap e749: 8 total, 8 up, 8 in 2024-02-13T15:02:18.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:18 smithi111 bash[23388]: cluster 2024-02-13T15:02:18.286331+0000 mgr.y (mgr.14613) 715 : cluster 0 pgmap v1216: 300 pgs: 300 active+clean; 4.4 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:19 smithi062 bash[21479]: cluster 2024-02-13T15:02:18.509968+0000 mon.a (mon.0) 3453 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T15:02:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:19 smithi062 bash[28859]: cluster 2024-02-13T15:02:18.509968+0000 mon.a (mon.0) 3453 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T15:02:19.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:19 smithi111 bash[23388]: cluster 2024-02-13T15:02:18.509968+0000 mon.a (mon.0) 3453 : cluster 3 Health check failed: 1 cache pools at or near target size (CACHE_POOL_NEAR_FULL) 2024-02-13T15:02:21.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:21 smithi062 bash[21479]: audit 2024-02-13T15:02:20.035561+0000 mon.a (mon.0) 3454 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:21.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:21 smithi062 bash[21479]: audit 2024-02-13T15:02:20.039941+0000 mon.b (mon.1) 277 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:21.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:21 smithi062 bash[21479]: cluster 2024-02-13T15:02:20.289124+0000 mgr.y (mgr.14613) 716 : cluster 0 pgmap v1217: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:21 smithi062 bash[28859]: audit 2024-02-13T15:02:20.035561+0000 mon.a (mon.0) 3454 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:21 smithi062 bash[28859]: audit 2024-02-13T15:02:20.039941+0000 mon.b (mon.1) 277 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:21.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:21 smithi062 bash[28859]: cluster 2024-02-13T15:02:20.289124+0000 mgr.y (mgr.14613) 716 : cluster 0 pgmap v1217: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:21.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:02:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:02:21.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:21 smithi111 bash[23388]: audit 2024-02-13T15:02:20.035561+0000 mon.a (mon.0) 3454 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:21.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:21 smithi111 bash[23388]: audit 2024-02-13T15:02:20.039941+0000 mon.b (mon.1) 277 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:21.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:21 smithi111 bash[23388]: cluster 2024-02-13T15:02:20.289124+0000 mgr.y (mgr.14613) 716 : cluster 0 pgmap v1217: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 2.4 KiB/s rd, 0 B/s wr, 3 op/s 2024-02-13T15:02:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:22 smithi062 bash[21479]: audit 2024-02-13T15:02:20.873407+0000 mgr.y (mgr.14613) 717 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:22.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:22 smithi062 bash[28859]: audit 2024-02-13T15:02:20.873407+0000 mgr.y (mgr.14613) 717 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:22.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:22 smithi111 bash[23388]: audit 2024-02-13T15:02:20.873407+0000 mgr.y (mgr.14613) 717 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:23.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:23 smithi062 bash[21479]: cluster 2024-02-13T15:02:22.290057+0000 mgr.y (mgr.14613) 718 : cluster 0 pgmap v1218: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 754 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:23 smithi062 bash[28859]: cluster 2024-02-13T15:02:22.290057+0000 mgr.y (mgr.14613) 718 : cluster 0 pgmap v1218: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 754 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:23.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:23 smithi111 bash[23388]: cluster 2024-02-13T15:02:22.290057+0000 mgr.y (mgr.14613) 718 : cluster 0 pgmap v1218: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 754 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:25 smithi062 bash[21479]: cluster 2024-02-13T15:02:24.291022+0000 mgr.y (mgr.14613) 719 : cluster 0 pgmap v1219: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T15:02:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:25 smithi062 bash[28859]: cluster 2024-02-13T15:02:24.291022+0000 mgr.y (mgr.14613) 719 : cluster 0 pgmap v1219: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T15:02:25.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:25 smithi111 bash[23388]: cluster 2024-02-13T15:02:24.291022+0000 mgr.y (mgr.14613) 719 : cluster 0 pgmap v1219: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 B/s wr, 0 op/s 2024-02-13T15:02:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:02:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:02:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:02:27.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:27 smithi062 bash[21479]: cluster 2024-02-13T15:02:26.293893+0000 mgr.y (mgr.14613) 720 : cluster 0 pgmap v1220: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:27 smithi062 bash[28859]: cluster 2024-02-13T15:02:26.293893+0000 mgr.y (mgr.14613) 720 : cluster 0 pgmap v1220: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:27.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:27 smithi111 bash[23388]: cluster 2024-02-13T15:02:26.293893+0000 mgr.y (mgr.14613) 720 : cluster 0 pgmap v1220: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:28 smithi062 bash[21479]: audit 2024-02-13T15:02:27.541245+0000 mon.a (mon.0) 3455 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:28 smithi062 bash[28859]: audit 2024-02-13T15:02:27.541245+0000 mon.a (mon.0) 3455 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:28 smithi111 bash[23388]: audit 2024-02-13T15:02:27.541245+0000 mon.a (mon.0) 3455 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:29 smithi062 bash[28859]: cluster 2024-02-13T15:02:28.294867+0000 mgr.y (mgr.14613) 721 : cluster 0 pgmap v1221: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 949 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:29 smithi062 bash[28859]: audit 2024-02-13T15:02:28.364094+0000 mon.a (mon.0) 3456 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:29 smithi062 bash[28859]: cluster 2024-02-13T15:02:28.370820+0000 mon.a (mon.0) 3457 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-02-13T15:02:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:29 smithi062 bash[28859]: audit 2024-02-13T15:02:28.371492+0000 mon.a (mon.0) 3458 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:29 smithi062 bash[21479]: cluster 2024-02-13T15:02:28.294867+0000 mgr.y (mgr.14613) 721 : cluster 0 pgmap v1221: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 949 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:29 smithi062 bash[21479]: audit 2024-02-13T15:02:28.364094+0000 mon.a (mon.0) 3456 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:29 smithi062 bash[21479]: cluster 2024-02-13T15:02:28.370820+0000 mon.a (mon.0) 3457 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-02-13T15:02:29.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:29 smithi062 bash[21479]: audit 2024-02-13T15:02:28.371492+0000 mon.a (mon.0) 3458 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:29 smithi111 bash[23388]: cluster 2024-02-13T15:02:28.294867+0000 mgr.y (mgr.14613) 721 : cluster 0 pgmap v1221: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 949 B/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:29 smithi111 bash[23388]: audit 2024-02-13T15:02:28.364094+0000 mon.a (mon.0) 3456 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:29 smithi111 bash[23388]: cluster 2024-02-13T15:02:28.370820+0000 mon.a (mon.0) 3457 : cluster 0 osdmap e750: 8 total, 8 up, 8 in 2024-02-13T15:02:29.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:29 smithi111 bash[23388]: audit 2024-02-13T15:02:28.371492+0000 mon.a (mon.0) 3458 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:30 smithi062 bash[28859]: audit 2024-02-13T15:02:29.366661+0000 mon.a (mon.0) 3459 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]': finished 2024-02-13T15:02:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:30 smithi062 bash[28859]: cluster 2024-02-13T15:02:29.374353+0000 mon.a (mon.0) 3460 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-02-13T15:02:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:30 smithi062 bash[28859]: audit 2024-02-13T15:02:29.461232+0000 mon.a (mon.0) 3461 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:30 smithi062 bash[28859]: audit 2024-02-13T15:02:29.462097+0000 mon.a (mon.0) 3462 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:30 smithi062 bash[21479]: audit 2024-02-13T15:02:29.366661+0000 mon.a (mon.0) 3459 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]': finished 2024-02-13T15:02:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:30 smithi062 bash[21479]: cluster 2024-02-13T15:02:29.374353+0000 mon.a (mon.0) 3460 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-02-13T15:02:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:30 smithi062 bash[21479]: audit 2024-02-13T15:02:29.461232+0000 mon.a (mon.0) 3461 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:30 smithi062 bash[21479]: audit 2024-02-13T15:02:29.462097+0000 mon.a (mon.0) 3462 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:30 smithi111 bash[23388]: audit 2024-02-13T15:02:29.366661+0000 mon.a (mon.0) 3459 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]': finished 2024-02-13T15:02:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:30 smithi111 bash[23388]: cluster 2024-02-13T15:02:29.374353+0000 mon.a (mon.0) 3460 : cluster 0 osdmap e751: 8 total, 8 up, 8 in 2024-02-13T15:02:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:30 smithi111 bash[23388]: audit 2024-02-13T15:02:29.461232+0000 mon.a (mon.0) 3461 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:30 smithi111 bash[23388]: audit 2024-02-13T15:02:29.462097+0000 mon.a (mon.0) 3462 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-146"}]: dispatch 2024-02-13T15:02:31.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:02:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:02:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:31 smithi062 bash[28859]: cluster 2024-02-13T15:02:30.297527+0000 mgr.y (mgr.14613) 722 : cluster 0 pgmap v1224: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:31 smithi062 bash[28859]: cluster 2024-02-13T15:02:30.380785+0000 mon.a (mon.0) 3463 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:31 smithi062 bash[28859]: cluster 2024-02-13T15:02:30.380842+0000 mon.a (mon.0) 3464 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T15:02:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:31 smithi062 bash[28859]: cluster 2024-02-13T15:02:30.403806+0000 mon.a (mon.0) 3465 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-02-13T15:02:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:31 smithi062 bash[21479]: cluster 2024-02-13T15:02:30.297527+0000 mgr.y (mgr.14613) 722 : cluster 0 pgmap v1224: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:31 smithi062 bash[21479]: cluster 2024-02-13T15:02:30.380785+0000 mon.a (mon.0) 3463 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:31 smithi062 bash[21479]: cluster 2024-02-13T15:02:30.380842+0000 mon.a (mon.0) 3464 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T15:02:31.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:31 smithi062 bash[21479]: cluster 2024-02-13T15:02:30.403806+0000 mon.a (mon.0) 3465 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-02-13T15:02:31.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:31 smithi111 bash[23388]: cluster 2024-02-13T15:02:30.297527+0000 mgr.y (mgr.14613) 722 : cluster 0 pgmap v1224: 300 pgs: 300 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 0 B/s wr, 1 op/s 2024-02-13T15:02:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:31 smithi111 bash[23388]: cluster 2024-02-13T15:02:30.380785+0000 mon.a (mon.0) 3463 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:31 smithi111 bash[23388]: cluster 2024-02-13T15:02:30.380842+0000 mon.a (mon.0) 3464 : cluster 1 Health check cleared: CACHE_POOL_NEAR_FULL (was: 1 cache pools at or near target size) 2024-02-13T15:02:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:31 smithi111 bash[23388]: cluster 2024-02-13T15:02:30.403806+0000 mon.a (mon.0) 3465 : cluster 0 osdmap e752: 8 total, 8 up, 8 in 2024-02-13T15:02:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[28859]: audit 2024-02-13T15:02:30.881491+0000 mgr.y (mgr.14613) 723 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[28859]: cluster 2024-02-13T15:02:31.408284+0000 mon.a (mon.0) 3466 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-02-13T15:02:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[28859]: audit 2024-02-13T15:02:31.412213+0000 mon.a (mon.0) 3467 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[28859]: audit 2024-02-13T15:02:32.399769+0000 mon.a (mon.0) 3468 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[28859]: cluster 2024-02-13T15:02:32.410757+0000 mon.a (mon.0) 3469 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-02-13T15:02:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[21479]: audit 2024-02-13T15:02:30.881491+0000 mgr.y (mgr.14613) 723 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[21479]: cluster 2024-02-13T15:02:31.408284+0000 mon.a (mon.0) 3466 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-02-13T15:02:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[21479]: audit 2024-02-13T15:02:31.412213+0000 mon.a (mon.0) 3467 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[21479]: audit 2024-02-13T15:02:32.399769+0000 mon.a (mon.0) 3468 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:32 smithi062 bash[21479]: cluster 2024-02-13T15:02:32.410757+0000 mon.a (mon.0) 3469 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-02-13T15:02:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:32 smithi111 bash[23388]: audit 2024-02-13T15:02:30.881491+0000 mgr.y (mgr.14613) 723 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:32 smithi111 bash[23388]: cluster 2024-02-13T15:02:31.408284+0000 mon.a (mon.0) 3466 : cluster 0 osdmap e753: 8 total, 8 up, 8 in 2024-02-13T15:02:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:32 smithi111 bash[23388]: audit 2024-02-13T15:02:31.412213+0000 mon.a (mon.0) 3467 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-148","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:32 smithi111 bash[23388]: audit 2024-02-13T15:02:32.399769+0000 mon.a (mon.0) 3468 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-148","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:32 smithi111 bash[23388]: cluster 2024-02-13T15:02:32.410757+0000 mon.a (mon.0) 3469 : cluster 0 osdmap e754: 8 total, 8 up, 8 in 2024-02-13T15:02:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:33 smithi062 bash[21479]: cluster 2024-02-13T15:02:32.298367+0000 mgr.y (mgr.14613) 724 : cluster 0 pgmap v1227: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T15:02:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:33 smithi062 bash[21479]: audit 2024-02-13T15:02:32.460252+0000 mon.a (mon.0) 3470 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:02:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:33 smithi062 bash[28859]: cluster 2024-02-13T15:02:32.298367+0000 mgr.y (mgr.14613) 724 : cluster 0 pgmap v1227: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T15:02:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:33 smithi062 bash[28859]: audit 2024-02-13T15:02:32.460252+0000 mon.a (mon.0) 3470 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:02:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:33 smithi111 bash[23388]: cluster 2024-02-13T15:02:32.298367+0000 mgr.y (mgr.14613) 724 : cluster 0 pgmap v1227: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-02-13T15:02:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:33 smithi111 bash[23388]: audit 2024-02-13T15:02:32.460252+0000 mon.a (mon.0) 3470 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148", "force_nonempty": "--force-nonempty" }]: dispatch 2024-02-13T15:02:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:34 smithi062 bash[21479]: audit 2024-02-13T15:02:33.435529+0000 mon.a (mon.0) 3471 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:02:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:34 smithi062 bash[21479]: cluster 2024-02-13T15:02:33.442501+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-02-13T15:02:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:34 smithi062 bash[21479]: audit 2024-02-13T15:02:33.459682+0000 mon.a (mon.0) 3473 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]: dispatch 2024-02-13T15:02:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:34 smithi062 bash[28859]: audit 2024-02-13T15:02:33.435529+0000 mon.a (mon.0) 3471 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:02:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:34 smithi062 bash[28859]: cluster 2024-02-13T15:02:33.442501+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-02-13T15:02:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:34 smithi062 bash[28859]: audit 2024-02-13T15:02:33.459682+0000 mon.a (mon.0) 3473 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]: dispatch 2024-02-13T15:02:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:34 smithi111 bash[23388]: audit 2024-02-13T15:02:33.435529+0000 mon.a (mon.0) 3471 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier add", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148", "force_nonempty": "--force-nonempty" }]': finished 2024-02-13T15:02:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:34 smithi111 bash[23388]: cluster 2024-02-13T15:02:33.442501+0000 mon.a (mon.0) 3472 : cluster 0 osdmap e755: 8 total, 8 up, 8 in 2024-02-13T15:02:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:34 smithi111 bash[23388]: audit 2024-02-13T15:02:33.459682+0000 mon.a (mon.0) 3473 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]: dispatch 2024-02-13T15:02:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[28859]: cluster 2024-02-13T15:02:34.299246+0000 mgr.y (mgr.14613) 725 : cluster 0 pgmap v1230: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[28859]: audit 2024-02-13T15:02:34.438076+0000 mon.a (mon.0) 3474 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]': finished 2024-02-13T15:02:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[28859]: cluster 2024-02-13T15:02:34.445462+0000 mon.a (mon.0) 3475 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-02-13T15:02:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[28859]: audit 2024-02-13T15:02:34.525908+0000 mon.a (mon.0) 3476 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[28859]: audit 2024-02-13T15:02:34.526691+0000 mon.a (mon.0) 3477 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]: dispatch 2024-02-13T15:02:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[28859]: audit 2024-02-13T15:02:35.081247+0000 mon.a (mon.0) 3478 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[28859]: audit 2024-02-13T15:02:35.085801+0000 mon.b (mon.1) 278 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[21479]: cluster 2024-02-13T15:02:34.299246+0000 mgr.y (mgr.14613) 725 : cluster 0 pgmap v1230: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[21479]: audit 2024-02-13T15:02:34.438076+0000 mon.a (mon.0) 3474 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]': finished 2024-02-13T15:02:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[21479]: cluster 2024-02-13T15:02:34.445462+0000 mon.a (mon.0) 3475 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-02-13T15:02:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[21479]: audit 2024-02-13T15:02:34.525908+0000 mon.a (mon.0) 3476 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[21479]: audit 2024-02-13T15:02:34.526691+0000 mon.a (mon.0) 3477 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]: dispatch 2024-02-13T15:02:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[21479]: audit 2024-02-13T15:02:35.081247+0000 mon.a (mon.0) 3478 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:35 smithi062 bash[21479]: audit 2024-02-13T15:02:35.085801+0000 mon.b (mon.1) 278 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:35 smithi111 bash[23388]: cluster 2024-02-13T15:02:34.299246+0000 mgr.y (mgr.14613) 725 : cluster 0 pgmap v1230: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:35 smithi111 bash[23388]: audit 2024-02-13T15:02:34.438076+0000 mon.a (mon.0) 3474 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]': finished 2024-02-13T15:02:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:35 smithi111 bash[23388]: cluster 2024-02-13T15:02:34.445462+0000 mon.a (mon.0) 3475 : cluster 0 osdmap e756: 8 total, 8 up, 8 in 2024-02-13T15:02:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:35 smithi111 bash[23388]: audit 2024-02-13T15:02:34.525908+0000 mon.a (mon.0) 3476 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:35 smithi111 bash[23388]: audit 2024-02-13T15:02:34.526691+0000 mon.a (mon.0) 3477 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-148"}]: dispatch 2024-02-13T15:02:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:35 smithi111 bash[23388]: audit 2024-02-13T15:02:35.081247+0000 mon.a (mon.0) 3478 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:35 smithi111 bash[23388]: audit 2024-02-13T15:02:35.085801+0000 mon.b (mon.1) 278 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:36.497 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:02:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:02:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:02:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:36 smithi062 bash[21479]: cluster 2024-02-13T15:02:35.470780+0000 mon.a (mon.0) 3479 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-02-13T15:02:36.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:36 smithi062 bash[28859]: cluster 2024-02-13T15:02:35.470780+0000 mon.a (mon.0) 3479 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-02-13T15:02:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:36 smithi111 bash[23388]: cluster 2024-02-13T15:02:35.470780+0000 mon.a (mon.0) 3479 : cluster 0 osdmap e757: 8 total, 8 up, 8 in 2024-02-13T15:02:37.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:37 smithi062 bash[28859]: cluster 2024-02-13T15:02:36.300125+0000 mgr.y (mgr.14613) 726 : cluster 0 pgmap v1233: 268 pgs: 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:02:37.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:37 smithi062 bash[28859]: cluster 2024-02-13T15:02:36.476865+0000 mon.a (mon.0) 3480 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-02-13T15:02:37.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:37 smithi062 bash[28859]: audit 2024-02-13T15:02:36.482587+0000 mon.a (mon.0) 3481 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:37.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:37 smithi062 bash[28859]: audit 2024-02-13T15:02:37.470358+0000 mon.a (mon.0) 3482 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:37 smithi062 bash[21479]: cluster 2024-02-13T15:02:36.300125+0000 mgr.y (mgr.14613) 726 : cluster 0 pgmap v1233: 268 pgs: 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:02:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:37 smithi062 bash[21479]: cluster 2024-02-13T15:02:36.476865+0000 mon.a (mon.0) 3480 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-02-13T15:02:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:37 smithi062 bash[21479]: audit 2024-02-13T15:02:36.482587+0000 mon.a (mon.0) 3481 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:37.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:37 smithi062 bash[21479]: audit 2024-02-13T15:02:37.470358+0000 mon.a (mon.0) 3482 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:37.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:37 smithi111 bash[23388]: cluster 2024-02-13T15:02:36.300125+0000 mgr.y (mgr.14613) 726 : cluster 0 pgmap v1233: 268 pgs: 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:02:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:37 smithi111 bash[23388]: cluster 2024-02-13T15:02:36.476865+0000 mon.a (mon.0) 3480 : cluster 0 osdmap e758: 8 total, 8 up, 8 in 2024-02-13T15:02:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:37 smithi111 bash[23388]: audit 2024-02-13T15:02:36.482587+0000 mon.a (mon.0) 3481 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-150","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:37 smithi111 bash[23388]: audit 2024-02-13T15:02:37.470358+0000 mon.a (mon.0) 3482 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-150","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[28859]: cluster 2024-02-13T15:02:37.482677+0000 mon.a (mon.0) 3483 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-02-13T15:02:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[28859]: audit 2024-02-13T15:02:37.576311+0000 mon.a (mon.0) 3484 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[28859]: audit 2024-02-13T15:02:37.576817+0000 mon.a (mon.0) 3485 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-150"}]: dispatch 2024-02-13T15:02:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[28859]: cluster 2024-02-13T15:02:37.875344+0000 mon.a (mon.0) 3486 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[28859]: cluster 2024-02-13T15:02:38.301016+0000 mgr.y (mgr.14613) 727 : cluster 0 pgmap v1236: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:02:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[21479]: cluster 2024-02-13T15:02:37.482677+0000 mon.a (mon.0) 3483 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-02-13T15:02:38.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[21479]: audit 2024-02-13T15:02:37.576311+0000 mon.a (mon.0) 3484 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:38.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[21479]: audit 2024-02-13T15:02:37.576817+0000 mon.a (mon.0) 3485 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-150"}]: dispatch 2024-02-13T15:02:38.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[21479]: cluster 2024-02-13T15:02:37.875344+0000 mon.a (mon.0) 3486 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:38.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:38 smithi062 bash[21479]: cluster 2024-02-13T15:02:38.301016+0000 mgr.y (mgr.14613) 727 : cluster 0 pgmap v1236: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:02:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:38 smithi111 bash[23388]: cluster 2024-02-13T15:02:37.482677+0000 mon.a (mon.0) 3483 : cluster 0 osdmap e759: 8 total, 8 up, 8 in 2024-02-13T15:02:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:38 smithi111 bash[23388]: audit 2024-02-13T15:02:37.576311+0000 mon.a (mon.0) 3484 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:38 smithi111 bash[23388]: audit 2024-02-13T15:02:37.576817+0000 mon.a (mon.0) 3485 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-150"}]: dispatch 2024-02-13T15:02:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:38 smithi111 bash[23388]: cluster 2024-02-13T15:02:37.875344+0000 mon.a (mon.0) 3486 : cluster 3 Health check update: 5 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:38 smithi111 bash[23388]: cluster 2024-02-13T15:02:38.301016+0000 mgr.y (mgr.14613) 727 : cluster 0 pgmap v1236: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 1 op/s 2024-02-13T15:02:39.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:39 smithi062 bash[28859]: cluster 2024-02-13T15:02:38.529856+0000 mon.a (mon.0) 3487 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-02-13T15:02:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:39 smithi062 bash[21479]: cluster 2024-02-13T15:02:38.529856+0000 mon.a (mon.0) 3487 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-02-13T15:02:39.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:39 smithi111 bash[23388]: cluster 2024-02-13T15:02:38.529856+0000 mon.a (mon.0) 3487 : cluster 0 osdmap e760: 8 total, 8 up, 8 in 2024-02-13T15:02:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:40 smithi062 bash[21479]: cluster 2024-02-13T15:02:39.536194+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-02-13T15:02:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:40 smithi062 bash[21479]: audit 2024-02-13T15:02:39.542570+0000 mon.a (mon.0) 3489 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:40 smithi062 bash[21479]: cluster 2024-02-13T15:02:40.303699+0000 mgr.y (mgr.14613) 728 : cluster 0 pgmap v1239: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:02:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:40 smithi062 bash[28859]: cluster 2024-02-13T15:02:39.536194+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-02-13T15:02:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:40 smithi062 bash[28859]: audit 2024-02-13T15:02:39.542570+0000 mon.a (mon.0) 3489 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:40 smithi062 bash[28859]: cluster 2024-02-13T15:02:40.303699+0000 mgr.y (mgr.14613) 728 : cluster 0 pgmap v1239: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:02:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:40 smithi111 bash[23388]: cluster 2024-02-13T15:02:39.536194+0000 mon.a (mon.0) 3488 : cluster 0 osdmap e761: 8 total, 8 up, 8 in 2024-02-13T15:02:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:40 smithi111 bash[23388]: audit 2024-02-13T15:02:39.542570+0000 mon.a (mon.0) 3489 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-152","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:40 smithi111 bash[23388]: cluster 2024-02-13T15:02:40.303699+0000 mgr.y (mgr.14613) 728 : cluster 0 pgmap v1239: 300 pgs: 32 creating+peering, 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:02:41.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:02:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:02:42.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[21479]: audit 2024-02-13T15:02:40.538788+0000 mon.a (mon.0) 3490 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:42.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[21479]: cluster 2024-02-13T15:02:40.548964+0000 mon.a (mon.0) 3491 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-02-13T15:02:42.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[21479]: audit 2024-02-13T15:02:40.657004+0000 mon.a (mon.0) 3492 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:42.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[21479]: audit 2024-02-13T15:02:40.657631+0000 mon.a (mon.0) 3493 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-152"}]: dispatch 2024-02-13T15:02:42.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[21479]: audit 2024-02-13T15:02:40.892878+0000 mgr.y (mgr.14613) 729 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:42.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[28859]: audit 2024-02-13T15:02:40.538788+0000 mon.a (mon.0) 3490 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:42.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[28859]: cluster 2024-02-13T15:02:40.548964+0000 mon.a (mon.0) 3491 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-02-13T15:02:42.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[28859]: audit 2024-02-13T15:02:40.657004+0000 mon.a (mon.0) 3492 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:42.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[28859]: audit 2024-02-13T15:02:40.657631+0000 mon.a (mon.0) 3493 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-152"}]: dispatch 2024-02-13T15:02:42.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:42 smithi062 bash[28859]: audit 2024-02-13T15:02:40.892878+0000 mgr.y (mgr.14613) 729 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:42 smithi111 bash[23388]: audit 2024-02-13T15:02:40.538788+0000 mon.a (mon.0) 3490 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-152","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:42 smithi111 bash[23388]: cluster 2024-02-13T15:02:40.548964+0000 mon.a (mon.0) 3491 : cluster 0 osdmap e762: 8 total, 8 up, 8 in 2024-02-13T15:02:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:42 smithi111 bash[23388]: audit 2024-02-13T15:02:40.657004+0000 mon.a (mon.0) 3492 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:42 smithi111 bash[23388]: audit 2024-02-13T15:02:40.657631+0000 mon.a (mon.0) 3493 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-152"}]: dispatch 2024-02-13T15:02:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:42 smithi111 bash[23388]: audit 2024-02-13T15:02:40.892878+0000 mgr.y (mgr.14613) 729 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[21479]: cluster 2024-02-13T15:02:41.550971+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-02-13T15:02:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[21479]: cluster 2024-02-13T15:02:42.304560+0000 mgr.y (mgr.14613) 730 : cluster 0 pgmap v1242: 268 pgs: 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:02:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[21479]: cluster 2024-02-13T15:02:42.554691+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-02-13T15:02:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[21479]: audit 2024-02-13T15:02:42.560264+0000 mon.a (mon.0) 3496 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:43.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[21479]: cluster 2024-02-13T15:02:42.877290+0000 mon.a (mon.0) 3497 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:43.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[28859]: cluster 2024-02-13T15:02:41.550971+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-02-13T15:02:43.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[28859]: cluster 2024-02-13T15:02:42.304560+0000 mgr.y (mgr.14613) 730 : cluster 0 pgmap v1242: 268 pgs: 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:02:43.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[28859]: cluster 2024-02-13T15:02:42.554691+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-02-13T15:02:43.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[28859]: audit 2024-02-13T15:02:42.560264+0000 mon.a (mon.0) 3496 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:43.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:43 smithi062 bash[28859]: cluster 2024-02-13T15:02:42.877290+0000 mon.a (mon.0) 3497 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:43.343 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:43 smithi111 bash[23388]: cluster 2024-02-13T15:02:41.550971+0000 mon.a (mon.0) 3494 : cluster 0 osdmap e763: 8 total, 8 up, 8 in 2024-02-13T15:02:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:43 smithi111 bash[23388]: cluster 2024-02-13T15:02:42.304560+0000 mgr.y (mgr.14613) 730 : cluster 0 pgmap v1242: 268 pgs: 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-13T15:02:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:43 smithi111 bash[23388]: cluster 2024-02-13T15:02:42.554691+0000 mon.a (mon.0) 3495 : cluster 0 osdmap e764: 8 total, 8 up, 8 in 2024-02-13T15:02:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:43 smithi111 bash[23388]: audit 2024-02-13T15:02:42.560264+0000 mon.a (mon.0) 3496 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-154","app": "rados","yes_i_really_mean_it": true}]: dispatch 2024-02-13T15:02:43.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:43 smithi111 bash[23388]: cluster 2024-02-13T15:02:42.877290+0000 mon.a (mon.0) 3497 : cluster 3 Health check update: 6 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[21479]: audit 2024-02-13T15:02:43.548527+0000 mon.a (mon.0) 3498 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[21479]: cluster 2024-02-13T15:02:43.558007+0000 mon.a (mon.0) 3499 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-02-13T15:02:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[21479]: audit 2024-02-13T15:02:43.579320+0000 mon.a (mon.0) 3500 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-111","var": "dedup_tier","val": "test-rados-api-smithi062-64695-154"}]: dispatch 2024-02-13T15:02:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[21479]: audit 2024-02-13T15:02:43.627128+0000 mon.a (mon.0) 3501 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[21479]: audit 2024-02-13T15:02:43.627786+0000 mon.a (mon.0) 3502 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-154"}]: dispatch 2024-02-13T15:02:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[21479]: audit 2024-02-13T15:02:44.078919+0000 mon.b (mon.1) 279 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:02:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[21479]: cluster 2024-02-13T15:02:44.305424+0000 mgr.y (mgr.14613) 731 : cluster 0 pgmap v1245: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[28859]: audit 2024-02-13T15:02:43.548527+0000 mon.a (mon.0) 3498 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[28859]: cluster 2024-02-13T15:02:43.558007+0000 mon.a (mon.0) 3499 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-02-13T15:02:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[28859]: audit 2024-02-13T15:02:43.579320+0000 mon.a (mon.0) 3500 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-111","var": "dedup_tier","val": "test-rados-api-smithi062-64695-154"}]: dispatch 2024-02-13T15:02:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[28859]: audit 2024-02-13T15:02:43.627128+0000 mon.a (mon.0) 3501 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[28859]: audit 2024-02-13T15:02:43.627786+0000 mon.a (mon.0) 3502 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-154"}]: dispatch 2024-02-13T15:02:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[28859]: audit 2024-02-13T15:02:44.078919+0000 mon.b (mon.1) 279 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:02:44.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:44 smithi062 bash[28859]: cluster 2024-02-13T15:02:44.305424+0000 mgr.y (mgr.14613) 731 : cluster 0 pgmap v1245: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:44 smithi111 bash[23388]: audit 2024-02-13T15:02:43.548527+0000 mon.a (mon.0) 3498 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi062-64695-154","app": "rados","yes_i_really_mean_it": true}]': finished 2024-02-13T15:02:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:44 smithi111 bash[23388]: cluster 2024-02-13T15:02:43.558007+0000 mon.a (mon.0) 3499 : cluster 0 osdmap e765: 8 total, 8 up, 8 in 2024-02-13T15:02:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:44 smithi111 bash[23388]: audit 2024-02-13T15:02:43.579320+0000 mon.a (mon.0) 3500 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd pool set","pool":"test-rados-api-smithi062-64695-111","var": "dedup_tier","val": "test-rados-api-smithi062-64695-154"}]: dispatch 2024-02-13T15:02:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:44 smithi111 bash[23388]: audit 2024-02-13T15:02:43.627128+0000 mon.a (mon.0) 3501 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove-overlay", "pool": "test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:44 smithi111 bash[23388]: audit 2024-02-13T15:02:43.627786+0000 mon.a (mon.0) 3502 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd tier remove", "pool": "test-rados-api-smithi062-64695-111", "tierpool": "test-rados-api-smithi062-64695-154"}]: dispatch 2024-02-13T15:02:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:44 smithi111 bash[23388]: audit 2024-02-13T15:02:44.078919+0000 mon.b (mon.1) 279 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:02:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:44 smithi111 bash[23388]: cluster 2024-02-13T15:02:44.305424+0000 mgr.y (mgr.14613) 731 : cluster 0 pgmap v1245: 300 pgs: 32 unknown, 268 active+clean; 4.4 MiB data, 701 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:45 smithi111 bash[23388]: cluster 2024-02-13T15:02:44.566760+0000 mon.a (mon.0) 3503 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-02-13T15:02:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:45 smithi111 bash[23388]: audit 2024-02-13T15:02:44.817596+0000 mon.b (mon.1) 280 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:02:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:45 smithi111 bash[23388]: audit 2024-02-13T15:02:44.819382+0000 mon.b (mon.1) 281 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:02:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:45 smithi111 bash[23388]: audit 2024-02-13T15:02:44.825369+0000 mon.a (mon.0) 3504 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:45 smithi062 bash[28859]: cluster 2024-02-13T15:02:44.566760+0000 mon.a (mon.0) 3503 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-02-13T15:02:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:45 smithi062 bash[28859]: audit 2024-02-13T15:02:44.817596+0000 mon.b (mon.1) 280 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:02:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:45 smithi062 bash[28859]: audit 2024-02-13T15:02:44.819382+0000 mon.b (mon.1) 281 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:02:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:45 smithi062 bash[28859]: audit 2024-02-13T15:02:44.825369+0000 mon.a (mon.0) 3504 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:45 smithi062 bash[21479]: cluster 2024-02-13T15:02:44.566760+0000 mon.a (mon.0) 3503 : cluster 0 osdmap e766: 8 total, 8 up, 8 in 2024-02-13T15:02:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:45 smithi062 bash[21479]: audit 2024-02-13T15:02:44.817596+0000 mon.b (mon.1) 280 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:02:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:45 smithi062 bash[21479]: audit 2024-02-13T15:02:44.819382+0000 mon.b (mon.1) 281 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:02:46.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:45 smithi062 bash[21479]: audit 2024-02-13T15:02:44.825369+0000 mon.a (mon.0) 3504 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:02:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:02:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:02:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:46 smithi111 bash[23388]: cluster 2024-02-13T15:02:45.569971+0000 mon.a (mon.0) 3505 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-02-13T15:02:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:46 smithi111 bash[23388]: audit 2024-02-13T15:02:45.572601+0000 mon.a (mon.0) 3506 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:46 smithi111 bash[23388]: cluster 2024-02-13T15:02:46.306263+0000 mgr.y (mgr.14613) 732 : cluster 0 pgmap v1248: 260 pgs: 260 active+clean; 582 KiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:02:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:46 smithi111 bash[23388]: audit 2024-02-13T15:02:46.564062+0000 mon.a (mon.0) 3507 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:46 smithi111 bash[23388]: cluster 2024-02-13T15:02:46.571365+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-02-13T15:02:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:46 smithi111 bash[23388]: audit 2024-02-13T15:02:46.573745+0000 mon.a (mon.0) 3509 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[21479]: cluster 2024-02-13T15:02:45.569971+0000 mon.a (mon.0) 3505 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-02-13T15:02:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[21479]: audit 2024-02-13T15:02:45.572601+0000 mon.a (mon.0) 3506 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[21479]: cluster 2024-02-13T15:02:46.306263+0000 mgr.y (mgr.14613) 732 : cluster 0 pgmap v1248: 260 pgs: 260 active+clean; 582 KiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:02:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[21479]: audit 2024-02-13T15:02:46.564062+0000 mon.a (mon.0) 3507 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[21479]: cluster 2024-02-13T15:02:46.571365+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-02-13T15:02:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[21479]: audit 2024-02-13T15:02:46.573745+0000 mon.a (mon.0) 3509 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[28859]: cluster 2024-02-13T15:02:45.569971+0000 mon.a (mon.0) 3505 : cluster 0 osdmap e767: 8 total, 8 up, 8 in 2024-02-13T15:02:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[28859]: audit 2024-02-13T15:02:45.572601+0000 mon.a (mon.0) 3506 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[28859]: cluster 2024-02-13T15:02:46.306263+0000 mgr.y (mgr.14613) 732 : cluster 0 pgmap v1248: 260 pgs: 260 active+clean; 582 KiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:02:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[28859]: audit 2024-02-13T15:02:46.564062+0000 mon.a (mon.0) 3507 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile rm", "name": "testprofile-test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[28859]: cluster 2024-02-13T15:02:46.571365+0000 mon.a (mon.0) 3508 : cluster 0 osdmap e768: 8 total, 8 up, 8 in 2024-02-13T15:02:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:46 smithi062 bash[28859]: audit 2024-02-13T15:02:46.573745+0000 mon.a (mon.0) 3509 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd=[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]: dispatch 2024-02-13T15:02:47.592 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlush (7720 ms) 2024-02-13T15:02:47.592 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FailedFlush 2024-02-13T15:02:47.592 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FailedFlush (12551 ms) 2024-02-13T15:02:47.592 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.Flush 2024-02-13T15:02:47.592 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.Flush (8085 ms) 2024-02-13T15:02:47.592 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushSnap 2024-02-13T15:02:47.592 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushSnap (13120 ms) 2024-02-13T15:02:47.592 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.FlushTryFlushRaces 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.FlushTryFlushRaces (7284 ms) 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TryFlushReadRace 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TryFlushReadRace (8099 ms) 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetRead 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: hmm, no HitSet yet 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: ok, hit_set contains 317:602f83fe:::foo:head 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetRead (8160 ms) 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.HitSetTrim 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,0 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: first is 1707836483 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,0 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,0 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,0 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,0 2024-02-13T15:02:47.593 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,1707836488,1707836489,0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,1707836488,1707836489,0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,1707836488,1707836489,0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,1707836488,1707836489,1707836491,1707836492,0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,1707836488,1707836489,1707836491,1707836492,0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836483,1707836485,1707836486,1707836488,1707836489,1707836491,1707836492,0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: got ls 1707836486,1707836488,1707836489,1707836491,1707836492,1707836494,1707836495,0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: first now 1707836486, trimmed 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.HitSetTrim (20286 ms) 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.PromoteOn2ndRead 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: foo0 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: verifying foo0 is eventually promoted 2024-02-13T15:02:47.594 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.PromoteOn2ndRead (14109 ms) 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ProxyRead 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ProxyRead (17928 ms) 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.CachePin 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.CachePin (23009 ms) 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetRedirectRead 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetRedirectRead (5065 ms) 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.SetChunkRead 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.SetChunkRead (3060 ms) 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.ManifestPromoteRead 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.ManifestPromoteRead (3023 ms) 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ RUN ] LibRadosTwoPoolsECPP.TrySetDedupTier 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ OK ] LibRadosTwoPoolsECPP.TrySetDedupTier (3014 ms) 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] 22 tests from LibRadosTwoPoolsECPP (231499 ms total) 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: 2024-02-13T15:02:47.595 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [----------] Global test environment tear-down 2024-02-13T15:02:47.596 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [==========] 77 tests from 4 test suites ran. (888846 ms total) 2024-02-13T15:02:47.596 INFO:tasks.workunit.client.0.smithi062.stdout: api_tier_pp: [ PASSED ] 77 tests. 2024-02-13T15:02:47.598 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.598 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64531 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64531 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64726 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64726 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65096 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65096 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64897 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64897 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64793 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64793 2024-02-13T15:02:47.599 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64602 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64602 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64843 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64843 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65262 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65262 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65298 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65298 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64636 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64636 2024-02-13T15:02:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65164 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65164 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65014 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65014 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64515 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64515 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64547 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64547 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65024 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65024 2024-02-13T15:02:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64507 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64507 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64523 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64523 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65402 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65402 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.602 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64734 2024-02-13T15:02:47.603 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64734 2024-02-13T15:02:47.603 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:02:47.603 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65424 2024-02-13T15:02:47.603 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65424 2024-02-13T15:02:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:48 smithi111 bash[23388]: audit 2024-02-13T15:02:47.567427+0000 mon.a (mon.0) 3510 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:48 smithi111 bash[23388]: cluster 2024-02-13T15:02:47.575764+0000 mon.a (mon.0) 3511 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-02-13T15:02:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:48 smithi111 bash[23388]: cluster 2024-02-13T15:02:47.878589+0000 mon.a (mon.0) 3512 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:48 smithi111 bash[23388]: cluster 2024-02-13T15:02:48.307114+0000 mgr.y (mgr.14613) 733 : cluster 0 pgmap v1251: 260 pgs: 260 active+clean; 582 KiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:02:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:48 smithi062 bash[21479]: audit 2024-02-13T15:02:47.567427+0000 mon.a (mon.0) 3510 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:48 smithi062 bash[21479]: cluster 2024-02-13T15:02:47.575764+0000 mon.a (mon.0) 3511 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-02-13T15:02:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:48 smithi062 bash[21479]: cluster 2024-02-13T15:02:47.878589+0000 mon.a (mon.0) 3512 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:48 smithi062 bash[21479]: cluster 2024-02-13T15:02:48.307114+0000 mgr.y (mgr.14613) 733 : cluster 0 pgmap v1251: 260 pgs: 260 active+clean; 582 KiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:02:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:48 smithi062 bash[28859]: audit 2024-02-13T15:02:47.567427+0000 mon.a (mon.0) 3510 : audit 1 from='client.? v1:172.21.15.62:0/2480718451' entity='client.admin' cmd='[{"prefix": "osd crush rule rm", "name":"test-rados-api-smithi062-64695-111"}]': finished 2024-02-13T15:02:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:48 smithi062 bash[28859]: cluster 2024-02-13T15:02:47.575764+0000 mon.a (mon.0) 3511 : cluster 0 osdmap e769: 8 total, 8 up, 8 in 2024-02-13T15:02:49.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:48 smithi062 bash[28859]: cluster 2024-02-13T15:02:47.878589+0000 mon.a (mon.0) 3512 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:02:49.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:48 smithi062 bash[28859]: cluster 2024-02-13T15:02:48.307114+0000 mgr.y (mgr.14613) 733 : cluster 0 pgmap v1251: 260 pgs: 260 active+clean; 582 KiB data, 737 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:02:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:50 smithi062 bash[28859]: audit 2024-02-13T15:02:50.121272+0000 mon.b (mon.1) 282 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:50 smithi062 bash[21479]: audit 2024-02-13T15:02:50.121272+0000 mon.b (mon.1) 282 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:50.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:50 smithi111 bash[23388]: audit 2024-02-13T15:02:50.121272+0000 mon.b (mon.1) 282 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:02:51.184 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:02:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:02:51.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:51 smithi062 bash[28859]: cluster 2024-02-13T15:02:50.309602+0000 mgr.y (mgr.14613) 734 : cluster 0 pgmap v1252: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:51.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:51 smithi062 bash[21479]: cluster 2024-02-13T15:02:50.309602+0000 mgr.y (mgr.14613) 734 : cluster 0 pgmap v1252: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:51.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:51 smithi111 bash[23388]: cluster 2024-02-13T15:02:50.309602+0000 mgr.y (mgr.14613) 734 : cluster 0 pgmap v1252: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail 2024-02-13T15:02:52.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:52 smithi062 bash[28859]: audit 2024-02-13T15:02:50.901128+0000 mgr.y (mgr.14613) 735 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:52 smithi062 bash[21479]: audit 2024-02-13T15:02:50.901128+0000 mgr.y (mgr.14613) 735 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:52 smithi111 bash[23388]: audit 2024-02-13T15:02:50.901128+0000 mgr.y (mgr.14613) 735 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:02:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:53 smithi062 bash[21479]: cluster 2024-02-13T15:02:52.310380+0000 mgr.y (mgr.14613) 736 : cluster 0 pgmap v1253: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 759 B/s rd, 0 op/s 2024-02-13T15:02:53.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:53 smithi062 bash[28859]: cluster 2024-02-13T15:02:52.310380+0000 mgr.y (mgr.14613) 736 : cluster 0 pgmap v1253: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 759 B/s rd, 0 op/s 2024-02-13T15:02:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:53 smithi111 bash[23388]: cluster 2024-02-13T15:02:52.310380+0000 mgr.y (mgr.14613) 736 : cluster 0 pgmap v1253: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 759 B/s rd, 0 op/s 2024-02-13T15:02:55.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:55 smithi062 bash[21479]: cluster 2024-02-13T15:02:54.311186+0000 mgr.y (mgr.14613) 737 : cluster 0 pgmap v1254: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T15:02:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:55 smithi062 bash[28859]: cluster 2024-02-13T15:02:54.311186+0000 mgr.y (mgr.14613) 737 : cluster 0 pgmap v1254: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T15:02:55.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:55 smithi111 bash[23388]: cluster 2024-02-13T15:02:54.311186+0000 mgr.y (mgr.14613) 737 : cluster 0 pgmap v1254: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T15:02:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:02:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:02:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:02:57.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:57 smithi062 bash[21479]: cluster 2024-02-13T15:02:56.313576+0000 mgr.y (mgr.14613) 738 : cluster 0 pgmap v1255: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:02:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:57 smithi062 bash[28859]: cluster 2024-02-13T15:02:56.313576+0000 mgr.y (mgr.14613) 738 : cluster 0 pgmap v1255: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:02:57.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:57 smithi111 bash[23388]: cluster 2024-02-13T15:02:56.313576+0000 mgr.y (mgr.14613) 738 : cluster 0 pgmap v1255: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:02:59.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:02:59 smithi062 bash[21479]: cluster 2024-02-13T15:02:58.314507+0000 mgr.y (mgr.14613) 739 : cluster 0 pgmap v1256: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-02-13T15:02:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:02:59 smithi062 bash[28859]: cluster 2024-02-13T15:02:58.314507+0000 mgr.y (mgr.14613) 739 : cluster 0 pgmap v1256: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-02-13T15:02:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:02:59 smithi111 bash[23388]: cluster 2024-02-13T15:02:58.314507+0000 mgr.y (mgr.14613) 739 : cluster 0 pgmap v1256: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 953 B/s rd, 0 op/s 2024-02-13T15:03:01.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:03:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:03:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:01 smithi062 bash[28859]: cluster 2024-02-13T15:03:00.316899+0000 mgr.y (mgr.14613) 740 : cluster 0 pgmap v1257: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:01 smithi062 bash[21479]: cluster 2024-02-13T15:03:00.316899+0000 mgr.y (mgr.14613) 740 : cluster 0 pgmap v1257: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:01 smithi111 bash[23388]: cluster 2024-02-13T15:03:00.316899+0000 mgr.y (mgr.14613) 740 : cluster 0 pgmap v1257: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:02 smithi062 bash[28859]: audit 2024-02-13T15:03:00.909937+0000 mgr.y (mgr.14613) 741 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:02 smithi062 bash[21479]: audit 2024-02-13T15:03:00.909937+0000 mgr.y (mgr.14613) 741 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:02 smithi111 bash[23388]: audit 2024-02-13T15:03:00.909937+0000 mgr.y (mgr.14613) 741 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:03.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:03 smithi062 bash[28859]: cluster 2024-02-13T15:03:02.317765+0000 mgr.y (mgr.14613) 742 : cluster 0 pgmap v1258: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:03 smithi062 bash[21479]: cluster 2024-02-13T15:03:02.317765+0000 mgr.y (mgr.14613) 742 : cluster 0 pgmap v1258: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:03 smithi111 bash[23388]: cluster 2024-02-13T15:03:02.317765+0000 mgr.y (mgr.14613) 742 : cluster 0 pgmap v1258: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:05 smithi062 bash[28859]: cluster 2024-02-13T15:03:04.318648+0000 mgr.y (mgr.14613) 743 : cluster 0 pgmap v1259: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:05 smithi062 bash[28859]: audit 2024-02-13T15:03:05.156615+0000 mon.b (mon.1) 283 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:05 smithi062 bash[21479]: cluster 2024-02-13T15:03:04.318648+0000 mgr.y (mgr.14613) 743 : cluster 0 pgmap v1259: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:05 smithi062 bash[21479]: audit 2024-02-13T15:03:05.156615+0000 mon.b (mon.1) 283 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:05 smithi111 bash[23388]: cluster 2024-02-13T15:03:04.318648+0000 mgr.y (mgr.14613) 743 : cluster 0 pgmap v1259: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:05 smithi111 bash[23388]: audit 2024-02-13T15:03:05.156615+0000 mon.b (mon.1) 283 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:03:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:03:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:03:07.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:07 smithi062 bash[21479]: cluster 2024-02-13T15:03:06.321097+0000 mgr.y (mgr.14613) 744 : cluster 0 pgmap v1260: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:07 smithi062 bash[28859]: cluster 2024-02-13T15:03:06.321097+0000 mgr.y (mgr.14613) 744 : cluster 0 pgmap v1260: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:07.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:07 smithi111 bash[23388]: cluster 2024-02-13T15:03:06.321097+0000 mgr.y (mgr.14613) 744 : cluster 0 pgmap v1260: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:09 smithi062 bash[28859]: cluster 2024-02-13T15:03:08.321975+0000 mgr.y (mgr.14613) 745 : cluster 0 pgmap v1261: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:09 smithi062 bash[21479]: cluster 2024-02-13T15:03:08.321975+0000 mgr.y (mgr.14613) 745 : cluster 0 pgmap v1261: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:09 smithi111 bash[23388]: cluster 2024-02-13T15:03:08.321975+0000 mgr.y (mgr.14613) 745 : cluster 0 pgmap v1261: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:11.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:03:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:03:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:11 smithi062 bash[21479]: cluster 2024-02-13T15:03:10.324341+0000 mgr.y (mgr.14613) 746 : cluster 0 pgmap v1262: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:11 smithi062 bash[28859]: cluster 2024-02-13T15:03:10.324341+0000 mgr.y (mgr.14613) 746 : cluster 0 pgmap v1262: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:11.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:11 smithi111 bash[23388]: cluster 2024-02-13T15:03:10.324341+0000 mgr.y (mgr.14613) 746 : cluster 0 pgmap v1262: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:12.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:12 smithi062 bash[28859]: audit 2024-02-13T15:03:10.921326+0000 mgr.y (mgr.14613) 747 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:12 smithi062 bash[21479]: audit 2024-02-13T15:03:10.921326+0000 mgr.y (mgr.14613) 747 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:12 smithi111 bash[23388]: audit 2024-02-13T15:03:10.921326+0000 mgr.y (mgr.14613) 747 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:13.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:13 smithi062 bash[21479]: cluster 2024-02-13T15:03:12.325226+0000 mgr.y (mgr.14613) 748 : cluster 0 pgmap v1263: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:13.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:13 smithi062 bash[28859]: cluster 2024-02-13T15:03:12.325226+0000 mgr.y (mgr.14613) 748 : cluster 0 pgmap v1263: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:13.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:13 smithi111 bash[23388]: cluster 2024-02-13T15:03:12.325226+0000 mgr.y (mgr.14613) 748 : cluster 0 pgmap v1263: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:15.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:15 smithi062 bash[21479]: cluster 2024-02-13T15:03:14.326084+0000 mgr.y (mgr.14613) 749 : cluster 0 pgmap v1264: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:15 smithi062 bash[28859]: cluster 2024-02-13T15:03:14.326084+0000 mgr.y (mgr.14613) 749 : cluster 0 pgmap v1264: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:15 smithi111 bash[23388]: cluster 2024-02-13T15:03:14.326084+0000 mgr.y (mgr.14613) 749 : cluster 0 pgmap v1264: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:03:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:03:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:03:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:17 smithi062 bash[21479]: cluster 2024-02-13T15:03:16.328637+0000 mgr.y (mgr.14613) 750 : cluster 0 pgmap v1265: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:17 smithi062 bash[28859]: cluster 2024-02-13T15:03:16.328637+0000 mgr.y (mgr.14613) 750 : cluster 0 pgmap v1265: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:17 smithi111 bash[23388]: cluster 2024-02-13T15:03:16.328637+0000 mgr.y (mgr.14613) 750 : cluster 0 pgmap v1265: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:19 smithi062 bash[21479]: cluster 2024-02-13T15:03:18.329508+0000 mgr.y (mgr.14613) 751 : cluster 0 pgmap v1266: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:19.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:19 smithi062 bash[28859]: cluster 2024-02-13T15:03:18.329508+0000 mgr.y (mgr.14613) 751 : cluster 0 pgmap v1266: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:19 smithi111 bash[23388]: cluster 2024-02-13T15:03:18.329508+0000 mgr.y (mgr.14613) 751 : cluster 0 pgmap v1266: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:20 smithi062 bash[21479]: audit 2024-02-13T15:03:20.191465+0000 mon.b (mon.1) 284 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:20 smithi062 bash[28859]: audit 2024-02-13T15:03:20.191465+0000 mon.b (mon.1) 284 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:20 smithi111 bash[23388]: audit 2024-02-13T15:03:20.191465+0000 mon.b (mon.1) 284 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:21.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:03:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:03:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:21 smithi062 bash[21479]: cluster 2024-02-13T15:03:20.332293+0000 mgr.y (mgr.14613) 752 : cluster 0 pgmap v1267: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:21 smithi062 bash[28859]: cluster 2024-02-13T15:03:20.332293+0000 mgr.y (mgr.14613) 752 : cluster 0 pgmap v1267: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:21 smithi111 bash[23388]: cluster 2024-02-13T15:03:20.332293+0000 mgr.y (mgr.14613) 752 : cluster 0 pgmap v1267: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:22 smithi062 bash[21479]: audit 2024-02-13T15:03:20.932569+0000 mgr.y (mgr.14613) 753 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:22 smithi062 bash[28859]: audit 2024-02-13T15:03:20.932569+0000 mgr.y (mgr.14613) 753 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:22 smithi111 bash[23388]: audit 2024-02-13T15:03:20.932569+0000 mgr.y (mgr.14613) 753 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:23 smithi062 bash[21479]: cluster 2024-02-13T15:03:22.333144+0000 mgr.y (mgr.14613) 754 : cluster 0 pgmap v1268: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:23 smithi062 bash[28859]: cluster 2024-02-13T15:03:22.333144+0000 mgr.y (mgr.14613) 754 : cluster 0 pgmap v1268: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:23 smithi111 bash[23388]: cluster 2024-02-13T15:03:22.333144+0000 mgr.y (mgr.14613) 754 : cluster 0 pgmap v1268: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:25 smithi062 bash[21479]: cluster 2024-02-13T15:03:24.333976+0000 mgr.y (mgr.14613) 755 : cluster 0 pgmap v1269: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:25 smithi062 bash[28859]: cluster 2024-02-13T15:03:24.333976+0000 mgr.y (mgr.14613) 755 : cluster 0 pgmap v1269: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:25.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:25 smithi111 bash[23388]: cluster 2024-02-13T15:03:24.333976+0000 mgr.y (mgr.14613) 755 : cluster 0 pgmap v1269: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:03:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:03:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:03:27.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:27 smithi062 bash[21479]: cluster 2024-02-13T15:03:26.336538+0000 mgr.y (mgr.14613) 756 : cluster 0 pgmap v1270: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:27 smithi062 bash[28859]: cluster 2024-02-13T15:03:26.336538+0000 mgr.y (mgr.14613) 756 : cluster 0 pgmap v1270: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:27.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:27 smithi111 bash[23388]: cluster 2024-02-13T15:03:26.336538+0000 mgr.y (mgr.14613) 756 : cluster 0 pgmap v1270: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:29 smithi062 bash[28859]: cluster 2024-02-13T15:03:28.337467+0000 mgr.y (mgr.14613) 757 : cluster 0 pgmap v1271: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:29 smithi062 bash[21479]: cluster 2024-02-13T15:03:28.337467+0000 mgr.y (mgr.14613) 757 : cluster 0 pgmap v1271: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:29.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:29 smithi111 bash[23388]: cluster 2024-02-13T15:03:28.337467+0000 mgr.y (mgr.14613) 757 : cluster 0 pgmap v1271: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:31.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:03:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:03:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:31 smithi062 bash[21479]: cluster 2024-02-13T15:03:30.339874+0000 mgr.y (mgr.14613) 758 : cluster 0 pgmap v1272: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:31 smithi062 bash[28859]: cluster 2024-02-13T15:03:30.339874+0000 mgr.y (mgr.14613) 758 : cluster 0 pgmap v1272: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:31 smithi111 bash[23388]: cluster 2024-02-13T15:03:30.339874+0000 mgr.y (mgr.14613) 758 : cluster 0 pgmap v1272: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:32 smithi062 bash[21479]: audit 2024-02-13T15:03:30.938077+0000 mgr.y (mgr.14613) 759 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:32 smithi062 bash[28859]: audit 2024-02-13T15:03:30.938077+0000 mgr.y (mgr.14613) 759 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:32 smithi111 bash[23388]: audit 2024-02-13T15:03:30.938077+0000 mgr.y (mgr.14613) 759 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:33 smithi062 bash[21479]: cluster 2024-02-13T15:03:32.340732+0000 mgr.y (mgr.14613) 760 : cluster 0 pgmap v1273: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:33 smithi062 bash[28859]: cluster 2024-02-13T15:03:32.340732+0000 mgr.y (mgr.14613) 760 : cluster 0 pgmap v1273: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:33 smithi111 bash[23388]: cluster 2024-02-13T15:03:32.340732+0000 mgr.y (mgr.14613) 760 : cluster 0 pgmap v1273: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:35 smithi062 bash[28859]: cluster 2024-02-13T15:03:34.341572+0000 mgr.y (mgr.14613) 761 : cluster 0 pgmap v1274: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:35 smithi062 bash[28859]: audit 2024-02-13T15:03:35.225606+0000 mon.b (mon.1) 285 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:35 smithi062 bash[21479]: cluster 2024-02-13T15:03:34.341572+0000 mgr.y (mgr.14613) 761 : cluster 0 pgmap v1274: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:35 smithi062 bash[21479]: audit 2024-02-13T15:03:35.225606+0000 mon.b (mon.1) 285 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:35 smithi111 bash[23388]: cluster 2024-02-13T15:03:34.341572+0000 mgr.y (mgr.14613) 761 : cluster 0 pgmap v1274: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:35 smithi111 bash[23388]: audit 2024-02-13T15:03:35.225606+0000 mon.b (mon.1) 285 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:36.509 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:03:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:03:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:03:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:36 smithi062 bash[21479]: cluster 2024-02-13T15:03:36.344191+0000 mgr.y (mgr.14613) 762 : cluster 0 pgmap v1275: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:36.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:36 smithi062 bash[28859]: cluster 2024-02-13T15:03:36.344191+0000 mgr.y (mgr.14613) 762 : cluster 0 pgmap v1275: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:36 smithi111 bash[23388]: cluster 2024-02-13T15:03:36.344191+0000 mgr.y (mgr.14613) 762 : cluster 0 pgmap v1275: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:39 smithi062 bash[21479]: cluster 2024-02-13T15:03:38.345223+0000 mgr.y (mgr.14613) 763 : cluster 0 pgmap v1276: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:39.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:39 smithi062 bash[28859]: cluster 2024-02-13T15:03:38.345223+0000 mgr.y (mgr.14613) 763 : cluster 0 pgmap v1276: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:39.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:39 smithi111 bash[23388]: cluster 2024-02-13T15:03:38.345223+0000 mgr.y (mgr.14613) 763 : cluster 0 pgmap v1276: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:41.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:03:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:03:41.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:41 smithi062 bash[21479]: cluster 2024-02-13T15:03:40.347806+0000 mgr.y (mgr.14613) 764 : cluster 0 pgmap v1277: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:41.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:41 smithi062 bash[28859]: cluster 2024-02-13T15:03:40.347806+0000 mgr.y (mgr.14613) 764 : cluster 0 pgmap v1277: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:41 smithi111 bash[23388]: cluster 2024-02-13T15:03:40.347806+0000 mgr.y (mgr.14613) 764 : cluster 0 pgmap v1277: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:03:42.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:42 smithi062 bash[28859]: audit 2024-02-13T15:03:40.949384+0000 mgr.y (mgr.14613) 765 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:42 smithi062 bash[21479]: audit 2024-02-13T15:03:40.949384+0000 mgr.y (mgr.14613) 765 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:42 smithi111 bash[23388]: audit 2024-02-13T15:03:40.949384+0000 mgr.y (mgr.14613) 765 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:43.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:43 smithi062 bash[28859]: cluster 2024-02-13T15:03:42.348822+0000 mgr.y (mgr.14613) 766 : cluster 0 pgmap v1278: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:43 smithi062 bash[21479]: cluster 2024-02-13T15:03:42.348822+0000 mgr.y (mgr.14613) 766 : cluster 0 pgmap v1278: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:43 smithi111 bash[23388]: cluster 2024-02-13T15:03:42.348822+0000 mgr.y (mgr.14613) 766 : cluster 0 pgmap v1278: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:45 smithi062 bash[21479]: cluster 2024-02-13T15:03:44.349774+0000 mgr.y (mgr.14613) 767 : cluster 0 pgmap v1279: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:45 smithi062 bash[21479]: audit 2024-02-13T15:03:44.916555+0000 mon.b (mon.1) 286 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:03:45.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:45 smithi062 bash[28859]: cluster 2024-02-13T15:03:44.349774+0000 mgr.y (mgr.14613) 767 : cluster 0 pgmap v1279: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:45.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:45 smithi062 bash[28859]: audit 2024-02-13T15:03:44.916555+0000 mon.b (mon.1) 286 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:03:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:45 smithi111 bash[23388]: cluster 2024-02-13T15:03:44.349774+0000 mgr.y (mgr.14613) 767 : cluster 0 pgmap v1279: 260 pgs: 260 active+clean; 582 KiB data, 731 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:45 smithi111 bash[23388]: audit 2024-02-13T15:03:44.916555+0000 mon.b (mon.1) 286 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:03:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:03:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:03:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:03:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:46 smithi062 bash[28859]: audit 2024-02-13T15:03:45.711617+0000 mon.b (mon.1) 287 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:03:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:46 smithi062 bash[28859]: audit 2024-02-13T15:03:45.713733+0000 mon.b (mon.1) 288 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:03:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:46 smithi062 bash[28859]: audit 2024-02-13T15:03:45.726125+0000 mon.a (mon.0) 3513 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:03:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:46 smithi062 bash[21479]: audit 2024-02-13T15:03:45.711617+0000 mon.b (mon.1) 287 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:03:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:46 smithi062 bash[21479]: audit 2024-02-13T15:03:45.713733+0000 mon.b (mon.1) 288 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:03:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:46 smithi062 bash[21479]: audit 2024-02-13T15:03:45.726125+0000 mon.a (mon.0) 3513 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:03:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:46 smithi111 bash[23388]: audit 2024-02-13T15:03:45.711617+0000 mon.b (mon.1) 287 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:03:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:46 smithi111 bash[23388]: audit 2024-02-13T15:03:45.713733+0000 mon.b (mon.1) 288 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:03:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:46 smithi111 bash[23388]: audit 2024-02-13T15:03:45.726125+0000 mon.a (mon.0) 3513 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:03:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:47 smithi062 bash[28859]: cluster 2024-02-13T15:03:46.352319+0000 mgr.y (mgr.14613) 768 : cluster 0 pgmap v1280: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:47 smithi062 bash[21479]: cluster 2024-02-13T15:03:46.352319+0000 mgr.y (mgr.14613) 768 : cluster 0 pgmap v1280: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:47 smithi111 bash[23388]: cluster 2024-02-13T15:03:46.352319+0000 mgr.y (mgr.14613) 768 : cluster 0 pgmap v1280: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:49 smithi062 bash[21479]: cluster 2024-02-13T15:03:48.353198+0000 mgr.y (mgr.14613) 769 : cluster 0 pgmap v1281: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:49 smithi062 bash[28859]: cluster 2024-02-13T15:03:48.353198+0000 mgr.y (mgr.14613) 769 : cluster 0 pgmap v1281: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:49.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:49 smithi111 bash[23388]: cluster 2024-02-13T15:03:48.353198+0000 mgr.y (mgr.14613) 769 : cluster 0 pgmap v1281: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:50 smithi062 bash[21479]: audit 2024-02-13T15:03:50.260719+0000 mon.b (mon.1) 289 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:50 smithi062 bash[28859]: audit 2024-02-13T15:03:50.260719+0000 mon.b (mon.1) 289 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:50 smithi111 bash[23388]: audit 2024-02-13T15:03:50.260719+0000 mon.b (mon.1) 289 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:03:51.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:03:50 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:03:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:51 smithi062 bash[28859]: cluster 2024-02-13T15:03:50.355658+0000 mgr.y (mgr.14613) 770 : cluster 0 pgmap v1282: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:51 smithi062 bash[21479]: cluster 2024-02-13T15:03:50.355658+0000 mgr.y (mgr.14613) 770 : cluster 0 pgmap v1282: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:51 smithi111 bash[23388]: cluster 2024-02-13T15:03:50.355658+0000 mgr.y (mgr.14613) 770 : cluster 0 pgmap v1282: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:52 smithi062 bash[21479]: audit 2024-02-13T15:03:50.960016+0000 mgr.y (mgr.14613) 771 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:52 smithi062 bash[28859]: audit 2024-02-13T15:03:50.960016+0000 mgr.y (mgr.14613) 771 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:52 smithi111 bash[23388]: audit 2024-02-13T15:03:50.960016+0000 mgr.y (mgr.14613) 771 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:03:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:53 smithi062 bash[21479]: cluster 2024-02-13T15:03:52.356524+0000 mgr.y (mgr.14613) 772 : cluster 0 pgmap v1283: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:53 smithi062 bash[28859]: cluster 2024-02-13T15:03:52.356524+0000 mgr.y (mgr.14613) 772 : cluster 0 pgmap v1283: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:53 smithi111 bash[23388]: cluster 2024-02-13T15:03:52.356524+0000 mgr.y (mgr.14613) 772 : cluster 0 pgmap v1283: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:55.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:55 smithi062 bash[21479]: cluster 2024-02-13T15:03:54.357398+0000 mgr.y (mgr.14613) 773 : cluster 0 pgmap v1284: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:55 smithi062 bash[28859]: cluster 2024-02-13T15:03:54.357398+0000 mgr.y (mgr.14613) 773 : cluster 0 pgmap v1284: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:55.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:55 smithi111 bash[23388]: cluster 2024-02-13T15:03:54.357398+0000 mgr.y (mgr.14613) 773 : cluster 0 pgmap v1284: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:03:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:03:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:03:57.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:57 smithi062 bash[28859]: cluster 2024-02-13T15:03:56.359952+0000 mgr.y (mgr.14613) 774 : cluster 0 pgmap v1285: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:57.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:57 smithi062 bash[21479]: cluster 2024-02-13T15:03:56.359952+0000 mgr.y (mgr.14613) 774 : cluster 0 pgmap v1285: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:57.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:57 smithi111 bash[23388]: cluster 2024-02-13T15:03:56.359952+0000 mgr.y (mgr.14613) 774 : cluster 0 pgmap v1285: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:03:59.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:03:59 smithi062 bash[21479]: cluster 2024-02-13T15:03:58.360841+0000 mgr.y (mgr.14613) 775 : cluster 0 pgmap v1286: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:03:59 smithi062 bash[28859]: cluster 2024-02-13T15:03:58.360841+0000 mgr.y (mgr.14613) 775 : cluster 0 pgmap v1286: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:03:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:03:59 smithi111 bash[23388]: cluster 2024-02-13T15:03:58.360841+0000 mgr.y (mgr.14613) 775 : cluster 0 pgmap v1286: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:01.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:04:00 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:04:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:01 smithi062 bash[28859]: cluster 2024-02-13T15:04:00.363323+0000 mgr.y (mgr.14613) 776 : cluster 0 pgmap v1287: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:01 smithi062 bash[21479]: cluster 2024-02-13T15:04:00.363323+0000 mgr.y (mgr.14613) 776 : cluster 0 pgmap v1287: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:01 smithi111 bash[23388]: cluster 2024-02-13T15:04:00.363323+0000 mgr.y (mgr.14613) 776 : cluster 0 pgmap v1287: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:02 smithi062 bash[21479]: audit 2024-02-13T15:04:00.962464+0000 mgr.y (mgr.14613) 777 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:02 smithi062 bash[28859]: audit 2024-02-13T15:04:00.962464+0000 mgr.y (mgr.14613) 777 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:02 smithi111 bash[23388]: audit 2024-02-13T15:04:00.962464+0000 mgr.y (mgr.14613) 777 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:03.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:03 smithi062 bash[28859]: cluster 2024-02-13T15:04:02.364180+0000 mgr.y (mgr.14613) 778 : cluster 0 pgmap v1288: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:03 smithi062 bash[21479]: cluster 2024-02-13T15:04:02.364180+0000 mgr.y (mgr.14613) 778 : cluster 0 pgmap v1288: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:03 smithi111 bash[23388]: cluster 2024-02-13T15:04:02.364180+0000 mgr.y (mgr.14613) 778 : cluster 0 pgmap v1288: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:05 smithi062 bash[21479]: cluster 2024-02-13T15:04:04.365031+0000 mgr.y (mgr.14613) 779 : cluster 0 pgmap v1289: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:05 smithi062 bash[21479]: audit 2024-02-13T15:04:05.295849+0000 mon.b (mon.1) 290 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:05 smithi062 bash[28859]: cluster 2024-02-13T15:04:04.365031+0000 mgr.y (mgr.14613) 779 : cluster 0 pgmap v1289: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:05 smithi062 bash[28859]: audit 2024-02-13T15:04:05.295849+0000 mon.b (mon.1) 290 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:05 smithi111 bash[23388]: cluster 2024-02-13T15:04:04.365031+0000 mgr.y (mgr.14613) 779 : cluster 0 pgmap v1289: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:05 smithi111 bash[23388]: audit 2024-02-13T15:04:05.295849+0000 mon.b (mon.1) 290 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:04:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:04:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:04:07.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:07 smithi062 bash[21479]: cluster 2024-02-13T15:04:06.367543+0000 mgr.y (mgr.14613) 780 : cluster 0 pgmap v1290: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:07 smithi062 bash[28859]: cluster 2024-02-13T15:04:06.367543+0000 mgr.y (mgr.14613) 780 : cluster 0 pgmap v1290: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:07.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:07 smithi111 bash[23388]: cluster 2024-02-13T15:04:06.367543+0000 mgr.y (mgr.14613) 780 : cluster 0 pgmap v1290: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:09 smithi062 bash[21479]: cluster 2024-02-13T15:04:08.368467+0000 mgr.y (mgr.14613) 781 : cluster 0 pgmap v1291: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:09 smithi062 bash[28859]: cluster 2024-02-13T15:04:08.368467+0000 mgr.y (mgr.14613) 781 : cluster 0 pgmap v1291: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:09 smithi111 bash[23388]: cluster 2024-02-13T15:04:08.368467+0000 mgr.y (mgr.14613) 781 : cluster 0 pgmap v1291: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:10 smithi062 bash[21479]: cluster 2024-02-13T15:04:10.370956+0000 mgr.y (mgr.14613) 782 : cluster 0 pgmap v1292: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:10 smithi062 bash[28859]: cluster 2024-02-13T15:04:10.370956+0000 mgr.y (mgr.14613) 782 : cluster 0 pgmap v1292: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:10 smithi111 bash[23388]: cluster 2024-02-13T15:04:10.370956+0000 mgr.y (mgr.14613) 782 : cluster 0 pgmap v1292: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:11.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:04:10 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:04:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:11 smithi062 bash[21479]: audit 2024-02-13T15:04:10.973839+0000 mgr.y (mgr.14613) 783 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:11 smithi062 bash[28859]: audit 2024-02-13T15:04:10.973839+0000 mgr.y (mgr.14613) 783 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:11 smithi111 bash[23388]: audit 2024-02-13T15:04:10.973839+0000 mgr.y (mgr.14613) 783 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:12 smithi111 bash[23388]: cluster 2024-02-13T15:04:12.371801+0000 mgr.y (mgr.14613) 784 : cluster 0 pgmap v1293: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:13.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:12 smithi062 bash[21479]: cluster 2024-02-13T15:04:12.371801+0000 mgr.y (mgr.14613) 784 : cluster 0 pgmap v1293: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:13.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:12 smithi062 bash[28859]: cluster 2024-02-13T15:04:12.371801+0000 mgr.y (mgr.14613) 784 : cluster 0 pgmap v1293: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:15.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:15 smithi062 bash[21479]: cluster 2024-02-13T15:04:14.372651+0000 mgr.y (mgr.14613) 785 : cluster 0 pgmap v1294: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:15.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:15 smithi062 bash[28859]: cluster 2024-02-13T15:04:14.372651+0000 mgr.y (mgr.14613) 785 : cluster 0 pgmap v1294: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:15 smithi111 bash[23388]: cluster 2024-02-13T15:04:14.372651+0000 mgr.y (mgr.14613) 785 : cluster 0 pgmap v1294: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:04:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:04:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:04:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:17 smithi062 bash[21479]: cluster 2024-02-13T15:04:16.375167+0000 mgr.y (mgr.14613) 786 : cluster 0 pgmap v1295: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:17 smithi062 bash[28859]: cluster 2024-02-13T15:04:16.375167+0000 mgr.y (mgr.14613) 786 : cluster 0 pgmap v1295: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:17 smithi111 bash[23388]: cluster 2024-02-13T15:04:16.375167+0000 mgr.y (mgr.14613) 786 : cluster 0 pgmap v1295: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:19.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:19 smithi062 bash[21479]: cluster 2024-02-13T15:04:18.375978+0000 mgr.y (mgr.14613) 787 : cluster 0 pgmap v1296: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:19.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:19 smithi062 bash[28859]: cluster 2024-02-13T15:04:18.375978+0000 mgr.y (mgr.14613) 787 : cluster 0 pgmap v1296: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:19.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:19 smithi111 bash[23388]: cluster 2024-02-13T15:04:18.375978+0000 mgr.y (mgr.14613) 787 : cluster 0 pgmap v1296: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:20 smithi062 bash[21479]: audit 2024-02-13T15:04:20.330179+0000 mon.b (mon.1) 291 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:20.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:20 smithi062 bash[28859]: audit 2024-02-13T15:04:20.330179+0000 mon.b (mon.1) 291 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:20 smithi111 bash[23388]: audit 2024-02-13T15:04:20.330179+0000 mon.b (mon.1) 291 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:21.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:04:20 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:04:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:21 smithi062 bash[28859]: cluster 2024-02-13T15:04:20.378404+0000 mgr.y (mgr.14613) 788 : cluster 0 pgmap v1297: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:21 smithi062 bash[21479]: cluster 2024-02-13T15:04:20.378404+0000 mgr.y (mgr.14613) 788 : cluster 0 pgmap v1297: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:21 smithi111 bash[23388]: cluster 2024-02-13T15:04:20.378404+0000 mgr.y (mgr.14613) 788 : cluster 0 pgmap v1297: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:22 smithi062 bash[28859]: audit 2024-02-13T15:04:20.985209+0000 mgr.y (mgr.14613) 789 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:22 smithi062 bash[21479]: audit 2024-02-13T15:04:20.985209+0000 mgr.y (mgr.14613) 789 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:22 smithi111 bash[23388]: audit 2024-02-13T15:04:20.985209+0000 mgr.y (mgr.14613) 789 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:23 smithi062 bash[28859]: cluster 2024-02-13T15:04:22.379276+0000 mgr.y (mgr.14613) 790 : cluster 0 pgmap v1298: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:23 smithi062 bash[21479]: cluster 2024-02-13T15:04:22.379276+0000 mgr.y (mgr.14613) 790 : cluster 0 pgmap v1298: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:23 smithi111 bash[23388]: cluster 2024-02-13T15:04:22.379276+0000 mgr.y (mgr.14613) 790 : cluster 0 pgmap v1298: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:25 smithi062 bash[21479]: cluster 2024-02-13T15:04:24.380108+0000 mgr.y (mgr.14613) 791 : cluster 0 pgmap v1299: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:25 smithi062 bash[28859]: cluster 2024-02-13T15:04:24.380108+0000 mgr.y (mgr.14613) 791 : cluster 0 pgmap v1299: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:25.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:25 smithi111 bash[23388]: cluster 2024-02-13T15:04:24.380108+0000 mgr.y (mgr.14613) 791 : cluster 0 pgmap v1299: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:04:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:04:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:04:27.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:27 smithi062 bash[21479]: cluster 2024-02-13T15:04:26.382581+0000 mgr.y (mgr.14613) 792 : cluster 0 pgmap v1300: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:27 smithi062 bash[28859]: cluster 2024-02-13T15:04:26.382581+0000 mgr.y (mgr.14613) 792 : cluster 0 pgmap v1300: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:27.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:27 smithi111 bash[23388]: cluster 2024-02-13T15:04:26.382581+0000 mgr.y (mgr.14613) 792 : cluster 0 pgmap v1300: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:29 smithi062 bash[21479]: cluster 2024-02-13T15:04:28.383430+0000 mgr.y (mgr.14613) 793 : cluster 0 pgmap v1301: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:29 smithi062 bash[28859]: cluster 2024-02-13T15:04:28.383430+0000 mgr.y (mgr.14613) 793 : cluster 0 pgmap v1301: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:29.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:29 smithi111 bash[23388]: cluster 2024-02-13T15:04:28.383430+0000 mgr.y (mgr.14613) 793 : cluster 0 pgmap v1301: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:31.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:04:30 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:04:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:31 smithi062 bash[21479]: cluster 2024-02-13T15:04:30.385840+0000 mgr.y (mgr.14613) 794 : cluster 0 pgmap v1302: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:31 smithi062 bash[28859]: cluster 2024-02-13T15:04:30.385840+0000 mgr.y (mgr.14613) 794 : cluster 0 pgmap v1302: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:31 smithi111 bash[23388]: cluster 2024-02-13T15:04:30.385840+0000 mgr.y (mgr.14613) 794 : cluster 0 pgmap v1302: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:32 smithi062 bash[21479]: audit 2024-02-13T15:04:30.989184+0000 mgr.y (mgr.14613) 795 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:32 smithi062 bash[28859]: audit 2024-02-13T15:04:30.989184+0000 mgr.y (mgr.14613) 795 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:32 smithi111 bash[23388]: audit 2024-02-13T15:04:30.989184+0000 mgr.y (mgr.14613) 795 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:33 smithi062 bash[28859]: cluster 2024-02-13T15:04:32.386677+0000 mgr.y (mgr.14613) 796 : cluster 0 pgmap v1303: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:33 smithi062 bash[21479]: cluster 2024-02-13T15:04:32.386677+0000 mgr.y (mgr.14613) 796 : cluster 0 pgmap v1303: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:33 smithi111 bash[23388]: cluster 2024-02-13T15:04:32.386677+0000 mgr.y (mgr.14613) 796 : cluster 0 pgmap v1303: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:35 smithi062 bash[28859]: cluster 2024-02-13T15:04:34.387627+0000 mgr.y (mgr.14613) 797 : cluster 0 pgmap v1304: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:35 smithi062 bash[28859]: audit 2024-02-13T15:04:35.364453+0000 mon.b (mon.1) 292 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:35 smithi062 bash[21479]: cluster 2024-02-13T15:04:34.387627+0000 mgr.y (mgr.14613) 797 : cluster 0 pgmap v1304: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:35 smithi062 bash[21479]: audit 2024-02-13T15:04:35.364453+0000 mon.b (mon.1) 292 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:35 smithi111 bash[23388]: cluster 2024-02-13T15:04:34.387627+0000 mgr.y (mgr.14613) 797 : cluster 0 pgmap v1304: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:04:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:35 smithi111 bash[23388]: audit 2024-02-13T15:04:35.364453+0000 mon.b (mon.1) 292 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:04:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:04:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:04:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:37 smithi062 bash[21479]: cluster 2024-02-13T15:04:36.390156+0000 mgr.y (mgr.14613) 798 : cluster 0 pgmap v1305: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:37.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:37 smithi062 bash[28859]: cluster 2024-02-13T15:04:36.390156+0000 mgr.y (mgr.14613) 798 : cluster 0 pgmap v1305: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:37 smithi111 bash[23388]: cluster 2024-02-13T15:04:36.390156+0000 mgr.y (mgr.14613) 798 : cluster 0 pgmap v1305: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:38 smithi062 bash[21479]: cluster 2024-02-13T15:04:38.391062+0000 mgr.y (mgr.14613) 799 : cluster 0 pgmap v1306: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:38 smithi062 bash[28859]: cluster 2024-02-13T15:04:38.391062+0000 mgr.y (mgr.14613) 799 : cluster 0 pgmap v1306: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:38 smithi111 bash[23388]: cluster 2024-02-13T15:04:38.391062+0000 mgr.y (mgr.14613) 799 : cluster 0 pgmap v1306: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:41.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:04:40 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:04:41.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:41 smithi062 bash[21479]: cluster 2024-02-13T15:04:40.393494+0000 mgr.y (mgr.14613) 800 : cluster 0 pgmap v1307: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:41.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:41 smithi062 bash[28859]: cluster 2024-02-13T15:04:40.393494+0000 mgr.y (mgr.14613) 800 : cluster 0 pgmap v1307: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:41 smithi111 bash[23388]: cluster 2024-02-13T15:04:40.393494+0000 mgr.y (mgr.14613) 800 : cluster 0 pgmap v1307: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:42 smithi062 bash[21479]: audit 2024-02-13T15:04:40.994286+0000 mgr.y (mgr.14613) 801 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:42 smithi062 bash[28859]: audit 2024-02-13T15:04:40.994286+0000 mgr.y (mgr.14613) 801 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:42 smithi111 bash[23388]: audit 2024-02-13T15:04:40.994286+0000 mgr.y (mgr.14613) 801 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:43 smithi062 bash[21479]: cluster 2024-02-13T15:04:42.394307+0000 mgr.y (mgr.14613) 802 : cluster 0 pgmap v1308: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:43 smithi062 bash[28859]: cluster 2024-02-13T15:04:42.394307+0000 mgr.y (mgr.14613) 802 : cluster 0 pgmap v1308: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:43 smithi111 bash[23388]: cluster 2024-02-13T15:04:42.394307+0000 mgr.y (mgr.14613) 802 : cluster 0 pgmap v1308: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:45 smithi062 bash[21479]: cluster 2024-02-13T15:04:44.395179+0000 mgr.y (mgr.14613) 803 : cluster 0 pgmap v1309: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:45.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:45 smithi062 bash[28859]: cluster 2024-02-13T15:04:44.395179+0000 mgr.y (mgr.14613) 803 : cluster 0 pgmap v1309: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:45 smithi111 bash[23388]: cluster 2024-02-13T15:04:44.395179+0000 mgr.y (mgr.14613) 803 : cluster 0 pgmap v1309: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:46 smithi062 bash[21479]: audit 2024-02-13T15:04:45.821220+0000 mon.b (mon.1) 293 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:04:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:46 smithi062 bash[21479]: audit 2024-02-13T15:04:46.412967+0000 mon.a (mon.0) 3514 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:46 smithi062 bash[21479]: audit 2024-02-13T15:04:46.428116+0000 mon.a (mon.0) 3515 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:46 smithi062 bash[28859]: audit 2024-02-13T15:04:45.821220+0000 mon.b (mon.1) 293 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:04:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:46 smithi062 bash[28859]: audit 2024-02-13T15:04:46.412967+0000 mon.a (mon.0) 3514 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:46 smithi062 bash[28859]: audit 2024-02-13T15:04:46.428116+0000 mon.a (mon.0) 3515 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:46.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:04:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:04:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:04:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:46 smithi111 bash[23388]: audit 2024-02-13T15:04:45.821220+0000 mon.b (mon.1) 293 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:04:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:46 smithi111 bash[23388]: audit 2024-02-13T15:04:46.412967+0000 mon.a (mon.0) 3514 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:46 smithi111 bash[23388]: audit 2024-02-13T15:04:46.428116+0000 mon.a (mon.0) 3515 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:47 smithi062 bash[21479]: cluster 2024-02-13T15:04:46.396426+0000 mgr.y (mgr.14613) 804 : cluster 0 pgmap v1310: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:47 smithi062 bash[21479]: audit 2024-02-13T15:04:47.133835+0000 mon.b (mon.1) 294 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:04:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:47 smithi062 bash[21479]: audit 2024-02-13T15:04:47.136103+0000 mon.b (mon.1) 295 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:04:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:47 smithi062 bash[21479]: audit 2024-02-13T15:04:47.146155+0000 mon.a (mon.0) 3516 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:47 smithi062 bash[28859]: cluster 2024-02-13T15:04:46.396426+0000 mgr.y (mgr.14613) 804 : cluster 0 pgmap v1310: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:47 smithi062 bash[28859]: audit 2024-02-13T15:04:47.133835+0000 mon.b (mon.1) 294 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:04:47.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:47 smithi062 bash[28859]: audit 2024-02-13T15:04:47.136103+0000 mon.b (mon.1) 295 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:04:47.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:47 smithi062 bash[28859]: audit 2024-02-13T15:04:47.146155+0000 mon.a (mon.0) 3516 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:47 smithi111 bash[23388]: cluster 2024-02-13T15:04:46.396426+0000 mgr.y (mgr.14613) 804 : cluster 0 pgmap v1310: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:47 smithi111 bash[23388]: audit 2024-02-13T15:04:47.133835+0000 mon.b (mon.1) 294 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:04:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:47 smithi111 bash[23388]: audit 2024-02-13T15:04:47.136103+0000 mon.b (mon.1) 295 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:04:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:47 smithi111 bash[23388]: audit 2024-02-13T15:04:47.146155+0000 mon.a (mon.0) 3516 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:04:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:49 smithi062 bash[21479]: cluster 2024-02-13T15:04:48.397257+0000 mgr.y (mgr.14613) 805 : cluster 0 pgmap v1311: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:49 smithi062 bash[28859]: cluster 2024-02-13T15:04:48.397257+0000 mgr.y (mgr.14613) 805 : cluster 0 pgmap v1311: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:49.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:49 smithi111 bash[23388]: cluster 2024-02-13T15:04:48.397257+0000 mgr.y (mgr.14613) 805 : cluster 0 pgmap v1311: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:50 smithi062 bash[21479]: audit 2024-02-13T15:04:50.399393+0000 mon.b (mon.1) 296 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:50 smithi062 bash[28859]: audit 2024-02-13T15:04:50.399393+0000 mon.b (mon.1) 296 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:50 smithi111 bash[23388]: audit 2024-02-13T15:04:50.399393+0000 mon.b (mon.1) 296 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:04:51.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:04:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:04:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:51 smithi062 bash[21479]: cluster 2024-02-13T15:04:50.399717+0000 mgr.y (mgr.14613) 806 : cluster 0 pgmap v1312: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:51 smithi062 bash[28859]: cluster 2024-02-13T15:04:50.399717+0000 mgr.y (mgr.14613) 806 : cluster 0 pgmap v1312: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:51 smithi111 bash[23388]: cluster 2024-02-13T15:04:50.399717+0000 mgr.y (mgr.14613) 806 : cluster 0 pgmap v1312: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:52 smithi062 bash[21479]: audit 2024-02-13T15:04:51.005656+0000 mgr.y (mgr.14613) 807 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:52 smithi062 bash[28859]: audit 2024-02-13T15:04:51.005656+0000 mgr.y (mgr.14613) 807 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:52 smithi111 bash[23388]: audit 2024-02-13T15:04:51.005656+0000 mgr.y (mgr.14613) 807 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:04:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:53 smithi062 bash[28859]: cluster 2024-02-13T15:04:52.400692+0000 mgr.y (mgr.14613) 808 : cluster 0 pgmap v1313: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:53 smithi062 bash[21479]: cluster 2024-02-13T15:04:52.400692+0000 mgr.y (mgr.14613) 808 : cluster 0 pgmap v1313: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:53 smithi111 bash[23388]: cluster 2024-02-13T15:04:52.400692+0000 mgr.y (mgr.14613) 808 : cluster 0 pgmap v1313: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:55.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:55 smithi062 bash[21479]: cluster 2024-02-13T15:04:54.401731+0000 mgr.y (mgr.14613) 809 : cluster 0 pgmap v1314: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:55 smithi062 bash[28859]: cluster 2024-02-13T15:04:54.401731+0000 mgr.y (mgr.14613) 809 : cluster 0 pgmap v1314: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:55.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:55 smithi111 bash[23388]: cluster 2024-02-13T15:04:54.401731+0000 mgr.y (mgr.14613) 809 : cluster 0 pgmap v1314: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:56.522 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:04:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:04:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:04:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:56 smithi062 bash[28859]: cluster 2024-02-13T15:04:56.404227+0000 mgr.y (mgr.14613) 810 : cluster 0 pgmap v1315: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:56 smithi062 bash[21479]: cluster 2024-02-13T15:04:56.404227+0000 mgr.y (mgr.14613) 810 : cluster 0 pgmap v1315: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:56 smithi111 bash[23388]: cluster 2024-02-13T15:04:56.404227+0000 mgr.y (mgr.14613) 810 : cluster 0 pgmap v1315: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:04:59.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:04:59 smithi062 bash[28859]: cluster 2024-02-13T15:04:58.405103+0000 mgr.y (mgr.14613) 811 : cluster 0 pgmap v1316: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:59.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:04:59 smithi062 bash[21479]: cluster 2024-02-13T15:04:58.405103+0000 mgr.y (mgr.14613) 811 : cluster 0 pgmap v1316: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:04:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:04:59 smithi111 bash[23388]: cluster 2024-02-13T15:04:58.405103+0000 mgr.y (mgr.14613) 811 : cluster 0 pgmap v1316: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:01.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:05:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:05:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:01 smithi062 bash[21479]: cluster 2024-02-13T15:05:00.407666+0000 mgr.y (mgr.14613) 812 : cluster 0 pgmap v1317: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:01 smithi062 bash[28859]: cluster 2024-02-13T15:05:00.407666+0000 mgr.y (mgr.14613) 812 : cluster 0 pgmap v1317: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:01 smithi111 bash[23388]: cluster 2024-02-13T15:05:00.407666+0000 mgr.y (mgr.14613) 812 : cluster 0 pgmap v1317: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:02 smithi062 bash[28859]: audit 2024-02-13T15:05:01.016795+0000 mgr.y (mgr.14613) 813 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:02 smithi062 bash[21479]: audit 2024-02-13T15:05:01.016795+0000 mgr.y (mgr.14613) 813 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:02 smithi111 bash[23388]: audit 2024-02-13T15:05:01.016795+0000 mgr.y (mgr.14613) 813 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:03.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:03 smithi062 bash[28859]: cluster 2024-02-13T15:05:02.408553+0000 mgr.y (mgr.14613) 814 : cluster 0 pgmap v1318: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:03 smithi062 bash[21479]: cluster 2024-02-13T15:05:02.408553+0000 mgr.y (mgr.14613) 814 : cluster 0 pgmap v1318: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:03 smithi111 bash[23388]: cluster 2024-02-13T15:05:02.408553+0000 mgr.y (mgr.14613) 814 : cluster 0 pgmap v1318: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:05 smithi062 bash[28859]: cluster 2024-02-13T15:05:04.409391+0000 mgr.y (mgr.14613) 815 : cluster 0 pgmap v1319: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:05.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:05 smithi062 bash[28859]: audit 2024-02-13T15:05:05.434512+0000 mon.b (mon.1) 297 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:05 smithi062 bash[21479]: cluster 2024-02-13T15:05:04.409391+0000 mgr.y (mgr.14613) 815 : cluster 0 pgmap v1319: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:05.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:05 smithi062 bash[21479]: audit 2024-02-13T15:05:05.434512+0000 mon.b (mon.1) 297 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:05 smithi111 bash[23388]: cluster 2024-02-13T15:05:04.409391+0000 mgr.y (mgr.14613) 815 : cluster 0 pgmap v1319: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:05.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:05 smithi111 bash[23388]: audit 2024-02-13T15:05:05.434512+0000 mon.b (mon.1) 297 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:05:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:05:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:05:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:07 smithi062 bash[28859]: cluster 2024-02-13T15:05:06.412076+0000 mgr.y (mgr.14613) 816 : cluster 0 pgmap v1320: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:07.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:07 smithi062 bash[21479]: cluster 2024-02-13T15:05:06.412076+0000 mgr.y (mgr.14613) 816 : cluster 0 pgmap v1320: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:07.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:07 smithi111 bash[23388]: cluster 2024-02-13T15:05:06.412076+0000 mgr.y (mgr.14613) 816 : cluster 0 pgmap v1320: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:09 smithi062 bash[21479]: cluster 2024-02-13T15:05:08.412964+0000 mgr.y (mgr.14613) 817 : cluster 0 pgmap v1321: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:09 smithi062 bash[28859]: cluster 2024-02-13T15:05:08.412964+0000 mgr.y (mgr.14613) 817 : cluster 0 pgmap v1321: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:09 smithi111 bash[23388]: cluster 2024-02-13T15:05:08.412964+0000 mgr.y (mgr.14613) 817 : cluster 0 pgmap v1321: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:11.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:05:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:05:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:11 smithi062 bash[28859]: cluster 2024-02-13T15:05:10.415404+0000 mgr.y (mgr.14613) 818 : cluster 0 pgmap v1322: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:11 smithi062 bash[21479]: cluster 2024-02-13T15:05:10.415404+0000 mgr.y (mgr.14613) 818 : cluster 0 pgmap v1322: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:11 smithi111 bash[23388]: cluster 2024-02-13T15:05:10.415404+0000 mgr.y (mgr.14613) 818 : cluster 0 pgmap v1322: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:12 smithi062 bash[21479]: audit 2024-02-13T15:05:11.028177+0000 mgr.y (mgr.14613) 819 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:12.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:12 smithi062 bash[28859]: audit 2024-02-13T15:05:11.028177+0000 mgr.y (mgr.14613) 819 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:12 smithi111 bash[23388]: audit 2024-02-13T15:05:11.028177+0000 mgr.y (mgr.14613) 819 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:13.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:13 smithi062 bash[21479]: cluster 2024-02-13T15:05:12.416284+0000 mgr.y (mgr.14613) 820 : cluster 0 pgmap v1323: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:13.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:13 smithi062 bash[28859]: cluster 2024-02-13T15:05:12.416284+0000 mgr.y (mgr.14613) 820 : cluster 0 pgmap v1323: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:13.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:13 smithi111 bash[23388]: cluster 2024-02-13T15:05:12.416284+0000 mgr.y (mgr.14613) 820 : cluster 0 pgmap v1323: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:15.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:15 smithi062 bash[21479]: cluster 2024-02-13T15:05:14.417104+0000 mgr.y (mgr.14613) 821 : cluster 0 pgmap v1324: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:15.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:15 smithi062 bash[28859]: cluster 2024-02-13T15:05:14.417104+0000 mgr.y (mgr.14613) 821 : cluster 0 pgmap v1324: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:15.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:15 smithi111 bash[23388]: cluster 2024-02-13T15:05:14.417104+0000 mgr.y (mgr.14613) 821 : cluster 0 pgmap v1324: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:16.517 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:05:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:05:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:05:16.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:16 smithi062 bash[21479]: cluster 2024-02-13T15:05:16.419569+0000 mgr.y (mgr.14613) 822 : cluster 0 pgmap v1325: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:16.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:16 smithi062 bash[28859]: cluster 2024-02-13T15:05:16.419569+0000 mgr.y (mgr.14613) 822 : cluster 0 pgmap v1325: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:16 smithi111 bash[23388]: cluster 2024-02-13T15:05:16.419569+0000 mgr.y (mgr.14613) 822 : cluster 0 pgmap v1325: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:18 smithi062 bash[21479]: cluster 2024-02-13T15:05:18.420426+0000 mgr.y (mgr.14613) 823 : cluster 0 pgmap v1326: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:19.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:18 smithi062 bash[28859]: cluster 2024-02-13T15:05:18.420426+0000 mgr.y (mgr.14613) 823 : cluster 0 pgmap v1326: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:19.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:18 smithi111 bash[23388]: cluster 2024-02-13T15:05:18.420426+0000 mgr.y (mgr.14613) 823 : cluster 0 pgmap v1326: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:20 smithi062 bash[21479]: cluster 2024-02-13T15:05:20.422912+0000 mgr.y (mgr.14613) 824 : cluster 0 pgmap v1327: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:20 smithi062 bash[21479]: audit 2024-02-13T15:05:20.469830+0000 mon.b (mon.1) 298 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:20 smithi062 bash[28859]: cluster 2024-02-13T15:05:20.422912+0000 mgr.y (mgr.14613) 824 : cluster 0 pgmap v1327: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:20.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:20 smithi062 bash[28859]: audit 2024-02-13T15:05:20.469830+0000 mon.b (mon.1) 298 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:20 smithi111 bash[23388]: cluster 2024-02-13T15:05:20.422912+0000 mgr.y (mgr.14613) 824 : cluster 0 pgmap v1327: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:20 smithi111 bash[23388]: audit 2024-02-13T15:05:20.469830+0000 mon.b (mon.1) 298 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:21.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:05:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:05:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:21 smithi062 bash[21479]: audit 2024-02-13T15:05:21.039541+0000 mgr.y (mgr.14613) 825 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:21 smithi062 bash[28859]: audit 2024-02-13T15:05:21.039541+0000 mgr.y (mgr.14613) 825 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:21 smithi111 bash[23388]: audit 2024-02-13T15:05:21.039541+0000 mgr.y (mgr.14613) 825 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:22 smithi062 bash[21479]: cluster 2024-02-13T15:05:22.423785+0000 mgr.y (mgr.14613) 826 : cluster 0 pgmap v1328: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:22 smithi062 bash[28859]: cluster 2024-02-13T15:05:22.423785+0000 mgr.y (mgr.14613) 826 : cluster 0 pgmap v1328: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:22 smithi111 bash[23388]: cluster 2024-02-13T15:05:22.423785+0000 mgr.y (mgr.14613) 826 : cluster 0 pgmap v1328: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:25.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:25 smithi062 bash[21479]: cluster 2024-02-13T15:05:24.424644+0000 mgr.y (mgr.14613) 827 : cluster 0 pgmap v1329: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:25.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:25 smithi062 bash[28859]: cluster 2024-02-13T15:05:24.424644+0000 mgr.y (mgr.14613) 827 : cluster 0 pgmap v1329: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:25.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:25 smithi111 bash[23388]: cluster 2024-02-13T15:05:24.424644+0000 mgr.y (mgr.14613) 827 : cluster 0 pgmap v1329: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:05:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:05:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:05:27.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:27 smithi062 bash[21479]: cluster 2024-02-13T15:05:26.427091+0000 mgr.y (mgr.14613) 828 : cluster 0 pgmap v1330: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:27.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:27 smithi062 bash[28859]: cluster 2024-02-13T15:05:26.427091+0000 mgr.y (mgr.14613) 828 : cluster 0 pgmap v1330: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:27.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:27 smithi111 bash[23388]: cluster 2024-02-13T15:05:26.427091+0000 mgr.y (mgr.14613) 828 : cluster 0 pgmap v1330: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:29.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:29 smithi062 bash[21479]: cluster 2024-02-13T15:05:28.427931+0000 mgr.y (mgr.14613) 829 : cluster 0 pgmap v1331: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:29.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:29 smithi062 bash[28859]: cluster 2024-02-13T15:05:28.427931+0000 mgr.y (mgr.14613) 829 : cluster 0 pgmap v1331: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:29.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:29 smithi111 bash[23388]: cluster 2024-02-13T15:05:28.427931+0000 mgr.y (mgr.14613) 829 : cluster 0 pgmap v1331: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:31.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:05:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:05:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:31 smithi062 bash[28859]: cluster 2024-02-13T15:05:30.430391+0000 mgr.y (mgr.14613) 830 : cluster 0 pgmap v1332: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:31 smithi062 bash[21479]: cluster 2024-02-13T15:05:30.430391+0000 mgr.y (mgr.14613) 830 : cluster 0 pgmap v1332: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:31 smithi111 bash[23388]: cluster 2024-02-13T15:05:30.430391+0000 mgr.y (mgr.14613) 830 : cluster 0 pgmap v1332: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:32 smithi062 bash[28859]: audit 2024-02-13T15:05:31.050976+0000 mgr.y (mgr.14613) 831 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:32 smithi062 bash[21479]: audit 2024-02-13T15:05:31.050976+0000 mgr.y (mgr.14613) 831 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:32 smithi111 bash[23388]: audit 2024-02-13T15:05:31.050976+0000 mgr.y (mgr.14613) 831 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:33 smithi062 bash[28859]: cluster 2024-02-13T15:05:32.431237+0000 mgr.y (mgr.14613) 832 : cluster 0 pgmap v1333: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:33 smithi062 bash[21479]: cluster 2024-02-13T15:05:32.431237+0000 mgr.y (mgr.14613) 832 : cluster 0 pgmap v1333: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:33 smithi111 bash[23388]: cluster 2024-02-13T15:05:32.431237+0000 mgr.y (mgr.14613) 832 : cluster 0 pgmap v1333: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:35 smithi062 bash[21479]: cluster 2024-02-13T15:05:34.432105+0000 mgr.y (mgr.14613) 833 : cluster 0 pgmap v1334: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:35 smithi062 bash[21479]: audit 2024-02-13T15:05:35.510550+0000 mon.b (mon.1) 299 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:35 smithi062 bash[28859]: cluster 2024-02-13T15:05:34.432105+0000 mgr.y (mgr.14613) 833 : cluster 0 pgmap v1334: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:35 smithi062 bash[28859]: audit 2024-02-13T15:05:35.510550+0000 mon.b (mon.1) 299 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:35 smithi111 bash[23388]: cluster 2024-02-13T15:05:34.432105+0000 mgr.y (mgr.14613) 833 : cluster 0 pgmap v1334: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:35 smithi111 bash[23388]: audit 2024-02-13T15:05:35.510550+0000 mon.b (mon.1) 299 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:05:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:05:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:05:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:37 smithi062 bash[21479]: cluster 2024-02-13T15:05:36.434920+0000 mgr.y (mgr.14613) 834 : cluster 0 pgmap v1335: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:37.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:37 smithi062 bash[28859]: cluster 2024-02-13T15:05:36.434920+0000 mgr.y (mgr.14613) 834 : cluster 0 pgmap v1335: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:37 smithi111 bash[23388]: cluster 2024-02-13T15:05:36.434920+0000 mgr.y (mgr.14613) 834 : cluster 0 pgmap v1335: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:38 smithi111 bash[23388]: cluster 2024-02-13T15:05:38.435992+0000 mgr.y (mgr.14613) 835 : cluster 0 pgmap v1336: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:38 smithi062 bash[28859]: cluster 2024-02-13T15:05:38.435992+0000 mgr.y (mgr.14613) 835 : cluster 0 pgmap v1336: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:38 smithi062 bash[21479]: cluster 2024-02-13T15:05:38.435992+0000 mgr.y (mgr.14613) 835 : cluster 0 pgmap v1336: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:41.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:05:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:05:41.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:41 smithi062 bash[28859]: cluster 2024-02-13T15:05:40.438629+0000 mgr.y (mgr.14613) 836 : cluster 0 pgmap v1337: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:41.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:41 smithi062 bash[21479]: cluster 2024-02-13T15:05:40.438629+0000 mgr.y (mgr.14613) 836 : cluster 0 pgmap v1337: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:41 smithi111 bash[23388]: cluster 2024-02-13T15:05:40.438629+0000 mgr.y (mgr.14613) 836 : cluster 0 pgmap v1337: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:42 smithi062 bash[21479]: audit 2024-02-13T15:05:41.062287+0000 mgr.y (mgr.14613) 837 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:42 smithi062 bash[28859]: audit 2024-02-13T15:05:41.062287+0000 mgr.y (mgr.14613) 837 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:42 smithi111 bash[23388]: audit 2024-02-13T15:05:41.062287+0000 mgr.y (mgr.14613) 837 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:43 smithi062 bash[21479]: cluster 2024-02-13T15:05:42.439531+0000 mgr.y (mgr.14613) 838 : cluster 0 pgmap v1338: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:43 smithi062 bash[28859]: cluster 2024-02-13T15:05:42.439531+0000 mgr.y (mgr.14613) 838 : cluster 0 pgmap v1338: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:43 smithi111 bash[23388]: cluster 2024-02-13T15:05:42.439531+0000 mgr.y (mgr.14613) 838 : cluster 0 pgmap v1338: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:44.844 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:05:44 smithi111 bash[50603]: logger=cleanup t=2024-02-13T15:05:44.436956024Z level=info msg="Completed cleanup jobs" duration=81.171778ms 2024-02-13T15:05:45.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:45 smithi062 bash[21479]: cluster 2024-02-13T15:05:44.440385+0000 mgr.y (mgr.14613) 839 : cluster 0 pgmap v1339: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:45.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:45 smithi062 bash[28859]: cluster 2024-02-13T15:05:44.440385+0000 mgr.y (mgr.14613) 839 : cluster 0 pgmap v1339: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:45.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:45 smithi111 bash[23388]: cluster 2024-02-13T15:05:44.440385+0000 mgr.y (mgr.14613) 839 : cluster 0 pgmap v1339: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:05:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:05:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:05:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:47 smithi062 bash[28859]: cluster 2024-02-13T15:05:46.443036+0000 mgr.y (mgr.14613) 840 : cluster 0 pgmap v1340: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:47.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:47 smithi062 bash[28859]: audit 2024-02-13T15:05:47.239535+0000 mon.b (mon.1) 300 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:05:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:47 smithi062 bash[21479]: cluster 2024-02-13T15:05:46.443036+0000 mgr.y (mgr.14613) 840 : cluster 0 pgmap v1340: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:47.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:47 smithi062 bash[21479]: audit 2024-02-13T15:05:47.239535+0000 mon.b (mon.1) 300 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:05:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:47 smithi111 bash[23388]: cluster 2024-02-13T15:05:46.443036+0000 mgr.y (mgr.14613) 840 : cluster 0 pgmap v1340: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:47.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:47 smithi111 bash[23388]: audit 2024-02-13T15:05:47.239535+0000 mon.b (mon.1) 300 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:05:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:48 smithi111 bash[23388]: audit 2024-02-13T15:05:47.817636+0000 mon.a (mon.0) 3517 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:49.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:48 smithi111 bash[23388]: audit 2024-02-13T15:05:47.836031+0000 mon.a (mon.0) 3518 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:49.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:48 smithi111 bash[23388]: cluster 2024-02-13T15:05:48.443932+0000 mgr.y (mgr.14613) 841 : cluster 0 pgmap v1341: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:49.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:48 smithi111 bash[23388]: audit 2024-02-13T15:05:48.539880+0000 mon.b (mon.1) 301 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:05:49.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:48 smithi111 bash[23388]: audit 2024-02-13T15:05:48.542156+0000 mon.b (mon.1) 302 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:05:49.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:48 smithi111 bash[23388]: audit 2024-02-13T15:05:48.555719+0000 mon.a (mon.0) 3519 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[21479]: audit 2024-02-13T15:05:47.817636+0000 mon.a (mon.0) 3517 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[21479]: audit 2024-02-13T15:05:47.836031+0000 mon.a (mon.0) 3518 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[21479]: cluster 2024-02-13T15:05:48.443932+0000 mgr.y (mgr.14613) 841 : cluster 0 pgmap v1341: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[21479]: audit 2024-02-13T15:05:48.539880+0000 mon.b (mon.1) 301 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:05:49.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[21479]: audit 2024-02-13T15:05:48.542156+0000 mon.b (mon.1) 302 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:05:49.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[21479]: audit 2024-02-13T15:05:48.555719+0000 mon.a (mon.0) 3519 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[28859]: audit 2024-02-13T15:05:47.817636+0000 mon.a (mon.0) 3517 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[28859]: audit 2024-02-13T15:05:47.836031+0000 mon.a (mon.0) 3518 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[28859]: cluster 2024-02-13T15:05:48.443932+0000 mgr.y (mgr.14613) 841 : cluster 0 pgmap v1341: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[28859]: audit 2024-02-13T15:05:48.539880+0000 mon.b (mon.1) 301 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:05:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[28859]: audit 2024-02-13T15:05:48.542156+0000 mon.b (mon.1) 302 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:05:49.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:48 smithi062 bash[28859]: audit 2024-02-13T15:05:48.555719+0000 mon.a (mon.0) 3519 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:05:51.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:05:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:05:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:51 smithi062 bash[21479]: cluster 2024-02-13T15:05:50.446356+0000 mgr.y (mgr.14613) 842 : cluster 0 pgmap v1342: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:51 smithi062 bash[21479]: audit 2024-02-13T15:05:50.550291+0000 mon.b (mon.1) 303 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:51 smithi062 bash[28859]: cluster 2024-02-13T15:05:50.446356+0000 mgr.y (mgr.14613) 842 : cluster 0 pgmap v1342: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:51 smithi062 bash[28859]: audit 2024-02-13T15:05:50.550291+0000 mon.b (mon.1) 303 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:51 smithi111 bash[23388]: cluster 2024-02-13T15:05:50.446356+0000 mgr.y (mgr.14613) 842 : cluster 0 pgmap v1342: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:51 smithi111 bash[23388]: audit 2024-02-13T15:05:50.550291+0000 mon.b (mon.1) 303 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:05:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:52 smithi062 bash[21479]: audit 2024-02-13T15:05:51.073651+0000 mgr.y (mgr.14613) 843 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:52 smithi062 bash[28859]: audit 2024-02-13T15:05:51.073651+0000 mgr.y (mgr.14613) 843 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:52 smithi111 bash[23388]: audit 2024-02-13T15:05:51.073651+0000 mgr.y (mgr.14613) 843 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:05:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:53 smithi062 bash[21479]: cluster 2024-02-13T15:05:52.447336+0000 mgr.y (mgr.14613) 844 : cluster 0 pgmap v1343: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:53.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:53 smithi062 bash[28859]: cluster 2024-02-13T15:05:52.447336+0000 mgr.y (mgr.14613) 844 : cluster 0 pgmap v1343: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:53 smithi111 bash[23388]: cluster 2024-02-13T15:05:52.447336+0000 mgr.y (mgr.14613) 844 : cluster 0 pgmap v1343: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:55.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:55 smithi062 bash[21479]: cluster 2024-02-13T15:05:54.448360+0000 mgr.y (mgr.14613) 845 : cluster 0 pgmap v1344: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:55.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:55 smithi062 bash[28859]: cluster 2024-02-13T15:05:54.448360+0000 mgr.y (mgr.14613) 845 : cluster 0 pgmap v1344: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:55.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:55 smithi111 bash[23388]: cluster 2024-02-13T15:05:54.448360+0000 mgr.y (mgr.14613) 845 : cluster 0 pgmap v1344: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:56.532 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:05:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:05:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:05:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:56 smithi062 bash[21479]: cluster 2024-02-13T15:05:56.450936+0000 mgr.y (mgr.14613) 846 : cluster 0 pgmap v1345: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:56 smithi062 bash[28859]: cluster 2024-02-13T15:05:56.450936+0000 mgr.y (mgr.14613) 846 : cluster 0 pgmap v1345: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:56 smithi111 bash[23388]: cluster 2024-02-13T15:05:56.450936+0000 mgr.y (mgr.14613) 846 : cluster 0 pgmap v1345: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:05:59.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:05:59 smithi062 bash[21479]: cluster 2024-02-13T15:05:58.451759+0000 mgr.y (mgr.14613) 847 : cluster 0 pgmap v1346: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:59.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:05:59 smithi062 bash[28859]: cluster 2024-02-13T15:05:58.451759+0000 mgr.y (mgr.14613) 847 : cluster 0 pgmap v1346: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:05:59.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:05:59 smithi111 bash[23388]: cluster 2024-02-13T15:05:58.451759+0000 mgr.y (mgr.14613) 847 : cluster 0 pgmap v1346: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:01.345 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:06:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:06:01.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:01 smithi062 bash[21479]: cluster 2024-02-13T15:06:00.454290+0000 mgr.y (mgr.14613) 848 : cluster 0 pgmap v1347: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:01.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:01 smithi062 bash[28859]: cluster 2024-02-13T15:06:00.454290+0000 mgr.y (mgr.14613) 848 : cluster 0 pgmap v1347: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:01 smithi111 bash[23388]: cluster 2024-02-13T15:06:00.454290+0000 mgr.y (mgr.14613) 848 : cluster 0 pgmap v1347: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:02 smithi062 bash[28859]: audit 2024-02-13T15:06:01.079441+0000 mgr.y (mgr.14613) 849 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:02 smithi062 bash[21479]: audit 2024-02-13T15:06:01.079441+0000 mgr.y (mgr.14613) 849 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:02 smithi111 bash[23388]: audit 2024-02-13T15:06:01.079441+0000 mgr.y (mgr.14613) 849 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:03.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:03 smithi062 bash[21479]: cluster 2024-02-13T15:06:02.455205+0000 mgr.y (mgr.14613) 850 : cluster 0 pgmap v1348: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:03.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:03 smithi062 bash[28859]: cluster 2024-02-13T15:06:02.455205+0000 mgr.y (mgr.14613) 850 : cluster 0 pgmap v1348: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:03.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:03 smithi111 bash[23388]: cluster 2024-02-13T15:06:02.455205+0000 mgr.y (mgr.14613) 850 : cluster 0 pgmap v1348: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:04.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:04 smithi062 bash[21479]: cluster 2024-02-13T15:06:04.456038+0000 mgr.y (mgr.14613) 851 : cluster 0 pgmap v1349: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:04.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:04 smithi062 bash[28859]: cluster 2024-02-13T15:06:04.456038+0000 mgr.y (mgr.14613) 851 : cluster 0 pgmap v1349: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:04 smithi111 bash[23388]: cluster 2024-02-13T15:06:04.456038+0000 mgr.y (mgr.14613) 851 : cluster 0 pgmap v1349: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:06.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:05 smithi062 bash[21479]: audit 2024-02-13T15:06:05.585898+0000 mon.b (mon.1) 304 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:06.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:05 smithi062 bash[28859]: audit 2024-02-13T15:06:05.585898+0000 mon.b (mon.1) 304 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:06.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:05 smithi111 bash[23388]: audit 2024-02-13T15:06:05.585898+0000 mon.b (mon.1) 304 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:06:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:06:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:06:07.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:06 smithi062 bash[28859]: cluster 2024-02-13T15:06:06.458588+0000 mgr.y (mgr.14613) 852 : cluster 0 pgmap v1350: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:07.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:06 smithi062 bash[21479]: cluster 2024-02-13T15:06:06.458588+0000 mgr.y (mgr.14613) 852 : cluster 0 pgmap v1350: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:07.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:06 smithi111 bash[23388]: cluster 2024-02-13T15:06:06.458588+0000 mgr.y (mgr.14613) 852 : cluster 0 pgmap v1350: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:09 smithi062 bash[28859]: cluster 2024-02-13T15:06:08.459391+0000 mgr.y (mgr.14613) 853 : cluster 0 pgmap v1351: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:09.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:09 smithi062 bash[21479]: cluster 2024-02-13T15:06:08.459391+0000 mgr.y (mgr.14613) 853 : cluster 0 pgmap v1351: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:09 smithi111 bash[23388]: cluster 2024-02-13T15:06:08.459391+0000 mgr.y (mgr.14613) 853 : cluster 0 pgmap v1351: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:11.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:06:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:06:11.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:11 smithi062 bash[21479]: cluster 2024-02-13T15:06:10.461865+0000 mgr.y (mgr.14613) 854 : cluster 0 pgmap v1352: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:11.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:11 smithi062 bash[28859]: cluster 2024-02-13T15:06:10.461865+0000 mgr.y (mgr.14613) 854 : cluster 0 pgmap v1352: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:11.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:11 smithi111 bash[23388]: cluster 2024-02-13T15:06:10.461865+0000 mgr.y (mgr.14613) 854 : cluster 0 pgmap v1352: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:12 smithi062 bash[21479]: audit 2024-02-13T15:06:11.090850+0000 mgr.y (mgr.14613) 855 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:12.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:12 smithi062 bash[28859]: audit 2024-02-13T15:06:11.090850+0000 mgr.y (mgr.14613) 855 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:12 smithi111 bash[23388]: audit 2024-02-13T15:06:11.090850+0000 mgr.y (mgr.14613) 855 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:13.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:13 smithi062 bash[21479]: cluster 2024-02-13T15:06:12.462801+0000 mgr.y (mgr.14613) 856 : cluster 0 pgmap v1353: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:13.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:13 smithi062 bash[28859]: cluster 2024-02-13T15:06:12.462801+0000 mgr.y (mgr.14613) 856 : cluster 0 pgmap v1353: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:13.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:13 smithi111 bash[23388]: cluster 2024-02-13T15:06:12.462801+0000 mgr.y (mgr.14613) 856 : cluster 0 pgmap v1353: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:14 smithi062 bash[21479]: cluster 2024-02-13T15:06:14.463644+0000 mgr.y (mgr.14613) 857 : cluster 0 pgmap v1354: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:14.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:14 smithi062 bash[28859]: cluster 2024-02-13T15:06:14.463644+0000 mgr.y (mgr.14613) 857 : cluster 0 pgmap v1354: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:14 smithi111 bash[23388]: cluster 2024-02-13T15:06:14.463644+0000 mgr.y (mgr.14613) 857 : cluster 0 pgmap v1354: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:06:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:06:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:06:17.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:17 smithi062 bash[21479]: cluster 2024-02-13T15:06:16.466121+0000 mgr.y (mgr.14613) 858 : cluster 0 pgmap v1355: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:17.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:17 smithi062 bash[28859]: cluster 2024-02-13T15:06:16.466121+0000 mgr.y (mgr.14613) 858 : cluster 0 pgmap v1355: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:17.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:17 smithi111 bash[23388]: cluster 2024-02-13T15:06:16.466121+0000 mgr.y (mgr.14613) 858 : cluster 0 pgmap v1355: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:19.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:18 smithi062 bash[21479]: cluster 2024-02-13T15:06:18.466981+0000 mgr.y (mgr.14613) 859 : cluster 0 pgmap v1356: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:19.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:18 smithi062 bash[28859]: cluster 2024-02-13T15:06:18.466981+0000 mgr.y (mgr.14613) 859 : cluster 0 pgmap v1356: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:19.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:18 smithi111 bash[23388]: cluster 2024-02-13T15:06:18.466981+0000 mgr.y (mgr.14613) 859 : cluster 0 pgmap v1356: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:21.528 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:06:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:06:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:21 smithi062 bash[21479]: cluster 2024-02-13T15:06:20.469476+0000 mgr.y (mgr.14613) 860 : cluster 0 pgmap v1357: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:21 smithi062 bash[21479]: audit 2024-02-13T15:06:20.622423+0000 mon.b (mon.1) 305 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:21 smithi062 bash[28859]: cluster 2024-02-13T15:06:20.469476+0000 mgr.y (mgr.14613) 860 : cluster 0 pgmap v1357: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:21.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:21 smithi062 bash[28859]: audit 2024-02-13T15:06:20.622423+0000 mon.b (mon.1) 305 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:21 smithi111 bash[23388]: cluster 2024-02-13T15:06:20.469476+0000 mgr.y (mgr.14613) 860 : cluster 0 pgmap v1357: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:21 smithi111 bash[23388]: audit 2024-02-13T15:06:20.622423+0000 mon.b (mon.1) 305 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:22 smithi062 bash[21479]: audit 2024-02-13T15:06:21.102269+0000 mgr.y (mgr.14613) 861 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:22 smithi062 bash[21479]: cluster 2024-02-13T15:06:22.470593+0000 mgr.y (mgr.14613) 862 : cluster 0 pgmap v1358: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:22 smithi062 bash[28859]: audit 2024-02-13T15:06:21.102269+0000 mgr.y (mgr.14613) 861 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:22 smithi062 bash[28859]: cluster 2024-02-13T15:06:22.470593+0000 mgr.y (mgr.14613) 862 : cluster 0 pgmap v1358: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:22 smithi111 bash[23388]: audit 2024-02-13T15:06:21.102269+0000 mgr.y (mgr.14613) 861 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:22 smithi111 bash[23388]: cluster 2024-02-13T15:06:22.470593+0000 mgr.y (mgr.14613) 862 : cluster 0 pgmap v1358: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:24 smithi111 bash[23388]: cluster 2024-02-13T15:06:24.471379+0000 mgr.y (mgr.14613) 863 : cluster 0 pgmap v1359: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:25.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:24 smithi062 bash[28859]: cluster 2024-02-13T15:06:24.471379+0000 mgr.y (mgr.14613) 863 : cluster 0 pgmap v1359: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:25.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:24 smithi062 bash[21479]: cluster 2024-02-13T15:06:24.471379+0000 mgr.y (mgr.14613) 863 : cluster 0 pgmap v1359: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:06:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:06:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:06:26.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:26 smithi111 bash[23388]: cluster 2024-02-13T15:06:26.473989+0000 mgr.y (mgr.14613) 864 : cluster 0 pgmap v1360: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:26 smithi062 bash[21479]: cluster 2024-02-13T15:06:26.473989+0000 mgr.y (mgr.14613) 864 : cluster 0 pgmap v1360: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:27.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:26 smithi062 bash[28859]: cluster 2024-02-13T15:06:26.473989+0000 mgr.y (mgr.14613) 864 : cluster 0 pgmap v1360: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:28 smithi111 bash[23388]: cluster 2024-02-13T15:06:28.474875+0000 mgr.y (mgr.14613) 865 : cluster 0 pgmap v1361: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:29.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:28 smithi062 bash[21479]: cluster 2024-02-13T15:06:28.474875+0000 mgr.y (mgr.14613) 865 : cluster 0 pgmap v1361: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:28 smithi062 bash[28859]: cluster 2024-02-13T15:06:28.474875+0000 mgr.y (mgr.14613) 865 : cluster 0 pgmap v1361: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:30 smithi111 bash[23388]: cluster 2024-02-13T15:06:30.477671+0000 mgr.y (mgr.14613) 866 : cluster 0 pgmap v1362: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:31.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:30 smithi062 bash[21479]: cluster 2024-02-13T15:06:30.477671+0000 mgr.y (mgr.14613) 866 : cluster 0 pgmap v1362: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:30 smithi062 bash[28859]: cluster 2024-02-13T15:06:30.477671+0000 mgr.y (mgr.14613) 866 : cluster 0 pgmap v1362: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:31.582 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:06:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:06:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:31 smithi111 bash[23388]: audit 2024-02-13T15:06:31.113561+0000 mgr.y (mgr.14613) 867 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:31 smithi062 bash[21479]: audit 2024-02-13T15:06:31.113561+0000 mgr.y (mgr.14613) 867 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:32.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:31 smithi062 bash[28859]: audit 2024-02-13T15:06:31.113561+0000 mgr.y (mgr.14613) 867 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:32 smithi111 bash[23388]: cluster 2024-02-13T15:06:32.478581+0000 mgr.y (mgr.14613) 868 : cluster 0 pgmap v1363: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:32 smithi062 bash[21479]: cluster 2024-02-13T15:06:32.478581+0000 mgr.y (mgr.14613) 868 : cluster 0 pgmap v1363: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:32 smithi062 bash[28859]: cluster 2024-02-13T15:06:32.478581+0000 mgr.y (mgr.14613) 868 : cluster 0 pgmap v1363: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:34 smithi111 bash[23388]: cluster 2024-02-13T15:06:34.479377+0000 mgr.y (mgr.14613) 869 : cluster 0 pgmap v1364: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:35.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:34 smithi062 bash[21479]: cluster 2024-02-13T15:06:34.479377+0000 mgr.y (mgr.14613) 869 : cluster 0 pgmap v1364: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:34 smithi062 bash[28859]: cluster 2024-02-13T15:06:34.479377+0000 mgr.y (mgr.14613) 869 : cluster 0 pgmap v1364: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:36.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:35 smithi062 bash[21479]: audit 2024-02-13T15:06:35.657215+0000 mon.b (mon.1) 306 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:36.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:35 smithi062 bash[28859]: audit 2024-02-13T15:06:35.657215+0000 mon.b (mon.1) 306 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:35 smithi111 bash[23388]: audit 2024-02-13T15:06:35.657215+0000 mon.b (mon.1) 306 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:06:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:06:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:06:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:36 smithi062 bash[21479]: cluster 2024-02-13T15:06:36.481838+0000 mgr.y (mgr.14613) 870 : cluster 0 pgmap v1365: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:37.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:36 smithi062 bash[28859]: cluster 2024-02-13T15:06:36.481838+0000 mgr.y (mgr.14613) 870 : cluster 0 pgmap v1365: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:36 smithi111 bash[23388]: cluster 2024-02-13T15:06:36.481838+0000 mgr.y (mgr.14613) 870 : cluster 0 pgmap v1365: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:38 smithi111 bash[23388]: cluster 2024-02-13T15:06:38.482731+0000 mgr.y (mgr.14613) 871 : cluster 0 pgmap v1366: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:38 smithi062 bash[28859]: cluster 2024-02-13T15:06:38.482731+0000 mgr.y (mgr.14613) 871 : cluster 0 pgmap v1366: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:38 smithi062 bash[21479]: cluster 2024-02-13T15:06:38.482731+0000 mgr.y (mgr.14613) 871 : cluster 0 pgmap v1366: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:40.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:40 smithi111 bash[23388]: cluster 2024-02-13T15:06:40.485752+0000 mgr.y (mgr.14613) 872 : cluster 0 pgmap v1367: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:40 smithi062 bash[28859]: cluster 2024-02-13T15:06:40.485752+0000 mgr.y (mgr.14613) 872 : cluster 0 pgmap v1367: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:41.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:40 smithi062 bash[21479]: cluster 2024-02-13T15:06:40.485752+0000 mgr.y (mgr.14613) 872 : cluster 0 pgmap v1367: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:41.583 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:06:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:06:41.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:41 smithi111 bash[23388]: audit 2024-02-13T15:06:41.117021+0000 mgr.y (mgr.14613) 873 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:41 smithi062 bash[28859]: audit 2024-02-13T15:06:41.117021+0000 mgr.y (mgr.14613) 873 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:42.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:41 smithi062 bash[21479]: audit 2024-02-13T15:06:41.117021+0000 mgr.y (mgr.14613) 873 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:42 smithi111 bash[23388]: cluster 2024-02-13T15:06:42.486626+0000 mgr.y (mgr.14613) 874 : cluster 0 pgmap v1368: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:42 smithi062 bash[28859]: cluster 2024-02-13T15:06:42.486626+0000 mgr.y (mgr.14613) 874 : cluster 0 pgmap v1368: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:42 smithi062 bash[21479]: cluster 2024-02-13T15:06:42.486626+0000 mgr.y (mgr.14613) 874 : cluster 0 pgmap v1368: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:44 smithi111 bash[23388]: cluster 2024-02-13T15:06:44.487454+0000 mgr.y (mgr.14613) 875 : cluster 0 pgmap v1369: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:44 smithi062 bash[21479]: cluster 2024-02-13T15:06:44.487454+0000 mgr.y (mgr.14613) 875 : cluster 0 pgmap v1369: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:44 smithi062 bash[28859]: cluster 2024-02-13T15:06:44.487454+0000 mgr.y (mgr.14613) 875 : cluster 0 pgmap v1369: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:06:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:06:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:06:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:46 smithi111 bash[23388]: cluster 2024-02-13T15:06:46.489881+0000 mgr.y (mgr.14613) 876 : cluster 0 pgmap v1370: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:46 smithi062 bash[21479]: cluster 2024-02-13T15:06:46.489881+0000 mgr.y (mgr.14613) 876 : cluster 0 pgmap v1370: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:47.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:46 smithi062 bash[28859]: cluster 2024-02-13T15:06:46.489881+0000 mgr.y (mgr.14613) 876 : cluster 0 pgmap v1370: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:48 smithi111 bash[23388]: cluster 2024-02-13T15:06:48.490948+0000 mgr.y (mgr.14613) 877 : cluster 0 pgmap v1371: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:48 smithi062 bash[28859]: cluster 2024-02-13T15:06:48.490948+0000 mgr.y (mgr.14613) 877 : cluster 0 pgmap v1371: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:48 smithi062 bash[21479]: cluster 2024-02-13T15:06:48.490948+0000 mgr.y (mgr.14613) 877 : cluster 0 pgmap v1371: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:49.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:49 smithi111 bash[23388]: audit 2024-02-13T15:06:48.650550+0000 mon.b (mon.1) 307 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:06:50.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:49 smithi062 bash[21479]: audit 2024-02-13T15:06:48.650550+0000 mon.b (mon.1) 307 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:06:50.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:49 smithi062 bash[28859]: audit 2024-02-13T15:06:48.650550+0000 mon.b (mon.1) 307 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:06:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:50 smithi111 bash[23388]: cluster 2024-02-13T15:06:50.493367+0000 mgr.y (mgr.14613) 878 : cluster 0 pgmap v1372: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:51.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:50 smithi062 bash[21479]: cluster 2024-02-13T15:06:50.493367+0000 mgr.y (mgr.14613) 878 : cluster 0 pgmap v1372: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:51.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:50 smithi062 bash[28859]: cluster 2024-02-13T15:06:50.493367+0000 mgr.y (mgr.14613) 878 : cluster 0 pgmap v1372: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:51.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:06:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:06:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:51 smithi062 bash[28859]: audit 2024-02-13T15:06:50.691521+0000 mon.b (mon.1) 308 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:51 smithi062 bash[28859]: audit 2024-02-13T15:06:51.128457+0000 mgr.y (mgr.14613) 879 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:51 smithi062 bash[21479]: audit 2024-02-13T15:06:50.691521+0000 mon.b (mon.1) 308 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:51 smithi062 bash[21479]: audit 2024-02-13T15:06:51.128457+0000 mgr.y (mgr.14613) 879 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:51 smithi111 bash[23388]: audit 2024-02-13T15:06:50.691521+0000 mon.b (mon.1) 308 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:06:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:51 smithi111 bash[23388]: audit 2024-02-13T15:06:51.128457+0000 mgr.y (mgr.14613) 879 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:06:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:52 smithi062 bash[21479]: cluster 2024-02-13T15:06:52.494168+0000 mgr.y (mgr.14613) 880 : cluster 0 pgmap v1373: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:53.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:52 smithi062 bash[28859]: cluster 2024-02-13T15:06:52.494168+0000 mgr.y (mgr.14613) 880 : cluster 0 pgmap v1373: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:53.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:52 smithi111 bash[23388]: cluster 2024-02-13T15:06:52.494168+0000 mgr.y (mgr.14613) 880 : cluster 0 pgmap v1373: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[28859]: audit 2024-02-13T15:06:54.287648+0000 mon.a (mon.0) 3520 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[28859]: audit 2024-02-13T15:06:54.299072+0000 mon.a (mon.0) 3521 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[28859]: cluster 2024-02-13T15:06:54.495011+0000 mgr.y (mgr.14613) 881 : cluster 0 pgmap v1374: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:55.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[28859]: audit 2024-02-13T15:06:54.695102+0000 mon.a (mon.0) 3522 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[28859]: audit 2024-02-13T15:06:54.708895+0000 mon.a (mon.0) 3523 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[21479]: audit 2024-02-13T15:06:54.287648+0000 mon.a (mon.0) 3520 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[21479]: audit 2024-02-13T15:06:54.299072+0000 mon.a (mon.0) 3521 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[21479]: cluster 2024-02-13T15:06:54.495011+0000 mgr.y (mgr.14613) 881 : cluster 0 pgmap v1374: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:55.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[21479]: audit 2024-02-13T15:06:54.695102+0000 mon.a (mon.0) 3522 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:55 smithi062 bash[21479]: audit 2024-02-13T15:06:54.708895+0000 mon.a (mon.0) 3523 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:55 smithi111 bash[23388]: audit 2024-02-13T15:06:54.287648+0000 mon.a (mon.0) 3520 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:55 smithi111 bash[23388]: audit 2024-02-13T15:06:54.299072+0000 mon.a (mon.0) 3521 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:55 smithi111 bash[23388]: cluster 2024-02-13T15:06:54.495011+0000 mgr.y (mgr.14613) 881 : cluster 0 pgmap v1374: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:55.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:55 smithi111 bash[23388]: audit 2024-02-13T15:06:54.695102+0000 mon.a (mon.0) 3522 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:55.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:55 smithi111 bash[23388]: audit 2024-02-13T15:06:54.708895+0000 mon.a (mon.0) 3523 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:06:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:06:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:06:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:56 smithi062 bash[28859]: audit 2024-02-13T15:06:55.346573+0000 mon.b (mon.1) 309 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:06:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:56 smithi062 bash[28859]: audit 2024-02-13T15:06:55.348464+0000 mon.b (mon.1) 310 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:06:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:56 smithi062 bash[28859]: audit 2024-02-13T15:06:55.361150+0000 mon.a (mon.0) 3524 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:56.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:56 smithi062 bash[21479]: audit 2024-02-13T15:06:55.346573+0000 mon.b (mon.1) 309 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:06:56.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:56 smithi062 bash[21479]: audit 2024-02-13T15:06:55.348464+0000 mon.b (mon.1) 310 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:06:56.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:56 smithi062 bash[21479]: audit 2024-02-13T15:06:55.361150+0000 mon.a (mon.0) 3524 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:56 smithi111 bash[23388]: audit 2024-02-13T15:06:55.346573+0000 mon.b (mon.1) 309 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:06:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:56 smithi111 bash[23388]: audit 2024-02-13T15:06:55.348464+0000 mon.b (mon.1) 310 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:06:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:56 smithi111 bash[23388]: audit 2024-02-13T15:06:55.361150+0000 mon.a (mon.0) 3524 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:06:57.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:57 smithi062 bash[28859]: cluster 2024-02-13T15:06:56.497450+0000 mgr.y (mgr.14613) 882 : cluster 0 pgmap v1375: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:57.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:57 smithi062 bash[21479]: cluster 2024-02-13T15:06:56.497450+0000 mgr.y (mgr.14613) 882 : cluster 0 pgmap v1375: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:57.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:57 smithi111 bash[23388]: cluster 2024-02-13T15:06:56.497450+0000 mgr.y (mgr.14613) 882 : cluster 0 pgmap v1375: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:06:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:06:58 smithi111 bash[23388]: cluster 2024-02-13T15:06:58.498337+0000 mgr.y (mgr.14613) 883 : cluster 0 pgmap v1376: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:06:58 smithi062 bash[28859]: cluster 2024-02-13T15:06:58.498337+0000 mgr.y (mgr.14613) 883 : cluster 0 pgmap v1376: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:06:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:06:58 smithi062 bash[21479]: cluster 2024-02-13T15:06:58.498337+0000 mgr.y (mgr.14613) 883 : cluster 0 pgmap v1376: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:00 smithi111 bash[23388]: cluster 2024-02-13T15:07:00.500773+0000 mgr.y (mgr.14613) 884 : cluster 0 pgmap v1377: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:00 smithi062 bash[28859]: cluster 2024-02-13T15:07:00.500773+0000 mgr.y (mgr.14613) 884 : cluster 0 pgmap v1377: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:00 smithi062 bash[21479]: cluster 2024-02-13T15:07:00.500773+0000 mgr.y (mgr.14613) 884 : cluster 0 pgmap v1377: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:01.589 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:07:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:07:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:01 smithi111 bash[23388]: audit 2024-02-13T15:07:01.139784+0000 mgr.y (mgr.14613) 885 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:02.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:01 smithi062 bash[21479]: audit 2024-02-13T15:07:01.139784+0000 mgr.y (mgr.14613) 885 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:02.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:01 smithi062 bash[28859]: audit 2024-02-13T15:07:01.139784+0000 mgr.y (mgr.14613) 885 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:03.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:02 smithi062 bash[21479]: cluster 2024-02-13T15:07:02.501725+0000 mgr.y (mgr.14613) 886 : cluster 0 pgmap v1378: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:03.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:02 smithi062 bash[28859]: cluster 2024-02-13T15:07:02.501725+0000 mgr.y (mgr.14613) 886 : cluster 0 pgmap v1378: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:03.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:02 smithi111 bash[23388]: cluster 2024-02-13T15:07:02.501725+0000 mgr.y (mgr.14613) 886 : cluster 0 pgmap v1378: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:04.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:04 smithi111 bash[23388]: cluster 2024-02-13T15:07:04.502634+0000 mgr.y (mgr.14613) 887 : cluster 0 pgmap v1379: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:05.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:04 smithi062 bash[28859]: cluster 2024-02-13T15:07:04.502634+0000 mgr.y (mgr.14613) 887 : cluster 0 pgmap v1379: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:05.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:04 smithi062 bash[21479]: cluster 2024-02-13T15:07:04.502634+0000 mgr.y (mgr.14613) 887 : cluster 0 pgmap v1379: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:06.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:05 smithi062 bash[28859]: audit 2024-02-13T15:07:05.726658+0000 mon.b (mon.1) 311 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:06.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:05 smithi062 bash[21479]: audit 2024-02-13T15:07:05.726658+0000 mon.b (mon.1) 311 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:06.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:05 smithi111 bash[23388]: audit 2024-02-13T15:07:05.726658+0000 mon.b (mon.1) 311 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:07:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:07:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:07:07.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:06 smithi062 bash[28859]: cluster 2024-02-13T15:07:06.505086+0000 mgr.y (mgr.14613) 888 : cluster 0 pgmap v1380: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:07.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:06 smithi062 bash[21479]: cluster 2024-02-13T15:07:06.505086+0000 mgr.y (mgr.14613) 888 : cluster 0 pgmap v1380: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:07.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:06 smithi111 bash[23388]: cluster 2024-02-13T15:07:06.505086+0000 mgr.y (mgr.14613) 888 : cluster 0 pgmap v1380: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:08.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:08 smithi111 bash[23388]: cluster 2024-02-13T15:07:08.505940+0000 mgr.y (mgr.14613) 889 : cluster 0 pgmap v1381: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:09.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:08 smithi062 bash[28859]: cluster 2024-02-13T15:07:08.505940+0000 mgr.y (mgr.14613) 889 : cluster 0 pgmap v1381: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:08 smithi062 bash[21479]: cluster 2024-02-13T15:07:08.505940+0000 mgr.y (mgr.14613) 889 : cluster 0 pgmap v1381: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:10.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:10 smithi111 bash[23388]: cluster 2024-02-13T15:07:10.508440+0000 mgr.y (mgr.14613) 890 : cluster 0 pgmap v1382: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:11.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:10 smithi062 bash[21479]: cluster 2024-02-13T15:07:10.508440+0000 mgr.y (mgr.14613) 890 : cluster 0 pgmap v1382: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:11.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:10 smithi062 bash[28859]: cluster 2024-02-13T15:07:10.508440+0000 mgr.y (mgr.14613) 890 : cluster 0 pgmap v1382: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:11.589 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:07:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:07:11.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:11 smithi111 bash[23388]: audit 2024-02-13T15:07:11.151169+0000 mgr.y (mgr.14613) 891 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:12.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:11 smithi062 bash[28859]: audit 2024-02-13T15:07:11.151169+0000 mgr.y (mgr.14613) 891 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:12.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:11 smithi062 bash[21479]: audit 2024-02-13T15:07:11.151169+0000 mgr.y (mgr.14613) 891 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:13.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:12 smithi062 bash[21479]: cluster 2024-02-13T15:07:12.509305+0000 mgr.y (mgr.14613) 892 : cluster 0 pgmap v1383: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:13.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:12 smithi062 bash[28859]: cluster 2024-02-13T15:07:12.509305+0000 mgr.y (mgr.14613) 892 : cluster 0 pgmap v1383: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:13.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:12 smithi111 bash[23388]: cluster 2024-02-13T15:07:12.509305+0000 mgr.y (mgr.14613) 892 : cluster 0 pgmap v1383: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:14 smithi111 bash[23388]: cluster 2024-02-13T15:07:14.510170+0000 mgr.y (mgr.14613) 893 : cluster 0 pgmap v1384: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:14 smithi062 bash[21479]: cluster 2024-02-13T15:07:14.510170+0000 mgr.y (mgr.14613) 893 : cluster 0 pgmap v1384: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:15.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:14 smithi062 bash[28859]: cluster 2024-02-13T15:07:14.510170+0000 mgr.y (mgr.14613) 893 : cluster 0 pgmap v1384: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:07:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:07:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:07:16.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:16 smithi111 bash[23388]: cluster 2024-02-13T15:07:16.512672+0000 mgr.y (mgr.14613) 894 : cluster 0 pgmap v1385: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:16 smithi062 bash[21479]: cluster 2024-02-13T15:07:16.512672+0000 mgr.y (mgr.14613) 894 : cluster 0 pgmap v1385: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:17.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:16 smithi062 bash[28859]: cluster 2024-02-13T15:07:16.512672+0000 mgr.y (mgr.14613) 894 : cluster 0 pgmap v1385: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:18 smithi111 bash[23388]: cluster 2024-02-13T15:07:18.513561+0000 mgr.y (mgr.14613) 895 : cluster 0 pgmap v1386: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:18 smithi062 bash[28859]: cluster 2024-02-13T15:07:18.513561+0000 mgr.y (mgr.14613) 895 : cluster 0 pgmap v1386: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:18 smithi062 bash[21479]: cluster 2024-02-13T15:07:18.513561+0000 mgr.y (mgr.14613) 895 : cluster 0 pgmap v1386: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:20.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:20 smithi111 bash[23388]: cluster 2024-02-13T15:07:20.516079+0000 mgr.y (mgr.14613) 896 : cluster 0 pgmap v1387: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:21.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:20 smithi062 bash[28859]: cluster 2024-02-13T15:07:20.516079+0000 mgr.y (mgr.14613) 896 : cluster 0 pgmap v1387: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:20 smithi062 bash[21479]: cluster 2024-02-13T15:07:20.516079+0000 mgr.y (mgr.14613) 896 : cluster 0 pgmap v1387: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:21.591 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:07:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:07:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:21 smithi111 bash[23388]: audit 2024-02-13T15:07:20.762405+0000 mon.b (mon.1) 312 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:21 smithi111 bash[23388]: audit 2024-02-13T15:07:21.152943+0000 mgr.y (mgr.14613) 897 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:22.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:21 smithi062 bash[28859]: audit 2024-02-13T15:07:20.762405+0000 mon.b (mon.1) 312 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:22.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:21 smithi062 bash[28859]: audit 2024-02-13T15:07:21.152943+0000 mgr.y (mgr.14613) 897 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:22.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:21 smithi062 bash[21479]: audit 2024-02-13T15:07:20.762405+0000 mon.b (mon.1) 312 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:22.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:21 smithi062 bash[21479]: audit 2024-02-13T15:07:21.152943+0000 mgr.y (mgr.14613) 897 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:22 smithi062 bash[21479]: cluster 2024-02-13T15:07:22.516899+0000 mgr.y (mgr.14613) 898 : cluster 0 pgmap v1388: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:23.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:22 smithi062 bash[28859]: cluster 2024-02-13T15:07:22.516899+0000 mgr.y (mgr.14613) 898 : cluster 0 pgmap v1388: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:22 smithi111 bash[23388]: cluster 2024-02-13T15:07:22.516899+0000 mgr.y (mgr.14613) 898 : cluster 0 pgmap v1388: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:24 smithi111 bash[23388]: cluster 2024-02-13T15:07:24.517791+0000 mgr.y (mgr.14613) 899 : cluster 0 pgmap v1389: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:25.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:24 smithi062 bash[28859]: cluster 2024-02-13T15:07:24.517791+0000 mgr.y (mgr.14613) 899 : cluster 0 pgmap v1389: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:25.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:24 smithi062 bash[21479]: cluster 2024-02-13T15:07:24.517791+0000 mgr.y (mgr.14613) 899 : cluster 0 pgmap v1389: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:07:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:07:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:07:26.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:26 smithi111 bash[23388]: cluster 2024-02-13T15:07:26.520235+0000 mgr.y (mgr.14613) 900 : cluster 0 pgmap v1390: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:26 smithi062 bash[21479]: cluster 2024-02-13T15:07:26.520235+0000 mgr.y (mgr.14613) 900 : cluster 0 pgmap v1390: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:27.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:26 smithi062 bash[28859]: cluster 2024-02-13T15:07:26.520235+0000 mgr.y (mgr.14613) 900 : cluster 0 pgmap v1390: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:28 smithi111 bash[23388]: cluster 2024-02-13T15:07:28.521101+0000 mgr.y (mgr.14613) 901 : cluster 0 pgmap v1391: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:28 smithi062 bash[28859]: cluster 2024-02-13T15:07:28.521101+0000 mgr.y (mgr.14613) 901 : cluster 0 pgmap v1391: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:29.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:28 smithi062 bash[21479]: cluster 2024-02-13T15:07:28.521101+0000 mgr.y (mgr.14613) 901 : cluster 0 pgmap v1391: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:30 smithi111 bash[23388]: cluster 2024-02-13T15:07:30.523773+0000 mgr.y (mgr.14613) 902 : cluster 0 pgmap v1392: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:31.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:30 smithi062 bash[21479]: cluster 2024-02-13T15:07:30.523773+0000 mgr.y (mgr.14613) 902 : cluster 0 pgmap v1392: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:31.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:30 smithi062 bash[28859]: cluster 2024-02-13T15:07:30.523773+0000 mgr.y (mgr.14613) 902 : cluster 0 pgmap v1392: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:31.592 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:07:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:07:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:31 smithi111 bash[23388]: audit 2024-02-13T15:07:31.164310+0000 mgr.y (mgr.14613) 903 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:32.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:31 smithi062 bash[21479]: audit 2024-02-13T15:07:31.164310+0000 mgr.y (mgr.14613) 903 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:32.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:31 smithi062 bash[28859]: audit 2024-02-13T15:07:31.164310+0000 mgr.y (mgr.14613) 903 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:32 smithi062 bash[28859]: cluster 2024-02-13T15:07:32.524673+0000 mgr.y (mgr.14613) 904 : cluster 0 pgmap v1393: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:32 smithi062 bash[21479]: cluster 2024-02-13T15:07:32.524673+0000 mgr.y (mgr.14613) 904 : cluster 0 pgmap v1393: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:32 smithi111 bash[23388]: cluster 2024-02-13T15:07:32.524673+0000 mgr.y (mgr.14613) 904 : cluster 0 pgmap v1393: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:34 smithi111 bash[23388]: cluster 2024-02-13T15:07:34.525527+0000 mgr.y (mgr.14613) 905 : cluster 0 pgmap v1394: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:34 smithi062 bash[28859]: cluster 2024-02-13T15:07:34.525527+0000 mgr.y (mgr.14613) 905 : cluster 0 pgmap v1394: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:35.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:34 smithi062 bash[21479]: cluster 2024-02-13T15:07:34.525527+0000 mgr.y (mgr.14613) 905 : cluster 0 pgmap v1394: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:35 smithi062 bash[28859]: audit 2024-02-13T15:07:35.798006+0000 mon.b (mon.1) 313 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:36.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:35 smithi062 bash[21479]: audit 2024-02-13T15:07:35.798006+0000 mon.b (mon.1) 313 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:35 smithi111 bash[23388]: audit 2024-02-13T15:07:35.798006+0000 mon.b (mon.1) 313 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:07:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:07:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:07:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:36 smithi062 bash[21479]: cluster 2024-02-13T15:07:36.528062+0000 mgr.y (mgr.14613) 906 : cluster 0 pgmap v1395: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:36 smithi062 bash[28859]: cluster 2024-02-13T15:07:36.528062+0000 mgr.y (mgr.14613) 906 : cluster 0 pgmap v1395: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:36 smithi111 bash[23388]: cluster 2024-02-13T15:07:36.528062+0000 mgr.y (mgr.14613) 906 : cluster 0 pgmap v1395: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:38 smithi111 bash[23388]: cluster 2024-02-13T15:07:38.528944+0000 mgr.y (mgr.14613) 907 : cluster 0 pgmap v1396: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:38 smithi062 bash[28859]: cluster 2024-02-13T15:07:38.528944+0000 mgr.y (mgr.14613) 907 : cluster 0 pgmap v1396: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:38 smithi062 bash[21479]: cluster 2024-02-13T15:07:38.528944+0000 mgr.y (mgr.14613) 907 : cluster 0 pgmap v1396: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:40.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:40 smithi111 bash[23388]: cluster 2024-02-13T15:07:40.531471+0000 mgr.y (mgr.14613) 908 : cluster 0 pgmap v1397: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:40 smithi062 bash[21479]: cluster 2024-02-13T15:07:40.531471+0000 mgr.y (mgr.14613) 908 : cluster 0 pgmap v1397: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:40 smithi062 bash[28859]: cluster 2024-02-13T15:07:40.531471+0000 mgr.y (mgr.14613) 908 : cluster 0 pgmap v1397: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:41.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:07:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:07:42.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:41 smithi062 bash[21479]: audit 2024-02-13T15:07:41.175684+0000 mgr.y (mgr.14613) 909 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:42.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:41 smithi062 bash[28859]: audit 2024-02-13T15:07:41.175684+0000 mgr.y (mgr.14613) 909 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:42.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:41 smithi111 bash[23388]: audit 2024-02-13T15:07:41.175684+0000 mgr.y (mgr.14613) 909 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:42 smithi062 bash[21479]: cluster 2024-02-13T15:07:42.532357+0000 mgr.y (mgr.14613) 910 : cluster 0 pgmap v1398: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:42 smithi062 bash[28859]: cluster 2024-02-13T15:07:42.532357+0000 mgr.y (mgr.14613) 910 : cluster 0 pgmap v1398: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:43.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:42 smithi111 bash[23388]: cluster 2024-02-13T15:07:42.532357+0000 mgr.y (mgr.14613) 910 : cluster 0 pgmap v1398: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:44 smithi062 bash[21479]: cluster 2024-02-13T15:07:44.533184+0000 mgr.y (mgr.14613) 911 : cluster 0 pgmap v1399: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:45.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:44 smithi062 bash[28859]: cluster 2024-02-13T15:07:44.533184+0000 mgr.y (mgr.14613) 911 : cluster 0 pgmap v1399: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:45.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:44 smithi111 bash[23388]: cluster 2024-02-13T15:07:44.533184+0000 mgr.y (mgr.14613) 911 : cluster 0 pgmap v1399: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:07:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:07:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:07:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:46 smithi062 bash[21479]: cluster 2024-02-13T15:07:46.535725+0000 mgr.y (mgr.14613) 912 : cluster 0 pgmap v1400: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:46 smithi062 bash[28859]: cluster 2024-02-13T15:07:46.535725+0000 mgr.y (mgr.14613) 912 : cluster 0 pgmap v1400: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:47.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:46 smithi111 bash[23388]: cluster 2024-02-13T15:07:46.535725+0000 mgr.y (mgr.14613) 912 : cluster 0 pgmap v1400: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:48 smithi062 bash[21479]: cluster 2024-02-13T15:07:48.536619+0000 mgr.y (mgr.14613) 913 : cluster 0 pgmap v1401: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:49.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:48 smithi062 bash[28859]: cluster 2024-02-13T15:07:48.536619+0000 mgr.y (mgr.14613) 913 : cluster 0 pgmap v1401: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:48 smithi111 bash[23388]: cluster 2024-02-13T15:07:48.536619+0000 mgr.y (mgr.14613) 913 : cluster 0 pgmap v1401: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:51.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:50 smithi062 bash[21479]: cluster 2024-02-13T15:07:50.539149+0000 mgr.y (mgr.14613) 914 : cluster 0 pgmap v1402: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:51.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:50 smithi062 bash[28859]: cluster 2024-02-13T15:07:50.539149+0000 mgr.y (mgr.14613) 914 : cluster 0 pgmap v1402: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:51.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:50 smithi111 bash[23388]: cluster 2024-02-13T15:07:50.539149+0000 mgr.y (mgr.14613) 914 : cluster 0 pgmap v1402: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:51.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:07:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:07:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:51 smithi062 bash[21479]: audit 2024-02-13T15:07:50.832432+0000 mon.b (mon.1) 314 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:51 smithi062 bash[21479]: audit 2024-02-13T15:07:51.186960+0000 mgr.y (mgr.14613) 915 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:51 smithi062 bash[28859]: audit 2024-02-13T15:07:50.832432+0000 mon.b (mon.1) 314 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:51 smithi062 bash[28859]: audit 2024-02-13T15:07:51.186960+0000 mgr.y (mgr.14613) 915 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:51 smithi111 bash[23388]: audit 2024-02-13T15:07:50.832432+0000 mon.b (mon.1) 314 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:07:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:51 smithi111 bash[23388]: audit 2024-02-13T15:07:51.186960+0000 mgr.y (mgr.14613) 915 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:07:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:52 smithi062 bash[21479]: cluster 2024-02-13T15:07:52.540004+0000 mgr.y (mgr.14613) 916 : cluster 0 pgmap v1403: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:52 smithi062 bash[28859]: cluster 2024-02-13T15:07:52.540004+0000 mgr.y (mgr.14613) 916 : cluster 0 pgmap v1403: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:53.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:52 smithi111 bash[23388]: cluster 2024-02-13T15:07:52.540004+0000 mgr.y (mgr.14613) 916 : cluster 0 pgmap v1403: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:55.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:54 smithi062 bash[21479]: cluster 2024-02-13T15:07:54.540887+0000 mgr.y (mgr.14613) 917 : cluster 0 pgmap v1404: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:55.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:54 smithi062 bash[28859]: cluster 2024-02-13T15:07:54.540887+0000 mgr.y (mgr.14613) 917 : cluster 0 pgmap v1404: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:55.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:54 smithi111 bash[23388]: cluster 2024-02-13T15:07:54.540887+0000 mgr.y (mgr.14613) 917 : cluster 0 pgmap v1404: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:07:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:55 smithi062 bash[28859]: audit 2024-02-13T15:07:55.456401+0000 mon.b (mon.1) 315 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:07:56.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:55 smithi062 bash[21479]: audit 2024-02-13T15:07:55.456401+0000 mon.b (mon.1) 315 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:07:56.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:55 smithi111 bash[23388]: audit 2024-02-13T15:07:55.456401+0000 mon.b (mon.1) 315 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:07:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:07:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:07:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:07:57.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:56 smithi062 bash[21479]: audit 2024-02-13T15:07:56.249310+0000 mon.b (mon.1) 316 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:07:57.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:56 smithi062 bash[21479]: audit 2024-02-13T15:07:56.251152+0000 mon.b (mon.1) 317 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:07:57.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:56 smithi062 bash[21479]: audit 2024-02-13T15:07:56.260669+0000 mon.a (mon.0) 3525 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:07:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:56 smithi062 bash[28859]: audit 2024-02-13T15:07:56.249310+0000 mon.b (mon.1) 316 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:07:57.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:56 smithi062 bash[28859]: audit 2024-02-13T15:07:56.251152+0000 mon.b (mon.1) 317 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:07:57.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:56 smithi062 bash[28859]: audit 2024-02-13T15:07:56.260669+0000 mon.a (mon.0) 3525 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:07:57.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:56 smithi111 bash[23388]: audit 2024-02-13T15:07:56.249310+0000 mon.b (mon.1) 316 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:07:57.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:56 smithi111 bash[23388]: audit 2024-02-13T15:07:56.251152+0000 mon.b (mon.1) 317 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:07:57.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:56 smithi111 bash[23388]: audit 2024-02-13T15:07:56.260669+0000 mon.a (mon.0) 3525 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:07:58.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:07:58 smithi062 bash[28859]: cluster 2024-02-13T15:07:56.543391+0000 mgr.y (mgr.14613) 918 : cluster 0 pgmap v1405: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:58.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:07:58 smithi062 bash[21479]: cluster 2024-02-13T15:07:56.543391+0000 mgr.y (mgr.14613) 918 : cluster 0 pgmap v1405: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:07:58.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:07:58 smithi111 bash[23388]: cluster 2024-02-13T15:07:56.543391+0000 mgr.y (mgr.14613) 918 : cluster 0 pgmap v1405: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:00.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:00 smithi062 bash[21479]: cluster 2024-02-13T15:07:58.544279+0000 mgr.y (mgr.14613) 919 : cluster 0 pgmap v1406: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:00.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:00 smithi062 bash[28859]: cluster 2024-02-13T15:07:58.544279+0000 mgr.y (mgr.14613) 919 : cluster 0 pgmap v1406: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:00.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:00 smithi111 bash[23388]: cluster 2024-02-13T15:07:58.544279+0000 mgr.y (mgr.14613) 919 : cluster 0 pgmap v1406: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:01.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:08:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:08:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:02 smithi062 bash[28859]: cluster 2024-02-13T15:08:00.546815+0000 mgr.y (mgr.14613) 920 : cluster 0 pgmap v1407: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:02.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:02 smithi062 bash[28859]: audit 2024-02-13T15:08:01.198374+0000 mgr.y (mgr.14613) 921 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:02.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:02 smithi062 bash[21479]: cluster 2024-02-13T15:08:00.546815+0000 mgr.y (mgr.14613) 920 : cluster 0 pgmap v1407: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:02.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:02 smithi062 bash[21479]: audit 2024-02-13T15:08:01.198374+0000 mgr.y (mgr.14613) 921 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:02.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:02 smithi111 bash[23388]: cluster 2024-02-13T15:08:00.546815+0000 mgr.y (mgr.14613) 920 : cluster 0 pgmap v1407: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:02.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:02 smithi111 bash[23388]: audit 2024-02-13T15:08:01.198374+0000 mgr.y (mgr.14613) 921 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:04.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:04 smithi062 bash[21479]: cluster 2024-02-13T15:08:02.547632+0000 mgr.y (mgr.14613) 922 : cluster 0 pgmap v1408: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:04.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:04 smithi062 bash[28859]: cluster 2024-02-13T15:08:02.547632+0000 mgr.y (mgr.14613) 922 : cluster 0 pgmap v1408: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:04.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:04 smithi111 bash[23388]: cluster 2024-02-13T15:08:02.547632+0000 mgr.y (mgr.14613) 922 : cluster 0 pgmap v1408: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:08:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:08:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:08:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:06 smithi062 bash[21479]: cluster 2024-02-13T15:08:04.548483+0000 mgr.y (mgr.14613) 923 : cluster 0 pgmap v1409: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:06 smithi062 bash[21479]: audit 2024-02-13T15:08:05.866616+0000 mon.b (mon.1) 318 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:06 smithi062 bash[28859]: cluster 2024-02-13T15:08:04.548483+0000 mgr.y (mgr.14613) 923 : cluster 0 pgmap v1409: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:06 smithi062 bash[28859]: audit 2024-02-13T15:08:05.866616+0000 mon.b (mon.1) 318 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:06.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:06 smithi111 bash[23388]: cluster 2024-02-13T15:08:04.548483+0000 mgr.y (mgr.14613) 923 : cluster 0 pgmap v1409: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:06.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:06 smithi111 bash[23388]: audit 2024-02-13T15:08:05.866616+0000 mon.b (mon.1) 318 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:08.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:08 smithi062 bash[21479]: cluster 2024-02-13T15:08:06.550996+0000 mgr.y (mgr.14613) 924 : cluster 0 pgmap v1410: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:08.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:08 smithi062 bash[28859]: cluster 2024-02-13T15:08:06.550996+0000 mgr.y (mgr.14613) 924 : cluster 0 pgmap v1410: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:08 smithi111 bash[23388]: cluster 2024-02-13T15:08:06.550996+0000 mgr.y (mgr.14613) 924 : cluster 0 pgmap v1410: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:10 smithi062 bash[21479]: cluster 2024-02-13T15:08:08.551862+0000 mgr.y (mgr.14613) 925 : cluster 0 pgmap v1411: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:10.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:10 smithi062 bash[28859]: cluster 2024-02-13T15:08:08.551862+0000 mgr.y (mgr.14613) 925 : cluster 0 pgmap v1411: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:10 smithi111 bash[23388]: cluster 2024-02-13T15:08:08.551862+0000 mgr.y (mgr.14613) 925 : cluster 0 pgmap v1411: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:11.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:08:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:08:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:12 smithi062 bash[28859]: cluster 2024-02-13T15:08:10.554499+0000 mgr.y (mgr.14613) 926 : cluster 0 pgmap v1412: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:12 smithi062 bash[28859]: audit 2024-02-13T15:08:11.200929+0000 mgr.y (mgr.14613) 927 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:12.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:12 smithi062 bash[21479]: cluster 2024-02-13T15:08:10.554499+0000 mgr.y (mgr.14613) 926 : cluster 0 pgmap v1412: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:12.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:12 smithi062 bash[21479]: audit 2024-02-13T15:08:11.200929+0000 mgr.y (mgr.14613) 927 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:12 smithi111 bash[23388]: cluster 2024-02-13T15:08:10.554499+0000 mgr.y (mgr.14613) 926 : cluster 0 pgmap v1412: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:12 smithi111 bash[23388]: audit 2024-02-13T15:08:11.200929+0000 mgr.y (mgr.14613) 927 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:14 smithi062 bash[21479]: cluster 2024-02-13T15:08:12.555365+0000 mgr.y (mgr.14613) 928 : cluster 0 pgmap v1413: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:14.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:14 smithi062 bash[28859]: cluster 2024-02-13T15:08:12.555365+0000 mgr.y (mgr.14613) 928 : cluster 0 pgmap v1413: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:14.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:14 smithi111 bash[23388]: cluster 2024-02-13T15:08:12.555365+0000 mgr.y (mgr.14613) 928 : cluster 0 pgmap v1413: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:08:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:08:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:08:16.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:16 smithi062 bash[28859]: cluster 2024-02-13T15:08:14.556172+0000 mgr.y (mgr.14613) 929 : cluster 0 pgmap v1414: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:16 smithi062 bash[21479]: cluster 2024-02-13T15:08:14.556172+0000 mgr.y (mgr.14613) 929 : cluster 0 pgmap v1414: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:16.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:16 smithi111 bash[23388]: cluster 2024-02-13T15:08:14.556172+0000 mgr.y (mgr.14613) 929 : cluster 0 pgmap v1414: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:18 smithi062 bash[28859]: cluster 2024-02-13T15:08:16.558714+0000 mgr.y (mgr.14613) 930 : cluster 0 pgmap v1415: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:18.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:18 smithi062 bash[21479]: cluster 2024-02-13T15:08:16.558714+0000 mgr.y (mgr.14613) 930 : cluster 0 pgmap v1415: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:18.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:18 smithi111 bash[23388]: cluster 2024-02-13T15:08:16.558714+0000 mgr.y (mgr.14613) 930 : cluster 0 pgmap v1415: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:20.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:20 smithi062 bash[28859]: cluster 2024-02-13T15:08:18.559526+0000 mgr.y (mgr.14613) 931 : cluster 0 pgmap v1416: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:20.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:20 smithi062 bash[21479]: cluster 2024-02-13T15:08:18.559526+0000 mgr.y (mgr.14613) 931 : cluster 0 pgmap v1416: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:20 smithi111 bash[23388]: cluster 2024-02-13T15:08:18.559526+0000 mgr.y (mgr.14613) 931 : cluster 0 pgmap v1416: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:21.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:21 smithi111 bash[23388]: audit 2024-02-13T15:08:20.901831+0000 mon.b (mon.1) 319 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:21.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:08:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:08:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:21 smithi062 bash[28859]: audit 2024-02-13T15:08:20.901831+0000 mon.b (mon.1) 319 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:21 smithi062 bash[21479]: audit 2024-02-13T15:08:20.901831+0000 mon.b (mon.1) 319 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:22 smithi111 bash[23388]: cluster 2024-02-13T15:08:20.562050+0000 mgr.y (mgr.14613) 932 : cluster 0 pgmap v1417: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:22.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:22 smithi111 bash[23388]: audit 2024-02-13T15:08:21.210540+0000 mgr.y (mgr.14613) 933 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:22 smithi062 bash[21479]: cluster 2024-02-13T15:08:20.562050+0000 mgr.y (mgr.14613) 932 : cluster 0 pgmap v1417: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:22.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:22 smithi062 bash[21479]: audit 2024-02-13T15:08:21.210540+0000 mgr.y (mgr.14613) 933 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:22.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:22 smithi062 bash[28859]: cluster 2024-02-13T15:08:20.562050+0000 mgr.y (mgr.14613) 932 : cluster 0 pgmap v1417: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:22.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:22 smithi062 bash[28859]: audit 2024-02-13T15:08:21.210540+0000 mgr.y (mgr.14613) 933 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:24.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:24 smithi111 bash[23388]: cluster 2024-02-13T15:08:22.562982+0000 mgr.y (mgr.14613) 934 : cluster 0 pgmap v1418: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:24 smithi062 bash[21479]: cluster 2024-02-13T15:08:22.562982+0000 mgr.y (mgr.14613) 934 : cluster 0 pgmap v1418: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:24.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:24 smithi062 bash[28859]: cluster 2024-02-13T15:08:22.562982+0000 mgr.y (mgr.14613) 934 : cluster 0 pgmap v1418: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:26.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:26 smithi062 bash[21479]: cluster 2024-02-13T15:08:24.563790+0000 mgr.y (mgr.14613) 935 : cluster 0 pgmap v1419: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:26.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:08:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:08:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:08:26.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:26 smithi062 bash[28859]: cluster 2024-02-13T15:08:24.563790+0000 mgr.y (mgr.14613) 935 : cluster 0 pgmap v1419: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:26.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:26 smithi111 bash[23388]: cluster 2024-02-13T15:08:24.563790+0000 mgr.y (mgr.14613) 935 : cluster 0 pgmap v1419: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:28.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:28 smithi111 bash[23388]: cluster 2024-02-13T15:08:26.566331+0000 mgr.y (mgr.14613) 936 : cluster 0 pgmap v1420: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:28 smithi062 bash[21479]: cluster 2024-02-13T15:08:26.566331+0000 mgr.y (mgr.14613) 936 : cluster 0 pgmap v1420: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:28 smithi062 bash[28859]: cluster 2024-02-13T15:08:26.566331+0000 mgr.y (mgr.14613) 936 : cluster 0 pgmap v1420: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:30.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:30 smithi111 bash[23388]: cluster 2024-02-13T15:08:28.567201+0000 mgr.y (mgr.14613) 937 : cluster 0 pgmap v1421: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:30 smithi062 bash[21479]: cluster 2024-02-13T15:08:28.567201+0000 mgr.y (mgr.14613) 937 : cluster 0 pgmap v1421: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:30 smithi062 bash[28859]: cluster 2024-02-13T15:08:28.567201+0000 mgr.y (mgr.14613) 937 : cluster 0 pgmap v1421: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:31.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:08:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:08:32.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:32 smithi111 bash[23388]: cluster 2024-02-13T15:08:30.569688+0000 mgr.y (mgr.14613) 938 : cluster 0 pgmap v1422: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:32.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:32 smithi111 bash[23388]: audit 2024-02-13T15:08:31.218092+0000 mgr.y (mgr.14613) 939 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:32 smithi062 bash[21479]: cluster 2024-02-13T15:08:30.569688+0000 mgr.y (mgr.14613) 938 : cluster 0 pgmap v1422: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:32 smithi062 bash[21479]: audit 2024-02-13T15:08:31.218092+0000 mgr.y (mgr.14613) 939 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:32 smithi062 bash[28859]: cluster 2024-02-13T15:08:30.569688+0000 mgr.y (mgr.14613) 938 : cluster 0 pgmap v1422: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:32 smithi062 bash[28859]: audit 2024-02-13T15:08:31.218092+0000 mgr.y (mgr.14613) 939 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:34 smithi062 bash[21479]: cluster 2024-02-13T15:08:32.570575+0000 mgr.y (mgr.14613) 940 : cluster 0 pgmap v1423: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:34 smithi062 bash[28859]: cluster 2024-02-13T15:08:32.570575+0000 mgr.y (mgr.14613) 940 : cluster 0 pgmap v1423: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:34 smithi111 bash[23388]: cluster 2024-02-13T15:08:32.570575+0000 mgr.y (mgr.14613) 940 : cluster 0 pgmap v1423: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:08:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:08:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:08:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:36 smithi062 bash[21479]: cluster 2024-02-13T15:08:34.571802+0000 mgr.y (mgr.14613) 941 : cluster 0 pgmap v1424: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:36.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:36 smithi062 bash[21479]: audit 2024-02-13T15:08:35.936766+0000 mon.b (mon.1) 320 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:36.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:36 smithi062 bash[28859]: cluster 2024-02-13T15:08:34.571802+0000 mgr.y (mgr.14613) 941 : cluster 0 pgmap v1424: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:36.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:36 smithi062 bash[28859]: audit 2024-02-13T15:08:35.936766+0000 mon.b (mon.1) 320 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:36.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:36 smithi111 bash[23388]: cluster 2024-02-13T15:08:34.571802+0000 mgr.y (mgr.14613) 941 : cluster 0 pgmap v1424: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:36.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:36 smithi111 bash[23388]: audit 2024-02-13T15:08:35.936766+0000 mon.b (mon.1) 320 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:38 smithi062 bash[21479]: cluster 2024-02-13T15:08:36.574379+0000 mgr.y (mgr.14613) 942 : cluster 0 pgmap v1425: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:38 smithi062 bash[28859]: cluster 2024-02-13T15:08:36.574379+0000 mgr.y (mgr.14613) 942 : cluster 0 pgmap v1425: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:38.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:38 smithi111 bash[23388]: cluster 2024-02-13T15:08:36.574379+0000 mgr.y (mgr.14613) 942 : cluster 0 pgmap v1425: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:40 smithi062 bash[21479]: cluster 2024-02-13T15:08:38.575231+0000 mgr.y (mgr.14613) 943 : cluster 0 pgmap v1426: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:40 smithi062 bash[28859]: cluster 2024-02-13T15:08:38.575231+0000 mgr.y (mgr.14613) 943 : cluster 0 pgmap v1426: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:40 smithi111 bash[23388]: cluster 2024-02-13T15:08:38.575231+0000 mgr.y (mgr.14613) 943 : cluster 0 pgmap v1426: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:41.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:08:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:08:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:42 smithi062 bash[21479]: cluster 2024-02-13T15:08:40.577727+0000 mgr.y (mgr.14613) 944 : cluster 0 pgmap v1427: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:42 smithi062 bash[21479]: audit 2024-02-13T15:08:41.223424+0000 mgr.y (mgr.14613) 945 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:42 smithi062 bash[28859]: cluster 2024-02-13T15:08:40.577727+0000 mgr.y (mgr.14613) 944 : cluster 0 pgmap v1427: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:42 smithi062 bash[28859]: audit 2024-02-13T15:08:41.223424+0000 mgr.y (mgr.14613) 945 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:42 smithi111 bash[23388]: cluster 2024-02-13T15:08:40.577727+0000 mgr.y (mgr.14613) 944 : cluster 0 pgmap v1427: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:42.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:42 smithi111 bash[23388]: audit 2024-02-13T15:08:41.223424+0000 mgr.y (mgr.14613) 945 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:44 smithi062 bash[21479]: cluster 2024-02-13T15:08:42.578739+0000 mgr.y (mgr.14613) 946 : cluster 0 pgmap v1428: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:44 smithi062 bash[28859]: cluster 2024-02-13T15:08:42.578739+0000 mgr.y (mgr.14613) 946 : cluster 0 pgmap v1428: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:44 smithi111 bash[23388]: cluster 2024-02-13T15:08:42.578739+0000 mgr.y (mgr.14613) 946 : cluster 0 pgmap v1428: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:46 smithi062 bash[21479]: cluster 2024-02-13T15:08:44.579778+0000 mgr.y (mgr.14613) 947 : cluster 0 pgmap v1429: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:46.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:08:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:08:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:08:46.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:46 smithi062 bash[28859]: cluster 2024-02-13T15:08:44.579778+0000 mgr.y (mgr.14613) 947 : cluster 0 pgmap v1429: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:46 smithi111 bash[23388]: cluster 2024-02-13T15:08:44.579778+0000 mgr.y (mgr.14613) 947 : cluster 0 pgmap v1429: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:48 smithi062 bash[21479]: cluster 2024-02-13T15:08:46.582329+0000 mgr.y (mgr.14613) 948 : cluster 0 pgmap v1430: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:48 smithi062 bash[28859]: cluster 2024-02-13T15:08:46.582329+0000 mgr.y (mgr.14613) 948 : cluster 0 pgmap v1430: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:48 smithi111 bash[23388]: cluster 2024-02-13T15:08:46.582329+0000 mgr.y (mgr.14613) 948 : cluster 0 pgmap v1430: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:50 smithi062 bash[21479]: cluster 2024-02-13T15:08:48.583127+0000 mgr.y (mgr.14613) 949 : cluster 0 pgmap v1431: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:50 smithi062 bash[28859]: cluster 2024-02-13T15:08:48.583127+0000 mgr.y (mgr.14613) 949 : cluster 0 pgmap v1431: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:50 smithi111 bash[23388]: cluster 2024-02-13T15:08:48.583127+0000 mgr.y (mgr.14613) 949 : cluster 0 pgmap v1431: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:51.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:08:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:08:51.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:51 smithi111 bash[23388]: audit 2024-02-13T15:08:50.971880+0000 mon.b (mon.1) 321 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:51 smithi062 bash[21479]: audit 2024-02-13T15:08:50.971880+0000 mon.b (mon.1) 321 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:51 smithi062 bash[28859]: audit 2024-02-13T15:08:50.971880+0000 mon.b (mon.1) 321 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:08:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:52 smithi062 bash[28859]: cluster 2024-02-13T15:08:50.585651+0000 mgr.y (mgr.14613) 950 : cluster 0 pgmap v1432: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:52 smithi062 bash[28859]: audit 2024-02-13T15:08:51.230824+0000 mgr.y (mgr.14613) 951 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:52 smithi062 bash[21479]: cluster 2024-02-13T15:08:50.585651+0000 mgr.y (mgr.14613) 950 : cluster 0 pgmap v1432: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:52 smithi062 bash[21479]: audit 2024-02-13T15:08:51.230824+0000 mgr.y (mgr.14613) 951 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:52 smithi111 bash[23388]: cluster 2024-02-13T15:08:50.585651+0000 mgr.y (mgr.14613) 950 : cluster 0 pgmap v1432: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:52 smithi111 bash[23388]: audit 2024-02-13T15:08:51.230824+0000 mgr.y (mgr.14613) 951 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:08:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:54 smithi062 bash[21479]: cluster 2024-02-13T15:08:52.586627+0000 mgr.y (mgr.14613) 952 : cluster 0 pgmap v1433: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:54 smithi062 bash[28859]: cluster 2024-02-13T15:08:52.586627+0000 mgr.y (mgr.14613) 952 : cluster 0 pgmap v1433: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:54 smithi111 bash[23388]: cluster 2024-02-13T15:08:52.586627+0000 mgr.y (mgr.14613) 952 : cluster 0 pgmap v1433: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:56 smithi062 bash[21479]: cluster 2024-02-13T15:08:54.587447+0000 mgr.y (mgr.14613) 953 : cluster 0 pgmap v1434: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:56 smithi062 bash[21479]: audit 2024-02-13T15:08:56.354465+0000 mon.b (mon.1) 322 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:08:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:08:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:08:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:08:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:56 smithi062 bash[28859]: cluster 2024-02-13T15:08:54.587447+0000 mgr.y (mgr.14613) 953 : cluster 0 pgmap v1434: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:56.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:56 smithi062 bash[28859]: audit 2024-02-13T15:08:56.354465+0000 mon.b (mon.1) 322 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:08:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:56 smithi111 bash[23388]: cluster 2024-02-13T15:08:54.587447+0000 mgr.y (mgr.14613) 953 : cluster 0 pgmap v1434: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:08:56.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:56 smithi111 bash[23388]: audit 2024-02-13T15:08:56.354465+0000 mon.b (mon.1) 322 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:08:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:57 smithi062 bash[21479]: audit 2024-02-13T15:08:57.135731+0000 mon.b (mon.1) 323 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:08:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:57 smithi062 bash[21479]: audit 2024-02-13T15:08:57.137658+0000 mon.b (mon.1) 324 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:08:57.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:57 smithi062 bash[21479]: audit 2024-02-13T15:08:57.146213+0000 mon.a (mon.0) 3526 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:08:57.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:57 smithi062 bash[28859]: audit 2024-02-13T15:08:57.135731+0000 mon.b (mon.1) 323 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:08:57.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:57 smithi062 bash[28859]: audit 2024-02-13T15:08:57.137658+0000 mon.b (mon.1) 324 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:08:57.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:57 smithi062 bash[28859]: audit 2024-02-13T15:08:57.146213+0000 mon.a (mon.0) 3526 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:08:57.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:57 smithi111 bash[23388]: audit 2024-02-13T15:08:57.135731+0000 mon.b (mon.1) 323 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:08:57.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:57 smithi111 bash[23388]: audit 2024-02-13T15:08:57.137658+0000 mon.b (mon.1) 324 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:08:57.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:57 smithi111 bash[23388]: audit 2024-02-13T15:08:57.146213+0000 mon.a (mon.0) 3526 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:08:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:08:58 smithi062 bash[21479]: cluster 2024-02-13T15:08:56.589846+0000 mgr.y (mgr.14613) 954 : cluster 0 pgmap v1435: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:58.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:08:58 smithi062 bash[28859]: cluster 2024-02-13T15:08:56.589846+0000 mgr.y (mgr.14613) 954 : cluster 0 pgmap v1435: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:08:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:08:58 smithi111 bash[23388]: cluster 2024-02-13T15:08:56.589846+0000 mgr.y (mgr.14613) 954 : cluster 0 pgmap v1435: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:00 smithi062 bash[21479]: cluster 2024-02-13T15:08:58.590731+0000 mgr.y (mgr.14613) 955 : cluster 0 pgmap v1436: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:00 smithi062 bash[28859]: cluster 2024-02-13T15:08:58.590731+0000 mgr.y (mgr.14613) 955 : cluster 0 pgmap v1436: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:00 smithi111 bash[23388]: cluster 2024-02-13T15:08:58.590731+0000 mgr.y (mgr.14613) 955 : cluster 0 pgmap v1436: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:01.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:09:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:09:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:02 smithi062 bash[28859]: cluster 2024-02-13T15:09:00.593289+0000 mgr.y (mgr.14613) 956 : cluster 0 pgmap v1437: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:02 smithi062 bash[28859]: audit 2024-02-13T15:09:01.242190+0000 mgr.y (mgr.14613) 957 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:02 smithi062 bash[21479]: cluster 2024-02-13T15:09:00.593289+0000 mgr.y (mgr.14613) 956 : cluster 0 pgmap v1437: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:02 smithi062 bash[21479]: audit 2024-02-13T15:09:01.242190+0000 mgr.y (mgr.14613) 957 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:02 smithi111 bash[23388]: cluster 2024-02-13T15:09:00.593289+0000 mgr.y (mgr.14613) 956 : cluster 0 pgmap v1437: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:02 smithi111 bash[23388]: audit 2024-02-13T15:09:01.242190+0000 mgr.y (mgr.14613) 957 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:04.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:04 smithi062 bash[21479]: cluster 2024-02-13T15:09:02.594198+0000 mgr.y (mgr.14613) 958 : cluster 0 pgmap v1438: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:04.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:04 smithi062 bash[28859]: cluster 2024-02-13T15:09:02.594198+0000 mgr.y (mgr.14613) 958 : cluster 0 pgmap v1438: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:04 smithi111 bash[23388]: cluster 2024-02-13T15:09:02.594198+0000 mgr.y (mgr.14613) 958 : cluster 0 pgmap v1438: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:09:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:09:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:09:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:06 smithi062 bash[28859]: cluster 2024-02-13T15:09:04.595081+0000 mgr.y (mgr.14613) 959 : cluster 0 pgmap v1439: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:06 smithi062 bash[28859]: audit 2024-02-13T15:09:06.007100+0000 mon.b (mon.1) 325 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:06 smithi062 bash[21479]: cluster 2024-02-13T15:09:04.595081+0000 mgr.y (mgr.14613) 959 : cluster 0 pgmap v1439: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:06 smithi062 bash[21479]: audit 2024-02-13T15:09:06.007100+0000 mon.b (mon.1) 325 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:06 smithi111 bash[23388]: cluster 2024-02-13T15:09:04.595081+0000 mgr.y (mgr.14613) 959 : cluster 0 pgmap v1439: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:06.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:06 smithi111 bash[23388]: audit 2024-02-13T15:09:06.007100+0000 mon.b (mon.1) 325 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:08.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:08 smithi062 bash[28859]: cluster 2024-02-13T15:09:06.597691+0000 mgr.y (mgr.14613) 960 : cluster 0 pgmap v1440: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:08.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:08 smithi062 bash[21479]: cluster 2024-02-13T15:09:06.597691+0000 mgr.y (mgr.14613) 960 : cluster 0 pgmap v1440: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:08 smithi111 bash[23388]: cluster 2024-02-13T15:09:06.597691+0000 mgr.y (mgr.14613) 960 : cluster 0 pgmap v1440: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:10 smithi062 bash[28859]: cluster 2024-02-13T15:09:08.598754+0000 mgr.y (mgr.14613) 961 : cluster 0 pgmap v1441: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:10 smithi062 bash[21479]: cluster 2024-02-13T15:09:08.598754+0000 mgr.y (mgr.14613) 961 : cluster 0 pgmap v1441: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:10 smithi111 bash[23388]: cluster 2024-02-13T15:09:08.598754+0000 mgr.y (mgr.14613) 961 : cluster 0 pgmap v1441: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:11.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:09:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:09:12.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:12 smithi062 bash[28859]: cluster 2024-02-13T15:09:10.601297+0000 mgr.y (mgr.14613) 962 : cluster 0 pgmap v1442: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:12 smithi062 bash[28859]: audit 2024-02-13T15:09:11.244546+0000 mgr.y (mgr.14613) 963 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:12 smithi062 bash[21479]: cluster 2024-02-13T15:09:10.601297+0000 mgr.y (mgr.14613) 962 : cluster 0 pgmap v1442: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:12 smithi062 bash[21479]: audit 2024-02-13T15:09:11.244546+0000 mgr.y (mgr.14613) 963 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:12 smithi111 bash[23388]: cluster 2024-02-13T15:09:10.601297+0000 mgr.y (mgr.14613) 962 : cluster 0 pgmap v1442: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:12.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:12 smithi111 bash[23388]: audit 2024-02-13T15:09:11.244546+0000 mgr.y (mgr.14613) 963 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:14.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:14 smithi062 bash[21479]: cluster 2024-02-13T15:09:12.602166+0000 mgr.y (mgr.14613) 964 : cluster 0 pgmap v1443: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:14.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:14 smithi062 bash[28859]: cluster 2024-02-13T15:09:12.602166+0000 mgr.y (mgr.14613) 964 : cluster 0 pgmap v1443: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:14 smithi111 bash[23388]: cluster 2024-02-13T15:09:12.602166+0000 mgr.y (mgr.14613) 964 : cluster 0 pgmap v1443: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:16 smithi062 bash[21479]: cluster 2024-02-13T15:09:14.603166+0000 mgr.y (mgr.14613) 965 : cluster 0 pgmap v1444: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:16.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:09:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:09:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:09:16.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:16 smithi062 bash[28859]: cluster 2024-02-13T15:09:14.603166+0000 mgr.y (mgr.14613) 965 : cluster 0 pgmap v1444: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:16 smithi111 bash[23388]: cluster 2024-02-13T15:09:14.603166+0000 mgr.y (mgr.14613) 965 : cluster 0 pgmap v1444: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:18 smithi062 bash[21479]: cluster 2024-02-13T15:09:16.605747+0000 mgr.y (mgr.14613) 966 : cluster 0 pgmap v1445: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:18.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:18 smithi062 bash[28859]: cluster 2024-02-13T15:09:16.605747+0000 mgr.y (mgr.14613) 966 : cluster 0 pgmap v1445: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:18 smithi111 bash[23388]: cluster 2024-02-13T15:09:16.605747+0000 mgr.y (mgr.14613) 966 : cluster 0 pgmap v1445: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:20 smithi062 bash[21479]: cluster 2024-02-13T15:09:18.606656+0000 mgr.y (mgr.14613) 967 : cluster 0 pgmap v1446: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:20.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:20 smithi062 bash[28859]: cluster 2024-02-13T15:09:18.606656+0000 mgr.y (mgr.14613) 967 : cluster 0 pgmap v1446: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:20 smithi111 bash[23388]: cluster 2024-02-13T15:09:18.606656+0000 mgr.y (mgr.14613) 967 : cluster 0 pgmap v1446: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:21.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:21 smithi111 bash[23388]: audit 2024-02-13T15:09:21.043201+0000 mon.b (mon.1) 326 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:21.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:09:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:09:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:21 smithi062 bash[21479]: audit 2024-02-13T15:09:21.043201+0000 mon.b (mon.1) 326 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:21 smithi062 bash[28859]: audit 2024-02-13T15:09:21.043201+0000 mon.b (mon.1) 326 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:22 smithi062 bash[28859]: cluster 2024-02-13T15:09:20.609161+0000 mgr.y (mgr.14613) 968 : cluster 0 pgmap v1447: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:22 smithi062 bash[28859]: audit 2024-02-13T15:09:21.250251+0000 mgr.y (mgr.14613) 969 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:22.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:22 smithi062 bash[21479]: cluster 2024-02-13T15:09:20.609161+0000 mgr.y (mgr.14613) 968 : cluster 0 pgmap v1447: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:22.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:22 smithi062 bash[21479]: audit 2024-02-13T15:09:21.250251+0000 mgr.y (mgr.14613) 969 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:22 smithi111 bash[23388]: cluster 2024-02-13T15:09:20.609161+0000 mgr.y (mgr.14613) 968 : cluster 0 pgmap v1447: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:22 smithi111 bash[23388]: audit 2024-02-13T15:09:21.250251+0000 mgr.y (mgr.14613) 969 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:24 smithi062 bash[28859]: cluster 2024-02-13T15:09:22.610030+0000 mgr.y (mgr.14613) 970 : cluster 0 pgmap v1448: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:24.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:24 smithi062 bash[21479]: cluster 2024-02-13T15:09:22.610030+0000 mgr.y (mgr.14613) 970 : cluster 0 pgmap v1448: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:24 smithi111 bash[23388]: cluster 2024-02-13T15:09:22.610030+0000 mgr.y (mgr.14613) 970 : cluster 0 pgmap v1448: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:26.488 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:09:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:09:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:09:26.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:26 smithi062 bash[21479]: cluster 2024-02-13T15:09:24.610957+0000 mgr.y (mgr.14613) 971 : cluster 0 pgmap v1449: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:26.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:26 smithi062 bash[28859]: cluster 2024-02-13T15:09:24.610957+0000 mgr.y (mgr.14613) 971 : cluster 0 pgmap v1449: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:26.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:26 smithi111 bash[23388]: cluster 2024-02-13T15:09:24.610957+0000 mgr.y (mgr.14613) 971 : cluster 0 pgmap v1449: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:28 smithi062 bash[28859]: cluster 2024-02-13T15:09:26.613464+0000 mgr.y (mgr.14613) 972 : cluster 0 pgmap v1450: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:28 smithi062 bash[21479]: cluster 2024-02-13T15:09:26.613464+0000 mgr.y (mgr.14613) 972 : cluster 0 pgmap v1450: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:28 smithi111 bash[23388]: cluster 2024-02-13T15:09:26.613464+0000 mgr.y (mgr.14613) 972 : cluster 0 pgmap v1450: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:30 smithi062 bash[28859]: cluster 2024-02-13T15:09:28.614315+0000 mgr.y (mgr.14613) 973 : cluster 0 pgmap v1451: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:30 smithi062 bash[21479]: cluster 2024-02-13T15:09:28.614315+0000 mgr.y (mgr.14613) 973 : cluster 0 pgmap v1451: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:30 smithi111 bash[23388]: cluster 2024-02-13T15:09:28.614315+0000 mgr.y (mgr.14613) 973 : cluster 0 pgmap v1451: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:31.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:09:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:09:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:32 smithi062 bash[28859]: cluster 2024-02-13T15:09:30.617245+0000 mgr.y (mgr.14613) 974 : cluster 0 pgmap v1452: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:32 smithi062 bash[28859]: audit 2024-02-13T15:09:31.261699+0000 mgr.y (mgr.14613) 975 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:32 smithi062 bash[21479]: cluster 2024-02-13T15:09:30.617245+0000 mgr.y (mgr.14613) 974 : cluster 0 pgmap v1452: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:32 smithi062 bash[21479]: audit 2024-02-13T15:09:31.261699+0000 mgr.y (mgr.14613) 975 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:32 smithi111 bash[23388]: cluster 2024-02-13T15:09:30.617245+0000 mgr.y (mgr.14613) 974 : cluster 0 pgmap v1452: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:32 smithi111 bash[23388]: audit 2024-02-13T15:09:31.261699+0000 mgr.y (mgr.14613) 975 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:34 smithi062 bash[21479]: cluster 2024-02-13T15:09:32.618268+0000 mgr.y (mgr.14613) 976 : cluster 0 pgmap v1453: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:34 smithi062 bash[28859]: cluster 2024-02-13T15:09:32.618268+0000 mgr.y (mgr.14613) 976 : cluster 0 pgmap v1453: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:34 smithi111 bash[23388]: cluster 2024-02-13T15:09:32.618268+0000 mgr.y (mgr.14613) 976 : cluster 0 pgmap v1453: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:36.510 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:09:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:09:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:09:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:36 smithi062 bash[21479]: cluster 2024-02-13T15:09:34.619267+0000 mgr.y (mgr.14613) 977 : cluster 0 pgmap v1454: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:36.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:36 smithi062 bash[21479]: audit 2024-02-13T15:09:36.079157+0000 mon.b (mon.1) 327 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:36.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:36 smithi062 bash[28859]: cluster 2024-02-13T15:09:34.619267+0000 mgr.y (mgr.14613) 977 : cluster 0 pgmap v1454: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:36.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:36 smithi062 bash[28859]: audit 2024-02-13T15:09:36.079157+0000 mon.b (mon.1) 327 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:36 smithi111 bash[23388]: cluster 2024-02-13T15:09:34.619267+0000 mgr.y (mgr.14613) 977 : cluster 0 pgmap v1454: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:36 smithi111 bash[23388]: audit 2024-02-13T15:09:36.079157+0000 mon.b (mon.1) 327 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:38 smithi062 bash[21479]: cluster 2024-02-13T15:09:36.621826+0000 mgr.y (mgr.14613) 978 : cluster 0 pgmap v1455: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:38.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:38 smithi062 bash[28859]: cluster 2024-02-13T15:09:36.621826+0000 mgr.y (mgr.14613) 978 : cluster 0 pgmap v1455: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:38 smithi111 bash[23388]: cluster 2024-02-13T15:09:36.621826+0000 mgr.y (mgr.14613) 978 : cluster 0 pgmap v1455: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:40 smithi062 bash[21479]: cluster 2024-02-13T15:09:38.622727+0000 mgr.y (mgr.14613) 979 : cluster 0 pgmap v1456: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:40.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:40 smithi062 bash[28859]: cluster 2024-02-13T15:09:38.622727+0000 mgr.y (mgr.14613) 979 : cluster 0 pgmap v1456: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:40 smithi111 bash[23388]: cluster 2024-02-13T15:09:38.622727+0000 mgr.y (mgr.14613) 979 : cluster 0 pgmap v1456: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:41.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:09:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:09:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:42 smithi062 bash[21479]: cluster 2024-02-13T15:09:40.625186+0000 mgr.y (mgr.14613) 980 : cluster 0 pgmap v1457: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:42 smithi062 bash[21479]: audit 2024-02-13T15:09:41.273159+0000 mgr.y (mgr.14613) 981 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:42.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:42 smithi062 bash[28859]: cluster 2024-02-13T15:09:40.625186+0000 mgr.y (mgr.14613) 980 : cluster 0 pgmap v1457: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:42.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:42 smithi062 bash[28859]: audit 2024-02-13T15:09:41.273159+0000 mgr.y (mgr.14613) 981 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:42 smithi111 bash[23388]: cluster 2024-02-13T15:09:40.625186+0000 mgr.y (mgr.14613) 980 : cluster 0 pgmap v1457: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:42 smithi111 bash[23388]: audit 2024-02-13T15:09:41.273159+0000 mgr.y (mgr.14613) 981 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:44 smithi062 bash[28859]: cluster 2024-02-13T15:09:42.626064+0000 mgr.y (mgr.14613) 982 : cluster 0 pgmap v1458: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:44.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:44 smithi062 bash[21479]: cluster 2024-02-13T15:09:42.626064+0000 mgr.y (mgr.14613) 982 : cluster 0 pgmap v1458: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:44 smithi111 bash[23388]: cluster 2024-02-13T15:09:42.626064+0000 mgr.y (mgr.14613) 982 : cluster 0 pgmap v1458: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:46.530 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:09:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:09:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:09:46.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:46 smithi062 bash[21479]: cluster 2024-02-13T15:09:44.627331+0000 mgr.y (mgr.14613) 983 : cluster 0 pgmap v1459: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:46.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:46 smithi062 bash[28859]: cluster 2024-02-13T15:09:44.627331+0000 mgr.y (mgr.14613) 983 : cluster 0 pgmap v1459: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:46 smithi111 bash[23388]: cluster 2024-02-13T15:09:44.627331+0000 mgr.y (mgr.14613) 983 : cluster 0 pgmap v1459: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:48 smithi062 bash[21479]: cluster 2024-02-13T15:09:46.629860+0000 mgr.y (mgr.14613) 984 : cluster 0 pgmap v1460: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:48.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:48 smithi062 bash[28859]: cluster 2024-02-13T15:09:46.629860+0000 mgr.y (mgr.14613) 984 : cluster 0 pgmap v1460: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:48 smithi111 bash[23388]: cluster 2024-02-13T15:09:46.629860+0000 mgr.y (mgr.14613) 984 : cluster 0 pgmap v1460: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:50 smithi062 bash[21479]: cluster 2024-02-13T15:09:48.630736+0000 mgr.y (mgr.14613) 985 : cluster 0 pgmap v1461: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:50.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:50 smithi062 bash[28859]: cluster 2024-02-13T15:09:48.630736+0000 mgr.y (mgr.14613) 985 : cluster 0 pgmap v1461: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:50 smithi111 bash[23388]: cluster 2024-02-13T15:09:48.630736+0000 mgr.y (mgr.14613) 985 : cluster 0 pgmap v1461: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:51.548 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:09:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:09:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:51 smithi062 bash[21479]: audit 2024-02-13T15:09:51.113291+0000 mon.b (mon.1) 328 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:51 smithi062 bash[28859]: audit 2024-02-13T15:09:51.113291+0000 mon.b (mon.1) 328 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:51 smithi111 bash[23388]: audit 2024-02-13T15:09:51.113291+0000 mon.b (mon.1) 328 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:09:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:52 smithi062 bash[21479]: cluster 2024-02-13T15:09:50.633216+0000 mgr.y (mgr.14613) 986 : cluster 0 pgmap v1462: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:52 smithi062 bash[21479]: audit 2024-02-13T15:09:51.284420+0000 mgr.y (mgr.14613) 987 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:52 smithi062 bash[28859]: cluster 2024-02-13T15:09:50.633216+0000 mgr.y (mgr.14613) 986 : cluster 0 pgmap v1462: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:52 smithi062 bash[28859]: audit 2024-02-13T15:09:51.284420+0000 mgr.y (mgr.14613) 987 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:52 smithi111 bash[23388]: cluster 2024-02-13T15:09:50.633216+0000 mgr.y (mgr.14613) 986 : cluster 0 pgmap v1462: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:52.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:52 smithi111 bash[23388]: audit 2024-02-13T15:09:51.284420+0000 mgr.y (mgr.14613) 987 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:09:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:54 smithi062 bash[28859]: cluster 2024-02-13T15:09:52.634094+0000 mgr.y (mgr.14613) 988 : cluster 0 pgmap v1463: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:54.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:54 smithi062 bash[21479]: cluster 2024-02-13T15:09:52.634094+0000 mgr.y (mgr.14613) 988 : cluster 0 pgmap v1463: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:54 smithi111 bash[23388]: cluster 2024-02-13T15:09:52.634094+0000 mgr.y (mgr.14613) 988 : cluster 0 pgmap v1463: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:56.557 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:09:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:09:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:09:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:56 smithi062 bash[21479]: cluster 2024-02-13T15:09:54.635019+0000 mgr.y (mgr.14613) 989 : cluster 0 pgmap v1464: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:56 smithi062 bash[28859]: cluster 2024-02-13T15:09:54.635019+0000 mgr.y (mgr.14613) 989 : cluster 0 pgmap v1464: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:56.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:56 smithi111 bash[23388]: cluster 2024-02-13T15:09:54.635019+0000 mgr.y (mgr.14613) 989 : cluster 0 pgmap v1464: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:09:57.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:57 smithi111 bash[23388]: audit 2024-02-13T15:09:57.230684+0000 mon.b (mon.1) 329 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:09:58.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:57 smithi062 bash[28859]: audit 2024-02-13T15:09:57.230684+0000 mon.b (mon.1) 329 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:09:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:57 smithi062 bash[21479]: audit 2024-02-13T15:09:57.230684+0000 mon.b (mon.1) 329 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:09:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:58 smithi111 bash[23388]: cluster 2024-02-13T15:09:56.637545+0000 mgr.y (mgr.14613) 990 : cluster 0 pgmap v1465: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:58 smithi062 bash[21479]: cluster 2024-02-13T15:09:56.637545+0000 mgr.y (mgr.14613) 990 : cluster 0 pgmap v1465: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:58 smithi062 bash[28859]: cluster 2024-02-13T15:09:56.637545+0000 mgr.y (mgr.14613) 990 : cluster 0 pgmap v1465: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:09:59.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:09:59 smithi111 bash[23388]: cluster 2024-02-13T15:09:58.638357+0000 mgr.y (mgr.14613) 991 : cluster 0 pgmap v1466: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:00.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:09:59 smithi062 bash[21479]: cluster 2024-02-13T15:09:58.638357+0000 mgr.y (mgr.14613) 991 : cluster 0 pgmap v1466: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:00.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:09:59 smithi062 bash[28859]: cluster 2024-02-13T15:09:58.638357+0000 mgr.y (mgr.14613) 991 : cluster 0 pgmap v1466: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:00 smithi111 bash[23388]: cluster 2024-02-13T15:10:00.000146+0000 mon.a (mon.0) 3527 : cluster 3 Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-13T15:10:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:00 smithi111 bash[23388]: cluster 2024-02-13T15:10:00.000190+0000 mon.a (mon.0) 3528 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-02-13T15:10:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:00 smithi111 bash[23388]: cluster 2024-02-13T15:10:00.000207+0000 mon.a (mon.0) 3529 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:10:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:00 smithi111 bash[23388]: cluster 2024-02-13T15:10:00.000224+0000 mon.a (mon.0) 3530 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T15:10:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:00 smithi111 bash[23388]: cluster 2024-02-13T15:10:00.000240+0000 mon.a (mon.0) 3531 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T15:10:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:00 smithi111 bash[23388]: cluster 2024-02-13T15:10:00.000275+0000 mon.a (mon.0) 3532 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T15:10:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:00 smithi111 bash[23388]: cluster 2024-02-13T15:10:00.000313+0000 mon.a (mon.0) 3533 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:10:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[28859]: cluster 2024-02-13T15:10:00.000146+0000 mon.a (mon.0) 3527 : cluster 3 Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-13T15:10:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[28859]: cluster 2024-02-13T15:10:00.000190+0000 mon.a (mon.0) 3528 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-02-13T15:10:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[28859]: cluster 2024-02-13T15:10:00.000207+0000 mon.a (mon.0) 3529 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[28859]: cluster 2024-02-13T15:10:00.000224+0000 mon.a (mon.0) 3530 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[28859]: cluster 2024-02-13T15:10:00.000240+0000 mon.a (mon.0) 3531 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[28859]: cluster 2024-02-13T15:10:00.000275+0000 mon.a (mon.0) 3532 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[28859]: cluster 2024-02-13T15:10:00.000313+0000 mon.a (mon.0) 3533 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[21479]: cluster 2024-02-13T15:10:00.000146+0000 mon.a (mon.0) 3527 : cluster 3 Health detail: HEALTH_WARN 4 pool(s) do not have an application enabled 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[21479]: cluster 2024-02-13T15:10:00.000190+0000 mon.a (mon.0) 3528 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 4 pool(s) do not have an application enabled 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[21479]: cluster 2024-02-13T15:10:00.000207+0000 mon.a (mon.0) 3529 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[21479]: cluster 2024-02-13T15:10:00.000224+0000 mon.a (mon.0) 3530 : cluster 3 application not enabled on pool 'SetOpFlagssmithi062-65429-1' 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[21479]: cluster 2024-02-13T15:10:00.000240+0000 mon.a (mon.0) 3531 : cluster 3 application not enabled on pool 'WatchNotifysmithi062-65456-1' 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[21479]: cluster 2024-02-13T15:10:00.000275+0000 mon.a (mon.0) 3532 : cluster 3 application not enabled on pool 'AssertExistssmithi062-65494-1' 2024-02-13T15:10:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:00 smithi062 bash[21479]: cluster 2024-02-13T15:10:00.000313+0000 mon.a (mon.0) 3533 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:10:01.587 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:10:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:10:01.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:01 smithi111 bash[23388]: cluster 2024-02-13T15:10:00.640791+0000 mgr.y (mgr.14613) 992 : cluster 0 pgmap v1467: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:01.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:01 smithi111 bash[23388]: audit 2024-02-13T15:10:01.295759+0000 mgr.y (mgr.14613) 993 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:02.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:01 smithi062 bash[21479]: cluster 2024-02-13T15:10:00.640791+0000 mgr.y (mgr.14613) 992 : cluster 0 pgmap v1467: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:02.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:01 smithi062 bash[21479]: audit 2024-02-13T15:10:01.295759+0000 mgr.y (mgr.14613) 993 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:02.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:01 smithi062 bash[28859]: cluster 2024-02-13T15:10:00.640791+0000 mgr.y (mgr.14613) 992 : cluster 0 pgmap v1467: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:02.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:01 smithi062 bash[28859]: audit 2024-02-13T15:10:01.295759+0000 mgr.y (mgr.14613) 993 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:04.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:03 smithi062 bash[28859]: cluster 2024-02-13T15:10:02.641715+0000 mgr.y (mgr.14613) 994 : cluster 0 pgmap v1468: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:04.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:03 smithi062 bash[21479]: cluster 2024-02-13T15:10:02.641715+0000 mgr.y (mgr.14613) 994 : cluster 0 pgmap v1468: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:04.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:03 smithi111 bash[23388]: cluster 2024-02-13T15:10:02.641715+0000 mgr.y (mgr.14613) 994 : cluster 0 pgmap v1468: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:05.978 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:05 smithi062 bash[28859]: cluster 2024-02-13T15:10:04.642580+0000 mgr.y (mgr.14613) 995 : cluster 0 pgmap v1469: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:05.979 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:05 smithi062 bash[21479]: cluster 2024-02-13T15:10:04.642580+0000 mgr.y (mgr.14613) 995 : cluster 0 pgmap v1469: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:06.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:05 smithi111 bash[23388]: cluster 2024-02-13T15:10:04.642580+0000 mgr.y (mgr.14613) 995 : cluster 0 pgmap v1469: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:06.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:10:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:10:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:10:07.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:06 smithi062 bash[21479]: audit 2024-02-13T15:10:06.147577+0000 mon.b (mon.1) 330 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:07.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:06 smithi062 bash[28859]: audit 2024-02-13T15:10:06.147577+0000 mon.b (mon.1) 330 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:07.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:06 smithi111 bash[23388]: audit 2024-02-13T15:10:06.147577+0000 mon.b (mon.1) 330 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:08.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:07 smithi062 bash[21479]: cluster 2024-02-13T15:10:06.644969+0000 mgr.y (mgr.14613) 996 : cluster 0 pgmap v1470: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:08.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:07 smithi062 bash[28859]: cluster 2024-02-13T15:10:06.644969+0000 mgr.y (mgr.14613) 996 : cluster 0 pgmap v1470: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:08.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:07 smithi111 bash[23388]: cluster 2024-02-13T15:10:06.644969+0000 mgr.y (mgr.14613) 996 : cluster 0 pgmap v1470: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[21479]: audit 2024-02-13T15:10:08.213172+0000 mon.a (mon.0) 3534 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:09.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[21479]: audit 2024-02-13T15:10:08.231483+0000 mon.a (mon.0) 3535 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:09.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[21479]: audit 2024-02-13T15:10:08.236689+0000 mon.b (mon.1) 331 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:10:09.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[21479]: audit 2024-02-13T15:10:08.238928+0000 mon.b (mon.1) 332 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:10:09.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[21479]: audit 2024-02-13T15:10:08.250066+0000 mon.a (mon.0) 3536 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:09.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[28859]: audit 2024-02-13T15:10:08.213172+0000 mon.a (mon.0) 3534 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:09.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[28859]: audit 2024-02-13T15:10:08.231483+0000 mon.a (mon.0) 3535 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:09.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[28859]: audit 2024-02-13T15:10:08.236689+0000 mon.b (mon.1) 331 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:10:09.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[28859]: audit 2024-02-13T15:10:08.238928+0000 mon.b (mon.1) 332 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:10:09.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:09 smithi062 bash[28859]: audit 2024-02-13T15:10:08.250066+0000 mon.a (mon.0) 3536 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:09 smithi111 bash[23388]: audit 2024-02-13T15:10:08.213172+0000 mon.a (mon.0) 3534 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:09 smithi111 bash[23388]: audit 2024-02-13T15:10:08.231483+0000 mon.a (mon.0) 3535 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:09.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:09 smithi111 bash[23388]: audit 2024-02-13T15:10:08.236689+0000 mon.b (mon.1) 331 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:10:09.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:09 smithi111 bash[23388]: audit 2024-02-13T15:10:08.238928+0000 mon.b (mon.1) 332 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:10:09.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:09 smithi111 bash[23388]: audit 2024-02-13T15:10:08.250066+0000 mon.a (mon.0) 3536 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:10:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:10 smithi062 bash[21479]: cluster 2024-02-13T15:10:08.645835+0000 mgr.y (mgr.14613) 997 : cluster 0 pgmap v1471: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:10.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:10 smithi062 bash[28859]: cluster 2024-02-13T15:10:08.645835+0000 mgr.y (mgr.14613) 997 : cluster 0 pgmap v1471: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:10 smithi111 bash[23388]: cluster 2024-02-13T15:10:08.645835+0000 mgr.y (mgr.14613) 997 : cluster 0 pgmap v1471: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:11.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:10:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:10:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:12 smithi062 bash[21479]: cluster 2024-02-13T15:10:10.648354+0000 mgr.y (mgr.14613) 998 : cluster 0 pgmap v1472: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:12.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:12 smithi062 bash[21479]: audit 2024-02-13T15:10:11.307086+0000 mgr.y (mgr.14613) 999 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:12.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:12 smithi062 bash[28859]: cluster 2024-02-13T15:10:10.648354+0000 mgr.y (mgr.14613) 998 : cluster 0 pgmap v1472: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:12.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:12 smithi062 bash[28859]: audit 2024-02-13T15:10:11.307086+0000 mgr.y (mgr.14613) 999 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:12 smithi111 bash[23388]: cluster 2024-02-13T15:10:10.648354+0000 mgr.y (mgr.14613) 998 : cluster 0 pgmap v1472: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:12.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:12 smithi111 bash[23388]: audit 2024-02-13T15:10:11.307086+0000 mgr.y (mgr.14613) 999 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:14 smithi062 bash[21479]: cluster 2024-02-13T15:10:12.649208+0000 mgr.y (mgr.14613) 1000 : cluster 0 pgmap v1473: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:14.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:14 smithi062 bash[28859]: cluster 2024-02-13T15:10:12.649208+0000 mgr.y (mgr.14613) 1000 : cluster 0 pgmap v1473: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:14.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:14 smithi111 bash[23388]: cluster 2024-02-13T15:10:12.649208+0000 mgr.y (mgr.14613) 1000 : cluster 0 pgmap v1473: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:16 smithi062 bash[21479]: cluster 2024-02-13T15:10:14.650050+0000 mgr.y (mgr.14613) 1001 : cluster 0 pgmap v1474: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:16.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:16 smithi062 bash[28859]: cluster 2024-02-13T15:10:14.650050+0000 mgr.y (mgr.14613) 1001 : cluster 0 pgmap v1474: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:16.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:10:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:10:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:10:16.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:16 smithi111 bash[23388]: cluster 2024-02-13T15:10:14.650050+0000 mgr.y (mgr.14613) 1001 : cluster 0 pgmap v1474: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:18.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:18 smithi062 bash[21479]: cluster 2024-02-13T15:10:16.652528+0000 mgr.y (mgr.14613) 1002 : cluster 0 pgmap v1475: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:18.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:18 smithi062 bash[28859]: cluster 2024-02-13T15:10:16.652528+0000 mgr.y (mgr.14613) 1002 : cluster 0 pgmap v1475: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:18.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:18 smithi111 bash[23388]: cluster 2024-02-13T15:10:16.652528+0000 mgr.y (mgr.14613) 1002 : cluster 0 pgmap v1475: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:20.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:20 smithi062 bash[21479]: cluster 2024-02-13T15:10:18.653370+0000 mgr.y (mgr.14613) 1003 : cluster 0 pgmap v1476: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:20.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:20 smithi062 bash[28859]: cluster 2024-02-13T15:10:18.653370+0000 mgr.y (mgr.14613) 1003 : cluster 0 pgmap v1476: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:20 smithi111 bash[23388]: cluster 2024-02-13T15:10:18.653370+0000 mgr.y (mgr.14613) 1003 : cluster 0 pgmap v1476: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:21.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:21 smithi062 bash[28859]: audit 2024-02-13T15:10:21.183063+0000 mon.b (mon.1) 333 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:21.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:21 smithi062 bash[21479]: audit 2024-02-13T15:10:21.183063+0000 mon.b (mon.1) 333 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:21.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:21 smithi111 bash[23388]: audit 2024-02-13T15:10:21.183063+0000 mon.b (mon.1) 333 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:21.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:10:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:10:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:22 smithi062 bash[28859]: cluster 2024-02-13T15:10:20.655869+0000 mgr.y (mgr.14613) 1004 : cluster 0 pgmap v1477: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:22 smithi062 bash[28859]: audit 2024-02-13T15:10:21.318490+0000 mgr.y (mgr.14613) 1005 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:22 smithi062 bash[21479]: cluster 2024-02-13T15:10:20.655869+0000 mgr.y (mgr.14613) 1004 : cluster 0 pgmap v1477: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:22.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:22 smithi062 bash[21479]: audit 2024-02-13T15:10:21.318490+0000 mgr.y (mgr.14613) 1005 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:22 smithi111 bash[23388]: cluster 2024-02-13T15:10:20.655869+0000 mgr.y (mgr.14613) 1004 : cluster 0 pgmap v1477: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:22 smithi111 bash[23388]: audit 2024-02-13T15:10:21.318490+0000 mgr.y (mgr.14613) 1005 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:24.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:24 smithi062 bash[28859]: cluster 2024-02-13T15:10:22.656716+0000 mgr.y (mgr.14613) 1006 : cluster 0 pgmap v1478: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:24.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:24 smithi062 bash[21479]: cluster 2024-02-13T15:10:22.656716+0000 mgr.y (mgr.14613) 1006 : cluster 0 pgmap v1478: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:24.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:24 smithi111 bash[23388]: cluster 2024-02-13T15:10:22.656716+0000 mgr.y (mgr.14613) 1006 : cluster 0 pgmap v1478: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:26 smithi062 bash[28859]: cluster 2024-02-13T15:10:24.657606+0000 mgr.y (mgr.14613) 1007 : cluster 0 pgmap v1479: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:26.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:26 smithi062 bash[21479]: cluster 2024-02-13T15:10:24.657606+0000 mgr.y (mgr.14613) 1007 : cluster 0 pgmap v1479: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:26.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:10:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:10:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:10:26.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:26 smithi111 bash[23388]: cluster 2024-02-13T15:10:24.657606+0000 mgr.y (mgr.14613) 1007 : cluster 0 pgmap v1479: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:28.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:28 smithi062 bash[28859]: cluster 2024-02-13T15:10:26.660212+0000 mgr.y (mgr.14613) 1008 : cluster 0 pgmap v1480: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:28 smithi062 bash[21479]: cluster 2024-02-13T15:10:26.660212+0000 mgr.y (mgr.14613) 1008 : cluster 0 pgmap v1480: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:28.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:28 smithi111 bash[23388]: cluster 2024-02-13T15:10:26.660212+0000 mgr.y (mgr.14613) 1008 : cluster 0 pgmap v1480: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:30.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:30 smithi062 bash[21479]: cluster 2024-02-13T15:10:28.661094+0000 mgr.y (mgr.14613) 1009 : cluster 0 pgmap v1481: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:30.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:30 smithi062 bash[28859]: cluster 2024-02-13T15:10:28.661094+0000 mgr.y (mgr.14613) 1009 : cluster 0 pgmap v1481: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:30.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:30 smithi111 bash[23388]: cluster 2024-02-13T15:10:28.661094+0000 mgr.y (mgr.14613) 1009 : cluster 0 pgmap v1481: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:31.595 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:10:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:10:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:32 smithi062 bash[28859]: cluster 2024-02-13T15:10:30.663611+0000 mgr.y (mgr.14613) 1010 : cluster 0 pgmap v1482: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:32.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:32 smithi062 bash[28859]: audit 2024-02-13T15:10:31.329859+0000 mgr.y (mgr.14613) 1011 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:32.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:32 smithi062 bash[21479]: cluster 2024-02-13T15:10:30.663611+0000 mgr.y (mgr.14613) 1010 : cluster 0 pgmap v1482: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:32.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:32 smithi062 bash[21479]: audit 2024-02-13T15:10:31.329859+0000 mgr.y (mgr.14613) 1011 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:32 smithi111 bash[23388]: cluster 2024-02-13T15:10:30.663611+0000 mgr.y (mgr.14613) 1010 : cluster 0 pgmap v1482: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:32 smithi111 bash[23388]: audit 2024-02-13T15:10:31.329859+0000 mgr.y (mgr.14613) 1011 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:34.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:34 smithi062 bash[28859]: cluster 2024-02-13T15:10:32.664520+0000 mgr.y (mgr.14613) 1012 : cluster 0 pgmap v1483: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:34.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:34 smithi062 bash[21479]: cluster 2024-02-13T15:10:32.664520+0000 mgr.y (mgr.14613) 1012 : cluster 0 pgmap v1483: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:34.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:34 smithi111 bash[23388]: cluster 2024-02-13T15:10:32.664520+0000 mgr.y (mgr.14613) 1012 : cluster 0 pgmap v1483: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:10:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:10:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:10:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:36 smithi062 bash[28859]: cluster 2024-02-13T15:10:34.665323+0000 mgr.y (mgr.14613) 1013 : cluster 0 pgmap v1484: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:36 smithi062 bash[28859]: audit 2024-02-13T15:10:36.217776+0000 mon.b (mon.1) 334 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:36.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:36 smithi062 bash[21479]: cluster 2024-02-13T15:10:34.665323+0000 mgr.y (mgr.14613) 1013 : cluster 0 pgmap v1484: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:36.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:36 smithi062 bash[21479]: audit 2024-02-13T15:10:36.217776+0000 mon.b (mon.1) 334 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:36.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:36 smithi111 bash[23388]: cluster 2024-02-13T15:10:34.665323+0000 mgr.y (mgr.14613) 1013 : cluster 0 pgmap v1484: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:36.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:36 smithi111 bash[23388]: audit 2024-02-13T15:10:36.217776+0000 mon.b (mon.1) 334 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:38.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:38 smithi111 bash[23388]: cluster 2024-02-13T15:10:36.667833+0000 mgr.y (mgr.14613) 1014 : cluster 0 pgmap v1485: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:38 smithi062 bash[28859]: cluster 2024-02-13T15:10:36.667833+0000 mgr.y (mgr.14613) 1014 : cluster 0 pgmap v1485: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:38 smithi062 bash[21479]: cluster 2024-02-13T15:10:36.667833+0000 mgr.y (mgr.14613) 1014 : cluster 0 pgmap v1485: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:40.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:40 smithi111 bash[23388]: cluster 2024-02-13T15:10:38.668675+0000 mgr.y (mgr.14613) 1015 : cluster 0 pgmap v1486: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:40 smithi062 bash[28859]: cluster 2024-02-13T15:10:38.668675+0000 mgr.y (mgr.14613) 1015 : cluster 0 pgmap v1486: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:40 smithi062 bash[21479]: cluster 2024-02-13T15:10:38.668675+0000 mgr.y (mgr.14613) 1015 : cluster 0 pgmap v1486: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:41.594 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:10:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:10:42.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:42 smithi111 bash[23388]: cluster 2024-02-13T15:10:40.671228+0000 mgr.y (mgr.14613) 1016 : cluster 0 pgmap v1487: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:42.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:42 smithi111 bash[23388]: audit 2024-02-13T15:10:41.338230+0000 mgr.y (mgr.14613) 1017 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:42 smithi062 bash[28859]: cluster 2024-02-13T15:10:40.671228+0000 mgr.y (mgr.14613) 1016 : cluster 0 pgmap v1487: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:42 smithi062 bash[28859]: audit 2024-02-13T15:10:41.338230+0000 mgr.y (mgr.14613) 1017 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:42 smithi062 bash[21479]: cluster 2024-02-13T15:10:40.671228+0000 mgr.y (mgr.14613) 1016 : cluster 0 pgmap v1487: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:42 smithi062 bash[21479]: audit 2024-02-13T15:10:41.338230+0000 mgr.y (mgr.14613) 1017 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:44.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:44 smithi111 bash[23388]: cluster 2024-02-13T15:10:42.672234+0000 mgr.y (mgr.14613) 1018 : cluster 0 pgmap v1488: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:44 smithi062 bash[21479]: cluster 2024-02-13T15:10:42.672234+0000 mgr.y (mgr.14613) 1018 : cluster 0 pgmap v1488: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:44 smithi062 bash[28859]: cluster 2024-02-13T15:10:42.672234+0000 mgr.y (mgr.14613) 1018 : cluster 0 pgmap v1488: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:46 smithi062 bash[28859]: cluster 2024-02-13T15:10:44.673261+0000 mgr.y (mgr.14613) 1019 : cluster 0 pgmap v1489: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:46.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:46 smithi062 bash[21479]: cluster 2024-02-13T15:10:44.673261+0000 mgr.y (mgr.14613) 1019 : cluster 0 pgmap v1489: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:46.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:10:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:10:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:10:46.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:46 smithi111 bash[23388]: cluster 2024-02-13T15:10:44.673261+0000 mgr.y (mgr.14613) 1019 : cluster 0 pgmap v1489: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:48 smithi111 bash[23388]: cluster 2024-02-13T15:10:46.675804+0000 mgr.y (mgr.14613) 1020 : cluster 0 pgmap v1490: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:48 smithi062 bash[21479]: cluster 2024-02-13T15:10:46.675804+0000 mgr.y (mgr.14613) 1020 : cluster 0 pgmap v1490: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:48 smithi062 bash[28859]: cluster 2024-02-13T15:10:46.675804+0000 mgr.y (mgr.14613) 1020 : cluster 0 pgmap v1490: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:50 smithi062 bash[21479]: cluster 2024-02-13T15:10:48.676648+0000 mgr.y (mgr.14613) 1021 : cluster 0 pgmap v1491: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:50.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:50 smithi062 bash[28859]: cluster 2024-02-13T15:10:48.676648+0000 mgr.y (mgr.14613) 1021 : cluster 0 pgmap v1491: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:50 smithi111 bash[23388]: cluster 2024-02-13T15:10:48.676648+0000 mgr.y (mgr.14613) 1021 : cluster 0 pgmap v1491: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:51 smithi062 bash[21479]: audit 2024-02-13T15:10:51.256331+0000 mon.b (mon.1) 335 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:51.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:51 smithi062 bash[28859]: audit 2024-02-13T15:10:51.256331+0000 mon.b (mon.1) 335 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:51.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:10:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:10:51.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:51 smithi111 bash[23388]: audit 2024-02-13T15:10:51.256331+0000 mon.b (mon.1) 335 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:10:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:52 smithi062 bash[28859]: cluster 2024-02-13T15:10:50.679086+0000 mgr.y (mgr.14613) 1022 : cluster 0 pgmap v1492: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:52.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:52 smithi062 bash[28859]: audit 2024-02-13T15:10:51.343956+0000 mgr.y (mgr.14613) 1023 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:52.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:52 smithi062 bash[21479]: cluster 2024-02-13T15:10:50.679086+0000 mgr.y (mgr.14613) 1022 : cluster 0 pgmap v1492: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:52.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:52 smithi062 bash[21479]: audit 2024-02-13T15:10:51.343956+0000 mgr.y (mgr.14613) 1023 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:52 smithi111 bash[23388]: cluster 2024-02-13T15:10:50.679086+0000 mgr.y (mgr.14613) 1022 : cluster 0 pgmap v1492: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:52 smithi111 bash[23388]: audit 2024-02-13T15:10:51.343956+0000 mgr.y (mgr.14613) 1023 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:10:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:54 smithi062 bash[28859]: cluster 2024-02-13T15:10:52.679924+0000 mgr.y (mgr.14613) 1024 : cluster 0 pgmap v1493: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:54 smithi062 bash[21479]: cluster 2024-02-13T15:10:52.679924+0000 mgr.y (mgr.14613) 1024 : cluster 0 pgmap v1493: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:54 smithi111 bash[23388]: cluster 2024-02-13T15:10:52.679924+0000 mgr.y (mgr.14613) 1024 : cluster 0 pgmap v1493: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:56 smithi062 bash[21479]: cluster 2024-02-13T15:10:54.680716+0000 mgr.y (mgr.14613) 1025 : cluster 0 pgmap v1494: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:10:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:10:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:10:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:56 smithi062 bash[28859]: cluster 2024-02-13T15:10:54.680716+0000 mgr.y (mgr.14613) 1025 : cluster 0 pgmap v1494: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:56 smithi111 bash[23388]: cluster 2024-02-13T15:10:54.680716+0000 mgr.y (mgr.14613) 1025 : cluster 0 pgmap v1494: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:10:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:10:58 smithi062 bash[21479]: cluster 2024-02-13T15:10:56.683218+0000 mgr.y (mgr.14613) 1026 : cluster 0 pgmap v1495: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:58.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:10:58 smithi062 bash[28859]: cluster 2024-02-13T15:10:56.683218+0000 mgr.y (mgr.14613) 1026 : cluster 0 pgmap v1495: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:10:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:10:58 smithi111 bash[23388]: cluster 2024-02-13T15:10:56.683218+0000 mgr.y (mgr.14613) 1026 : cluster 0 pgmap v1495: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:00 smithi062 bash[21479]: cluster 2024-02-13T15:10:58.684303+0000 mgr.y (mgr.14613) 1027 : cluster 0 pgmap v1496: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:00 smithi062 bash[28859]: cluster 2024-02-13T15:10:58.684303+0000 mgr.y (mgr.14613) 1027 : cluster 0 pgmap v1496: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:00 smithi111 bash[23388]: cluster 2024-02-13T15:10:58.684303+0000 mgr.y (mgr.14613) 1027 : cluster 0 pgmap v1496: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:01.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:11:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:11:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:02 smithi062 bash[28859]: cluster 2024-02-13T15:11:00.686910+0000 mgr.y (mgr.14613) 1028 : cluster 0 pgmap v1497: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:02 smithi062 bash[28859]: audit 2024-02-13T15:11:01.355476+0000 mgr.y (mgr.14613) 1029 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:02 smithi062 bash[21479]: cluster 2024-02-13T15:11:00.686910+0000 mgr.y (mgr.14613) 1028 : cluster 0 pgmap v1497: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:02 smithi062 bash[21479]: audit 2024-02-13T15:11:01.355476+0000 mgr.y (mgr.14613) 1029 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:02 smithi111 bash[23388]: cluster 2024-02-13T15:11:00.686910+0000 mgr.y (mgr.14613) 1028 : cluster 0 pgmap v1497: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:02 smithi111 bash[23388]: audit 2024-02-13T15:11:01.355476+0000 mgr.y (mgr.14613) 1029 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:04.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:04 smithi062 bash[28859]: cluster 2024-02-13T15:11:02.687807+0000 mgr.y (mgr.14613) 1030 : cluster 0 pgmap v1498: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:04.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:04 smithi062 bash[21479]: cluster 2024-02-13T15:11:02.687807+0000 mgr.y (mgr.14613) 1030 : cluster 0 pgmap v1498: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:04 smithi111 bash[23388]: cluster 2024-02-13T15:11:02.687807+0000 mgr.y (mgr.14613) 1030 : cluster 0 pgmap v1498: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:11:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:11:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:11:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:06 smithi062 bash[21479]: cluster 2024-02-13T15:11:04.688691+0000 mgr.y (mgr.14613) 1031 : cluster 0 pgmap v1499: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:06 smithi062 bash[21479]: audit 2024-02-13T15:11:06.290859+0000 mon.b (mon.1) 336 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:06 smithi062 bash[28859]: cluster 2024-02-13T15:11:04.688691+0000 mgr.y (mgr.14613) 1031 : cluster 0 pgmap v1499: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:06.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:06 smithi062 bash[28859]: audit 2024-02-13T15:11:06.290859+0000 mon.b (mon.1) 336 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:06.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:06 smithi111 bash[23388]: cluster 2024-02-13T15:11:04.688691+0000 mgr.y (mgr.14613) 1031 : cluster 0 pgmap v1499: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:06.847 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:06 smithi111 bash[23388]: audit 2024-02-13T15:11:06.290859+0000 mon.b (mon.1) 336 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:08.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:08 smithi062 bash[28859]: cluster 2024-02-13T15:11:06.691217+0000 mgr.y (mgr.14613) 1032 : cluster 0 pgmap v1500: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:08.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:08 smithi062 bash[28859]: audit 2024-02-13T15:11:08.346378+0000 mon.b (mon.1) 337 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:11:08.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:08 smithi062 bash[21479]: cluster 2024-02-13T15:11:06.691217+0000 mgr.y (mgr.14613) 1032 : cluster 0 pgmap v1500: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:08.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:08 smithi062 bash[21479]: audit 2024-02-13T15:11:08.346378+0000 mon.b (mon.1) 337 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:11:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:08 smithi111 bash[23388]: cluster 2024-02-13T15:11:06.691217+0000 mgr.y (mgr.14613) 1032 : cluster 0 pgmap v1500: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:08 smithi111 bash[23388]: audit 2024-02-13T15:11:08.346378+0000 mon.b (mon.1) 337 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:11:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:09 smithi062 bash[21479]: audit 2024-02-13T15:11:09.131044+0000 mon.b (mon.1) 338 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:11:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:09 smithi062 bash[21479]: audit 2024-02-13T15:11:09.132719+0000 mon.b (mon.1) 339 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:11:09.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:09 smithi062 bash[21479]: audit 2024-02-13T15:11:09.141134+0000 mon.a (mon.0) 3537 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:11:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:09 smithi062 bash[28859]: audit 2024-02-13T15:11:09.131044+0000 mon.b (mon.1) 338 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:11:09.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:09 smithi062 bash[28859]: audit 2024-02-13T15:11:09.132719+0000 mon.b (mon.1) 339 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:11:09.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:09 smithi062 bash[28859]: audit 2024-02-13T15:11:09.141134+0000 mon.a (mon.0) 3537 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:11:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:09 smithi111 bash[23388]: audit 2024-02-13T15:11:09.131044+0000 mon.b (mon.1) 338 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:11:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:09 smithi111 bash[23388]: audit 2024-02-13T15:11:09.132719+0000 mon.b (mon.1) 339 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:11:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:09 smithi111 bash[23388]: audit 2024-02-13T15:11:09.141134+0000 mon.a (mon.0) 3537 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:11:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:10 smithi062 bash[21479]: cluster 2024-02-13T15:11:08.692081+0000 mgr.y (mgr.14613) 1033 : cluster 0 pgmap v1501: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:10.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:10 smithi062 bash[28859]: cluster 2024-02-13T15:11:08.692081+0000 mgr.y (mgr.14613) 1033 : cluster 0 pgmap v1501: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:10 smithi111 bash[23388]: cluster 2024-02-13T15:11:08.692081+0000 mgr.y (mgr.14613) 1033 : cluster 0 pgmap v1501: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:11.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:11:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:11:12.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:12 smithi062 bash[21479]: cluster 2024-02-13T15:11:10.694611+0000 mgr.y (mgr.14613) 1034 : cluster 0 pgmap v1502: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:12.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:12 smithi062 bash[21479]: audit 2024-02-13T15:11:11.366221+0000 mgr.y (mgr.14613) 1035 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:12 smithi062 bash[28859]: cluster 2024-02-13T15:11:10.694611+0000 mgr.y (mgr.14613) 1034 : cluster 0 pgmap v1502: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:12.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:12 smithi062 bash[28859]: audit 2024-02-13T15:11:11.366221+0000 mgr.y (mgr.14613) 1035 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:12 smithi111 bash[23388]: cluster 2024-02-13T15:11:10.694611+0000 mgr.y (mgr.14613) 1034 : cluster 0 pgmap v1502: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:12.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:12 smithi111 bash[23388]: audit 2024-02-13T15:11:11.366221+0000 mgr.y (mgr.14613) 1035 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:14.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:14 smithi062 bash[28859]: cluster 2024-02-13T15:11:12.695435+0000 mgr.y (mgr.14613) 1036 : cluster 0 pgmap v1503: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:14.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:14 smithi062 bash[21479]: cluster 2024-02-13T15:11:12.695435+0000 mgr.y (mgr.14613) 1036 : cluster 0 pgmap v1503: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:14 smithi111 bash[23388]: cluster 2024-02-13T15:11:12.695435+0000 mgr.y (mgr.14613) 1036 : cluster 0 pgmap v1503: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:11:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:11:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:11:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:16 smithi062 bash[28859]: cluster 2024-02-13T15:11:14.696250+0000 mgr.y (mgr.14613) 1037 : cluster 0 pgmap v1504: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:16 smithi062 bash[21479]: cluster 2024-02-13T15:11:14.696250+0000 mgr.y (mgr.14613) 1037 : cluster 0 pgmap v1504: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:16 smithi111 bash[23388]: cluster 2024-02-13T15:11:14.696250+0000 mgr.y (mgr.14613) 1037 : cluster 0 pgmap v1504: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:18.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:18 smithi062 bash[28859]: cluster 2024-02-13T15:11:16.698765+0000 mgr.y (mgr.14613) 1038 : cluster 0 pgmap v1505: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:18.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:18 smithi062 bash[21479]: cluster 2024-02-13T15:11:16.698765+0000 mgr.y (mgr.14613) 1038 : cluster 0 pgmap v1505: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:18 smithi111 bash[23388]: cluster 2024-02-13T15:11:16.698765+0000 mgr.y (mgr.14613) 1038 : cluster 0 pgmap v1505: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:20.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:20 smithi062 bash[21479]: cluster 2024-02-13T15:11:18.699572+0000 mgr.y (mgr.14613) 1039 : cluster 0 pgmap v1506: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:20.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:20 smithi062 bash[28859]: cluster 2024-02-13T15:11:18.699572+0000 mgr.y (mgr.14613) 1039 : cluster 0 pgmap v1506: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:20 smithi111 bash[23388]: cluster 2024-02-13T15:11:18.699572+0000 mgr.y (mgr.14613) 1039 : cluster 0 pgmap v1506: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:21.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:21 smithi062 bash[21479]: audit 2024-02-13T15:11:21.324829+0000 mon.b (mon.1) 340 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:21 smithi062 bash[28859]: audit 2024-02-13T15:11:21.324829+0000 mon.b (mon.1) 340 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:21 smithi111 bash[23388]: audit 2024-02-13T15:11:21.324829+0000 mon.b (mon.1) 340 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:21.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:11:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:11:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:22 smithi062 bash[21479]: cluster 2024-02-13T15:11:20.702069+0000 mgr.y (mgr.14613) 1040 : cluster 0 pgmap v1507: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:22 smithi062 bash[21479]: audit 2024-02-13T15:11:21.377618+0000 mgr.y (mgr.14613) 1041 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:22 smithi062 bash[28859]: cluster 2024-02-13T15:11:20.702069+0000 mgr.y (mgr.14613) 1040 : cluster 0 pgmap v1507: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:22 smithi062 bash[28859]: audit 2024-02-13T15:11:21.377618+0000 mgr.y (mgr.14613) 1041 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:22 smithi111 bash[23388]: cluster 2024-02-13T15:11:20.702069+0000 mgr.y (mgr.14613) 1040 : cluster 0 pgmap v1507: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:22 smithi111 bash[23388]: audit 2024-02-13T15:11:21.377618+0000 mgr.y (mgr.14613) 1041 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:24 smithi062 bash[21479]: cluster 2024-02-13T15:11:22.702959+0000 mgr.y (mgr.14613) 1042 : cluster 0 pgmap v1508: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:24 smithi062 bash[28859]: cluster 2024-02-13T15:11:22.702959+0000 mgr.y (mgr.14613) 1042 : cluster 0 pgmap v1508: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:24 smithi111 bash[23388]: cluster 2024-02-13T15:11:22.702959+0000 mgr.y (mgr.14613) 1042 : cluster 0 pgmap v1508: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:11:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:11:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:11:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:26 smithi062 bash[28859]: cluster 2024-02-13T15:11:24.703790+0000 mgr.y (mgr.14613) 1043 : cluster 0 pgmap v1509: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:26.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:26 smithi062 bash[21479]: cluster 2024-02-13T15:11:24.703790+0000 mgr.y (mgr.14613) 1043 : cluster 0 pgmap v1509: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:26.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:26 smithi111 bash[23388]: cluster 2024-02-13T15:11:24.703790+0000 mgr.y (mgr.14613) 1043 : cluster 0 pgmap v1509: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:28 smithi062 bash[21479]: cluster 2024-02-13T15:11:26.706358+0000 mgr.y (mgr.14613) 1044 : cluster 0 pgmap v1510: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:28.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:28 smithi062 bash[28859]: cluster 2024-02-13T15:11:26.706358+0000 mgr.y (mgr.14613) 1044 : cluster 0 pgmap v1510: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:28 smithi111 bash[23388]: cluster 2024-02-13T15:11:26.706358+0000 mgr.y (mgr.14613) 1044 : cluster 0 pgmap v1510: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:30 smithi062 bash[28859]: cluster 2024-02-13T15:11:28.707341+0000 mgr.y (mgr.14613) 1045 : cluster 0 pgmap v1511: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:30.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:30 smithi062 bash[21479]: cluster 2024-02-13T15:11:28.707341+0000 mgr.y (mgr.14613) 1045 : cluster 0 pgmap v1511: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:30 smithi111 bash[23388]: cluster 2024-02-13T15:11:28.707341+0000 mgr.y (mgr.14613) 1045 : cluster 0 pgmap v1511: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:31.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:11:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:11:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:32 smithi062 bash[21479]: cluster 2024-02-13T15:11:30.709961+0000 mgr.y (mgr.14613) 1046 : cluster 0 pgmap v1512: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:32.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:32 smithi062 bash[21479]: audit 2024-02-13T15:11:31.388867+0000 mgr.y (mgr.14613) 1047 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:32 smithi062 bash[28859]: cluster 2024-02-13T15:11:30.709961+0000 mgr.y (mgr.14613) 1046 : cluster 0 pgmap v1512: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:32 smithi062 bash[28859]: audit 2024-02-13T15:11:31.388867+0000 mgr.y (mgr.14613) 1047 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:32 smithi111 bash[23388]: cluster 2024-02-13T15:11:30.709961+0000 mgr.y (mgr.14613) 1046 : cluster 0 pgmap v1512: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:32 smithi111 bash[23388]: audit 2024-02-13T15:11:31.388867+0000 mgr.y (mgr.14613) 1047 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:34 smithi062 bash[21479]: cluster 2024-02-13T15:11:32.710872+0000 mgr.y (mgr.14613) 1048 : cluster 0 pgmap v1513: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:34 smithi062 bash[28859]: cluster 2024-02-13T15:11:32.710872+0000 mgr.y (mgr.14613) 1048 : cluster 0 pgmap v1513: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:34 smithi111 bash[23388]: cluster 2024-02-13T15:11:32.710872+0000 mgr.y (mgr.14613) 1048 : cluster 0 pgmap v1513: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:11:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:11:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:11:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:36 smithi062 bash[28859]: cluster 2024-02-13T15:11:34.711740+0000 mgr.y (mgr.14613) 1049 : cluster 0 pgmap v1514: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:36.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:36 smithi062 bash[28859]: audit 2024-02-13T15:11:36.360637+0000 mon.b (mon.1) 341 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:36.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:36 smithi062 bash[21479]: cluster 2024-02-13T15:11:34.711740+0000 mgr.y (mgr.14613) 1049 : cluster 0 pgmap v1514: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:36.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:36 smithi062 bash[21479]: audit 2024-02-13T15:11:36.360637+0000 mon.b (mon.1) 341 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:36 smithi111 bash[23388]: cluster 2024-02-13T15:11:34.711740+0000 mgr.y (mgr.14613) 1049 : cluster 0 pgmap v1514: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:36.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:36 smithi111 bash[23388]: audit 2024-02-13T15:11:36.360637+0000 mon.b (mon.1) 341 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:38 smithi062 bash[28859]: cluster 2024-02-13T15:11:36.714251+0000 mgr.y (mgr.14613) 1050 : cluster 0 pgmap v1515: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:38 smithi062 bash[21479]: cluster 2024-02-13T15:11:36.714251+0000 mgr.y (mgr.14613) 1050 : cluster 0 pgmap v1515: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:38 smithi111 bash[23388]: cluster 2024-02-13T15:11:36.714251+0000 mgr.y (mgr.14613) 1050 : cluster 0 pgmap v1515: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:40 smithi062 bash[28859]: cluster 2024-02-13T15:11:38.715178+0000 mgr.y (mgr.14613) 1051 : cluster 0 pgmap v1516: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:40 smithi062 bash[21479]: cluster 2024-02-13T15:11:38.715178+0000 mgr.y (mgr.14613) 1051 : cluster 0 pgmap v1516: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:40 smithi111 bash[23388]: cluster 2024-02-13T15:11:38.715178+0000 mgr.y (mgr.14613) 1051 : cluster 0 pgmap v1516: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:41.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:11:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:11:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:42 smithi062 bash[21479]: cluster 2024-02-13T15:11:40.717695+0000 mgr.y (mgr.14613) 1052 : cluster 0 pgmap v1517: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:42 smithi062 bash[21479]: audit 2024-02-13T15:11:41.400355+0000 mgr.y (mgr.14613) 1053 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:42 smithi062 bash[28859]: cluster 2024-02-13T15:11:40.717695+0000 mgr.y (mgr.14613) 1052 : cluster 0 pgmap v1517: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:42 smithi062 bash[28859]: audit 2024-02-13T15:11:41.400355+0000 mgr.y (mgr.14613) 1053 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:42 smithi111 bash[23388]: cluster 2024-02-13T15:11:40.717695+0000 mgr.y (mgr.14613) 1052 : cluster 0 pgmap v1517: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:42 smithi111 bash[23388]: audit 2024-02-13T15:11:41.400355+0000 mgr.y (mgr.14613) 1053 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:44 smithi062 bash[28859]: cluster 2024-02-13T15:11:42.718616+0000 mgr.y (mgr.14613) 1054 : cluster 0 pgmap v1518: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:44.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:44 smithi062 bash[21479]: cluster 2024-02-13T15:11:42.718616+0000 mgr.y (mgr.14613) 1054 : cluster 0 pgmap v1518: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:44 smithi111 bash[23388]: cluster 2024-02-13T15:11:42.718616+0000 mgr.y (mgr.14613) 1054 : cluster 0 pgmap v1518: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:46.487 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:11:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:11:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:11:46.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:46 smithi062 bash[21479]: cluster 2024-02-13T15:11:44.719407+0000 mgr.y (mgr.14613) 1055 : cluster 0 pgmap v1519: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:46 smithi062 bash[28859]: cluster 2024-02-13T15:11:44.719407+0000 mgr.y (mgr.14613) 1055 : cluster 0 pgmap v1519: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:46 smithi111 bash[23388]: cluster 2024-02-13T15:11:44.719407+0000 mgr.y (mgr.14613) 1055 : cluster 0 pgmap v1519: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:48 smithi062 bash[21479]: cluster 2024-02-13T15:11:46.721810+0000 mgr.y (mgr.14613) 1056 : cluster 0 pgmap v1520: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:48 smithi062 bash[28859]: cluster 2024-02-13T15:11:46.721810+0000 mgr.y (mgr.14613) 1056 : cluster 0 pgmap v1520: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:48 smithi111 bash[23388]: cluster 2024-02-13T15:11:46.721810+0000 mgr.y (mgr.14613) 1056 : cluster 0 pgmap v1520: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:50 smithi062 bash[21479]: cluster 2024-02-13T15:11:48.722692+0000 mgr.y (mgr.14613) 1057 : cluster 0 pgmap v1521: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:50 smithi062 bash[28859]: cluster 2024-02-13T15:11:48.722692+0000 mgr.y (mgr.14613) 1057 : cluster 0 pgmap v1521: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:50 smithi111 bash[23388]: cluster 2024-02-13T15:11:48.722692+0000 mgr.y (mgr.14613) 1057 : cluster 0 pgmap v1521: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:51.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:51 smithi062 bash[21479]: audit 2024-02-13T15:11:51.396582+0000 mon.b (mon.1) 342 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:51.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:51 smithi062 bash[28859]: audit 2024-02-13T15:11:51.396582+0000 mon.b (mon.1) 342 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:51.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:51 smithi111 bash[23388]: audit 2024-02-13T15:11:51.396582+0000 mon.b (mon.1) 342 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:11:51.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:11:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:11:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:52 smithi062 bash[21479]: cluster 2024-02-13T15:11:50.725143+0000 mgr.y (mgr.14613) 1058 : cluster 0 pgmap v1522: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:52 smithi062 bash[21479]: audit 2024-02-13T15:11:51.411753+0000 mgr.y (mgr.14613) 1059 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:52 smithi062 bash[28859]: cluster 2024-02-13T15:11:50.725143+0000 mgr.y (mgr.14613) 1058 : cluster 0 pgmap v1522: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:52 smithi062 bash[28859]: audit 2024-02-13T15:11:51.411753+0000 mgr.y (mgr.14613) 1059 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:52 smithi111 bash[23388]: cluster 2024-02-13T15:11:50.725143+0000 mgr.y (mgr.14613) 1058 : cluster 0 pgmap v1522: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:52 smithi111 bash[23388]: audit 2024-02-13T15:11:51.411753+0000 mgr.y (mgr.14613) 1059 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:11:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:54 smithi062 bash[28859]: cluster 2024-02-13T15:11:52.725998+0000 mgr.y (mgr.14613) 1060 : cluster 0 pgmap v1523: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:54 smithi062 bash[21479]: cluster 2024-02-13T15:11:52.725998+0000 mgr.y (mgr.14613) 1060 : cluster 0 pgmap v1523: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:54 smithi111 bash[23388]: cluster 2024-02-13T15:11:52.725998+0000 mgr.y (mgr.14613) 1060 : cluster 0 pgmap v1523: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:56.520 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:11:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:11:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:11:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:56 smithi062 bash[28859]: cluster 2024-02-13T15:11:54.726962+0000 mgr.y (mgr.14613) 1061 : cluster 0 pgmap v1524: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:56 smithi062 bash[21479]: cluster 2024-02-13T15:11:54.726962+0000 mgr.y (mgr.14613) 1061 : cluster 0 pgmap v1524: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:56 smithi111 bash[23388]: cluster 2024-02-13T15:11:54.726962+0000 mgr.y (mgr.14613) 1061 : cluster 0 pgmap v1524: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:11:58.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:11:58 smithi062 bash[28859]: cluster 2024-02-13T15:11:56.730410+0000 mgr.y (mgr.14613) 1062 : cluster 0 pgmap v1525: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:58.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:11:58 smithi062 bash[21479]: cluster 2024-02-13T15:11:56.730410+0000 mgr.y (mgr.14613) 1062 : cluster 0 pgmap v1525: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:11:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:11:58 smithi111 bash[23388]: cluster 2024-02-13T15:11:56.730410+0000 mgr.y (mgr.14613) 1062 : cluster 0 pgmap v1525: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:00 smithi062 bash[28859]: cluster 2024-02-13T15:11:58.731423+0000 mgr.y (mgr.14613) 1063 : cluster 0 pgmap v1526: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:00 smithi062 bash[21479]: cluster 2024-02-13T15:11:58.731423+0000 mgr.y (mgr.14613) 1063 : cluster 0 pgmap v1526: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:00 smithi111 bash[23388]: cluster 2024-02-13T15:11:58.731423+0000 mgr.y (mgr.14613) 1063 : cluster 0 pgmap v1526: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:01.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:12:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:12:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:02 smithi062 bash[28859]: cluster 2024-02-13T15:12:00.734153+0000 mgr.y (mgr.14613) 1064 : cluster 0 pgmap v1527: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:02.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:02 smithi062 bash[28859]: audit 2024-02-13T15:12:01.423155+0000 mgr.y (mgr.14613) 1065 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:02 smithi062 bash[21479]: cluster 2024-02-13T15:12:00.734153+0000 mgr.y (mgr.14613) 1064 : cluster 0 pgmap v1527: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:02.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:02 smithi062 bash[21479]: audit 2024-02-13T15:12:01.423155+0000 mgr.y (mgr.14613) 1065 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:02 smithi111 bash[23388]: cluster 2024-02-13T15:12:00.734153+0000 mgr.y (mgr.14613) 1064 : cluster 0 pgmap v1527: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:02 smithi111 bash[23388]: audit 2024-02-13T15:12:01.423155+0000 mgr.y (mgr.14613) 1065 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:04.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:04 smithi062 bash[28859]: cluster 2024-02-13T15:12:02.735090+0000 mgr.y (mgr.14613) 1066 : cluster 0 pgmap v1528: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:04.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:04 smithi062 bash[21479]: cluster 2024-02-13T15:12:02.735090+0000 mgr.y (mgr.14613) 1066 : cluster 0 pgmap v1528: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:04 smithi111 bash[23388]: cluster 2024-02-13T15:12:02.735090+0000 mgr.y (mgr.14613) 1066 : cluster 0 pgmap v1528: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:06.543 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:12:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:12:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:12:06.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:06 smithi062 bash[21479]: cluster 2024-02-13T15:12:04.736061+0000 mgr.y (mgr.14613) 1067 : cluster 0 pgmap v1529: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:06.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:06 smithi062 bash[21479]: audit 2024-02-13T15:12:06.430286+0000 mon.b (mon.1) 343 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:06.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:06 smithi062 bash[28859]: cluster 2024-02-13T15:12:04.736061+0000 mgr.y (mgr.14613) 1067 : cluster 0 pgmap v1529: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:06.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:06 smithi062 bash[28859]: audit 2024-02-13T15:12:06.430286+0000 mon.b (mon.1) 343 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:06 smithi111 bash[23388]: cluster 2024-02-13T15:12:04.736061+0000 mgr.y (mgr.14613) 1067 : cluster 0 pgmap v1529: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:06 smithi111 bash[23388]: audit 2024-02-13T15:12:06.430286+0000 mon.b (mon.1) 343 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:08.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:08 smithi062 bash[21479]: cluster 2024-02-13T15:12:06.738750+0000 mgr.y (mgr.14613) 1068 : cluster 0 pgmap v1530: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:08.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:08 smithi062 bash[28859]: cluster 2024-02-13T15:12:06.738750+0000 mgr.y (mgr.14613) 1068 : cluster 0 pgmap v1530: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:08 smithi111 bash[23388]: cluster 2024-02-13T15:12:06.738750+0000 mgr.y (mgr.14613) 1068 : cluster 0 pgmap v1530: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:09.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:09 smithi062 bash[21479]: audit 2024-02-13T15:12:09.239271+0000 mon.b (mon.1) 344 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:12:09.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:09 smithi062 bash[28859]: audit 2024-02-13T15:12:09.239271+0000 mon.b (mon.1) 344 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:12:09.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:09 smithi111 bash[23388]: audit 2024-02-13T15:12:09.239271+0000 mon.b (mon.1) 344 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:12:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:10 smithi062 bash[21479]: cluster 2024-02-13T15:12:08.739737+0000 mgr.y (mgr.14613) 1069 : cluster 0 pgmap v1531: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:10 smithi062 bash[21479]: audit 2024-02-13T15:12:09.968011+0000 mon.b (mon.1) 345 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:12:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:10 smithi062 bash[21479]: audit 2024-02-13T15:12:09.969869+0000 mon.b (mon.1) 346 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:12:10.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:10 smithi062 bash[21479]: audit 2024-02-13T15:12:09.979801+0000 mon.a (mon.0) 3538 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:12:10.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:10 smithi062 bash[28859]: cluster 2024-02-13T15:12:08.739737+0000 mgr.y (mgr.14613) 1069 : cluster 0 pgmap v1531: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:10.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:10 smithi062 bash[28859]: audit 2024-02-13T15:12:09.968011+0000 mon.b (mon.1) 345 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:12:10.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:10 smithi062 bash[28859]: audit 2024-02-13T15:12:09.969869+0000 mon.b (mon.1) 346 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:12:10.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:10 smithi062 bash[28859]: audit 2024-02-13T15:12:09.979801+0000 mon.a (mon.0) 3538 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:12:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:10 smithi111 bash[23388]: cluster 2024-02-13T15:12:08.739737+0000 mgr.y (mgr.14613) 1069 : cluster 0 pgmap v1531: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:10 smithi111 bash[23388]: audit 2024-02-13T15:12:09.968011+0000 mon.b (mon.1) 345 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:12:10.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:10 smithi111 bash[23388]: audit 2024-02-13T15:12:09.969869+0000 mon.b (mon.1) 346 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:12:10.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:10 smithi111 bash[23388]: audit 2024-02-13T15:12:09.979801+0000 mon.a (mon.0) 3538 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:12:11.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:12:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:12:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:12 smithi111 bash[23388]: cluster 2024-02-13T15:12:10.742306+0000 mgr.y (mgr.14613) 1070 : cluster 0 pgmap v1532: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:12.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:12 smithi111 bash[23388]: audit 2024-02-13T15:12:11.432845+0000 mgr.y (mgr.14613) 1071 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:13.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:12 smithi062 bash[28859]: cluster 2024-02-13T15:12:10.742306+0000 mgr.y (mgr.14613) 1070 : cluster 0 pgmap v1532: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:13.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:12 smithi062 bash[28859]: audit 2024-02-13T15:12:11.432845+0000 mgr.y (mgr.14613) 1071 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:13.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:12 smithi062 bash[21479]: cluster 2024-02-13T15:12:10.742306+0000 mgr.y (mgr.14613) 1070 : cluster 0 pgmap v1532: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:13.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:12 smithi062 bash[21479]: audit 2024-02-13T15:12:11.432845+0000 mgr.y (mgr.14613) 1071 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:14 smithi111 bash[23388]: cluster 2024-02-13T15:12:12.743188+0000 mgr.y (mgr.14613) 1072 : cluster 0 pgmap v1533: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:14 smithi062 bash[21479]: cluster 2024-02-13T15:12:12.743188+0000 mgr.y (mgr.14613) 1072 : cluster 0 pgmap v1533: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:14 smithi062 bash[28859]: cluster 2024-02-13T15:12:12.743188+0000 mgr.y (mgr.14613) 1072 : cluster 0 pgmap v1533: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:12:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:12:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:12:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:16 smithi111 bash[23388]: cluster 2024-02-13T15:12:14.744159+0000 mgr.y (mgr.14613) 1073 : cluster 0 pgmap v1534: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:17.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:16 smithi062 bash[28859]: cluster 2024-02-13T15:12:14.744159+0000 mgr.y (mgr.14613) 1073 : cluster 0 pgmap v1534: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:16 smithi062 bash[21479]: cluster 2024-02-13T15:12:14.744159+0000 mgr.y (mgr.14613) 1073 : cluster 0 pgmap v1534: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:18 smithi111 bash[23388]: cluster 2024-02-13T15:12:16.746721+0000 mgr.y (mgr.14613) 1074 : cluster 0 pgmap v1535: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:18 smithi062 bash[28859]: cluster 2024-02-13T15:12:16.746721+0000 mgr.y (mgr.14613) 1074 : cluster 0 pgmap v1535: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:18 smithi062 bash[21479]: cluster 2024-02-13T15:12:16.746721+0000 mgr.y (mgr.14613) 1074 : cluster 0 pgmap v1535: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:20.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:20 smithi111 bash[23388]: cluster 2024-02-13T15:12:18.747590+0000 mgr.y (mgr.14613) 1075 : cluster 0 pgmap v1536: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:20 smithi062 bash[21479]: cluster 2024-02-13T15:12:18.747590+0000 mgr.y (mgr.14613) 1075 : cluster 0 pgmap v1536: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:21.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:20 smithi062 bash[28859]: cluster 2024-02-13T15:12:18.747590+0000 mgr.y (mgr.14613) 1075 : cluster 0 pgmap v1536: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:12:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:21 smithi111 bash[23388]: audit 2024-02-13T15:12:21.465266+0000 mon.b (mon.1) 347 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:21.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:12:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:12:22.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:21 smithi062 bash[21479]: audit 2024-02-13T15:12:21.465266+0000 mon.b (mon.1) 347 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:22.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:21 smithi062 bash[28859]: audit 2024-02-13T15:12:21.465266+0000 mon.b (mon.1) 347 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:22 smithi111 bash[23388]: cluster 2024-02-13T15:12:20.750118+0000 mgr.y (mgr.14613) 1076 : cluster 0 pgmap v1537: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:22.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:22 smithi111 bash[23388]: audit 2024-02-13T15:12:21.437917+0000 mgr.y (mgr.14613) 1077 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:22 smithi062 bash[21479]: cluster 2024-02-13T15:12:20.750118+0000 mgr.y (mgr.14613) 1076 : cluster 0 pgmap v1537: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:22 smithi062 bash[21479]: audit 2024-02-13T15:12:21.437917+0000 mgr.y (mgr.14613) 1077 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:23.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:22 smithi062 bash[28859]: cluster 2024-02-13T15:12:20.750118+0000 mgr.y (mgr.14613) 1076 : cluster 0 pgmap v1537: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:23.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:22 smithi062 bash[28859]: audit 2024-02-13T15:12:21.437917+0000 mgr.y (mgr.14613) 1077 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:25.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:24 smithi062 bash[28859]: cluster 2024-02-13T15:12:22.751023+0000 mgr.y (mgr.14613) 1078 : cluster 0 pgmap v1538: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:25.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:24 smithi062 bash[21479]: cluster 2024-02-13T15:12:22.751023+0000 mgr.y (mgr.14613) 1078 : cluster 0 pgmap v1538: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:24 smithi111 bash[23388]: cluster 2024-02-13T15:12:22.751023+0000 mgr.y (mgr.14613) 1078 : cluster 0 pgmap v1538: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:26.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:25 smithi062 bash[28859]: cluster 2024-02-13T15:12:24.751867+0000 mgr.y (mgr.14613) 1079 : cluster 0 pgmap v1539: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:26.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:25 smithi062 bash[21479]: cluster 2024-02-13T15:12:24.751867+0000 mgr.y (mgr.14613) 1079 : cluster 0 pgmap v1539: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:26.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:25 smithi111 bash[23388]: cluster 2024-02-13T15:12:24.751867+0000 mgr.y (mgr.14613) 1079 : cluster 0 pgmap v1539: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:12:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:12:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:12:28.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:27 smithi062 bash[21479]: cluster 2024-02-13T15:12:26.754276+0000 mgr.y (mgr.14613) 1080 : cluster 0 pgmap v1540: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:28.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:27 smithi062 bash[28859]: cluster 2024-02-13T15:12:26.754276+0000 mgr.y (mgr.14613) 1080 : cluster 0 pgmap v1540: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:28.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:27 smithi111 bash[23388]: cluster 2024-02-13T15:12:26.754276+0000 mgr.y (mgr.14613) 1080 : cluster 0 pgmap v1540: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:30.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:29 smithi111 bash[23388]: cluster 2024-02-13T15:12:28.755174+0000 mgr.y (mgr.14613) 1081 : cluster 0 pgmap v1541: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:30.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:29 smithi062 bash[21479]: cluster 2024-02-13T15:12:28.755174+0000 mgr.y (mgr.14613) 1081 : cluster 0 pgmap v1541: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:29 smithi062 bash[28859]: cluster 2024-02-13T15:12:28.755174+0000 mgr.y (mgr.14613) 1081 : cluster 0 pgmap v1541: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:31.821 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:12:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:12:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:31 smithi111 bash[23388]: cluster 2024-02-13T15:12:30.757553+0000 mgr.y (mgr.14613) 1082 : cluster 0 pgmap v1542: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:32.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:31 smithi111 bash[23388]: audit 2024-02-13T15:12:31.449373+0000 mgr.y (mgr.14613) 1083 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:32.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:31 smithi062 bash[21479]: cluster 2024-02-13T15:12:30.757553+0000 mgr.y (mgr.14613) 1082 : cluster 0 pgmap v1542: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:32.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:31 smithi062 bash[21479]: audit 2024-02-13T15:12:31.449373+0000 mgr.y (mgr.14613) 1083 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:32.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:31 smithi062 bash[28859]: cluster 2024-02-13T15:12:30.757553+0000 mgr.y (mgr.14613) 1082 : cluster 0 pgmap v1542: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:32.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:31 smithi062 bash[28859]: audit 2024-02-13T15:12:31.449373+0000 mgr.y (mgr.14613) 1083 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:34.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:33 smithi111 bash[23388]: cluster 2024-02-13T15:12:32.758462+0000 mgr.y (mgr.14613) 1084 : cluster 0 pgmap v1543: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:34.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:33 smithi062 bash[28859]: cluster 2024-02-13T15:12:32.758462+0000 mgr.y (mgr.14613) 1084 : cluster 0 pgmap v1543: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:34.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:33 smithi062 bash[21479]: cluster 2024-02-13T15:12:32.758462+0000 mgr.y (mgr.14613) 1084 : cluster 0 pgmap v1543: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:36.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:35 smithi111 bash[23388]: cluster 2024-02-13T15:12:34.759399+0000 mgr.y (mgr.14613) 1085 : cluster 0 pgmap v1544: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:35 smithi062 bash[28859]: cluster 2024-02-13T15:12:34.759399+0000 mgr.y (mgr.14613) 1085 : cluster 0 pgmap v1544: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:36.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:35 smithi062 bash[21479]: cluster 2024-02-13T15:12:34.759399+0000 mgr.y (mgr.14613) 1085 : cluster 0 pgmap v1544: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:12:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:12:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:12:37.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:36 smithi111 bash[23388]: audit 2024-02-13T15:12:36.501590+0000 mon.b (mon.1) 348 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:36 smithi062 bash[28859]: audit 2024-02-13T15:12:36.501590+0000 mon.b (mon.1) 348 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:36 smithi062 bash[21479]: audit 2024-02-13T15:12:36.501590+0000 mon.b (mon.1) 348 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:38.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:37 smithi111 bash[23388]: cluster 2024-02-13T15:12:36.762076+0000 mgr.y (mgr.14613) 1086 : cluster 0 pgmap v1545: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:37 smithi062 bash[28859]: cluster 2024-02-13T15:12:36.762076+0000 mgr.y (mgr.14613) 1086 : cluster 0 pgmap v1545: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:37 smithi062 bash[21479]: cluster 2024-02-13T15:12:36.762076+0000 mgr.y (mgr.14613) 1086 : cluster 0 pgmap v1545: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:40.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:39 smithi062 bash[21479]: cluster 2024-02-13T15:12:38.762993+0000 mgr.y (mgr.14613) 1087 : cluster 0 pgmap v1546: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:40.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:39 smithi062 bash[28859]: cluster 2024-02-13T15:12:38.762993+0000 mgr.y (mgr.14613) 1087 : cluster 0 pgmap v1546: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:39 smithi111 bash[23388]: cluster 2024-02-13T15:12:38.762993+0000 mgr.y (mgr.14613) 1087 : cluster 0 pgmap v1546: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:41.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:12:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:12:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:41 smithi062 bash[28859]: cluster 2024-02-13T15:12:40.765478+0000 mgr.y (mgr.14613) 1088 : cluster 0 pgmap v1547: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:41 smithi062 bash[28859]: audit 2024-02-13T15:12:41.460836+0000 mgr.y (mgr.14613) 1089 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:42.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:41 smithi062 bash[21479]: cluster 2024-02-13T15:12:40.765478+0000 mgr.y (mgr.14613) 1088 : cluster 0 pgmap v1547: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:42.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:41 smithi062 bash[21479]: audit 2024-02-13T15:12:41.460836+0000 mgr.y (mgr.14613) 1089 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:41 smithi111 bash[23388]: cluster 2024-02-13T15:12:40.765478+0000 mgr.y (mgr.14613) 1088 : cluster 0 pgmap v1547: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:41 smithi111 bash[23388]: audit 2024-02-13T15:12:41.460836+0000 mgr.y (mgr.14613) 1089 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:43 smithi062 bash[21479]: cluster 2024-02-13T15:12:42.766486+0000 mgr.y (mgr.14613) 1090 : cluster 0 pgmap v1548: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:44.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:43 smithi062 bash[28859]: cluster 2024-02-13T15:12:42.766486+0000 mgr.y (mgr.14613) 1090 : cluster 0 pgmap v1548: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:44.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:43 smithi111 bash[23388]: cluster 2024-02-13T15:12:42.766486+0000 mgr.y (mgr.14613) 1090 : cluster 0 pgmap v1548: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:46.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:45 smithi062 bash[21479]: cluster 2024-02-13T15:12:44.767459+0000 mgr.y (mgr.14613) 1091 : cluster 0 pgmap v1549: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:46.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:45 smithi062 bash[28859]: cluster 2024-02-13T15:12:44.767459+0000 mgr.y (mgr.14613) 1091 : cluster 0 pgmap v1549: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:46.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:45 smithi111 bash[23388]: cluster 2024-02-13T15:12:44.767459+0000 mgr.y (mgr.14613) 1091 : cluster 0 pgmap v1549: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:12:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:12:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:12:48.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:47 smithi062 bash[21479]: cluster 2024-02-13T15:12:46.770023+0000 mgr.y (mgr.14613) 1092 : cluster 0 pgmap v1550: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:48.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:47 smithi062 bash[28859]: cluster 2024-02-13T15:12:46.770023+0000 mgr.y (mgr.14613) 1092 : cluster 0 pgmap v1550: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:48.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:47 smithi111 bash[23388]: cluster 2024-02-13T15:12:46.770023+0000 mgr.y (mgr.14613) 1092 : cluster 0 pgmap v1550: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:49 smithi062 bash[21479]: cluster 2024-02-13T15:12:48.770915+0000 mgr.y (mgr.14613) 1093 : cluster 0 pgmap v1551: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:50.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:49 smithi062 bash[28859]: cluster 2024-02-13T15:12:48.770915+0000 mgr.y (mgr.14613) 1093 : cluster 0 pgmap v1551: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:50.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:49 smithi111 bash[23388]: cluster 2024-02-13T15:12:48.770915+0000 mgr.y (mgr.14613) 1093 : cluster 0 pgmap v1551: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:51.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:12:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:12:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:51 smithi062 bash[21479]: cluster 2024-02-13T15:12:50.773346+0000 mgr.y (mgr.14613) 1094 : cluster 0 pgmap v1552: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:51 smithi062 bash[21479]: audit 2024-02-13T15:12:51.472309+0000 mgr.y (mgr.14613) 1095 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:51 smithi062 bash[21479]: audit 2024-02-13T15:12:51.536912+0000 mon.b (mon.1) 349 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:52.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:51 smithi062 bash[28859]: cluster 2024-02-13T15:12:50.773346+0000 mgr.y (mgr.14613) 1094 : cluster 0 pgmap v1552: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:52.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:51 smithi062 bash[28859]: audit 2024-02-13T15:12:51.472309+0000 mgr.y (mgr.14613) 1095 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:52.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:51 smithi062 bash[28859]: audit 2024-02-13T15:12:51.536912+0000 mon.b (mon.1) 349 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:51 smithi111 bash[23388]: cluster 2024-02-13T15:12:50.773346+0000 mgr.y (mgr.14613) 1094 : cluster 0 pgmap v1552: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:51 smithi111 bash[23388]: audit 2024-02-13T15:12:51.472309+0000 mgr.y (mgr.14613) 1095 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:12:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:51 smithi111 bash[23388]: audit 2024-02-13T15:12:51.536912+0000 mon.b (mon.1) 349 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:12:54.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:53 smithi062 bash[28859]: cluster 2024-02-13T15:12:52.774255+0000 mgr.y (mgr.14613) 1096 : cluster 0 pgmap v1553: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:54.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:53 smithi062 bash[21479]: cluster 2024-02-13T15:12:52.774255+0000 mgr.y (mgr.14613) 1096 : cluster 0 pgmap v1553: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:53 smithi111 bash[23388]: cluster 2024-02-13T15:12:52.774255+0000 mgr.y (mgr.14613) 1096 : cluster 0 pgmap v1553: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:56.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:55 smithi062 bash[28859]: cluster 2024-02-13T15:12:54.775146+0000 mgr.y (mgr.14613) 1097 : cluster 0 pgmap v1554: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:56.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:55 smithi062 bash[21479]: cluster 2024-02-13T15:12:54.775146+0000 mgr.y (mgr.14613) 1097 : cluster 0 pgmap v1554: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:55 smithi111 bash[23388]: cluster 2024-02-13T15:12:54.775146+0000 mgr.y (mgr.14613) 1097 : cluster 0 pgmap v1554: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:12:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:12:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:12:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:12:58.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:57 smithi062 bash[28859]: cluster 2024-02-13T15:12:56.777651+0000 mgr.y (mgr.14613) 1098 : cluster 0 pgmap v1555: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:58.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:57 smithi062 bash[21479]: cluster 2024-02-13T15:12:56.777651+0000 mgr.y (mgr.14613) 1098 : cluster 0 pgmap v1555: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:12:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:57 smithi111 bash[23388]: cluster 2024-02-13T15:12:56.777651+0000 mgr.y (mgr.14613) 1098 : cluster 0 pgmap v1555: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:00.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:12:59 smithi062 bash[21479]: cluster 2024-02-13T15:12:58.778494+0000 mgr.y (mgr.14613) 1099 : cluster 0 pgmap v1556: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:00.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:12:59 smithi062 bash[28859]: cluster 2024-02-13T15:12:58.778494+0000 mgr.y (mgr.14613) 1099 : cluster 0 pgmap v1556: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:00.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:12:59 smithi111 bash[23388]: cluster 2024-02-13T15:12:58.778494+0000 mgr.y (mgr.14613) 1099 : cluster 0 pgmap v1556: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:01.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:13:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:13:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:01 smithi062 bash[21479]: cluster 2024-02-13T15:13:00.780927+0000 mgr.y (mgr.14613) 1100 : cluster 0 pgmap v1557: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:01 smithi062 bash[21479]: audit 2024-02-13T15:13:01.473797+0000 mgr.y (mgr.14613) 1101 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:01 smithi062 bash[28859]: cluster 2024-02-13T15:13:00.780927+0000 mgr.y (mgr.14613) 1100 : cluster 0 pgmap v1557: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:02.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:01 smithi062 bash[28859]: audit 2024-02-13T15:13:01.473797+0000 mgr.y (mgr.14613) 1101 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:01 smithi111 bash[23388]: cluster 2024-02-13T15:13:00.780927+0000 mgr.y (mgr.14613) 1100 : cluster 0 pgmap v1557: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:01 smithi111 bash[23388]: audit 2024-02-13T15:13:01.473797+0000 mgr.y (mgr.14613) 1101 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:03 smithi062 bash[21479]: cluster 2024-02-13T15:13:02.781799+0000 mgr.y (mgr.14613) 1102 : cluster 0 pgmap v1558: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:04.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:03 smithi062 bash[28859]: cluster 2024-02-13T15:13:02.781799+0000 mgr.y (mgr.14613) 1102 : cluster 0 pgmap v1558: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:04.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:03 smithi111 bash[23388]: cluster 2024-02-13T15:13:02.781799+0000 mgr.y (mgr.14613) 1102 : cluster 0 pgmap v1558: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:06.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:05 smithi062 bash[21479]: cluster 2024-02-13T15:13:04.782684+0000 mgr.y (mgr.14613) 1103 : cluster 0 pgmap v1559: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:06.229 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:05 smithi062 bash[28859]: cluster 2024-02-13T15:13:04.782684+0000 mgr.y (mgr.14613) 1103 : cluster 0 pgmap v1559: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:05 smithi111 bash[23388]: cluster 2024-02-13T15:13:04.782684+0000 mgr.y (mgr.14613) 1103 : cluster 0 pgmap v1559: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:13:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:13:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:13:07.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:06 smithi062 bash[21479]: audit 2024-02-13T15:13:06.571264+0000 mon.b (mon.1) 350 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:06 smithi062 bash[28859]: audit 2024-02-13T15:13:06.571264+0000 mon.b (mon.1) 350 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:06 smithi111 bash[23388]: audit 2024-02-13T15:13:06.571264+0000 mon.b (mon.1) 350 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:08.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:07 smithi062 bash[21479]: cluster 2024-02-13T15:13:06.785187+0000 mgr.y (mgr.14613) 1104 : cluster 0 pgmap v1560: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:08.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:07 smithi062 bash[28859]: cluster 2024-02-13T15:13:06.785187+0000 mgr.y (mgr.14613) 1104 : cluster 0 pgmap v1560: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:08.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:07 smithi111 bash[23388]: cluster 2024-02-13T15:13:06.785187+0000 mgr.y (mgr.14613) 1104 : cluster 0 pgmap v1560: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:10.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:09 smithi062 bash[28859]: cluster 2024-02-13T15:13:08.786073+0000 mgr.y (mgr.14613) 1105 : cluster 0 pgmap v1561: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:10.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:09 smithi062 bash[21479]: cluster 2024-02-13T15:13:08.786073+0000 mgr.y (mgr.14613) 1105 : cluster 0 pgmap v1561: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:10.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:09 smithi111 bash[23388]: cluster 2024-02-13T15:13:08.786073+0000 mgr.y (mgr.14613) 1105 : cluster 0 pgmap v1561: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:11.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:10 smithi062 bash[21479]: audit 2024-02-13T15:13:10.069130+0000 mon.b (mon.1) 351 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:13:11.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:10 smithi062 bash[28859]: audit 2024-02-13T15:13:10.069130+0000 mon.b (mon.1) 351 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:13:11.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:10 smithi111 bash[23388]: audit 2024-02-13T15:13:10.069130+0000 mon.b (mon.1) 351 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:13:11.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:13:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:13:12.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:11 smithi062 bash[21479]: cluster 2024-02-13T15:13:10.788567+0000 mgr.y (mgr.14613) 1106 : cluster 0 pgmap v1562: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:12.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:11 smithi062 bash[21479]: audit 2024-02-13T15:13:11.485323+0000 mgr.y (mgr.14613) 1107 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:12.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:11 smithi062 bash[28859]: cluster 2024-02-13T15:13:10.788567+0000 mgr.y (mgr.14613) 1106 : cluster 0 pgmap v1562: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:12.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:11 smithi062 bash[28859]: audit 2024-02-13T15:13:11.485323+0000 mgr.y (mgr.14613) 1107 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:11 smithi111 bash[23388]: cluster 2024-02-13T15:13:10.788567+0000 mgr.y (mgr.14613) 1106 : cluster 0 pgmap v1562: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:11 smithi111 bash[23388]: audit 2024-02-13T15:13:11.485323+0000 mgr.y (mgr.14613) 1107 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:14.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:13 smithi062 bash[21479]: cluster 2024-02-13T15:13:12.789440+0000 mgr.y (mgr.14613) 1108 : cluster 0 pgmap v1563: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:14.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:13 smithi062 bash[28859]: cluster 2024-02-13T15:13:12.789440+0000 mgr.y (mgr.14613) 1108 : cluster 0 pgmap v1563: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:14.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:13 smithi111 bash[23388]: cluster 2024-02-13T15:13:12.789440+0000 mgr.y (mgr.14613) 1108 : cluster 0 pgmap v1563: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:16.095 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:15 smithi111 bash[23388]: cluster 2024-02-13T15:13:14.790386+0000 mgr.y (mgr.14613) 1109 : cluster 0 pgmap v1564: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:16.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:15 smithi062 bash[21479]: cluster 2024-02-13T15:13:14.790386+0000 mgr.y (mgr.14613) 1109 : cluster 0 pgmap v1564: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:16.228 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:15 smithi062 bash[28859]: cluster 2024-02-13T15:13:14.790386+0000 mgr.y (mgr.14613) 1109 : cluster 0 pgmap v1564: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:13:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:13:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:13:18.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:17 smithi111 bash[23388]: cluster 2024-02-13T15:13:16.792874+0000 mgr.y (mgr.14613) 1110 : cluster 0 pgmap v1565: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:18.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:17 smithi062 bash[21479]: cluster 2024-02-13T15:13:16.792874+0000 mgr.y (mgr.14613) 1110 : cluster 0 pgmap v1565: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:17 smithi062 bash[28859]: cluster 2024-02-13T15:13:16.792874+0000 mgr.y (mgr.14613) 1110 : cluster 0 pgmap v1565: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:20.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:20 smithi111 bash[23388]: cluster 2024-02-13T15:13:18.793722+0000 mgr.y (mgr.14613) 1111 : cluster 0 pgmap v1566: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:20.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:20 smithi062 bash[21479]: cluster 2024-02-13T15:13:18.793722+0000 mgr.y (mgr.14613) 1111 : cluster 0 pgmap v1566: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:20.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:20 smithi062 bash[28859]: cluster 2024-02-13T15:13:18.793722+0000 mgr.y (mgr.14613) 1111 : cluster 0 pgmap v1566: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[28859]: audit 2024-02-13T15:13:20.402715+0000 mon.a (mon.0) 3539 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[28859]: audit 2024-02-13T15:13:20.419271+0000 mon.a (mon.0) 3540 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[28859]: audit 2024-02-13T15:13:20.424219+0000 mon.b (mon.1) 352 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:13:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[28859]: audit 2024-02-13T15:13:20.426514+0000 mon.b (mon.1) 353 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:13:21.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[28859]: audit 2024-02-13T15:13:20.437262+0000 mon.a (mon.0) 3541 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:21.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[21479]: audit 2024-02-13T15:13:20.402715+0000 mon.a (mon.0) 3539 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:21.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[21479]: audit 2024-02-13T15:13:20.419271+0000 mon.a (mon.0) 3540 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:21.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[21479]: audit 2024-02-13T15:13:20.424219+0000 mon.b (mon.1) 352 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:13:21.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[21479]: audit 2024-02-13T15:13:20.426514+0000 mon.b (mon.1) 353 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:13:21.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:21 smithi062 bash[21479]: audit 2024-02-13T15:13:20.437262+0000 mon.a (mon.0) 3541 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:21.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:13:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:13:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:21 smithi111 bash[23388]: audit 2024-02-13T15:13:20.402715+0000 mon.a (mon.0) 3539 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:21.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:21 smithi111 bash[23388]: audit 2024-02-13T15:13:20.419271+0000 mon.a (mon.0) 3540 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:21.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:21 smithi111 bash[23388]: audit 2024-02-13T15:13:20.424219+0000 mon.b (mon.1) 352 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:13:21.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:21 smithi111 bash[23388]: audit 2024-02-13T15:13:20.426514+0000 mon.b (mon.1) 353 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:13:21.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:21 smithi111 bash[23388]: audit 2024-02-13T15:13:20.437262+0000 mon.a (mon.0) 3541 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:13:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:22 smithi062 bash[21479]: cluster 2024-02-13T15:13:20.796300+0000 mgr.y (mgr.14613) 1112 : cluster 0 pgmap v1567: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:22 smithi062 bash[21479]: audit 2024-02-13T15:13:21.489122+0000 mgr.y (mgr.14613) 1113 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:22.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:22 smithi062 bash[21479]: audit 2024-02-13T15:13:21.606167+0000 mon.b (mon.1) 354 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:22 smithi062 bash[28859]: cluster 2024-02-13T15:13:20.796300+0000 mgr.y (mgr.14613) 1112 : cluster 0 pgmap v1567: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:22 smithi062 bash[28859]: audit 2024-02-13T15:13:21.489122+0000 mgr.y (mgr.14613) 1113 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:22.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:22 smithi062 bash[28859]: audit 2024-02-13T15:13:21.606167+0000 mon.b (mon.1) 354 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:22 smithi111 bash[23388]: cluster 2024-02-13T15:13:20.796300+0000 mgr.y (mgr.14613) 1112 : cluster 0 pgmap v1567: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:22 smithi111 bash[23388]: audit 2024-02-13T15:13:21.489122+0000 mgr.y (mgr.14613) 1113 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:22.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:22 smithi111 bash[23388]: audit 2024-02-13T15:13:21.606167+0000 mon.b (mon.1) 354 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:24 smithi062 bash[21479]: cluster 2024-02-13T15:13:22.797318+0000 mgr.y (mgr.14613) 1114 : cluster 0 pgmap v1568: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:24 smithi062 bash[28859]: cluster 2024-02-13T15:13:22.797318+0000 mgr.y (mgr.14613) 1114 : cluster 0 pgmap v1568: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:24 smithi111 bash[23388]: cluster 2024-02-13T15:13:22.797318+0000 mgr.y (mgr.14613) 1114 : cluster 0 pgmap v1568: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:26.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:26 smithi062 bash[21479]: cluster 2024-02-13T15:13:24.798272+0000 mgr.y (mgr.14613) 1115 : cluster 0 pgmap v1569: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:13:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:13:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:13:26.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:26 smithi062 bash[28859]: cluster 2024-02-13T15:13:24.798272+0000 mgr.y (mgr.14613) 1115 : cluster 0 pgmap v1569: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:26.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:26 smithi111 bash[23388]: cluster 2024-02-13T15:13:24.798272+0000 mgr.y (mgr.14613) 1115 : cluster 0 pgmap v1569: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:28 smithi062 bash[28859]: cluster 2024-02-13T15:13:26.800792+0000 mgr.y (mgr.14613) 1116 : cluster 0 pgmap v1570: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:28 smithi062 bash[21479]: cluster 2024-02-13T15:13:26.800792+0000 mgr.y (mgr.14613) 1116 : cluster 0 pgmap v1570: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:28 smithi111 bash[23388]: cluster 2024-02-13T15:13:26.800792+0000 mgr.y (mgr.14613) 1116 : cluster 0 pgmap v1570: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:30 smithi062 bash[21479]: cluster 2024-02-13T15:13:28.801711+0000 mgr.y (mgr.14613) 1117 : cluster 0 pgmap v1571: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:30.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:30 smithi062 bash[28859]: cluster 2024-02-13T15:13:28.801711+0000 mgr.y (mgr.14613) 1117 : cluster 0 pgmap v1571: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:30.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:30 smithi111 bash[23388]: cluster 2024-02-13T15:13:28.801711+0000 mgr.y (mgr.14613) 1117 : cluster 0 pgmap v1571: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:31.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:13:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:13:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:32 smithi062 bash[21479]: cluster 2024-02-13T15:13:30.804165+0000 mgr.y (mgr.14613) 1118 : cluster 0 pgmap v1572: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:32 smithi062 bash[21479]: audit 2024-02-13T15:13:31.500522+0000 mgr.y (mgr.14613) 1119 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:32 smithi062 bash[28859]: cluster 2024-02-13T15:13:30.804165+0000 mgr.y (mgr.14613) 1118 : cluster 0 pgmap v1572: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:32 smithi062 bash[28859]: audit 2024-02-13T15:13:31.500522+0000 mgr.y (mgr.14613) 1119 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:32 smithi111 bash[23388]: cluster 2024-02-13T15:13:30.804165+0000 mgr.y (mgr.14613) 1118 : cluster 0 pgmap v1572: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:32 smithi111 bash[23388]: audit 2024-02-13T15:13:31.500522+0000 mgr.y (mgr.14613) 1119 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:34.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:34 smithi062 bash[28859]: cluster 2024-02-13T15:13:32.805032+0000 mgr.y (mgr.14613) 1120 : cluster 0 pgmap v1573: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:34 smithi062 bash[21479]: cluster 2024-02-13T15:13:32.805032+0000 mgr.y (mgr.14613) 1120 : cluster 0 pgmap v1573: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:34 smithi111 bash[23388]: cluster 2024-02-13T15:13:32.805032+0000 mgr.y (mgr.14613) 1120 : cluster 0 pgmap v1573: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:13:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:13:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:13:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:36 smithi062 bash[28859]: cluster 2024-02-13T15:13:34.805877+0000 mgr.y (mgr.14613) 1121 : cluster 0 pgmap v1574: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:36.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:36 smithi062 bash[21479]: cluster 2024-02-13T15:13:34.805877+0000 mgr.y (mgr.14613) 1121 : cluster 0 pgmap v1574: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:36 smithi111 bash[23388]: cluster 2024-02-13T15:13:34.805877+0000 mgr.y (mgr.14613) 1121 : cluster 0 pgmap v1574: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:37 smithi062 bash[21479]: audit 2024-02-13T15:13:36.641799+0000 mon.b (mon.1) 355 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:37.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:37 smithi062 bash[28859]: audit 2024-02-13T15:13:36.641799+0000 mon.b (mon.1) 355 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:37 smithi111 bash[23388]: audit 2024-02-13T15:13:36.641799+0000 mon.b (mon.1) 355 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:38 smithi062 bash[28859]: cluster 2024-02-13T15:13:36.808348+0000 mgr.y (mgr.14613) 1122 : cluster 0 pgmap v1575: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:38 smithi062 bash[21479]: cluster 2024-02-13T15:13:36.808348+0000 mgr.y (mgr.14613) 1122 : cluster 0 pgmap v1575: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:38 smithi111 bash[23388]: cluster 2024-02-13T15:13:36.808348+0000 mgr.y (mgr.14613) 1122 : cluster 0 pgmap v1575: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:40 smithi062 bash[28859]: cluster 2024-02-13T15:13:38.809240+0000 mgr.y (mgr.14613) 1123 : cluster 0 pgmap v1576: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:40 smithi062 bash[21479]: cluster 2024-02-13T15:13:38.809240+0000 mgr.y (mgr.14613) 1123 : cluster 0 pgmap v1576: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:40 smithi111 bash[23388]: cluster 2024-02-13T15:13:38.809240+0000 mgr.y (mgr.14613) 1123 : cluster 0 pgmap v1576: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:41.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:13:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:13:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:42 smithi062 bash[21479]: cluster 2024-02-13T15:13:40.811788+0000 mgr.y (mgr.14613) 1124 : cluster 0 pgmap v1577: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:42 smithi062 bash[21479]: audit 2024-02-13T15:13:41.502318+0000 mgr.y (mgr.14613) 1125 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:42 smithi062 bash[28859]: cluster 2024-02-13T15:13:40.811788+0000 mgr.y (mgr.14613) 1124 : cluster 0 pgmap v1577: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:42 smithi062 bash[28859]: audit 2024-02-13T15:13:41.502318+0000 mgr.y (mgr.14613) 1125 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:42 smithi111 bash[23388]: cluster 2024-02-13T15:13:40.811788+0000 mgr.y (mgr.14613) 1124 : cluster 0 pgmap v1577: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:13:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:42 smithi111 bash[23388]: audit 2024-02-13T15:13:41.502318+0000 mgr.y (mgr.14613) 1125 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:44 smithi062 bash[21479]: cluster 2024-02-13T15:13:42.812788+0000 mgr.y (mgr.14613) 1126 : cluster 0 pgmap v1578: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:44 smithi062 bash[28859]: cluster 2024-02-13T15:13:42.812788+0000 mgr.y (mgr.14613) 1126 : cluster 0 pgmap v1578: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:44 smithi111 bash[23388]: cluster 2024-02-13T15:13:42.812788+0000 mgr.y (mgr.14613) 1126 : cluster 0 pgmap v1578: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:46.501 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:13:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:13:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:13:46.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:46 smithi062 bash[21479]: cluster 2024-02-13T15:13:44.813612+0000 mgr.y (mgr.14613) 1127 : cluster 0 pgmap v1579: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:46 smithi062 bash[28859]: cluster 2024-02-13T15:13:44.813612+0000 mgr.y (mgr.14613) 1127 : cluster 0 pgmap v1579: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:46 smithi111 bash[23388]: cluster 2024-02-13T15:13:44.813612+0000 mgr.y (mgr.14613) 1127 : cluster 0 pgmap v1579: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:13:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:48 smithi062 bash[21479]: cluster 2024-02-13T15:13:46.816137+0000 mgr.y (mgr.14613) 1128 : cluster 0 pgmap v1580: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:48 smithi062 bash[28859]: cluster 2024-02-13T15:13:46.816137+0000 mgr.y (mgr.14613) 1128 : cluster 0 pgmap v1580: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:48 smithi111 bash[23388]: cluster 2024-02-13T15:13:46.816137+0000 mgr.y (mgr.14613) 1128 : cluster 0 pgmap v1580: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:50 smithi062 bash[21479]: cluster 2024-02-13T15:13:48.817029+0000 mgr.y (mgr.14613) 1129 : cluster 0 pgmap v1581: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:50 smithi062 bash[28859]: cluster 2024-02-13T15:13:48.817029+0000 mgr.y (mgr.14613) 1129 : cluster 0 pgmap v1581: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:50 smithi111 bash[23388]: cluster 2024-02-13T15:13:48.817029+0000 mgr.y (mgr.14613) 1129 : cluster 0 pgmap v1581: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:51.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:13:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:13:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:52 smithi062 bash[28859]: cluster 2024-02-13T15:13:50.819500+0000 mgr.y (mgr.14613) 1130 : cluster 0 pgmap v1582: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:52 smithi062 bash[28859]: audit 2024-02-13T15:13:51.513755+0000 mgr.y (mgr.14613) 1131 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:52 smithi062 bash[28859]: audit 2024-02-13T15:13:51.676248+0000 mon.b (mon.1) 356 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:52 smithi062 bash[21479]: cluster 2024-02-13T15:13:50.819500+0000 mgr.y (mgr.14613) 1130 : cluster 0 pgmap v1582: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:52 smithi062 bash[21479]: audit 2024-02-13T15:13:51.513755+0000 mgr.y (mgr.14613) 1131 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:52 smithi062 bash[21479]: audit 2024-02-13T15:13:51.676248+0000 mon.b (mon.1) 356 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:52 smithi111 bash[23388]: cluster 2024-02-13T15:13:50.819500+0000 mgr.y (mgr.14613) 1130 : cluster 0 pgmap v1582: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:52 smithi111 bash[23388]: audit 2024-02-13T15:13:51.513755+0000 mgr.y (mgr.14613) 1131 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:13:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:52 smithi111 bash[23388]: audit 2024-02-13T15:13:51.676248+0000 mon.b (mon.1) 356 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:13:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:54 smithi062 bash[28859]: cluster 2024-02-13T15:13:52.820404+0000 mgr.y (mgr.14613) 1132 : cluster 0 pgmap v1583: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:54 smithi062 bash[21479]: cluster 2024-02-13T15:13:52.820404+0000 mgr.y (mgr.14613) 1132 : cluster 0 pgmap v1583: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:54 smithi111 bash[23388]: cluster 2024-02-13T15:13:52.820404+0000 mgr.y (mgr.14613) 1132 : cluster 0 pgmap v1583: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:56.523 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:13:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:13:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:13:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:56 smithi062 bash[28859]: cluster 2024-02-13T15:13:54.821317+0000 mgr.y (mgr.14613) 1133 : cluster 0 pgmap v1584: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:56.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:56 smithi062 bash[21479]: cluster 2024-02-13T15:13:54.821317+0000 mgr.y (mgr.14613) 1133 : cluster 0 pgmap v1584: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:56.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:56 smithi111 bash[23388]: cluster 2024-02-13T15:13:54.821317+0000 mgr.y (mgr.14613) 1133 : cluster 0 pgmap v1584: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:13:58 smithi062 bash[21479]: cluster 2024-02-13T15:13:56.823875+0000 mgr.y (mgr.14613) 1134 : cluster 0 pgmap v1585: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:58.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:13:58 smithi062 bash[28859]: cluster 2024-02-13T15:13:56.823875+0000 mgr.y (mgr.14613) 1134 : cluster 0 pgmap v1585: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:13:58.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:13:58 smithi111 bash[23388]: cluster 2024-02-13T15:13:56.823875+0000 mgr.y (mgr.14613) 1134 : cluster 0 pgmap v1585: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-02-13T15:14:00.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:00 smithi062 bash[21479]: cluster 2024-02-13T15:13:58.824734+0000 mgr.y (mgr.14613) 1135 : cluster 0 pgmap v1586: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:00.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:00 smithi062 bash[28859]: cluster 2024-02-13T15:13:58.824734+0000 mgr.y (mgr.14613) 1135 : cluster 0 pgmap v1586: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:00 smithi111 bash[23388]: cluster 2024-02-13T15:13:58.824734+0000 mgr.y (mgr.14613) 1135 : cluster 0 pgmap v1586: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:01.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:14:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:14:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:02 smithi062 bash[21479]: cluster 2024-02-13T15:14:00.827339+0000 mgr.y (mgr.14613) 1136 : cluster 0 pgmap v1587: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:02.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:02 smithi062 bash[21479]: audit 2024-02-13T15:14:01.520226+0000 mgr.y (mgr.14613) 1137 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:02 smithi062 bash[28859]: cluster 2024-02-13T15:14:00.827339+0000 mgr.y (mgr.14613) 1136 : cluster 0 pgmap v1587: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:02.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:02 smithi062 bash[28859]: audit 2024-02-13T15:14:01.520226+0000 mgr.y (mgr.14613) 1137 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:02 smithi111 bash[23388]: cluster 2024-02-13T15:14:00.827339+0000 mgr.y (mgr.14613) 1136 : cluster 0 pgmap v1587: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:02.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:02 smithi111 bash[23388]: audit 2024-02-13T15:14:01.520226+0000 mgr.y (mgr.14613) 1137 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:04.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:04 smithi062 bash[28859]: cluster 2024-02-13T15:14:02.828228+0000 mgr.y (mgr.14613) 1138 : cluster 0 pgmap v1588: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:04.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:04 smithi062 bash[21479]: cluster 2024-02-13T15:14:02.828228+0000 mgr.y (mgr.14613) 1138 : cluster 0 pgmap v1588: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:04.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:04 smithi111 bash[23388]: cluster 2024-02-13T15:14:02.828228+0000 mgr.y (mgr.14613) 1138 : cluster 0 pgmap v1588: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:06.543 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:14:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:14:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:14:06.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:06 smithi062 bash[21479]: cluster 2024-02-13T15:14:04.829110+0000 mgr.y (mgr.14613) 1139 : cluster 0 pgmap v1589: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:06.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:06 smithi062 bash[28859]: cluster 2024-02-13T15:14:04.829110+0000 mgr.y (mgr.14613) 1139 : cluster 0 pgmap v1589: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:06 smithi111 bash[23388]: cluster 2024-02-13T15:14:04.829110+0000 mgr.y (mgr.14613) 1139 : cluster 0 pgmap v1589: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:07.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:07 smithi062 bash[21479]: audit 2024-02-13T15:14:06.710547+0000 mon.b (mon.1) 357 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:07.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:07 smithi062 bash[28859]: audit 2024-02-13T15:14:06.710547+0000 mon.b (mon.1) 357 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:07.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:07 smithi111 bash[23388]: audit 2024-02-13T15:14:06.710547+0000 mon.b (mon.1) 357 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:08.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:08 smithi062 bash[21479]: cluster 2024-02-13T15:14:06.831594+0000 mgr.y (mgr.14613) 1140 : cluster 0 pgmap v1590: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:08.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:08 smithi062 bash[28859]: cluster 2024-02-13T15:14:06.831594+0000 mgr.y (mgr.14613) 1140 : cluster 0 pgmap v1590: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:08.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:08 smithi111 bash[23388]: cluster 2024-02-13T15:14:06.831594+0000 mgr.y (mgr.14613) 1140 : cluster 0 pgmap v1590: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:10.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:10 smithi062 bash[21479]: cluster 2024-02-13T15:14:08.832457+0000 mgr.y (mgr.14613) 1141 : cluster 0 pgmap v1591: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:10.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:10 smithi062 bash[28859]: cluster 2024-02-13T15:14:08.832457+0000 mgr.y (mgr.14613) 1141 : cluster 0 pgmap v1591: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:10.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:10 smithi111 bash[23388]: cluster 2024-02-13T15:14:08.832457+0000 mgr.y (mgr.14613) 1141 : cluster 0 pgmap v1591: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:11.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:14:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:14:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:12 smithi111 bash[23388]: cluster 2024-02-13T15:14:10.834921+0000 mgr.y (mgr.14613) 1142 : cluster 0 pgmap v1592: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:12.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:12 smithi111 bash[23388]: audit 2024-02-13T15:14:11.531690+0000 mgr.y (mgr.14613) 1143 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:13.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:12 smithi062 bash[21479]: cluster 2024-02-13T15:14:10.834921+0000 mgr.y (mgr.14613) 1142 : cluster 0 pgmap v1592: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:13.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:12 smithi062 bash[21479]: audit 2024-02-13T15:14:11.531690+0000 mgr.y (mgr.14613) 1143 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:13.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:12 smithi062 bash[28859]: cluster 2024-02-13T15:14:10.834921+0000 mgr.y (mgr.14613) 1142 : cluster 0 pgmap v1592: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:13.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:12 smithi062 bash[28859]: audit 2024-02-13T15:14:11.531690+0000 mgr.y (mgr.14613) 1143 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:14.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:14 smithi111 bash[23388]: cluster 2024-02-13T15:14:12.835808+0000 mgr.y (mgr.14613) 1144 : cluster 0 pgmap v1593: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:14 smithi062 bash[21479]: cluster 2024-02-13T15:14:12.835808+0000 mgr.y (mgr.14613) 1144 : cluster 0 pgmap v1593: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:14 smithi062 bash[28859]: cluster 2024-02-13T15:14:12.835808+0000 mgr.y (mgr.14613) 1144 : cluster 0 pgmap v1593: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:14:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:14:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:14:16.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:16 smithi111 bash[23388]: cluster 2024-02-13T15:14:14.836700+0000 mgr.y (mgr.14613) 1145 : cluster 0 pgmap v1594: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:17.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:16 smithi062 bash[28859]: cluster 2024-02-13T15:14:14.836700+0000 mgr.y (mgr.14613) 1145 : cluster 0 pgmap v1594: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:17.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:16 smithi062 bash[21479]: cluster 2024-02-13T15:14:14.836700+0000 mgr.y (mgr.14613) 1145 : cluster 0 pgmap v1594: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:18.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:18 smithi111 bash[23388]: cluster 2024-02-13T15:14:16.839225+0000 mgr.y (mgr.14613) 1146 : cluster 0 pgmap v1595: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:19.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:18 smithi062 bash[28859]: cluster 2024-02-13T15:14:16.839225+0000 mgr.y (mgr.14613) 1146 : cluster 0 pgmap v1595: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:19.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:18 smithi062 bash[21479]: cluster 2024-02-13T15:14:16.839225+0000 mgr.y (mgr.14613) 1146 : cluster 0 pgmap v1595: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:20 smithi111 bash[23388]: cluster 2024-02-13T15:14:18.840096+0000 mgr.y (mgr.14613) 1147 : cluster 0 pgmap v1596: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:20.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:20 smithi111 bash[23388]: audit 2024-02-13T15:14:20.533497+0000 mon.b (mon.1) 358 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:14:21.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:20 smithi062 bash[28859]: cluster 2024-02-13T15:14:18.840096+0000 mgr.y (mgr.14613) 1147 : cluster 0 pgmap v1596: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:21.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:20 smithi062 bash[28859]: audit 2024-02-13T15:14:20.533497+0000 mon.b (mon.1) 358 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:14:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:20 smithi062 bash[21479]: cluster 2024-02-13T15:14:18.840096+0000 mgr.y (mgr.14613) 1147 : cluster 0 pgmap v1596: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:21.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:20 smithi062 bash[21479]: audit 2024-02-13T15:14:20.533497+0000 mon.b (mon.1) 358 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:14:21.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:14:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:14:21.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:21 smithi111 bash[23388]: audit 2024-02-13T15:14:21.262963+0000 mon.b (mon.1) 359 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:14:21.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:21 smithi111 bash[23388]: audit 2024-02-13T15:14:21.264866+0000 mon.b (mon.1) 360 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:14:21.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:21 smithi111 bash[23388]: audit 2024-02-13T15:14:21.275557+0000 mon.a (mon.0) 3542 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:14:22.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:21 smithi062 bash[21479]: audit 2024-02-13T15:14:21.262963+0000 mon.b (mon.1) 359 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:14:22.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:21 smithi062 bash[21479]: audit 2024-02-13T15:14:21.264866+0000 mon.b (mon.1) 360 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:14:22.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:21 smithi062 bash[21479]: audit 2024-02-13T15:14:21.275557+0000 mon.a (mon.0) 3542 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:14:22.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:21 smithi062 bash[28859]: audit 2024-02-13T15:14:21.262963+0000 mon.b (mon.1) 359 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:14:22.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:21 smithi062 bash[28859]: audit 2024-02-13T15:14:21.264866+0000 mon.b (mon.1) 360 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:14:22.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:21 smithi062 bash[28859]: audit 2024-02-13T15:14:21.275557+0000 mon.a (mon.0) 3542 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:14:23.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:22 smithi062 bash[28859]: cluster 2024-02-13T15:14:20.841667+0000 mgr.y (mgr.14613) 1148 : cluster 0 pgmap v1597: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:23.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:22 smithi062 bash[28859]: audit 2024-02-13T15:14:21.543117+0000 mgr.y (mgr.14613) 1149 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:23.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:22 smithi062 bash[28859]: audit 2024-02-13T15:14:21.745188+0000 mon.b (mon.1) 361 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:22 smithi062 bash[21479]: cluster 2024-02-13T15:14:20.841667+0000 mgr.y (mgr.14613) 1148 : cluster 0 pgmap v1597: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:22 smithi062 bash[21479]: audit 2024-02-13T15:14:21.543117+0000 mgr.y (mgr.14613) 1149 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:23.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:22 smithi062 bash[21479]: audit 2024-02-13T15:14:21.745188+0000 mon.b (mon.1) 361 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:22 smithi111 bash[23388]: cluster 2024-02-13T15:14:20.841667+0000 mgr.y (mgr.14613) 1148 : cluster 0 pgmap v1597: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:22 smithi111 bash[23388]: audit 2024-02-13T15:14:21.543117+0000 mgr.y (mgr.14613) 1149 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:23.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:22 smithi111 bash[23388]: audit 2024-02-13T15:14:21.745188+0000 mon.b (mon.1) 361 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:25.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:24 smithi062 bash[28859]: cluster 2024-02-13T15:14:22.842655+0000 mgr.y (mgr.14613) 1150 : cluster 0 pgmap v1598: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:25.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:24 smithi062 bash[21479]: cluster 2024-02-13T15:14:22.842655+0000 mgr.y (mgr.14613) 1150 : cluster 0 pgmap v1598: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:25.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:24 smithi111 bash[23388]: cluster 2024-02-13T15:14:22.842655+0000 mgr.y (mgr.14613) 1150 : cluster 0 pgmap v1598: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:14:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:14:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:14:27.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:26 smithi062 bash[21479]: cluster 2024-02-13T15:14:24.843495+0000 mgr.y (mgr.14613) 1151 : cluster 0 pgmap v1599: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:27.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:26 smithi062 bash[28859]: cluster 2024-02-13T15:14:24.843495+0000 mgr.y (mgr.14613) 1151 : cluster 0 pgmap v1599: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:27.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:26 smithi111 bash[23388]: cluster 2024-02-13T15:14:24.843495+0000 mgr.y (mgr.14613) 1151 : cluster 0 pgmap v1599: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:29.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:28 smithi062 bash[21479]: cluster 2024-02-13T15:14:26.846129+0000 mgr.y (mgr.14613) 1152 : cluster 0 pgmap v1600: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:28 smithi062 bash[28859]: cluster 2024-02-13T15:14:26.846129+0000 mgr.y (mgr.14613) 1152 : cluster 0 pgmap v1600: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:29.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:28 smithi111 bash[23388]: cluster 2024-02-13T15:14:26.846129+0000 mgr.y (mgr.14613) 1152 : cluster 0 pgmap v1600: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:31.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:30 smithi062 bash[21479]: cluster 2024-02-13T15:14:28.847035+0000 mgr.y (mgr.14613) 1153 : cluster 0 pgmap v1601: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:30 smithi062 bash[28859]: cluster 2024-02-13T15:14:28.847035+0000 mgr.y (mgr.14613) 1153 : cluster 0 pgmap v1601: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:31.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:30 smithi111 bash[23388]: cluster 2024-02-13T15:14:28.847035+0000 mgr.y (mgr.14613) 1153 : cluster 0 pgmap v1601: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:31.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:14:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:14:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:32 smithi062 bash[21479]: cluster 2024-02-13T15:14:30.849534+0000 mgr.y (mgr.14613) 1154 : cluster 0 pgmap v1602: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:32 smithi062 bash[21479]: audit 2024-02-13T15:14:31.544858+0000 mgr.y (mgr.14613) 1155 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:32 smithi062 bash[28859]: cluster 2024-02-13T15:14:30.849534+0000 mgr.y (mgr.14613) 1154 : cluster 0 pgmap v1602: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:32 smithi062 bash[28859]: audit 2024-02-13T15:14:31.544858+0000 mgr.y (mgr.14613) 1155 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:32 smithi111 bash[23388]: cluster 2024-02-13T15:14:30.849534+0000 mgr.y (mgr.14613) 1154 : cluster 0 pgmap v1602: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:33.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:32 smithi111 bash[23388]: audit 2024-02-13T15:14:31.544858+0000 mgr.y (mgr.14613) 1155 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:33 smithi062 bash[21479]: cluster 2024-02-13T15:14:32.850427+0000 mgr.y (mgr.14613) 1156 : cluster 0 pgmap v1603: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:33 smithi062 bash[28859]: cluster 2024-02-13T15:14:32.850427+0000 mgr.y (mgr.14613) 1156 : cluster 0 pgmap v1603: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:34.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:33 smithi111 bash[23388]: cluster 2024-02-13T15:14:32.850427+0000 mgr.y (mgr.14613) 1156 : cluster 0 pgmap v1603: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:36.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:35 smithi062 bash[28859]: cluster 2024-02-13T15:14:34.852881+0000 mgr.y (mgr.14613) 1157 : cluster 0 pgmap v1604: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:36.228 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:35 smithi062 bash[21479]: cluster 2024-02-13T15:14:34.852881+0000 mgr.y (mgr.14613) 1157 : cluster 0 pgmap v1604: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:35 smithi111 bash[23388]: cluster 2024-02-13T15:14:34.852881+0000 mgr.y (mgr.14613) 1157 : cluster 0 pgmap v1604: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:36.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:14:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:14:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:14:37.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:36 smithi062 bash[21479]: audit 2024-02-13T15:14:36.780173+0000 mon.b (mon.1) 362 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:37.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:36 smithi062 bash[28859]: audit 2024-02-13T15:14:36.780173+0000 mon.b (mon.1) 362 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:36 smithi111 bash[23388]: audit 2024-02-13T15:14:36.780173+0000 mon.b (mon.1) 362 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:38.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:37 smithi062 bash[21479]: cluster 2024-02-13T15:14:36.853738+0000 mgr.y (mgr.14613) 1158 : cluster 0 pgmap v1605: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:38.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:37 smithi062 bash[28859]: cluster 2024-02-13T15:14:36.853738+0000 mgr.y (mgr.14613) 1158 : cluster 0 pgmap v1605: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:37 smithi111 bash[23388]: cluster 2024-02-13T15:14:36.853738+0000 mgr.y (mgr.14613) 1158 : cluster 0 pgmap v1605: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:40.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:39 smithi062 bash[21479]: cluster 2024-02-13T15:14:38.854777+0000 mgr.y (mgr.14613) 1159 : cluster 0 pgmap v1606: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:40.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:39 smithi062 bash[28859]: cluster 2024-02-13T15:14:38.854777+0000 mgr.y (mgr.14613) 1159 : cluster 0 pgmap v1606: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:39 smithi111 bash[23388]: cluster 2024-02-13T15:14:38.854777+0000 mgr.y (mgr.14613) 1159 : cluster 0 pgmap v1606: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:41.845 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:14:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:14:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:41 smithi062 bash[28859]: cluster 2024-02-13T15:14:40.857273+0000 mgr.y (mgr.14613) 1160 : cluster 0 pgmap v1607: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:42.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:41 smithi062 bash[28859]: audit 2024-02-13T15:14:41.556285+0000 mgr.y (mgr.14613) 1161 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:42.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:41 smithi062 bash[21479]: cluster 2024-02-13T15:14:40.857273+0000 mgr.y (mgr.14613) 1160 : cluster 0 pgmap v1607: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:42.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:41 smithi062 bash[21479]: audit 2024-02-13T15:14:41.556285+0000 mgr.y (mgr.14613) 1161 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:41 smithi111 bash[23388]: cluster 2024-02-13T15:14:40.857273+0000 mgr.y (mgr.14613) 1160 : cluster 0 pgmap v1607: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:41 smithi111 bash[23388]: audit 2024-02-13T15:14:41.556285+0000 mgr.y (mgr.14613) 1161 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:44.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:43 smithi062 bash[21479]: cluster 2024-02-13T15:14:42.858163+0000 mgr.y (mgr.14613) 1162 : cluster 0 pgmap v1608: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:44.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:43 smithi062 bash[28859]: cluster 2024-02-13T15:14:42.858163+0000 mgr.y (mgr.14613) 1162 : cluster 0 pgmap v1608: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:44.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:43 smithi111 bash[23388]: cluster 2024-02-13T15:14:42.858163+0000 mgr.y (mgr.14613) 1162 : cluster 0 pgmap v1608: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:46.226 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:45 smithi062 bash[21479]: cluster 2024-02-13T15:14:44.860773+0000 mgr.y (mgr.14613) 1163 : cluster 0 pgmap v1609: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:46.226 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:45 smithi062 bash[28859]: cluster 2024-02-13T15:14:44.860773+0000 mgr.y (mgr.14613) 1163 : cluster 0 pgmap v1609: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:46.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:45 smithi111 bash[23388]: cluster 2024-02-13T15:14:44.860773+0000 mgr.y (mgr.14613) 1163 : cluster 0 pgmap v1609: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:46.561 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:14:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:14:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:14:48.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:47 smithi062 bash[28859]: cluster 2024-02-13T15:14:46.861795+0000 mgr.y (mgr.14613) 1164 : cluster 0 pgmap v1610: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:48.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:47 smithi062 bash[21479]: cluster 2024-02-13T15:14:46.861795+0000 mgr.y (mgr.14613) 1164 : cluster 0 pgmap v1610: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:48.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:47 smithi111 bash[23388]: cluster 2024-02-13T15:14:46.861795+0000 mgr.y (mgr.14613) 1164 : cluster 0 pgmap v1610: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:50.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:49 smithi062 bash[21479]: cluster 2024-02-13T15:14:48.862720+0000 mgr.y (mgr.14613) 1165 : cluster 0 pgmap v1611: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:50.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:49 smithi062 bash[28859]: cluster 2024-02-13T15:14:48.862720+0000 mgr.y (mgr.14613) 1165 : cluster 0 pgmap v1611: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:50.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:49 smithi111 bash[23388]: cluster 2024-02-13T15:14:48.862720+0000 mgr.y (mgr.14613) 1165 : cluster 0 pgmap v1611: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:51.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:14:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:14:52.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:51 smithi062 bash[28859]: cluster 2024-02-13T15:14:50.865166+0000 mgr.y (mgr.14613) 1166 : cluster 0 pgmap v1612: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:52.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:51 smithi062 bash[28859]: audit 2024-02-13T15:14:51.567714+0000 mgr.y (mgr.14613) 1167 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:52.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:51 smithi062 bash[28859]: audit 2024-02-13T15:14:51.815868+0000 mon.b (mon.1) 363 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:52.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:51 smithi062 bash[21479]: cluster 2024-02-13T15:14:50.865166+0000 mgr.y (mgr.14613) 1166 : cluster 0 pgmap v1612: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:51 smithi062 bash[21479]: audit 2024-02-13T15:14:51.567714+0000 mgr.y (mgr.14613) 1167 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:52.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:51 smithi062 bash[21479]: audit 2024-02-13T15:14:51.815868+0000 mon.b (mon.1) 363 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:51 smithi111 bash[23388]: cluster 2024-02-13T15:14:50.865166+0000 mgr.y (mgr.14613) 1166 : cluster 0 pgmap v1612: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:51 smithi111 bash[23388]: audit 2024-02-13T15:14:51.567714+0000 mgr.y (mgr.14613) 1167 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:14:52.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:51 smithi111 bash[23388]: audit 2024-02-13T15:14:51.815868+0000 mon.b (mon.1) 363 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:14:54.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:53 smithi062 bash[28859]: cluster 2024-02-13T15:14:52.866031+0000 mgr.y (mgr.14613) 1168 : cluster 0 pgmap v1613: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:54.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:53 smithi062 bash[21479]: cluster 2024-02-13T15:14:52.866031+0000 mgr.y (mgr.14613) 1168 : cluster 0 pgmap v1613: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:54.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:53 smithi111 bash[23388]: cluster 2024-02-13T15:14:52.866031+0000 mgr.y (mgr.14613) 1168 : cluster 0 pgmap v1613: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:56.227 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:55 smithi062 bash[21479]: cluster 2024-02-13T15:14:54.868496+0000 mgr.y (mgr.14613) 1169 : cluster 0 pgmap v1614: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:56.227 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:55 smithi062 bash[28859]: cluster 2024-02-13T15:14:54.868496+0000 mgr.y (mgr.14613) 1169 : cluster 0 pgmap v1614: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:56.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:55 smithi111 bash[23388]: cluster 2024-02-13T15:14:54.868496+0000 mgr.y (mgr.14613) 1169 : cluster 0 pgmap v1614: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:14:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:14:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:14:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:14:58.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:57 smithi062 bash[28859]: cluster 2024-02-13T15:14:56.869386+0000 mgr.y (mgr.14613) 1170 : cluster 0 pgmap v1615: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:58.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:57 smithi062 bash[21479]: cluster 2024-02-13T15:14:56.869386+0000 mgr.y (mgr.14613) 1170 : cluster 0 pgmap v1615: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:14:58.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:57 smithi111 bash[23388]: cluster 2024-02-13T15:14:56.869386+0000 mgr.y (mgr.14613) 1170 : cluster 0 pgmap v1615: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:00.311 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:14:59 smithi062 bash[21479]: cluster 2024-02-13T15:14:58.870272+0000 mgr.y (mgr.14613) 1171 : cluster 0 pgmap v1616: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:00.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:14:59 smithi062 bash[28859]: cluster 2024-02-13T15:14:58.870272+0000 mgr.y (mgr.14613) 1171 : cluster 0 pgmap v1616: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:00.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:14:59 smithi111 bash[23388]: cluster 2024-02-13T15:14:58.870272+0000 mgr.y (mgr.14613) 1171 : cluster 0 pgmap v1616: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:01.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:15:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:15:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:01 smithi062 bash[21479]: cluster 2024-02-13T15:15:00.872884+0000 mgr.y (mgr.14613) 1172 : cluster 0 pgmap v1617: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:01 smithi062 bash[21479]: audit 2024-02-13T15:15:01.579068+0000 mgr.y (mgr.14613) 1173 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:01 smithi062 bash[28859]: cluster 2024-02-13T15:15:00.872884+0000 mgr.y (mgr.14613) 1172 : cluster 0 pgmap v1617: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:01 smithi062 bash[28859]: audit 2024-02-13T15:15:01.579068+0000 mgr.y (mgr.14613) 1173 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:01 smithi111 bash[23388]: cluster 2024-02-13T15:15:00.872884+0000 mgr.y (mgr.14613) 1172 : cluster 0 pgmap v1617: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:02.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:01 smithi111 bash[23388]: audit 2024-02-13T15:15:01.579068+0000 mgr.y (mgr.14613) 1173 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:03 smithi062 bash[21479]: cluster 2024-02-13T15:15:02.873841+0000 mgr.y (mgr.14613) 1174 : cluster 0 pgmap v1618: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:04.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:03 smithi062 bash[28859]: cluster 2024-02-13T15:15:02.873841+0000 mgr.y (mgr.14613) 1174 : cluster 0 pgmap v1618: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:04.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:03 smithi111 bash[23388]: cluster 2024-02-13T15:15:02.873841+0000 mgr.y (mgr.14613) 1174 : cluster 0 pgmap v1618: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:06.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:15:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:15:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:15:06.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:05 smithi062 bash[28859]: cluster 2024-02-13T15:15:04.876336+0000 mgr.y (mgr.14613) 1175 : cluster 0 pgmap v1619: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:06.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:05 smithi062 bash[21479]: cluster 2024-02-13T15:15:04.876336+0000 mgr.y (mgr.14613) 1175 : cluster 0 pgmap v1619: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:06.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:05 smithi111 bash[23388]: cluster 2024-02-13T15:15:04.876336+0000 mgr.y (mgr.14613) 1175 : cluster 0 pgmap v1619: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:07.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:06 smithi062 bash[21479]: audit 2024-02-13T15:15:06.851097+0000 mon.b (mon.1) 364 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:07.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:06 smithi062 bash[28859]: audit 2024-02-13T15:15:06.851097+0000 mon.b (mon.1) 364 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:07.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:06 smithi111 bash[23388]: audit 2024-02-13T15:15:06.851097+0000 mon.b (mon.1) 364 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:08.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:07 smithi062 bash[28859]: cluster 2024-02-13T15:15:06.877169+0000 mgr.y (mgr.14613) 1176 : cluster 0 pgmap v1620: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:08.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:07 smithi062 bash[21479]: cluster 2024-02-13T15:15:06.877169+0000 mgr.y (mgr.14613) 1176 : cluster 0 pgmap v1620: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:08.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:07 smithi111 bash[23388]: cluster 2024-02-13T15:15:06.877169+0000 mgr.y (mgr.14613) 1176 : cluster 0 pgmap v1620: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:10.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:10 smithi062 bash[28859]: cluster 2024-02-13T15:15:08.878066+0000 mgr.y (mgr.14613) 1177 : cluster 0 pgmap v1621: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:10.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:10 smithi062 bash[21479]: cluster 2024-02-13T15:15:08.878066+0000 mgr.y (mgr.14613) 1177 : cluster 0 pgmap v1621: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:10.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:10 smithi111 bash[23388]: cluster 2024-02-13T15:15:08.878066+0000 mgr.y (mgr.14613) 1177 : cluster 0 pgmap v1621: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:11.847 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:15:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:15:12.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:12 smithi062 bash[21479]: cluster 2024-02-13T15:15:10.880666+0000 mgr.y (mgr.14613) 1178 : cluster 0 pgmap v1622: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:12.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:12 smithi062 bash[21479]: audit 2024-02-13T15:15:11.582438+0000 mgr.y (mgr.14613) 1179 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:12.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:12 smithi062 bash[28859]: cluster 2024-02-13T15:15:10.880666+0000 mgr.y (mgr.14613) 1178 : cluster 0 pgmap v1622: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:12.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:12 smithi062 bash[28859]: audit 2024-02-13T15:15:11.582438+0000 mgr.y (mgr.14613) 1179 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:12 smithi111 bash[23388]: cluster 2024-02-13T15:15:10.880666+0000 mgr.y (mgr.14613) 1178 : cluster 0 pgmap v1622: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:12 smithi111 bash[23388]: audit 2024-02-13T15:15:11.582438+0000 mgr.y (mgr.14613) 1179 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:14.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:14 smithi062 bash[21479]: cluster 2024-02-13T15:15:12.881549+0000 mgr.y (mgr.14613) 1180 : cluster 0 pgmap v1623: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:14.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:14 smithi062 bash[28859]: cluster 2024-02-13T15:15:12.881549+0000 mgr.y (mgr.14613) 1180 : cluster 0 pgmap v1623: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:14.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:14 smithi111 bash[23388]: cluster 2024-02-13T15:15:12.881549+0000 mgr.y (mgr.14613) 1180 : cluster 0 pgmap v1623: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:16.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:16 smithi062 bash[21479]: cluster 2024-02-13T15:15:14.884052+0000 mgr.y (mgr.14613) 1181 : cluster 0 pgmap v1624: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:16.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:15:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:15:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:15:16.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:16 smithi062 bash[28859]: cluster 2024-02-13T15:15:14.884052+0000 mgr.y (mgr.14613) 1181 : cluster 0 pgmap v1624: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:16.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:16 smithi111 bash[23388]: cluster 2024-02-13T15:15:14.884052+0000 mgr.y (mgr.14613) 1181 : cluster 0 pgmap v1624: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:18.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:18 smithi062 bash[21479]: cluster 2024-02-13T15:15:16.884935+0000 mgr.y (mgr.14613) 1182 : cluster 0 pgmap v1625: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:18 smithi062 bash[28859]: cluster 2024-02-13T15:15:16.884935+0000 mgr.y (mgr.14613) 1182 : cluster 0 pgmap v1625: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:18.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:18 smithi111 bash[23388]: cluster 2024-02-13T15:15:16.884935+0000 mgr.y (mgr.14613) 1182 : cluster 0 pgmap v1625: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:20.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:20 smithi062 bash[21479]: cluster 2024-02-13T15:15:18.885829+0000 mgr.y (mgr.14613) 1183 : cluster 0 pgmap v1626: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:20.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:20 smithi062 bash[28859]: cluster 2024-02-13T15:15:18.885829+0000 mgr.y (mgr.14613) 1183 : cluster 0 pgmap v1626: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:20.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:20 smithi111 bash[23388]: cluster 2024-02-13T15:15:18.885829+0000 mgr.y (mgr.14613) 1183 : cluster 0 pgmap v1626: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:21.846 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:15:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:15:22.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[21479]: cluster 2024-02-13T15:15:20.888414+0000 mgr.y (mgr.14613) 1184 : cluster 0 pgmap v1627: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:22.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[21479]: audit 2024-02-13T15:15:21.369268+0000 mon.b (mon.1) 365 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:15:22.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[21479]: audit 2024-02-13T15:15:21.590174+0000 mgr.y (mgr.14613) 1185 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:22.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[21479]: audit 2024-02-13T15:15:21.885182+0000 mon.b (mon.1) 366 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:22.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[21479]: audit 2024-02-13T15:15:21.957174+0000 mon.a (mon.0) 3543 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:22.314 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[21479]: audit 2024-02-13T15:15:21.977205+0000 mon.a (mon.0) 3544 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:22.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[28859]: cluster 2024-02-13T15:15:20.888414+0000 mgr.y (mgr.14613) 1184 : cluster 0 pgmap v1627: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:22.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[28859]: audit 2024-02-13T15:15:21.369268+0000 mon.b (mon.1) 365 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:15:22.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[28859]: audit 2024-02-13T15:15:21.590174+0000 mgr.y (mgr.14613) 1185 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:22.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[28859]: audit 2024-02-13T15:15:21.885182+0000 mon.b (mon.1) 366 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:22.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[28859]: audit 2024-02-13T15:15:21.957174+0000 mon.a (mon.0) 3543 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:22.314 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:22 smithi062 bash[28859]: audit 2024-02-13T15:15:21.977205+0000 mon.a (mon.0) 3544 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:22.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:22 smithi111 bash[23388]: cluster 2024-02-13T15:15:20.888414+0000 mgr.y (mgr.14613) 1184 : cluster 0 pgmap v1627: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:22.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:22 smithi111 bash[23388]: audit 2024-02-13T15:15:21.369268+0000 mon.b (mon.1) 365 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:15:22.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:22 smithi111 bash[23388]: audit 2024-02-13T15:15:21.590174+0000 mgr.y (mgr.14613) 1185 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:22.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:22 smithi111 bash[23388]: audit 2024-02-13T15:15:21.885182+0000 mon.b (mon.1) 366 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:22.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:22 smithi111 bash[23388]: audit 2024-02-13T15:15:21.957174+0000 mon.a (mon.0) 3543 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:22.345 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:22 smithi111 bash[23388]: audit 2024-02-13T15:15:21.977205+0000 mon.a (mon.0) 3544 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[21479]: audit 2024-02-13T15:15:22.522482+0000 mon.a (mon.0) 3545 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[21479]: audit 2024-02-13T15:15:22.534983+0000 mon.a (mon.0) 3546 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[21479]: audit 2024-02-13T15:15:23.146560+0000 mon.a (mon.0) 3547 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[21479]: audit 2024-02-13T15:15:23.163974+0000 mon.a (mon.0) 3548 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[21479]: audit 2024-02-13T15:15:23.168430+0000 mon.b (mon.1) 367 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:15:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[21479]: audit 2024-02-13T15:15:23.169743+0000 mon.b (mon.1) 368 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:15:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[21479]: audit 2024-02-13T15:15:23.180074+0000 mon.a (mon.0) 3549 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[28859]: audit 2024-02-13T15:15:22.522482+0000 mon.a (mon.0) 3545 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[28859]: audit 2024-02-13T15:15:22.534983+0000 mon.a (mon.0) 3546 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[28859]: audit 2024-02-13T15:15:23.146560+0000 mon.a (mon.0) 3547 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[28859]: audit 2024-02-13T15:15:23.163974+0000 mon.a (mon.0) 3548 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[28859]: audit 2024-02-13T15:15:23.168430+0000 mon.b (mon.1) 367 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:15:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[28859]: audit 2024-02-13T15:15:23.169743+0000 mon.b (mon.1) 368 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:15:23.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:23 smithi062 bash[28859]: audit 2024-02-13T15:15:23.180074+0000 mon.a (mon.0) 3549 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:23 smithi111 bash[23388]: audit 2024-02-13T15:15:22.522482+0000 mon.a (mon.0) 3545 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:23 smithi111 bash[23388]: audit 2024-02-13T15:15:22.534983+0000 mon.a (mon.0) 3546 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:23 smithi111 bash[23388]: audit 2024-02-13T15:15:23.146560+0000 mon.a (mon.0) 3547 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:23 smithi111 bash[23388]: audit 2024-02-13T15:15:23.163974+0000 mon.a (mon.0) 3548 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:23 smithi111 bash[23388]: audit 2024-02-13T15:15:23.168430+0000 mon.b (mon.1) 367 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:15:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:23 smithi111 bash[23388]: audit 2024-02-13T15:15:23.169743+0000 mon.b (mon.1) 368 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:15:23.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:23 smithi111 bash[23388]: audit 2024-02-13T15:15:23.180074+0000 mon.a (mon.0) 3549 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:15:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:24 smithi062 bash[21479]: cluster 2024-02-13T15:15:22.889279+0000 mgr.y (mgr.14613) 1186 : cluster 0 pgmap v1628: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:24 smithi062 bash[28859]: cluster 2024-02-13T15:15:22.889279+0000 mgr.y (mgr.14613) 1186 : cluster 0 pgmap v1628: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:24.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:24 smithi111 bash[23388]: cluster 2024-02-13T15:15:22.889279+0000 mgr.y (mgr.14613) 1186 : cluster 0 pgmap v1628: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:26.541 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:15:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:15:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:15:26.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:26 smithi062 bash[21479]: cluster 2024-02-13T15:15:24.891769+0000 mgr.y (mgr.14613) 1187 : cluster 0 pgmap v1629: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:26.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:26 smithi062 bash[28859]: cluster 2024-02-13T15:15:24.891769+0000 mgr.y (mgr.14613) 1187 : cluster 0 pgmap v1629: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:26.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:26 smithi111 bash[23388]: cluster 2024-02-13T15:15:24.891769+0000 mgr.y (mgr.14613) 1187 : cluster 0 pgmap v1629: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:28 smithi062 bash[21479]: cluster 2024-02-13T15:15:26.892632+0000 mgr.y (mgr.14613) 1188 : cluster 0 pgmap v1630: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:28 smithi062 bash[28859]: cluster 2024-02-13T15:15:26.892632+0000 mgr.y (mgr.14613) 1188 : cluster 0 pgmap v1630: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:28.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:28 smithi111 bash[23388]: cluster 2024-02-13T15:15:26.892632+0000 mgr.y (mgr.14613) 1188 : cluster 0 pgmap v1630: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:30 smithi062 bash[21479]: cluster 2024-02-13T15:15:28.893504+0000 mgr.y (mgr.14613) 1189 : cluster 0 pgmap v1631: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:30 smithi062 bash[28859]: cluster 2024-02-13T15:15:28.893504+0000 mgr.y (mgr.14613) 1189 : cluster 0 pgmap v1631: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:30.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:30 smithi111 bash[23388]: cluster 2024-02-13T15:15:28.893504+0000 mgr.y (mgr.14613) 1189 : cluster 0 pgmap v1631: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:32.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:15:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:15:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:32 smithi062 bash[21479]: cluster 2024-02-13T15:15:30.896165+0000 mgr.y (mgr.14613) 1190 : cluster 0 pgmap v1632: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:32 smithi062 bash[21479]: audit 2024-02-13T15:15:31.601508+0000 mgr.y (mgr.14613) 1191 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:32 smithi062 bash[28859]: cluster 2024-02-13T15:15:30.896165+0000 mgr.y (mgr.14613) 1190 : cluster 0 pgmap v1632: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:32 smithi062 bash[28859]: audit 2024-02-13T15:15:31.601508+0000 mgr.y (mgr.14613) 1191 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:32 smithi111 bash[23388]: cluster 2024-02-13T15:15:30.896165+0000 mgr.y (mgr.14613) 1190 : cluster 0 pgmap v1632: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:32 smithi111 bash[23388]: audit 2024-02-13T15:15:31.601508+0000 mgr.y (mgr.14613) 1191 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:34 smithi062 bash[21479]: cluster 2024-02-13T15:15:32.897031+0000 mgr.y (mgr.14613) 1192 : cluster 0 pgmap v1633: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:34.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:34 smithi062 bash[28859]: cluster 2024-02-13T15:15:32.897031+0000 mgr.y (mgr.14613) 1192 : cluster 0 pgmap v1633: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:34 smithi111 bash[23388]: cluster 2024-02-13T15:15:32.897031+0000 mgr.y (mgr.14613) 1192 : cluster 0 pgmap v1633: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:15:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:15:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:15:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:36 smithi111 bash[23388]: cluster 2024-02-13T15:15:34.899521+0000 mgr.y (mgr.14613) 1193 : cluster 0 pgmap v1634: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:37.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:36 smithi062 bash[28859]: cluster 2024-02-13T15:15:34.899521+0000 mgr.y (mgr.14613) 1193 : cluster 0 pgmap v1634: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:36 smithi062 bash[21479]: cluster 2024-02-13T15:15:34.899521+0000 mgr.y (mgr.14613) 1193 : cluster 0 pgmap v1634: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:37 smithi111 bash[23388]: audit 2024-02-13T15:15:36.903034+0000 mon.b (mon.1) 369 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:38.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:37 smithi062 bash[21479]: audit 2024-02-13T15:15:36.903034+0000 mon.b (mon.1) 369 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:38.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:37 smithi062 bash[28859]: audit 2024-02-13T15:15:36.903034+0000 mon.b (mon.1) 369 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:38 smithi111 bash[23388]: cluster 2024-02-13T15:15:36.900351+0000 mgr.y (mgr.14613) 1194 : cluster 0 pgmap v1635: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:38 smithi062 bash[28859]: cluster 2024-02-13T15:15:36.900351+0000 mgr.y (mgr.14613) 1194 : cluster 0 pgmap v1635: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:38 smithi062 bash[21479]: cluster 2024-02-13T15:15:36.900351+0000 mgr.y (mgr.14613) 1194 : cluster 0 pgmap v1635: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:40 smithi111 bash[23388]: cluster 2024-02-13T15:15:38.901227+0000 mgr.y (mgr.14613) 1195 : cluster 0 pgmap v1636: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:40 smithi062 bash[28859]: cluster 2024-02-13T15:15:38.901227+0000 mgr.y (mgr.14613) 1195 : cluster 0 pgmap v1636: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:40 smithi062 bash[21479]: cluster 2024-02-13T15:15:38.901227+0000 mgr.y (mgr.14613) 1195 : cluster 0 pgmap v1636: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:42.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:15:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:15:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:42 smithi111 bash[23388]: cluster 2024-02-13T15:15:40.903830+0000 mgr.y (mgr.14613) 1196 : cluster 0 pgmap v1637: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:42 smithi111 bash[23388]: audit 2024-02-13T15:15:41.612755+0000 mgr.y (mgr.14613) 1197 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:42 smithi062 bash[28859]: cluster 2024-02-13T15:15:40.903830+0000 mgr.y (mgr.14613) 1196 : cluster 0 pgmap v1637: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:42 smithi062 bash[28859]: audit 2024-02-13T15:15:41.612755+0000 mgr.y (mgr.14613) 1197 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:42 smithi062 bash[21479]: cluster 2024-02-13T15:15:40.903830+0000 mgr.y (mgr.14613) 1196 : cluster 0 pgmap v1637: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:42 smithi062 bash[21479]: audit 2024-02-13T15:15:41.612755+0000 mgr.y (mgr.14613) 1197 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:44 smithi111 bash[23388]: cluster 2024-02-13T15:15:42.905025+0000 mgr.y (mgr.14613) 1198 : cluster 0 pgmap v1638: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:44.844 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:15:44 smithi111 bash[50603]: logger=cleanup t=2024-02-13T15:15:44.392554192Z level=info msg="Completed cleanup jobs" duration=36.926387ms 2024-02-13T15:15:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:44 smithi062 bash[21479]: cluster 2024-02-13T15:15:42.905025+0000 mgr.y (mgr.14613) 1198 : cluster 0 pgmap v1638: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:44 smithi062 bash[28859]: cluster 2024-02-13T15:15:42.905025+0000 mgr.y (mgr.14613) 1198 : cluster 0 pgmap v1638: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:15:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:15:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:15:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:46 smithi111 bash[23388]: cluster 2024-02-13T15:15:44.907506+0000 mgr.y (mgr.14613) 1199 : cluster 0 pgmap v1639: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:46 smithi062 bash[28859]: cluster 2024-02-13T15:15:44.907506+0000 mgr.y (mgr.14613) 1199 : cluster 0 pgmap v1639: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:46 smithi062 bash[21479]: cluster 2024-02-13T15:15:44.907506+0000 mgr.y (mgr.14613) 1199 : cluster 0 pgmap v1639: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:48 smithi062 bash[28859]: cluster 2024-02-13T15:15:46.908383+0000 mgr.y (mgr.14613) 1200 : cluster 0 pgmap v1640: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:48 smithi062 bash[21479]: cluster 2024-02-13T15:15:46.908383+0000 mgr.y (mgr.14613) 1200 : cluster 0 pgmap v1640: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:48 smithi111 bash[23388]: cluster 2024-02-13T15:15:46.908383+0000 mgr.y (mgr.14613) 1200 : cluster 0 pgmap v1640: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:51.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:50 smithi062 bash[28859]: cluster 2024-02-13T15:15:48.909234+0000 mgr.y (mgr.14613) 1201 : cluster 0 pgmap v1641: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:51.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:50 smithi062 bash[21479]: cluster 2024-02-13T15:15:48.909234+0000 mgr.y (mgr.14613) 1201 : cluster 0 pgmap v1641: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:51.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:50 smithi111 bash[23388]: cluster 2024-02-13T15:15:48.909234+0000 mgr.y (mgr.14613) 1201 : cluster 0 pgmap v1641: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:52.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:15:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:15:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:52 smithi062 bash[28859]: cluster 2024-02-13T15:15:50.911944+0000 mgr.y (mgr.14613) 1202 : cluster 0 pgmap v1642: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:52 smithi062 bash[28859]: audit 2024-02-13T15:15:51.616355+0000 mgr.y (mgr.14613) 1203 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:52 smithi062 bash[28859]: audit 2024-02-13T15:15:51.938133+0000 mon.b (mon.1) 370 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:53.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:52 smithi062 bash[21479]: cluster 2024-02-13T15:15:50.911944+0000 mgr.y (mgr.14613) 1202 : cluster 0 pgmap v1642: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:53.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:52 smithi062 bash[21479]: audit 2024-02-13T15:15:51.616355+0000 mgr.y (mgr.14613) 1203 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:53.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:52 smithi062 bash[21479]: audit 2024-02-13T15:15:51.938133+0000 mon.b (mon.1) 370 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:53.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:52 smithi111 bash[23388]: cluster 2024-02-13T15:15:50.911944+0000 mgr.y (mgr.14613) 1202 : cluster 0 pgmap v1642: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:53.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:52 smithi111 bash[23388]: audit 2024-02-13T15:15:51.616355+0000 mgr.y (mgr.14613) 1203 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:15:53.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:52 smithi111 bash[23388]: audit 2024-02-13T15:15:51.938133+0000 mon.b (mon.1) 370 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:15:55.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:54 smithi062 bash[21479]: cluster 2024-02-13T15:15:52.912922+0000 mgr.y (mgr.14613) 1204 : cluster 0 pgmap v1643: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:55.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:54 smithi062 bash[28859]: cluster 2024-02-13T15:15:52.912922+0000 mgr.y (mgr.14613) 1204 : cluster 0 pgmap v1643: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:55.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:54 smithi111 bash[23388]: cluster 2024-02-13T15:15:52.912922+0000 mgr.y (mgr.14613) 1204 : cluster 0 pgmap v1643: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:15:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:15:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:15:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:56 smithi062 bash[28859]: cluster 2024-02-13T15:15:54.915367+0000 mgr.y (mgr.14613) 1205 : cluster 0 pgmap v1644: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:57.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:56 smithi062 bash[21479]: cluster 2024-02-13T15:15:54.915367+0000 mgr.y (mgr.14613) 1205 : cluster 0 pgmap v1644: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:57.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:56 smithi111 bash[23388]: cluster 2024-02-13T15:15:54.915367+0000 mgr.y (mgr.14613) 1205 : cluster 0 pgmap v1644: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:15:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:15:58 smithi062 bash[21479]: cluster 2024-02-13T15:15:56.916241+0000 mgr.y (mgr.14613) 1206 : cluster 0 pgmap v1645: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:15:58 smithi062 bash[28859]: cluster 2024-02-13T15:15:56.916241+0000 mgr.y (mgr.14613) 1206 : cluster 0 pgmap v1645: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:15:59.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:15:58 smithi111 bash[23388]: cluster 2024-02-13T15:15:56.916241+0000 mgr.y (mgr.14613) 1206 : cluster 0 pgmap v1645: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:00 smithi062 bash[28859]: cluster 2024-02-13T15:15:58.917063+0000 mgr.y (mgr.14613) 1207 : cluster 0 pgmap v1646: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:00 smithi062 bash[21479]: cluster 2024-02-13T15:15:58.917063+0000 mgr.y (mgr.14613) 1207 : cluster 0 pgmap v1646: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:01.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:00 smithi111 bash[23388]: cluster 2024-02-13T15:15:58.917063+0000 mgr.y (mgr.14613) 1207 : cluster 0 pgmap v1646: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:02.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:16:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:16:03.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:02 smithi062 bash[21479]: cluster 2024-02-13T15:16:00.919608+0000 mgr.y (mgr.14613) 1208 : cluster 0 pgmap v1647: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:03.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:02 smithi062 bash[21479]: audit 2024-02-13T15:16:01.625954+0000 mgr.y (mgr.14613) 1209 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:03.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:02 smithi062 bash[28859]: cluster 2024-02-13T15:16:00.919608+0000 mgr.y (mgr.14613) 1208 : cluster 0 pgmap v1647: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:03.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:02 smithi062 bash[28859]: audit 2024-02-13T15:16:01.625954+0000 mgr.y (mgr.14613) 1209 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:03.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:02 smithi111 bash[23388]: cluster 2024-02-13T15:16:00.919608+0000 mgr.y (mgr.14613) 1208 : cluster 0 pgmap v1647: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:03.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:02 smithi111 bash[23388]: audit 2024-02-13T15:16:01.625954+0000 mgr.y (mgr.14613) 1209 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:05.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:04 smithi062 bash[21479]: cluster 2024-02-13T15:16:02.920594+0000 mgr.y (mgr.14613) 1210 : cluster 0 pgmap v1648: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:05.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:04 smithi062 bash[28859]: cluster 2024-02-13T15:16:02.920594+0000 mgr.y (mgr.14613) 1210 : cluster 0 pgmap v1648: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:05.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:04 smithi111 bash[23388]: cluster 2024-02-13T15:16:02.920594+0000 mgr.y (mgr.14613) 1210 : cluster 0 pgmap v1648: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:16:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:16:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:16:07.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:06 smithi062 bash[28859]: cluster 2024-02-13T15:16:04.923025+0000 mgr.y (mgr.14613) 1211 : cluster 0 pgmap v1649: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:07.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:06 smithi062 bash[21479]: cluster 2024-02-13T15:16:04.923025+0000 mgr.y (mgr.14613) 1211 : cluster 0 pgmap v1649: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:07.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:06 smithi111 bash[23388]: cluster 2024-02-13T15:16:04.923025+0000 mgr.y (mgr.14613) 1211 : cluster 0 pgmap v1649: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:08.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:07 smithi062 bash[21479]: audit 2024-02-13T15:16:06.972231+0000 mon.b (mon.1) 371 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:08.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:07 smithi062 bash[28859]: audit 2024-02-13T15:16:06.972231+0000 mon.b (mon.1) 371 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:08.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:07 smithi111 bash[23388]: audit 2024-02-13T15:16:06.972231+0000 mon.b (mon.1) 371 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:08 smithi062 bash[21479]: cluster 2024-02-13T15:16:06.923834+0000 mgr.y (mgr.14613) 1212 : cluster 0 pgmap v1650: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:09.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:08 smithi062 bash[28859]: cluster 2024-02-13T15:16:06.923834+0000 mgr.y (mgr.14613) 1212 : cluster 0 pgmap v1650: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:08 smithi111 bash[23388]: cluster 2024-02-13T15:16:06.923834+0000 mgr.y (mgr.14613) 1212 : cluster 0 pgmap v1650: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:10.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:09 smithi062 bash[21479]: cluster 2024-02-13T15:16:08.924722+0000 mgr.y (mgr.14613) 1213 : cluster 0 pgmap v1651: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:10.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:09 smithi062 bash[28859]: cluster 2024-02-13T15:16:08.924722+0000 mgr.y (mgr.14613) 1213 : cluster 0 pgmap v1651: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:10.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:09 smithi111 bash[23388]: cluster 2024-02-13T15:16:08.924722+0000 mgr.y (mgr.14613) 1213 : cluster 0 pgmap v1651: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:11.985 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:16:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:16:12.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:11 smithi062 bash[21479]: cluster 2024-02-13T15:16:10.927254+0000 mgr.y (mgr.14613) 1214 : cluster 0 pgmap v1652: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:12.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:11 smithi062 bash[21479]: audit 2024-02-13T15:16:11.632619+0000 mgr.y (mgr.14613) 1215 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:11 smithi062 bash[28859]: cluster 2024-02-13T15:16:10.927254+0000 mgr.y (mgr.14613) 1214 : cluster 0 pgmap v1652: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:12.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:11 smithi062 bash[28859]: audit 2024-02-13T15:16:11.632619+0000 mgr.y (mgr.14613) 1215 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:11 smithi111 bash[23388]: cluster 2024-02-13T15:16:10.927254+0000 mgr.y (mgr.14613) 1214 : cluster 0 pgmap v1652: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:12.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:11 smithi111 bash[23388]: audit 2024-02-13T15:16:11.632619+0000 mgr.y (mgr.14613) 1215 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:14.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:13 smithi062 bash[28859]: cluster 2024-02-13T15:16:12.928068+0000 mgr.y (mgr.14613) 1216 : cluster 0 pgmap v1653: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:14.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:13 smithi062 bash[21479]: cluster 2024-02-13T15:16:12.928068+0000 mgr.y (mgr.14613) 1216 : cluster 0 pgmap v1653: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:14.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:13 smithi111 bash[23388]: cluster 2024-02-13T15:16:12.928068+0000 mgr.y (mgr.14613) 1216 : cluster 0 pgmap v1653: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:16.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:16:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:16:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:16:16.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:15 smithi062 bash[28859]: cluster 2024-02-13T15:16:14.930646+0000 mgr.y (mgr.14613) 1217 : cluster 0 pgmap v1654: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:16.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:15 smithi062 bash[21479]: cluster 2024-02-13T15:16:14.930646+0000 mgr.y (mgr.14613) 1217 : cluster 0 pgmap v1654: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:16.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:15 smithi111 bash[23388]: cluster 2024-02-13T15:16:14.930646+0000 mgr.y (mgr.14613) 1217 : cluster 0 pgmap v1654: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:18.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:17 smithi062 bash[21479]: cluster 2024-02-13T15:16:16.931547+0000 mgr.y (mgr.14613) 1218 : cluster 0 pgmap v1655: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:18.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:17 smithi062 bash[28859]: cluster 2024-02-13T15:16:16.931547+0000 mgr.y (mgr.14613) 1218 : cluster 0 pgmap v1655: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:18.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:17 smithi111 bash[23388]: cluster 2024-02-13T15:16:16.931547+0000 mgr.y (mgr.14613) 1218 : cluster 0 pgmap v1655: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:20.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:20 smithi062 bash[28859]: cluster 2024-02-13T15:16:18.932554+0000 mgr.y (mgr.14613) 1219 : cluster 0 pgmap v1656: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:20.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:20 smithi062 bash[21479]: cluster 2024-02-13T15:16:18.932554+0000 mgr.y (mgr.14613) 1219 : cluster 0 pgmap v1656: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:20.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:20 smithi111 bash[23388]: cluster 2024-02-13T15:16:18.932554+0000 mgr.y (mgr.14613) 1219 : cluster 0 pgmap v1656: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:22.006 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:16:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:16:22.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:22 smithi062 bash[21479]: cluster 2024-02-13T15:16:20.935165+0000 mgr.y (mgr.14613) 1220 : cluster 0 pgmap v1657: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:22.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:22 smithi062 bash[28859]: cluster 2024-02-13T15:16:20.935165+0000 mgr.y (mgr.14613) 1220 : cluster 0 pgmap v1657: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:22.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:22 smithi111 bash[23388]: cluster 2024-02-13T15:16:20.935165+0000 mgr.y (mgr.14613) 1220 : cluster 0 pgmap v1657: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:23 smithi062 bash[28859]: audit 2024-02-13T15:16:21.644003+0000 mgr.y (mgr.14613) 1221 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:23.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:23 smithi062 bash[28859]: audit 2024-02-13T15:16:22.012165+0000 mon.b (mon.1) 372 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:23.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:23 smithi062 bash[21479]: audit 2024-02-13T15:16:21.644003+0000 mgr.y (mgr.14613) 1221 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:23.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:23 smithi062 bash[21479]: audit 2024-02-13T15:16:22.012165+0000 mon.b (mon.1) 372 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:23.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:23 smithi111 bash[23388]: audit 2024-02-13T15:16:21.644003+0000 mgr.y (mgr.14613) 1221 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:23.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:23 smithi111 bash[23388]: audit 2024-02-13T15:16:22.012165+0000 mon.b (mon.1) 372 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:24.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:24 smithi062 bash[21479]: cluster 2024-02-13T15:16:22.935991+0000 mgr.y (mgr.14613) 1222 : cluster 0 pgmap v1658: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:24.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:24 smithi062 bash[21479]: audit 2024-02-13T15:16:23.271753+0000 mon.b (mon.1) 373 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:16:24.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:24 smithi062 bash[21479]: audit 2024-02-13T15:16:23.854287+0000 mon.a (mon.0) 3550 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:24.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:24 smithi062 bash[21479]: audit 2024-02-13T15:16:23.876609+0000 mon.a (mon.0) 3551 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:24.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:24 smithi062 bash[28859]: cluster 2024-02-13T15:16:22.935991+0000 mgr.y (mgr.14613) 1222 : cluster 0 pgmap v1658: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:24.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:24 smithi062 bash[28859]: audit 2024-02-13T15:16:23.271753+0000 mon.b (mon.1) 373 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:16:24.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:24 smithi062 bash[28859]: audit 2024-02-13T15:16:23.854287+0000 mon.a (mon.0) 3550 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:24.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:24 smithi062 bash[28859]: audit 2024-02-13T15:16:23.876609+0000 mon.a (mon.0) 3551 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:24.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:24 smithi111 bash[23388]: cluster 2024-02-13T15:16:22.935991+0000 mgr.y (mgr.14613) 1222 : cluster 0 pgmap v1658: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:24.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:24 smithi111 bash[23388]: audit 2024-02-13T15:16:23.271753+0000 mon.b (mon.1) 373 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:16:24.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:24 smithi111 bash[23388]: audit 2024-02-13T15:16:23.854287+0000 mon.a (mon.0) 3550 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:24.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:24 smithi111 bash[23388]: audit 2024-02-13T15:16:23.876609+0000 mon.a (mon.0) 3551 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:25.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:25 smithi062 bash[21479]: audit 2024-02-13T15:16:24.690050+0000 mon.b (mon.1) 374 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:16:25.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:25 smithi062 bash[21479]: audit 2024-02-13T15:16:24.691995+0000 mon.b (mon.1) 375 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:16:25.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:25 smithi062 bash[21479]: audit 2024-02-13T15:16:24.703439+0000 mon.a (mon.0) 3552 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:25.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:25 smithi062 bash[28859]: audit 2024-02-13T15:16:24.690050+0000 mon.b (mon.1) 374 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:16:25.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:25 smithi062 bash[28859]: audit 2024-02-13T15:16:24.691995+0000 mon.b (mon.1) 375 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:16:25.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:25 smithi062 bash[28859]: audit 2024-02-13T15:16:24.703439+0000 mon.a (mon.0) 3552 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:25.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:25 smithi111 bash[23388]: audit 2024-02-13T15:16:24.690050+0000 mon.b (mon.1) 374 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:16:25.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:25 smithi111 bash[23388]: audit 2024-02-13T15:16:24.691995+0000 mon.b (mon.1) 375 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:16:25.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:25 smithi111 bash[23388]: audit 2024-02-13T15:16:24.703439+0000 mon.a (mon.0) 3552 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:16:26.312 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:16:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:16:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:16:26.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:26 smithi062 bash[28859]: cluster 2024-02-13T15:16:24.938560+0000 mgr.y (mgr.14613) 1223 : cluster 0 pgmap v1659: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:26.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:26 smithi062 bash[21479]: cluster 2024-02-13T15:16:24.938560+0000 mgr.y (mgr.14613) 1223 : cluster 0 pgmap v1659: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:26.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:26 smithi111 bash[23388]: cluster 2024-02-13T15:16:24.938560+0000 mgr.y (mgr.14613) 1223 : cluster 0 pgmap v1659: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:28.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:28 smithi062 bash[21479]: cluster 2024-02-13T15:16:26.939373+0000 mgr.y (mgr.14613) 1224 : cluster 0 pgmap v1660: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:28.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:28 smithi062 bash[28859]: cluster 2024-02-13T15:16:26.939373+0000 mgr.y (mgr.14613) 1224 : cluster 0 pgmap v1660: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:28.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:28 smithi111 bash[23388]: cluster 2024-02-13T15:16:26.939373+0000 mgr.y (mgr.14613) 1224 : cluster 0 pgmap v1660: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:30.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:30 smithi062 bash[21479]: cluster 2024-02-13T15:16:28.940237+0000 mgr.y (mgr.14613) 1225 : cluster 0 pgmap v1661: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:30.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:30 smithi062 bash[28859]: cluster 2024-02-13T15:16:28.940237+0000 mgr.y (mgr.14613) 1225 : cluster 0 pgmap v1661: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:30.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:30 smithi111 bash[23388]: cluster 2024-02-13T15:16:28.940237+0000 mgr.y (mgr.14613) 1225 : cluster 0 pgmap v1661: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:32.048 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:16:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:16:32.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:32 smithi062 bash[21479]: cluster 2024-02-13T15:16:30.942874+0000 mgr.y (mgr.14613) 1226 : cluster 0 pgmap v1662: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:32.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:32 smithi062 bash[28859]: cluster 2024-02-13T15:16:30.942874+0000 mgr.y (mgr.14613) 1226 : cluster 0 pgmap v1662: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:32.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:32 smithi111 bash[23388]: cluster 2024-02-13T15:16:30.942874+0000 mgr.y (mgr.14613) 1226 : cluster 0 pgmap v1662: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:33.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:33 smithi062 bash[28859]: audit 2024-02-13T15:16:31.655312+0000 mgr.y (mgr.14613) 1227 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:33.313 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:33 smithi062 bash[21479]: audit 2024-02-13T15:16:31.655312+0000 mgr.y (mgr.14613) 1227 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:33.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:33 smithi111 bash[23388]: audit 2024-02-13T15:16:31.655312+0000 mgr.y (mgr.14613) 1227 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:34.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:34 smithi062 bash[28859]: cluster 2024-02-13T15:16:32.943785+0000 mgr.y (mgr.14613) 1228 : cluster 0 pgmap v1663: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:34.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:34 smithi062 bash[21479]: cluster 2024-02-13T15:16:32.943785+0000 mgr.y (mgr.14613) 1228 : cluster 0 pgmap v1663: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:34.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:34 smithi111 bash[23388]: cluster 2024-02-13T15:16:32.943785+0000 mgr.y (mgr.14613) 1228 : cluster 0 pgmap v1663: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:36.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:36 smithi111 bash[23388]: cluster 2024-02-13T15:16:34.946232+0000 mgr.y (mgr.14613) 1229 : cluster 0 pgmap v1664: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:36 smithi062 bash[21479]: cluster 2024-02-13T15:16:34.946232+0000 mgr.y (mgr.14613) 1229 : cluster 0 pgmap v1664: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:36 smithi062 bash[28859]: cluster 2024-02-13T15:16:34.946232+0000 mgr.y (mgr.14613) 1229 : cluster 0 pgmap v1664: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:16:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:16:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:16:37.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:37 smithi111 bash[23388]: audit 2024-02-13T15:16:37.048463+0000 mon.b (mon.1) 376 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:37.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:37 smithi062 bash[28859]: audit 2024-02-13T15:16:37.048463+0000 mon.b (mon.1) 376 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:37.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:37 smithi062 bash[21479]: audit 2024-02-13T15:16:37.048463+0000 mon.b (mon.1) 376 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:38.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:38 smithi111 bash[23388]: cluster 2024-02-13T15:16:36.947109+0000 mgr.y (mgr.14613) 1230 : cluster 0 pgmap v1665: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:38.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:38 smithi062 bash[21479]: cluster 2024-02-13T15:16:36.947109+0000 mgr.y (mgr.14613) 1230 : cluster 0 pgmap v1665: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:38.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:38 smithi062 bash[28859]: cluster 2024-02-13T15:16:36.947109+0000 mgr.y (mgr.14613) 1230 : cluster 0 pgmap v1665: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:40.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:40 smithi111 bash[23388]: cluster 2024-02-13T15:16:38.947922+0000 mgr.y (mgr.14613) 1231 : cluster 0 pgmap v1666: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:40.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:40 smithi062 bash[28859]: cluster 2024-02-13T15:16:38.947922+0000 mgr.y (mgr.14613) 1231 : cluster 0 pgmap v1666: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:40.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:40 smithi062 bash[21479]: cluster 2024-02-13T15:16:38.947922+0000 mgr.y (mgr.14613) 1231 : cluster 0 pgmap v1666: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:42.089 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:16:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:16:42.344 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:42 smithi111 bash[23388]: cluster 2024-02-13T15:16:40.950430+0000 mgr.y (mgr.14613) 1232 : cluster 0 pgmap v1667: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:42.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:42 smithi062 bash[21479]: cluster 2024-02-13T15:16:40.950430+0000 mgr.y (mgr.14613) 1232 : cluster 0 pgmap v1667: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:42.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:42 smithi062 bash[28859]: cluster 2024-02-13T15:16:40.950430+0000 mgr.y (mgr.14613) 1232 : cluster 0 pgmap v1667: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:43.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:43 smithi062 bash[28859]: audit 2024-02-13T15:16:41.666042+0000 mgr.y (mgr.14613) 1233 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:43.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:43 smithi062 bash[21479]: audit 2024-02-13T15:16:41.666042+0000 mgr.y (mgr.14613) 1233 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:43.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:43 smithi111 bash[23388]: audit 2024-02-13T15:16:41.666042+0000 mgr.y (mgr.14613) 1233 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:44.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:44 smithi062 bash[21479]: cluster 2024-02-13T15:16:42.951284+0000 mgr.y (mgr.14613) 1234 : cluster 0 pgmap v1668: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:44.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:44 smithi062 bash[28859]: cluster 2024-02-13T15:16:42.951284+0000 mgr.y (mgr.14613) 1234 : cluster 0 pgmap v1668: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:44.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:44 smithi111 bash[23388]: cluster 2024-02-13T15:16:42.951284+0000 mgr.y (mgr.14613) 1234 : cluster 0 pgmap v1668: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:46 smithi062 bash[28859]: cluster 2024-02-13T15:16:44.953705+0000 mgr.y (mgr.14613) 1235 : cluster 0 pgmap v1669: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:46 smithi062 bash[21479]: cluster 2024-02-13T15:16:44.953705+0000 mgr.y (mgr.14613) 1235 : cluster 0 pgmap v1669: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:16:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:16:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:16:46.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:46 smithi111 bash[23388]: cluster 2024-02-13T15:16:44.953705+0000 mgr.y (mgr.14613) 1235 : cluster 0 pgmap v1669: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:48.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:48 smithi062 bash[28859]: cluster 2024-02-13T15:16:46.954617+0000 mgr.y (mgr.14613) 1236 : cluster 0 pgmap v1670: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:48.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:48 smithi062 bash[21479]: cluster 2024-02-13T15:16:46.954617+0000 mgr.y (mgr.14613) 1236 : cluster 0 pgmap v1670: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:48.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:48 smithi111 bash[23388]: cluster 2024-02-13T15:16:46.954617+0000 mgr.y (mgr.14613) 1236 : cluster 0 pgmap v1670: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:50.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:50 smithi062 bash[28859]: cluster 2024-02-13T15:16:48.955486+0000 mgr.y (mgr.14613) 1237 : cluster 0 pgmap v1671: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:50.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:50 smithi062 bash[21479]: cluster 2024-02-13T15:16:48.955486+0000 mgr.y (mgr.14613) 1237 : cluster 0 pgmap v1671: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:50.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:50 smithi111 bash[23388]: cluster 2024-02-13T15:16:48.955486+0000 mgr.y (mgr.14613) 1237 : cluster 0 pgmap v1671: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:52.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:16:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:16:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:52 smithi062 bash[21479]: cluster 2024-02-13T15:16:50.957981+0000 mgr.y (mgr.14613) 1238 : cluster 0 pgmap v1672: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:52.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:52 smithi062 bash[21479]: audit 2024-02-13T15:16:52.092644+0000 mon.b (mon.1) 377 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:52.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:52 smithi062 bash[28859]: cluster 2024-02-13T15:16:50.957981+0000 mgr.y (mgr.14613) 1238 : cluster 0 pgmap v1672: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:52.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:52 smithi062 bash[28859]: audit 2024-02-13T15:16:52.092644+0000 mon.b (mon.1) 377 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:52 smithi111 bash[23388]: cluster 2024-02-13T15:16:50.957981+0000 mgr.y (mgr.14613) 1238 : cluster 0 pgmap v1672: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:52.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:52 smithi111 bash[23388]: audit 2024-02-13T15:16:52.092644+0000 mon.b (mon.1) 377 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:16:53.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:53 smithi062 bash[28859]: audit 2024-02-13T15:16:51.677512+0000 mgr.y (mgr.14613) 1239 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:53.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:53 smithi062 bash[21479]: audit 2024-02-13T15:16:51.677512+0000 mgr.y (mgr.14613) 1239 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:53 smithi111 bash[23388]: audit 2024-02-13T15:16:51.677512+0000 mgr.y (mgr.14613) 1239 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:16:54.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:54 smithi062 bash[21479]: cluster 2024-02-13T15:16:52.959009+0000 mgr.y (mgr.14613) 1240 : cluster 0 pgmap v1673: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:54.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:54 smithi062 bash[28859]: cluster 2024-02-13T15:16:52.959009+0000 mgr.y (mgr.14613) 1240 : cluster 0 pgmap v1673: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:54.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:54 smithi111 bash[23388]: cluster 2024-02-13T15:16:52.959009+0000 mgr.y (mgr.14613) 1240 : cluster 0 pgmap v1673: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:56 smithi062 bash[21479]: cluster 2024-02-13T15:16:54.961379+0000 mgr.y (mgr.14613) 1241 : cluster 0 pgmap v1674: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:56 smithi062 bash[28859]: cluster 2024-02-13T15:16:54.961379+0000 mgr.y (mgr.14613) 1241 : cluster 0 pgmap v1674: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:56.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:16:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:16:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:16:56.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:56 smithi111 bash[23388]: cluster 2024-02-13T15:16:54.961379+0000 mgr.y (mgr.14613) 1241 : cluster 0 pgmap v1674: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:16:58.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:16:58 smithi062 bash[21479]: cluster 2024-02-13T15:16:56.962242+0000 mgr.y (mgr.14613) 1242 : cluster 0 pgmap v1675: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:58.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:16:58 smithi062 bash[28859]: cluster 2024-02-13T15:16:56.962242+0000 mgr.y (mgr.14613) 1242 : cluster 0 pgmap v1675: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:16:58.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:16:58 smithi111 bash[23388]: cluster 2024-02-13T15:16:56.962242+0000 mgr.y (mgr.14613) 1242 : cluster 0 pgmap v1675: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:00.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:00 smithi062 bash[21479]: cluster 2024-02-13T15:16:58.963177+0000 mgr.y (mgr.14613) 1243 : cluster 0 pgmap v1676: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:00.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:00 smithi062 bash[28859]: cluster 2024-02-13T15:16:58.963177+0000 mgr.y (mgr.14613) 1243 : cluster 0 pgmap v1676: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:00.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:00 smithi111 bash[23388]: cluster 2024-02-13T15:16:58.963177+0000 mgr.y (mgr.14613) 1243 : cluster 0 pgmap v1676: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:02.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:17:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:17:02.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:02 smithi062 bash[21479]: cluster 2024-02-13T15:17:00.965759+0000 mgr.y (mgr.14613) 1244 : cluster 0 pgmap v1677: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:02 smithi062 bash[28859]: cluster 2024-02-13T15:17:00.965759+0000 mgr.y (mgr.14613) 1244 : cluster 0 pgmap v1677: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:02.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:02 smithi111 bash[23388]: cluster 2024-02-13T15:17:00.965759+0000 mgr.y (mgr.14613) 1244 : cluster 0 pgmap v1677: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:03.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:03 smithi062 bash[28859]: audit 2024-02-13T15:17:01.688927+0000 mgr.y (mgr.14613) 1245 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:03.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:03 smithi062 bash[21479]: audit 2024-02-13T15:17:01.688927+0000 mgr.y (mgr.14613) 1245 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:03.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:03 smithi111 bash[23388]: audit 2024-02-13T15:17:01.688927+0000 mgr.y (mgr.14613) 1245 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:04.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:04 smithi062 bash[28859]: cluster 2024-02-13T15:17:02.966687+0000 mgr.y (mgr.14613) 1246 : cluster 0 pgmap v1678: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:04.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:04 smithi062 bash[21479]: cluster 2024-02-13T15:17:02.966687+0000 mgr.y (mgr.14613) 1246 : cluster 0 pgmap v1678: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:04.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:04 smithi111 bash[23388]: cluster 2024-02-13T15:17:02.966687+0000 mgr.y (mgr.14613) 1246 : cluster 0 pgmap v1678: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:17:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:17:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:17:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:06 smithi062 bash[28859]: cluster 2024-02-13T15:17:04.968975+0000 mgr.y (mgr.14613) 1247 : cluster 0 pgmap v1679: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:06 smithi062 bash[21479]: cluster 2024-02-13T15:17:04.968975+0000 mgr.y (mgr.14613) 1247 : cluster 0 pgmap v1679: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:06.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:06 smithi111 bash[23388]: cluster 2024-02-13T15:17:04.968975+0000 mgr.y (mgr.14613) 1247 : cluster 0 pgmap v1679: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:07.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:07 smithi062 bash[28859]: audit 2024-02-13T15:17:07.133068+0000 mon.b (mon.1) 378 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:07.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:07 smithi062 bash[21479]: audit 2024-02-13T15:17:07.133068+0000 mon.b (mon.1) 378 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:07.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:07 smithi111 bash[23388]: audit 2024-02-13T15:17:07.133068+0000 mon.b (mon.1) 378 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:08.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:08 smithi062 bash[28859]: cluster 2024-02-13T15:17:06.969785+0000 mgr.y (mgr.14613) 1248 : cluster 0 pgmap v1680: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:08.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:08 smithi062 bash[21479]: cluster 2024-02-13T15:17:06.969785+0000 mgr.y (mgr.14613) 1248 : cluster 0 pgmap v1680: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:08 smithi111 bash[23388]: cluster 2024-02-13T15:17:06.969785+0000 mgr.y (mgr.14613) 1248 : cluster 0 pgmap v1680: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:10 smithi062 bash[28859]: cluster 2024-02-13T15:17:08.970680+0000 mgr.y (mgr.14613) 1249 : cluster 0 pgmap v1681: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:10 smithi062 bash[21479]: cluster 2024-02-13T15:17:08.970680+0000 mgr.y (mgr.14613) 1249 : cluster 0 pgmap v1681: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:10 smithi111 bash[23388]: cluster 2024-02-13T15:17:08.970680+0000 mgr.y (mgr.14613) 1249 : cluster 0 pgmap v1681: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:12.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:17:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:17:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:12 smithi062 bash[28859]: cluster 2024-02-13T15:17:10.973162+0000 mgr.y (mgr.14613) 1250 : cluster 0 pgmap v1682: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:12 smithi062 bash[21479]: cluster 2024-02-13T15:17:10.973162+0000 mgr.y (mgr.14613) 1250 : cluster 0 pgmap v1682: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:12.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:12 smithi111 bash[23388]: cluster 2024-02-13T15:17:10.973162+0000 mgr.y (mgr.14613) 1250 : cluster 0 pgmap v1682: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:13 smithi062 bash[21479]: audit 2024-02-13T15:17:11.700292+0000 mgr.y (mgr.14613) 1251 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:13 smithi062 bash[28859]: audit 2024-02-13T15:17:11.700292+0000 mgr.y (mgr.14613) 1251 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:13.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:13 smithi111 bash[23388]: audit 2024-02-13T15:17:11.700292+0000 mgr.y (mgr.14613) 1251 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:14.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:14 smithi062 bash[28859]: cluster 2024-02-13T15:17:12.974032+0000 mgr.y (mgr.14613) 1252 : cluster 0 pgmap v1683: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:14 smithi062 bash[21479]: cluster 2024-02-13T15:17:12.974032+0000 mgr.y (mgr.14613) 1252 : cluster 0 pgmap v1683: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:14.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:14 smithi111 bash[23388]: cluster 2024-02-13T15:17:12.974032+0000 mgr.y (mgr.14613) 1252 : cluster 0 pgmap v1683: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:17:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:17:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:17:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:16 smithi062 bash[28859]: cluster 2024-02-13T15:17:14.976492+0000 mgr.y (mgr.14613) 1253 : cluster 0 pgmap v1684: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:16 smithi062 bash[21479]: cluster 2024-02-13T15:17:14.976492+0000 mgr.y (mgr.14613) 1253 : cluster 0 pgmap v1684: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:16.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:16 smithi111 bash[23388]: cluster 2024-02-13T15:17:14.976492+0000 mgr.y (mgr.14613) 1253 : cluster 0 pgmap v1684: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:18 smithi062 bash[28859]: cluster 2024-02-13T15:17:16.977356+0000 mgr.y (mgr.14613) 1254 : cluster 0 pgmap v1685: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:18 smithi062 bash[21479]: cluster 2024-02-13T15:17:16.977356+0000 mgr.y (mgr.14613) 1254 : cluster 0 pgmap v1685: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:18.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:18 smithi111 bash[23388]: cluster 2024-02-13T15:17:16.977356+0000 mgr.y (mgr.14613) 1254 : cluster 0 pgmap v1685: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:20.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:20 smithi062 bash[28859]: cluster 2024-02-13T15:17:18.978229+0000 mgr.y (mgr.14613) 1255 : cluster 0 pgmap v1686: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:20.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:20 smithi062 bash[21479]: cluster 2024-02-13T15:17:18.978229+0000 mgr.y (mgr.14613) 1255 : cluster 0 pgmap v1686: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:20 smithi111 bash[23388]: cluster 2024-02-13T15:17:18.978229+0000 mgr.y (mgr.14613) 1255 : cluster 0 pgmap v1686: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-02-13T15:17:22.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:17:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:17:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:22 smithi062 bash[28859]: cluster 2024-02-13T15:17:20.980770+0000 mgr.y (mgr.14613) 1256 : cluster 0 pgmap v1687: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:22 smithi062 bash[28859]: audit 2024-02-13T15:17:22.166953+0000 mon.b (mon.1) 379 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:22 smithi062 bash[21479]: cluster 2024-02-13T15:17:20.980770+0000 mgr.y (mgr.14613) 1256 : cluster 0 pgmap v1687: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:22 smithi062 bash[21479]: audit 2024-02-13T15:17:22.166953+0000 mon.b (mon.1) 379 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:22 smithi111 bash[23388]: cluster 2024-02-13T15:17:20.980770+0000 mgr.y (mgr.14613) 1256 : cluster 0 pgmap v1687: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:22 smithi111 bash[23388]: audit 2024-02-13T15:17:22.166953+0000 mon.b (mon.1) 379 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:23.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:23 smithi062 bash[21479]: audit 2024-02-13T15:17:21.711644+0000 mgr.y (mgr.14613) 1257 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:23.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:23 smithi062 bash[28859]: audit 2024-02-13T15:17:21.711644+0000 mgr.y (mgr.14613) 1257 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:23.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:23 smithi111 bash[23388]: audit 2024-02-13T15:17:21.711644+0000 mgr.y (mgr.14613) 1257 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:24.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:24 smithi062 bash[21479]: cluster 2024-02-13T15:17:22.981653+0000 mgr.y (mgr.14613) 1258 : cluster 0 pgmap v1688: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:24.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:24 smithi062 bash[28859]: cluster 2024-02-13T15:17:22.981653+0000 mgr.y (mgr.14613) 1258 : cluster 0 pgmap v1688: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:24.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:24 smithi111 bash[23388]: cluster 2024-02-13T15:17:22.981653+0000 mgr.y (mgr.14613) 1258 : cluster 0 pgmap v1688: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:25 smithi062 bash[21479]: audit 2024-02-13T15:17:24.798951+0000 mon.b (mon.1) 380 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:17:25.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:25 smithi062 bash[28859]: audit 2024-02-13T15:17:24.798951+0000 mon.b (mon.1) 380 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:17:25.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:25 smithi111 bash[23388]: audit 2024-02-13T15:17:24.798951+0000 mon.b (mon.1) 380 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:17:26.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:26 smithi062 bash[21479]: cluster 2024-02-13T15:17:24.984109+0000 mgr.y (mgr.14613) 1259 : cluster 0 pgmap v1689: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:17:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:17:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:17:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:26 smithi062 bash[28859]: cluster 2024-02-13T15:17:24.984109+0000 mgr.y (mgr.14613) 1259 : cluster 0 pgmap v1689: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:26.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:26 smithi111 bash[23388]: cluster 2024-02-13T15:17:24.984109+0000 mgr.y (mgr.14613) 1259 : cluster 0 pgmap v1689: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:28 smithi062 bash[21479]: cluster 2024-02-13T15:17:26.985000+0000 mgr.y (mgr.14613) 1260 : cluster 0 pgmap v1690: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:28.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:28 smithi062 bash[28859]: cluster 2024-02-13T15:17:26.985000+0000 mgr.y (mgr.14613) 1260 : cluster 0 pgmap v1690: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:28 smithi111 bash[23388]: cluster 2024-02-13T15:17:26.985000+0000 mgr.y (mgr.14613) 1260 : cluster 0 pgmap v1690: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:30.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:30 smithi062 bash[21479]: cluster 2024-02-13T15:17:28.985969+0000 mgr.y (mgr.14613) 1261 : cluster 0 pgmap v1691: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:30.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:30 smithi062 bash[28859]: cluster 2024-02-13T15:17:28.985969+0000 mgr.y (mgr.14613) 1261 : cluster 0 pgmap v1691: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:30.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:30 smithi111 bash[23388]: cluster 2024-02-13T15:17:28.985969+0000 mgr.y (mgr.14613) 1261 : cluster 0 pgmap v1691: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:31 smithi062 bash[28859]: audit 2024-02-13T15:17:30.502433+0000 mon.a (mon.0) 3553 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:31 smithi062 bash[28859]: audit 2024-02-13T15:17:30.515298+0000 mon.a (mon.0) 3554 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:31 smithi062 bash[28859]: audit 2024-02-13T15:17:31.002016+0000 mon.a (mon.0) 3555 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:31 smithi062 bash[28859]: audit 2024-02-13T15:17:31.016659+0000 mon.a (mon.0) 3556 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:31 smithi062 bash[21479]: audit 2024-02-13T15:17:30.502433+0000 mon.a (mon.0) 3553 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:31 smithi062 bash[21479]: audit 2024-02-13T15:17:30.515298+0000 mon.a (mon.0) 3554 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:31 smithi062 bash[21479]: audit 2024-02-13T15:17:31.002016+0000 mon.a (mon.0) 3555 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:31 smithi062 bash[21479]: audit 2024-02-13T15:17:31.016659+0000 mon.a (mon.0) 3556 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.844 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:17:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:17:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:31 smithi111 bash[23388]: audit 2024-02-13T15:17:30.502433+0000 mon.a (mon.0) 3553 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:31 smithi111 bash[23388]: audit 2024-02-13T15:17:30.515298+0000 mon.a (mon.0) 3554 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:31 smithi111 bash[23388]: audit 2024-02-13T15:17:31.002016+0000 mon.a (mon.0) 3555 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:31.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:31 smithi111 bash[23388]: audit 2024-02-13T15:17:31.016659+0000 mon.a (mon.0) 3556 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:32 smithi062 bash[21479]: cluster 2024-02-13T15:17:30.988445+0000 mgr.y (mgr.14613) 1262 : cluster 0 pgmap v1692: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:32 smithi062 bash[21479]: audit 2024-02-13T15:17:31.706581+0000 mon.b (mon.1) 381 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:17:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:32 smithi062 bash[21479]: audit 2024-02-13T15:17:31.708804+0000 mon.b (mon.1) 382 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:17:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:32 smithi062 bash[21479]: audit 2024-02-13T15:17:31.719637+0000 mon.a (mon.0) 3557 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:32 smithi062 bash[28859]: cluster 2024-02-13T15:17:30.988445+0000 mgr.y (mgr.14613) 1262 : cluster 0 pgmap v1692: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:32 smithi062 bash[28859]: audit 2024-02-13T15:17:31.706581+0000 mon.b (mon.1) 381 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:17:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:32 smithi062 bash[28859]: audit 2024-02-13T15:17:31.708804+0000 mon.b (mon.1) 382 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:17:32.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:32 smithi062 bash[28859]: audit 2024-02-13T15:17:31.719637+0000 mon.a (mon.0) 3557 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:32 smithi111 bash[23388]: cluster 2024-02-13T15:17:30.988445+0000 mgr.y (mgr.14613) 1262 : cluster 0 pgmap v1692: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:32 smithi111 bash[23388]: audit 2024-02-13T15:17:31.706581+0000 mon.b (mon.1) 381 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:17:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:32 smithi111 bash[23388]: audit 2024-02-13T15:17:31.708804+0000 mon.b (mon.1) 382 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:17:32.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:32 smithi111 bash[23388]: audit 2024-02-13T15:17:31.719637+0000 mon.a (mon.0) 3557 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:17:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:33 smithi062 bash[21479]: audit 2024-02-13T15:17:31.721828+0000 mgr.y (mgr.14613) 1263 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:33.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:33 smithi062 bash[28859]: audit 2024-02-13T15:17:31.721828+0000 mgr.y (mgr.14613) 1263 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:33 smithi111 bash[23388]: audit 2024-02-13T15:17:31.721828+0000 mgr.y (mgr.14613) 1263 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:34.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:34 smithi062 bash[28859]: cluster 2024-02-13T15:17:32.989447+0000 mgr.y (mgr.14613) 1264 : cluster 0 pgmap v1693: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:34 smithi062 bash[21479]: cluster 2024-02-13T15:17:32.989447+0000 mgr.y (mgr.14613) 1264 : cluster 0 pgmap v1693: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:34 smithi111 bash[23388]: cluster 2024-02-13T15:17:32.989447+0000 mgr.y (mgr.14613) 1264 : cluster 0 pgmap v1693: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:36.534 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:17:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:17:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:17:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:36 smithi062 bash[21479]: cluster 2024-02-13T15:17:34.991965+0000 mgr.y (mgr.14613) 1265 : cluster 0 pgmap v1694: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:36.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:36 smithi062 bash[28859]: cluster 2024-02-13T15:17:34.991965+0000 mgr.y (mgr.14613) 1265 : cluster 0 pgmap v1694: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:36 smithi111 bash[23388]: cluster 2024-02-13T15:17:34.991965+0000 mgr.y (mgr.14613) 1265 : cluster 0 pgmap v1694: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:37 smithi062 bash[21479]: audit 2024-02-13T15:17:37.202097+0000 mon.b (mon.1) 383 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:37.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:37 smithi062 bash[28859]: audit 2024-02-13T15:17:37.202097+0000 mon.b (mon.1) 383 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:37.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:37 smithi111 bash[23388]: audit 2024-02-13T15:17:37.202097+0000 mon.b (mon.1) 383 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:38 smithi062 bash[28859]: cluster 2024-02-13T15:17:36.992932+0000 mgr.y (mgr.14613) 1266 : cluster 0 pgmap v1695: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:38 smithi062 bash[21479]: cluster 2024-02-13T15:17:36.992932+0000 mgr.y (mgr.14613) 1266 : cluster 0 pgmap v1695: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:38 smithi111 bash[23388]: cluster 2024-02-13T15:17:36.992932+0000 mgr.y (mgr.14613) 1266 : cluster 0 pgmap v1695: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:40 smithi062 bash[21479]: cluster 2024-02-13T15:17:38.993798+0000 mgr.y (mgr.14613) 1267 : cluster 0 pgmap v1696: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:40 smithi062 bash[28859]: cluster 2024-02-13T15:17:38.993798+0000 mgr.y (mgr.14613) 1267 : cluster 0 pgmap v1696: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:40.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:40 smithi111 bash[23388]: cluster 2024-02-13T15:17:38.993798+0000 mgr.y (mgr.14613) 1267 : cluster 0 pgmap v1696: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:42.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:17:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:17:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:42 smithi062 bash[28859]: cluster 2024-02-13T15:17:40.996239+0000 mgr.y (mgr.14613) 1268 : cluster 0 pgmap v1697: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:42 smithi062 bash[21479]: cluster 2024-02-13T15:17:40.996239+0000 mgr.y (mgr.14613) 1268 : cluster 0 pgmap v1697: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:42 smithi111 bash[23388]: cluster 2024-02-13T15:17:40.996239+0000 mgr.y (mgr.14613) 1268 : cluster 0 pgmap v1697: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:43 smithi111 bash[23388]: audit 2024-02-13T15:17:41.733141+0000 mgr.y (mgr.14613) 1269 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:44.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:43 smithi062 bash[28859]: audit 2024-02-13T15:17:41.733141+0000 mgr.y (mgr.14613) 1269 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:44.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:43 smithi062 bash[21479]: audit 2024-02-13T15:17:41.733141+0000 mgr.y (mgr.14613) 1269 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:44.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:44 smithi111 bash[23388]: cluster 2024-02-13T15:17:42.997117+0000 mgr.y (mgr.14613) 1270 : cluster 0 pgmap v1698: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:44 smithi062 bash[28859]: cluster 2024-02-13T15:17:42.997117+0000 mgr.y (mgr.14613) 1270 : cluster 0 pgmap v1698: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:44 smithi062 bash[21479]: cluster 2024-02-13T15:17:42.997117+0000 mgr.y (mgr.14613) 1270 : cluster 0 pgmap v1698: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:17:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:17:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:17:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:46 smithi111 bash[23388]: cluster 2024-02-13T15:17:44.999521+0000 mgr.y (mgr.14613) 1271 : cluster 0 pgmap v1699: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:46 smithi062 bash[21479]: cluster 2024-02-13T15:17:44.999521+0000 mgr.y (mgr.14613) 1271 : cluster 0 pgmap v1699: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:46 smithi062 bash[28859]: cluster 2024-02-13T15:17:44.999521+0000 mgr.y (mgr.14613) 1271 : cluster 0 pgmap v1699: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:48.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:48 smithi111 bash[23388]: cluster 2024-02-13T15:17:47.000362+0000 mgr.y (mgr.14613) 1272 : cluster 0 pgmap v1700: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:48 smithi062 bash[28859]: cluster 2024-02-13T15:17:47.000362+0000 mgr.y (mgr.14613) 1272 : cluster 0 pgmap v1700: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:48 smithi062 bash[21479]: cluster 2024-02-13T15:17:47.000362+0000 mgr.y (mgr.14613) 1272 : cluster 0 pgmap v1700: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:50 smithi111 bash[23388]: cluster 2024-02-13T15:17:49.001189+0000 mgr.y (mgr.14613) 1273 : cluster 0 pgmap v1701: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:51.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:50 smithi062 bash[21479]: cluster 2024-02-13T15:17:49.001189+0000 mgr.y (mgr.14613) 1273 : cluster 0 pgmap v1701: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:51.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:50 smithi062 bash[28859]: cluster 2024-02-13T15:17:49.001189+0000 mgr.y (mgr.14613) 1273 : cluster 0 pgmap v1701: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:52.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:17:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:17:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:52 smithi111 bash[23388]: cluster 2024-02-13T15:17:51.003778+0000 mgr.y (mgr.14613) 1274 : cluster 0 pgmap v1702: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:52.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:52 smithi111 bash[23388]: audit 2024-02-13T15:17:52.237319+0000 mon.b (mon.1) 384 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:52 smithi062 bash[28859]: cluster 2024-02-13T15:17:51.003778+0000 mgr.y (mgr.14613) 1274 : cluster 0 pgmap v1702: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:52 smithi062 bash[28859]: audit 2024-02-13T15:17:52.237319+0000 mon.b (mon.1) 384 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:52 smithi062 bash[21479]: cluster 2024-02-13T15:17:51.003778+0000 mgr.y (mgr.14613) 1274 : cluster 0 pgmap v1702: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:52 smithi062 bash[21479]: audit 2024-02-13T15:17:52.237319+0000 mon.b (mon.1) 384 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:17:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:53 smithi111 bash[23388]: audit 2024-02-13T15:17:51.738403+0000 mgr.y (mgr.14613) 1275 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:54.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:53 smithi062 bash[21479]: audit 2024-02-13T15:17:51.738403+0000 mgr.y (mgr.14613) 1275 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:54.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:53 smithi062 bash[28859]: audit 2024-02-13T15:17:51.738403+0000 mgr.y (mgr.14613) 1275 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:17:55.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:54 smithi062 bash[21479]: cluster 2024-02-13T15:17:53.004643+0000 mgr.y (mgr.14613) 1276 : cluster 0 pgmap v1703: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:55.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:54 smithi062 bash[28859]: cluster 2024-02-13T15:17:53.004643+0000 mgr.y (mgr.14613) 1276 : cluster 0 pgmap v1703: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:55.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:54 smithi111 bash[23388]: cluster 2024-02-13T15:17:53.004643+0000 mgr.y (mgr.14613) 1276 : cluster 0 pgmap v1703: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:17:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:17:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:17:57.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:56 smithi062 bash[21479]: cluster 2024-02-13T15:17:55.007029+0000 mgr.y (mgr.14613) 1277 : cluster 0 pgmap v1704: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:56 smithi062 bash[28859]: cluster 2024-02-13T15:17:55.007029+0000 mgr.y (mgr.14613) 1277 : cluster 0 pgmap v1704: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:57.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:56 smithi111 bash[23388]: cluster 2024-02-13T15:17:55.007029+0000 mgr.y (mgr.14613) 1277 : cluster 0 pgmap v1704: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:17:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:17:58 smithi062 bash[21479]: cluster 2024-02-13T15:17:57.008007+0000 mgr.y (mgr.14613) 1278 : cluster 0 pgmap v1705: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:17:58 smithi062 bash[28859]: cluster 2024-02-13T15:17:57.008007+0000 mgr.y (mgr.14613) 1278 : cluster 0 pgmap v1705: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:17:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:17:58 smithi111 bash[23388]: cluster 2024-02-13T15:17:57.008007+0000 mgr.y (mgr.14613) 1278 : cluster 0 pgmap v1705: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:00 smithi062 bash[21479]: cluster 2024-02-13T15:17:59.008917+0000 mgr.y (mgr.14613) 1279 : cluster 0 pgmap v1706: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:00 smithi062 bash[28859]: cluster 2024-02-13T15:17:59.008917+0000 mgr.y (mgr.14613) 1279 : cluster 0 pgmap v1706: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:01.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:00 smithi111 bash[23388]: cluster 2024-02-13T15:17:59.008917+0000 mgr.y (mgr.14613) 1279 : cluster 0 pgmap v1706: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:02.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:18:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:18:03.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:02 smithi062 bash[28859]: cluster 2024-02-13T15:18:01.011485+0000 mgr.y (mgr.14613) 1280 : cluster 0 pgmap v1707: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:03.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:02 smithi062 bash[21479]: cluster 2024-02-13T15:18:01.011485+0000 mgr.y (mgr.14613) 1280 : cluster 0 pgmap v1707: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:03.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:02 smithi111 bash[23388]: cluster 2024-02-13T15:18:01.011485+0000 mgr.y (mgr.14613) 1280 : cluster 0 pgmap v1707: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:04.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:03 smithi062 bash[21479]: audit 2024-02-13T15:18:01.747165+0000 mgr.y (mgr.14613) 1281 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:04.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:03 smithi062 bash[28859]: audit 2024-02-13T15:18:01.747165+0000 mgr.y (mgr.14613) 1281 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:04.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:03 smithi111 bash[23388]: audit 2024-02-13T15:18:01.747165+0000 mgr.y (mgr.14613) 1281 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:05.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:04 smithi062 bash[28859]: cluster 2024-02-13T15:18:03.012301+0000 mgr.y (mgr.14613) 1282 : cluster 0 pgmap v1708: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:05.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:04 smithi062 bash[21479]: cluster 2024-02-13T15:18:03.012301+0000 mgr.y (mgr.14613) 1282 : cluster 0 pgmap v1708: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:05.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:04 smithi111 bash[23388]: cluster 2024-02-13T15:18:03.012301+0000 mgr.y (mgr.14613) 1282 : cluster 0 pgmap v1708: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:18:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:18:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:18:07.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:06 smithi062 bash[21479]: cluster 2024-02-13T15:18:05.014769+0000 mgr.y (mgr.14613) 1283 : cluster 0 pgmap v1709: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:07.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:06 smithi062 bash[28859]: cluster 2024-02-13T15:18:05.014769+0000 mgr.y (mgr.14613) 1283 : cluster 0 pgmap v1709: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:07.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:06 smithi111 bash[23388]: cluster 2024-02-13T15:18:05.014769+0000 mgr.y (mgr.14613) 1283 : cluster 0 pgmap v1709: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:08.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:07 smithi062 bash[21479]: audit 2024-02-13T15:18:07.272309+0000 mon.b (mon.1) 385 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:08.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:07 smithi062 bash[28859]: audit 2024-02-13T15:18:07.272309+0000 mon.b (mon.1) 385 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:08.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:07 smithi111 bash[23388]: audit 2024-02-13T15:18:07.272309+0000 mon.b (mon.1) 385 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:08 smithi062 bash[21479]: cluster 2024-02-13T15:18:07.015707+0000 mgr.y (mgr.14613) 1284 : cluster 0 pgmap v1710: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:09.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:08 smithi062 bash[28859]: cluster 2024-02-13T15:18:07.015707+0000 mgr.y (mgr.14613) 1284 : cluster 0 pgmap v1710: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:08 smithi111 bash[23388]: cluster 2024-02-13T15:18:07.015707+0000 mgr.y (mgr.14613) 1284 : cluster 0 pgmap v1710: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:11.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:10 smithi062 bash[21479]: cluster 2024-02-13T15:18:09.016751+0000 mgr.y (mgr.14613) 1285 : cluster 0 pgmap v1711: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:11.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:10 smithi062 bash[28859]: cluster 2024-02-13T15:18:09.016751+0000 mgr.y (mgr.14613) 1285 : cluster 0 pgmap v1711: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:11.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:10 smithi111 bash[23388]: cluster 2024-02-13T15:18:09.016751+0000 mgr.y (mgr.14613) 1285 : cluster 0 pgmap v1711: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:12.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:18:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:18:13.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:12 smithi062 bash[21479]: cluster 2024-02-13T15:18:11.019330+0000 mgr.y (mgr.14613) 1286 : cluster 0 pgmap v1712: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:13.086 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:12 smithi062 bash[28859]: cluster 2024-02-13T15:18:11.019330+0000 mgr.y (mgr.14613) 1286 : cluster 0 pgmap v1712: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:13.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:12 smithi111 bash[23388]: cluster 2024-02-13T15:18:11.019330+0000 mgr.y (mgr.14613) 1286 : cluster 0 pgmap v1712: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:14.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:13 smithi062 bash[28859]: audit 2024-02-13T15:18:11.758585+0000 mgr.y (mgr.14613) 1287 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:14.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:13 smithi062 bash[21479]: audit 2024-02-13T15:18:11.758585+0000 mgr.y (mgr.14613) 1287 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:14.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:13 smithi111 bash[23388]: audit 2024-02-13T15:18:11.758585+0000 mgr.y (mgr.14613) 1287 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:15.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:14 smithi062 bash[28859]: cluster 2024-02-13T15:18:13.020218+0000 mgr.y (mgr.14613) 1288 : cluster 0 pgmap v1713: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:15.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:14 smithi062 bash[21479]: cluster 2024-02-13T15:18:13.020218+0000 mgr.y (mgr.14613) 1288 : cluster 0 pgmap v1713: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:15.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:14 smithi111 bash[23388]: cluster 2024-02-13T15:18:13.020218+0000 mgr.y (mgr.14613) 1288 : cluster 0 pgmap v1713: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:18:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:18:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:18:17.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:17 smithi062 bash[21479]: cluster 2024-02-13T15:18:15.022652+0000 mgr.y (mgr.14613) 1289 : cluster 0 pgmap v1714: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:17.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:17 smithi062 bash[21479]: cluster 2024-02-13T15:18:15.675111+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-02-13T15:18:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:17 smithi062 bash[28859]: cluster 2024-02-13T15:18:15.022652+0000 mgr.y (mgr.14613) 1289 : cluster 0 pgmap v1714: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:17 smithi062 bash[28859]: cluster 2024-02-13T15:18:15.675111+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-02-13T15:18:17.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:17 smithi111 bash[23388]: cluster 2024-02-13T15:18:15.022652+0000 mgr.y (mgr.14613) 1289 : cluster 0 pgmap v1714: 260 pgs: 260 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:17.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:17 smithi111 bash[23388]: cluster 2024-02-13T15:18:15.675111+0000 mon.a (mon.0) 3558 : cluster 0 osdmap e770: 8 total, 8 up, 8 in 2024-02-13T15:18:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:18 smithi062 bash[28859]: cluster 2024-02-13T15:18:17.023331+0000 mgr.y (mgr.14613) 1290 : cluster 0 pgmap v1716: 164 pgs: 164 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:18:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:18 smithi062 bash[28859]: cluster 2024-02-13T15:18:17.118045+0000 mon.a (mon.0) 3559 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-02-13T15:18:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:18 smithi062 bash[28859]: cluster 2024-02-13T15:18:17.154600+0000 mon.a (mon.0) 3560 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:18 smithi062 bash[21479]: cluster 2024-02-13T15:18:17.023331+0000 mgr.y (mgr.14613) 1290 : cluster 0 pgmap v1716: 164 pgs: 164 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:18:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:18 smithi062 bash[21479]: cluster 2024-02-13T15:18:17.118045+0000 mon.a (mon.0) 3559 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-02-13T15:18:18.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:18 smithi062 bash[21479]: cluster 2024-02-13T15:18:17.154600+0000 mon.a (mon.0) 3560 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:18.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:18 smithi111 bash[23388]: cluster 2024-02-13T15:18:17.023331+0000 mgr.y (mgr.14613) 1290 : cluster 0 pgmap v1716: 164 pgs: 164 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:18:18.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:18 smithi111 bash[23388]: cluster 2024-02-13T15:18:17.118045+0000 mon.a (mon.0) 3559 : cluster 0 osdmap e771: 8 total, 8 up, 8 in 2024-02-13T15:18:18.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:18 smithi111 bash[23388]: cluster 2024-02-13T15:18:17.154600+0000 mon.a (mon.0) 3560 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:19 smithi062 bash[28859]: cluster 2024-02-13T15:18:18.137672+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-02-13T15:18:19.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:19 smithi062 bash[21479]: cluster 2024-02-13T15:18:18.137672+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-02-13T15:18:19.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:19 smithi111 bash[23388]: cluster 2024-02-13T15:18:18.137672+0000 mon.a (mon.0) 3561 : cluster 0 osdmap e772: 8 total, 8 up, 8 in 2024-02-13T15:18:20.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:20 smithi062 bash[21479]: cluster 2024-02-13T15:18:19.024123+0000 mgr.y (mgr.14613) 1291 : cluster 0 pgmap v1719: 260 pgs: 96 unknown, 164 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:20.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:20 smithi062 bash[21479]: cluster 2024-02-13T15:18:19.150577+0000 mon.a (mon.0) 3562 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-02-13T15:18:20.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:20 smithi062 bash[28859]: cluster 2024-02-13T15:18:19.024123+0000 mgr.y (mgr.14613) 1291 : cluster 0 pgmap v1719: 260 pgs: 96 unknown, 164 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:20.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:20 smithi062 bash[28859]: cluster 2024-02-13T15:18:19.150577+0000 mon.a (mon.0) 3562 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-02-13T15:18:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:20 smithi111 bash[23388]: cluster 2024-02-13T15:18:19.024123+0000 mgr.y (mgr.14613) 1291 : cluster 0 pgmap v1719: 260 pgs: 96 unknown, 164 active+clean; 582 KiB data, 743 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:18:20.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:20 smithi111 bash[23388]: cluster 2024-02-13T15:18:19.150577+0000 mon.a (mon.0) 3562 : cluster 0 osdmap e773: 8 total, 8 up, 8 in 2024-02-13T15:18:21.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:21 smithi062 bash[28859]: cluster 2024-02-13T15:18:20.159505+0000 mon.a (mon.0) 3563 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-02-13T15:18:21.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:21 smithi062 bash[21479]: cluster 2024-02-13T15:18:20.159505+0000 mon.a (mon.0) 3563 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-02-13T15:18:21.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:21 smithi111 bash[23388]: cluster 2024-02-13T15:18:20.159505+0000 mon.a (mon.0) 3563 : cluster 0 osdmap e774: 8 total, 8 up, 8 in 2024-02-13T15:18:22.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:18:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:18:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:22 smithi062 bash[28859]: cluster 2024-02-13T15:18:21.024956+0000 mgr.y (mgr.14613) 1292 : cluster 0 pgmap v1722: 260 pgs: 64 unknown, 196 active+clean; 582 KiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:22 smithi062 bash[28859]: cluster 2024-02-13T15:18:21.170343+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-02-13T15:18:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:22 smithi062 bash[21479]: cluster 2024-02-13T15:18:21.024956+0000 mgr.y (mgr.14613) 1292 : cluster 0 pgmap v1722: 260 pgs: 64 unknown, 196 active+clean; 582 KiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:22 smithi062 bash[21479]: cluster 2024-02-13T15:18:21.170343+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-02-13T15:18:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:22 smithi111 bash[23388]: cluster 2024-02-13T15:18:21.024956+0000 mgr.y (mgr.14613) 1292 : cluster 0 pgmap v1722: 260 pgs: 64 unknown, 196 active+clean; 582 KiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:22.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:22 smithi111 bash[23388]: cluster 2024-02-13T15:18:21.170343+0000 mon.a (mon.0) 3564 : cluster 0 osdmap e775: 8 total, 8 up, 8 in 2024-02-13T15:18:23.228 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Running main() from gmock_main.cc 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [==========] Running 2 tests from 1 test suite. 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [----------] Global test environment set-up. 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotify 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: handle_notify cookie 94213336235360 notify_id 3302829850625 notifier_gid 24929 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotify (1816637 ms) 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ RUN ] NeoRadosWatchNotify.WatchNotifyTimeout 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Trying... 2024-02-13T15:18:23.229 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: handle_notify cookie 94213348960816 notify_id 3315714752516 notifier_gid 47036 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Waiting for 3.000000000s 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Timed out. 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Flushing... 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: Flushed... 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ OK ] NeoRadosWatchNotify.WatchNotifyTimeout (7534 ms) 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [----------] 2 tests from NeoRadosWatchNotify (1824171 ms total) 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [----------] Global test environment tear-down 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [==========] 2 tests from 1 test suite ran. (1824171 ms total) 2024-02-13T15:18:23.230 INFO:tasks.workunit.client.0.smithi062.stdout: watch_notify: [ PASSED ] 2 tests. 2024-02-13T15:18:23.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:23 smithi062 bash[21479]: audit 2024-02-13T15:18:21.769959+0000 mgr.y (mgr.14613) 1293 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:23.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:23 smithi062 bash[21479]: cluster 2024-02-13T15:18:22.175687+0000 mon.a (mon.0) 3565 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-02-13T15:18:23.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:23 smithi062 bash[21479]: audit 2024-02-13T15:18:22.306195+0000 mon.b (mon.1) 386 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:23.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:23 smithi062 bash[21479]: cluster 2024-02-13T15:18:23.143440+0000 mon.a (mon.0) 3566 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:23.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:23 smithi062 bash[28859]: audit 2024-02-13T15:18:21.769959+0000 mgr.y (mgr.14613) 1293 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:23.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:23 smithi062 bash[28859]: cluster 2024-02-13T15:18:22.175687+0000 mon.a (mon.0) 3565 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-02-13T15:18:23.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:23 smithi062 bash[28859]: audit 2024-02-13T15:18:22.306195+0000 mon.b (mon.1) 386 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:23.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:23 smithi062 bash[28859]: cluster 2024-02-13T15:18:23.143440+0000 mon.a (mon.0) 3566 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:23.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:23 smithi111 bash[23388]: audit 2024-02-13T15:18:21.769959+0000 mgr.y (mgr.14613) 1293 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:23.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:23 smithi111 bash[23388]: cluster 2024-02-13T15:18:22.175687+0000 mon.a (mon.0) 3565 : cluster 0 osdmap e776: 8 total, 8 up, 8 in 2024-02-13T15:18:23.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:23 smithi111 bash[23388]: audit 2024-02-13T15:18:22.306195+0000 mon.b (mon.1) 386 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:23.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:23 smithi111 bash[23388]: cluster 2024-02-13T15:18:23.143440+0000 mon.a (mon.0) 3566 : cluster 3 Health check update: 4 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:24.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:24 smithi062 bash[28859]: cluster 2024-02-13T15:18:23.025722+0000 mgr.y (mgr.14613) 1294 : cluster 0 pgmap v1725: 196 pgs: 196 active+clean; 582 KiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:24.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:24 smithi062 bash[28859]: cluster 2024-02-13T15:18:23.216948+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-02-13T15:18:24.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:24 smithi062 bash[21479]: cluster 2024-02-13T15:18:23.025722+0000 mgr.y (mgr.14613) 1294 : cluster 0 pgmap v1725: 196 pgs: 196 active+clean; 582 KiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:24.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:24 smithi062 bash[21479]: cluster 2024-02-13T15:18:23.216948+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-02-13T15:18:24.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:24 smithi111 bash[23388]: cluster 2024-02-13T15:18:23.025722+0000 mgr.y (mgr.14613) 1294 : cluster 0 pgmap v1725: 196 pgs: 196 active+clean; 582 KiB data, 774 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:24.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:24 smithi111 bash[23388]: cluster 2024-02-13T15:18:23.216948+0000 mon.a (mon.0) 3567 : cluster 0 osdmap e777: 8 total, 8 up, 8 in 2024-02-13T15:18:25.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:25 smithi062 bash[21479]: cluster 2024-02-13T15:18:24.216678+0000 mon.a (mon.0) 3568 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-02-13T15:18:25.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:25 smithi062 bash[28859]: cluster 2024-02-13T15:18:24.216678+0000 mon.a (mon.0) 3568 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-02-13T15:18:25.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:25 smithi111 bash[23388]: cluster 2024-02-13T15:18:24.216678+0000 mon.a (mon.0) 3568 : cluster 0 osdmap e778: 8 total, 8 up, 8 in 2024-02-13T15:18:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:18:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:18:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:18:26.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:26 smithi062 bash[28859]: cluster 2024-02-13T15:18:25.027731+0000 mgr.y (mgr.14613) 1295 : cluster 0 pgmap v1728: 228 pgs: 228 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-13T15:18:26.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:26 smithi062 bash[28859]: cluster 2024-02-13T15:18:25.245831+0000 mon.a (mon.0) 3569 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-02-13T15:18:26.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:26 smithi062 bash[21479]: cluster 2024-02-13T15:18:25.027731+0000 mgr.y (mgr.14613) 1295 : cluster 0 pgmap v1728: 228 pgs: 228 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-13T15:18:26.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:26 smithi062 bash[21479]: cluster 2024-02-13T15:18:25.245831+0000 mon.a (mon.0) 3569 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-02-13T15:18:26.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:26 smithi111 bash[23388]: cluster 2024-02-13T15:18:25.027731+0000 mgr.y (mgr.14613) 1295 : cluster 0 pgmap v1728: 228 pgs: 228 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-02-13T15:18:26.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:26 smithi111 bash[23388]: cluster 2024-02-13T15:18:25.245831+0000 mon.a (mon.0) 3569 : cluster 0 osdmap e779: 8 total, 8 up, 8 in 2024-02-13T15:18:27.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:27 smithi062 bash[21479]: cluster 2024-02-13T15:18:26.258660+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-02-13T15:18:27.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:27 smithi062 bash[28859]: cluster 2024-02-13T15:18:26.258660+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-02-13T15:18:27.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:27 smithi111 bash[23388]: cluster 2024-02-13T15:18:26.258660+0000 mon.a (mon.0) 3570 : cluster 0 osdmap e780: 8 total, 8 up, 8 in 2024-02-13T15:18:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:28 smithi062 bash[21479]: cluster 2024-02-13T15:18:27.028565+0000 mgr.y (mgr.14613) 1296 : cluster 0 pgmap v1731: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T15:18:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:28 smithi062 bash[21479]: cluster 2024-02-13T15:18:27.263572+0000 mon.a (mon.0) 3571 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-02-13T15:18:28.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:28 smithi062 bash[21479]: cluster 2024-02-13T15:18:28.144334+0000 mon.a (mon.0) 3572 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:28.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:28 smithi062 bash[28859]: cluster 2024-02-13T15:18:27.028565+0000 mgr.y (mgr.14613) 1296 : cluster 0 pgmap v1731: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T15:18:28.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:28 smithi062 bash[28859]: cluster 2024-02-13T15:18:27.263572+0000 mon.a (mon.0) 3571 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-02-13T15:18:28.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:28 smithi062 bash[28859]: cluster 2024-02-13T15:18:28.144334+0000 mon.a (mon.0) 3572 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:28 smithi111 bash[23388]: cluster 2024-02-13T15:18:27.028565+0000 mgr.y (mgr.14613) 1296 : cluster 0 pgmap v1731: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 op/s 2024-02-13T15:18:28.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:28 smithi111 bash[23388]: cluster 2024-02-13T15:18:27.263572+0000 mon.a (mon.0) 3571 : cluster 0 osdmap e781: 8 total, 8 up, 8 in 2024-02-13T15:18:28.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:28 smithi111 bash[23388]: cluster 2024-02-13T15:18:28.144334+0000 mon.a (mon.0) 3572 : cluster 3 Health check update: 3 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:29.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:29 smithi062 bash[21479]: cluster 2024-02-13T15:18:28.283337+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-02-13T15:18:29.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:29 smithi062 bash[28859]: cluster 2024-02-13T15:18:28.283337+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-02-13T15:18:29.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:29 smithi111 bash[23388]: cluster 2024-02-13T15:18:28.283337+0000 mon.a (mon.0) 3573 : cluster 0 osdmap e782: 8 total, 8 up, 8 in 2024-02-13T15:18:30.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:30 smithi111 bash[23388]: cluster 2024-02-13T15:18:29.029293+0000 mgr.y (mgr.14613) 1297 : cluster 0 pgmap v1734: 164 pgs: 164 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:30.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:30 smithi111 bash[23388]: cluster 2024-02-13T15:18:29.313156+0000 mon.a (mon.0) 3574 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-02-13T15:18:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:30 smithi062 bash[21479]: cluster 2024-02-13T15:18:29.029293+0000 mgr.y (mgr.14613) 1297 : cluster 0 pgmap v1734: 164 pgs: 164 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:30 smithi062 bash[21479]: cluster 2024-02-13T15:18:29.313156+0000 mon.a (mon.0) 3574 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-02-13T15:18:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:30 smithi062 bash[28859]: cluster 2024-02-13T15:18:29.029293+0000 mgr.y (mgr.14613) 1297 : cluster 0 pgmap v1734: 164 pgs: 164 active+clean; 582 KiB data, 790 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:30 smithi062 bash[28859]: cluster 2024-02-13T15:18:29.313156+0000 mon.a (mon.0) 3574 : cluster 0 osdmap e783: 8 total, 8 up, 8 in 2024-02-13T15:18:31.782 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:31 smithi111 bash[23388]: cluster 2024-02-13T15:18:30.318041+0000 mon.a (mon.0) 3575 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-02-13T15:18:31.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:31 smithi062 bash[21479]: cluster 2024-02-13T15:18:30.318041+0000 mon.a (mon.0) 3575 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-02-13T15:18:31.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:31 smithi062 bash[28859]: cluster 2024-02-13T15:18:30.318041+0000 mon.a (mon.0) 3575 : cluster 0 osdmap e784: 8 total, 8 up, 8 in 2024-02-13T15:18:32.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:18:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:18:32.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:32 smithi111 bash[23388]: cluster 2024-02-13T15:18:31.030155+0000 mgr.y (mgr.14613) 1298 : cluster 0 pgmap v1737: 228 pgs: 64 creating+peering, 164 active+clean; 582 KiB data, 796 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:32 smithi111 bash[23388]: cluster 2024-02-13T15:18:31.347063+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-02-13T15:18:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:32 smithi111 bash[23388]: audit 2024-02-13T15:18:31.814959+0000 mon.b (mon.1) 387 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:18:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:32 smithi062 bash[21479]: cluster 2024-02-13T15:18:31.030155+0000 mgr.y (mgr.14613) 1298 : cluster 0 pgmap v1737: 228 pgs: 64 creating+peering, 164 active+clean; 582 KiB data, 796 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:32 smithi062 bash[21479]: cluster 2024-02-13T15:18:31.347063+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-02-13T15:18:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:32 smithi062 bash[21479]: audit 2024-02-13T15:18:31.814959+0000 mon.b (mon.1) 387 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:18:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:32 smithi062 bash[28859]: cluster 2024-02-13T15:18:31.030155+0000 mgr.y (mgr.14613) 1298 : cluster 0 pgmap v1737: 228 pgs: 64 creating+peering, 164 active+clean; 582 KiB data, 796 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:32 smithi062 bash[28859]: cluster 2024-02-13T15:18:31.347063+0000 mon.a (mon.0) 3576 : cluster 0 osdmap e785: 8 total, 8 up, 8 in 2024-02-13T15:18:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:32 smithi062 bash[28859]: audit 2024-02-13T15:18:31.814959+0000 mon.b (mon.1) 387 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:18:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[28859]: audit 2024-02-13T15:18:31.781423+0000 mgr.y (mgr.14613) 1299 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[28859]: cluster 2024-02-13T15:18:32.350044+0000 mon.a (mon.0) 3577 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-02-13T15:18:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[28859]: audit 2024-02-13T15:18:32.545127+0000 mon.b (mon.1) 388 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:18:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[28859]: audit 2024-02-13T15:18:32.546892+0000 mon.b (mon.1) 389 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:18:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[28859]: audit 2024-02-13T15:18:32.554961+0000 mon.a (mon.0) 3578 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:18:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[21479]: audit 2024-02-13T15:18:31.781423+0000 mgr.y (mgr.14613) 1299 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[21479]: cluster 2024-02-13T15:18:32.350044+0000 mon.a (mon.0) 3577 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-02-13T15:18:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[21479]: audit 2024-02-13T15:18:32.545127+0000 mon.b (mon.1) 388 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:18:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[21479]: audit 2024-02-13T15:18:32.546892+0000 mon.b (mon.1) 389 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:18:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:33 smithi062 bash[21479]: audit 2024-02-13T15:18:32.554961+0000 mon.a (mon.0) 3578 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:18:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:33 smithi111 bash[23388]: audit 2024-02-13T15:18:31.781423+0000 mgr.y (mgr.14613) 1299 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:33.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:33 smithi111 bash[23388]: cluster 2024-02-13T15:18:32.350044+0000 mon.a (mon.0) 3577 : cluster 0 osdmap e786: 8 total, 8 up, 8 in 2024-02-13T15:18:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:33 smithi111 bash[23388]: audit 2024-02-13T15:18:32.545127+0000 mon.b (mon.1) 388 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:18:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:33 smithi111 bash[23388]: audit 2024-02-13T15:18:32.546892+0000 mon.b (mon.1) 389 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:18:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:33 smithi111 bash[23388]: audit 2024-02-13T15:18:32.554961+0000 mon.a (mon.0) 3578 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:18:34.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:34 smithi062 bash[21479]: cluster 2024-02-13T15:18:33.031105+0000 mgr.y (mgr.14613) 1300 : cluster 0 pgmap v1740: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 796 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:34 smithi062 bash[21479]: cluster 2024-02-13T15:18:33.357798+0000 mon.a (mon.0) 3579 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-02-13T15:18:34.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:34 smithi062 bash[28859]: cluster 2024-02-13T15:18:33.031105+0000 mgr.y (mgr.14613) 1300 : cluster 0 pgmap v1740: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 796 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:34.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:34 smithi062 bash[28859]: cluster 2024-02-13T15:18:33.357798+0000 mon.a (mon.0) 3579 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-02-13T15:18:34.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:34 smithi111 bash[23388]: cluster 2024-02-13T15:18:33.031105+0000 mgr.y (mgr.14613) 1300 : cluster 0 pgmap v1740: 228 pgs: 64 unknown, 164 active+clean; 582 KiB data, 796 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:34.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:34 smithi111 bash[23388]: cluster 2024-02-13T15:18:33.357798+0000 mon.a (mon.0) 3579 : cluster 0 osdmap e787: 8 total, 8 up, 8 in 2024-02-13T15:18:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:35 smithi062 bash[21479]: cluster 2024-02-13T15:18:34.391012+0000 mon.a (mon.0) 3580 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-02-13T15:18:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:35 smithi062 bash[28859]: cluster 2024-02-13T15:18:34.391012+0000 mon.a (mon.0) 3580 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-02-13T15:18:35.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:35 smithi111 bash[23388]: cluster 2024-02-13T15:18:34.391012+0000 mon.a (mon.0) 3580 : cluster 0 osdmap e788: 8 total, 8 up, 8 in 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: Running main() from gmock_main.cc 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [==========] Running 7 tests from 1 test suite. 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [----------] Global test environment set-up. 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertExists 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertExists (1816613 ms) 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.AssertVersion 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.AssertVersion (3489 ms) 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Xattrs 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.Xattrs (3009 ms) 2024-02-13T15:18:36.428 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Write 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.Write (3068 ms) 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.Exec 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.Exec (3056 ms) 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.WriteSame 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.WriteSame (3063 ms) 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ RUN ] NeoRadosWriteOps.CmpExt 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ OK ] NeoRadosWriteOps.CmpExt (5055 ms) 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [----------] 7 tests from NeoRadosWriteOps (1837353 ms total) 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [----------] Global test environment tear-down 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [==========] 7 tests from 1 test suite ran. (1837353 ms total) 2024-02-13T15:18:36.429 INFO:tasks.workunit.client.0.smithi062.stdout: write_operations: [ PASSED ] 7 tests. 2024-02-13T15:18:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:36 smithi062 bash[21479]: cluster 2024-02-13T15:18:35.033336+0000 mgr.y (mgr.14613) 1301 : cluster 0 pgmap v1743: 196 pgs: 196 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T15:18:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:36 smithi062 bash[21479]: cluster 2024-02-13T15:18:35.384276+0000 mon.a (mon.0) 3581 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:36 smithi062 bash[21479]: cluster 2024-02-13T15:18:35.403979+0000 mon.a (mon.0) 3582 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-02-13T15:18:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:36 smithi062 bash[28859]: cluster 2024-02-13T15:18:35.033336+0000 mgr.y (mgr.14613) 1301 : cluster 0 pgmap v1743: 196 pgs: 196 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T15:18:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:36 smithi062 bash[28859]: cluster 2024-02-13T15:18:35.384276+0000 mon.a (mon.0) 3581 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:36.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:36 smithi062 bash[28859]: cluster 2024-02-13T15:18:35.403979+0000 mon.a (mon.0) 3582 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-02-13T15:18:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:18:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:18:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:18:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:36 smithi111 bash[23388]: cluster 2024-02-13T15:18:35.033336+0000 mgr.y (mgr.14613) 1301 : cluster 0 pgmap v1743: 196 pgs: 196 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-13T15:18:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:36 smithi111 bash[23388]: cluster 2024-02-13T15:18:35.384276+0000 mon.a (mon.0) 3581 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:36 smithi111 bash[23388]: cluster 2024-02-13T15:18:35.403979+0000 mon.a (mon.0) 3582 : cluster 0 osdmap e789: 8 total, 8 up, 8 in 2024-02-13T15:18:37.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:37 smithi062 bash[28859]: cluster 2024-02-13T15:18:36.418352+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-02-13T15:18:37.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:37 smithi062 bash[28859]: audit 2024-02-13T15:18:37.338397+0000 mon.b (mon.1) 390 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:37 smithi062 bash[21479]: cluster 2024-02-13T15:18:36.418352+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-02-13T15:18:37.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:37 smithi062 bash[21479]: audit 2024-02-13T15:18:37.338397+0000 mon.b (mon.1) 390 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:37.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:37 smithi111 bash[23388]: cluster 2024-02-13T15:18:36.418352+0000 mon.a (mon.0) 3583 : cluster 0 osdmap e790: 8 total, 8 up, 8 in 2024-02-13T15:18:37.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:37 smithi111 bash[23388]: audit 2024-02-13T15:18:37.338397+0000 mon.b (mon.1) 390 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:38 smithi062 bash[28859]: cluster 2024-02-13T15:18:37.034129+0000 mgr.y (mgr.14613) 1302 : cluster 0 pgmap v1746: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:38.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:38 smithi062 bash[28859]: cluster 2024-02-13T15:18:37.427852+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-02-13T15:18:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:38 smithi062 bash[21479]: cluster 2024-02-13T15:18:37.034129+0000 mgr.y (mgr.14613) 1302 : cluster 0 pgmap v1746: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:38 smithi062 bash[21479]: cluster 2024-02-13T15:18:37.427852+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-02-13T15:18:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:38 smithi111 bash[23388]: cluster 2024-02-13T15:18:37.034129+0000 mgr.y (mgr.14613) 1302 : cluster 0 pgmap v1746: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:38 smithi111 bash[23388]: cluster 2024-02-13T15:18:37.427852+0000 mon.a (mon.0) 3584 : cluster 0 osdmap e791: 8 total, 8 up, 8 in 2024-02-13T15:18:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:39 smithi062 bash[21479]: cluster 2024-02-13T15:18:38.432388+0000 mon.a (mon.0) 3585 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-02-13T15:18:39.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:39 smithi062 bash[21479]: cluster 2024-02-13T15:18:39.435415+0000 mon.a (mon.0) 3586 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-02-13T15:18:39.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:39 smithi062 bash[28859]: cluster 2024-02-13T15:18:38.432388+0000 mon.a (mon.0) 3585 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-02-13T15:18:39.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:39 smithi062 bash[28859]: cluster 2024-02-13T15:18:39.435415+0000 mon.a (mon.0) 3586 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-02-13T15:18:39.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:39 smithi111 bash[23388]: cluster 2024-02-13T15:18:38.432388+0000 mon.a (mon.0) 3585 : cluster 0 osdmap e792: 8 total, 8 up, 8 in 2024-02-13T15:18:39.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:39 smithi111 bash[23388]: cluster 2024-02-13T15:18:39.435415+0000 mon.a (mon.0) 3586 : cluster 0 osdmap e793: 8 total, 8 up, 8 in 2024-02-13T15:18:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:40 smithi062 bash[21479]: cluster 2024-02-13T15:18:39.034921+0000 mgr.y (mgr.14613) 1303 : cluster 0 pgmap v1749: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:40 smithi062 bash[21479]: cluster 2024-02-13T15:18:40.457333+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-02-13T15:18:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:40 smithi062 bash[28859]: cluster 2024-02-13T15:18:39.034921+0000 mgr.y (mgr.14613) 1303 : cluster 0 pgmap v1749: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:40 smithi062 bash[28859]: cluster 2024-02-13T15:18:40.457333+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-02-13T15:18:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:40 smithi111 bash[23388]: cluster 2024-02-13T15:18:39.034921+0000 mgr.y (mgr.14613) 1303 : cluster 0 pgmap v1749: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 794 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:40 smithi111 bash[23388]: cluster 2024-02-13T15:18:40.457333+0000 mon.a (mon.0) 3587 : cluster 0 osdmap e794: 8 total, 8 up, 8 in 2024-02-13T15:18:41.793 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:41 smithi111 bash[23388]: cluster 2024-02-13T15:18:41.469143+0000 mon.a (mon.0) 3588 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:41.793 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:41 smithi111 bash[23388]: cluster 2024-02-13T15:18:41.487293+0000 mon.a (mon.0) 3589 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-02-13T15:18:41.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:41 smithi062 bash[21479]: cluster 2024-02-13T15:18:41.469143+0000 mon.a (mon.0) 3588 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:41.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:41 smithi062 bash[21479]: cluster 2024-02-13T15:18:41.487293+0000 mon.a (mon.0) 3589 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-02-13T15:18:41.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:41 smithi062 bash[28859]: cluster 2024-02-13T15:18:41.469143+0000 mon.a (mon.0) 3588 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:41.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:41 smithi062 bash[28859]: cluster 2024-02-13T15:18:41.487293+0000 mon.a (mon.0) 3589 : cluster 0 osdmap e795: 8 total, 8 up, 8 in 2024-02-13T15:18:42.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:18:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:18:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:42 smithi062 bash[21479]: cluster 2024-02-13T15:18:41.035648+0000 mgr.y (mgr.14613) 1304 : cluster 0 pgmap v1752: 164 pgs: 164 active+clean; 582 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:42 smithi062 bash[21479]: cluster 2024-02-13T15:18:42.492364+0000 mon.a (mon.0) 3590 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-02-13T15:18:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:42 smithi062 bash[28859]: cluster 2024-02-13T15:18:41.035648+0000 mgr.y (mgr.14613) 1304 : cluster 0 pgmap v1752: 164 pgs: 164 active+clean; 582 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:42 smithi062 bash[28859]: cluster 2024-02-13T15:18:42.492364+0000 mon.a (mon.0) 3590 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-02-13T15:18:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:42 smithi111 bash[23388]: cluster 2024-02-13T15:18:41.035648+0000 mgr.y (mgr.14613) 1304 : cluster 0 pgmap v1752: 164 pgs: 164 active+clean; 582 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:42 smithi111 bash[23388]: cluster 2024-02-13T15:18:42.492364+0000 mon.a (mon.0) 3590 : cluster 0 osdmap e796: 8 total, 8 up, 8 in 2024-02-13T15:18:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:43 smithi062 bash[21479]: audit 2024-02-13T15:18:41.792896+0000 mgr.y (mgr.14613) 1305 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:43.841 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:43 smithi062 bash[21479]: cluster 2024-02-13T15:18:43.496363+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-02-13T15:18:43.841 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:43 smithi062 bash[28859]: audit 2024-02-13T15:18:41.792896+0000 mgr.y (mgr.14613) 1305 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:43.841 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:43 smithi062 bash[28859]: cluster 2024-02-13T15:18:43.496363+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-02-13T15:18:43.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:43 smithi111 bash[23388]: audit 2024-02-13T15:18:41.792896+0000 mgr.y (mgr.14613) 1305 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:43.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:43 smithi111 bash[23388]: cluster 2024-02-13T15:18:43.496363+0000 mon.a (mon.0) 3591 : cluster 0 osdmap e797: 8 total, 8 up, 8 in 2024-02-13T15:18:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:44 smithi062 bash[21479]: cluster 2024-02-13T15:18:43.036441+0000 mgr.y (mgr.14613) 1306 : cluster 0 pgmap v1755: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:44 smithi062 bash[28859]: cluster 2024-02-13T15:18:43.036441+0000 mgr.y (mgr.14613) 1306 : cluster 0 pgmap v1755: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:44 smithi111 bash[23388]: cluster 2024-02-13T15:18:43.036441+0000 mgr.y (mgr.14613) 1306 : cluster 0 pgmap v1755: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 821 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:45.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:45 smithi111 bash[23388]: cluster 2024-02-13T15:18:44.556685+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-02-13T15:18:46.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:45 smithi062 bash[21479]: cluster 2024-02-13T15:18:44.556685+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-02-13T15:18:46.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:45 smithi062 bash[28859]: cluster 2024-02-13T15:18:44.556685+0000 mon.a (mon.0) 3592 : cluster 0 osdmap e798: 8 total, 8 up, 8 in 2024-02-13T15:18:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:18:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:18:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:18:46.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:46 smithi111 bash[23388]: cluster 2024-02-13T15:18:45.038513+0000 mgr.y (mgr.14613) 1307 : cluster 0 pgmap v1758: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:46.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:46 smithi111 bash[23388]: cluster 2024-02-13T15:18:45.576611+0000 mon.a (mon.0) 3593 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-02-13T15:18:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:46 smithi062 bash[28859]: cluster 2024-02-13T15:18:45.038513+0000 mgr.y (mgr.14613) 1307 : cluster 0 pgmap v1758: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:46 smithi062 bash[28859]: cluster 2024-02-13T15:18:45.576611+0000 mon.a (mon.0) 3593 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-02-13T15:18:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:46 smithi062 bash[21479]: cluster 2024-02-13T15:18:45.038513+0000 mgr.y (mgr.14613) 1307 : cluster 0 pgmap v1758: 196 pgs: 32 creating+peering, 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:46 smithi062 bash[21479]: cluster 2024-02-13T15:18:45.576611+0000 mon.a (mon.0) 3593 : cluster 0 osdmap e799: 8 total, 8 up, 8 in 2024-02-13T15:18:47.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:47 smithi111 bash[23388]: cluster 2024-02-13T15:18:46.577978+0000 mon.a (mon.0) 3594 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-02-13T15:18:48.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:47 smithi062 bash[21479]: cluster 2024-02-13T15:18:46.577978+0000 mon.a (mon.0) 3594 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-02-13T15:18:48.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:47 smithi062 bash[28859]: cluster 2024-02-13T15:18:46.577978+0000 mon.a (mon.0) 3594 : cluster 0 osdmap e800: 8 total, 8 up, 8 in 2024-02-13T15:18:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:48 smithi062 bash[28859]: cluster 2024-02-13T15:18:47.039374+0000 mgr.y (mgr.14613) 1308 : cluster 0 pgmap v1761: 164 pgs: 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:48 smithi062 bash[28859]: cluster 2024-02-13T15:18:47.571253+0000 mon.a (mon.0) 3595 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:48 smithi062 bash[28859]: cluster 2024-02-13T15:18:47.597734+0000 mon.a (mon.0) 3596 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-02-13T15:18:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:48 smithi062 bash[21479]: cluster 2024-02-13T15:18:47.039374+0000 mgr.y (mgr.14613) 1308 : cluster 0 pgmap v1761: 164 pgs: 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:49.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:48 smithi062 bash[21479]: cluster 2024-02-13T15:18:47.571253+0000 mon.a (mon.0) 3595 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:49.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:48 smithi062 bash[21479]: cluster 2024-02-13T15:18:47.597734+0000 mon.a (mon.0) 3596 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-02-13T15:18:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:48 smithi111 bash[23388]: cluster 2024-02-13T15:18:47.039374+0000 mgr.y (mgr.14613) 1308 : cluster 0 pgmap v1761: 164 pgs: 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:48 smithi111 bash[23388]: cluster 2024-02-13T15:18:47.571253+0000 mon.a (mon.0) 3595 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:49.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:48 smithi111 bash[23388]: cluster 2024-02-13T15:18:47.597734+0000 mon.a (mon.0) 3596 : cluster 0 osdmap e801: 8 total, 8 up, 8 in 2024-02-13T15:18:50.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:49 smithi062 bash[28859]: cluster 2024-02-13T15:18:48.596501+0000 mon.a (mon.0) 3597 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-02-13T15:18:50.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:49 smithi062 bash[21479]: cluster 2024-02-13T15:18:48.596501+0000 mon.a (mon.0) 3597 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-02-13T15:18:50.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:49 smithi111 bash[23388]: cluster 2024-02-13T15:18:48.596501+0000 mon.a (mon.0) 3597 : cluster 0 osdmap e802: 8 total, 8 up, 8 in 2024-02-13T15:18:51.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:50 smithi062 bash[28859]: cluster 2024-02-13T15:18:49.040184+0000 mgr.y (mgr.14613) 1309 : cluster 0 pgmap v1764: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:51.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:50 smithi062 bash[28859]: cluster 2024-02-13T15:18:49.637608+0000 mon.a (mon.0) 3598 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-02-13T15:18:51.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:50 smithi062 bash[21479]: cluster 2024-02-13T15:18:49.040184+0000 mgr.y (mgr.14613) 1309 : cluster 0 pgmap v1764: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:51.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:50 smithi062 bash[21479]: cluster 2024-02-13T15:18:49.637608+0000 mon.a (mon.0) 3598 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-02-13T15:18:51.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:50 smithi111 bash[23388]: cluster 2024-02-13T15:18:49.040184+0000 mgr.y (mgr.14613) 1309 : cluster 0 pgmap v1764: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 831 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:18:51.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:50 smithi111 bash[23388]: cluster 2024-02-13T15:18:49.637608+0000 mon.a (mon.0) 3598 : cluster 0 osdmap e803: 8 total, 8 up, 8 in 2024-02-13T15:18:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:51 smithi062 bash[28859]: cluster 2024-02-13T15:18:50.641557+0000 mon.a (mon.0) 3599 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-02-13T15:18:52.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:51 smithi062 bash[28859]: cluster 2024-02-13T15:18:51.641614+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-02-13T15:18:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:51 smithi062 bash[21479]: cluster 2024-02-13T15:18:50.641557+0000 mon.a (mon.0) 3599 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-02-13T15:18:52.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:51 smithi062 bash[21479]: cluster 2024-02-13T15:18:51.641614+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-02-13T15:18:52.094 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:18:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:18:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:51 smithi111 bash[23388]: cluster 2024-02-13T15:18:50.641557+0000 mon.a (mon.0) 3599 : cluster 0 osdmap e804: 8 total, 8 up, 8 in 2024-02-13T15:18:52.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:51 smithi111 bash[23388]: cluster 2024-02-13T15:18:51.641614+0000 mon.a (mon.0) 3600 : cluster 0 osdmap e805: 8 total, 8 up, 8 in 2024-02-13T15:18:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:52 smithi062 bash[28859]: cluster 2024-02-13T15:18:51.040997+0000 mgr.y (mgr.14613) 1310 : cluster 0 pgmap v1767: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 837 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:52 smithi062 bash[28859]: audit 2024-02-13T15:18:51.804328+0000 mgr.y (mgr.14613) 1311 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:52 smithi062 bash[28859]: audit 2024-02-13T15:18:52.372207+0000 mon.b (mon.1) 391 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:53.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:52 smithi062 bash[28859]: cluster 2024-02-13T15:18:52.676008+0000 mon.a (mon.0) 3601 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-02-13T15:18:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:52 smithi062 bash[21479]: cluster 2024-02-13T15:18:51.040997+0000 mgr.y (mgr.14613) 1310 : cluster 0 pgmap v1767: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 837 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:53.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:52 smithi062 bash[21479]: audit 2024-02-13T15:18:51.804328+0000 mgr.y (mgr.14613) 1311 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:53.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:52 smithi062 bash[21479]: audit 2024-02-13T15:18:52.372207+0000 mon.b (mon.1) 391 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:53.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:52 smithi062 bash[21479]: cluster 2024-02-13T15:18:52.676008+0000 mon.a (mon.0) 3601 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-02-13T15:18:53.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:52 smithi111 bash[23388]: cluster 2024-02-13T15:18:51.040997+0000 mgr.y (mgr.14613) 1310 : cluster 0 pgmap v1767: 196 pgs: 32 unknown, 164 active+clean; 582 KiB data, 837 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:53.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:52 smithi111 bash[23388]: audit 2024-02-13T15:18:51.804328+0000 mgr.y (mgr.14613) 1311 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:18:53.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:52 smithi111 bash[23388]: audit 2024-02-13T15:18:52.372207+0000 mon.b (mon.1) 391 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:18:53.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:52 smithi111 bash[23388]: cluster 2024-02-13T15:18:52.676008+0000 mon.a (mon.0) 3601 : cluster 0 osdmap e806: 8 total, 8 up, 8 in 2024-02-13T15:18:54.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:53 smithi062 bash[21479]: cluster 2024-02-13T15:18:53.041696+0000 mgr.y (mgr.14613) 1312 : cluster 0 pgmap v1770: 164 pgs: 164 active+clean; 582 KiB data, 837 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:54.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:53 smithi062 bash[21479]: cluster 2024-02-13T15:18:53.191428+0000 mon.a (mon.0) 3602 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:54.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:53 smithi062 bash[28859]: cluster 2024-02-13T15:18:53.041696+0000 mgr.y (mgr.14613) 1312 : cluster 0 pgmap v1770: 164 pgs: 164 active+clean; 582 KiB data, 837 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:54.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:53 smithi062 bash[28859]: cluster 2024-02-13T15:18:53.191428+0000 mon.a (mon.0) 3602 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:54.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:53 smithi111 bash[23388]: cluster 2024-02-13T15:18:53.041696+0000 mgr.y (mgr.14613) 1312 : cluster 0 pgmap v1770: 164 pgs: 164 active+clean; 582 KiB data, 837 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:54.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:53 smithi111 bash[23388]: cluster 2024-02-13T15:18:53.191428+0000 mon.a (mon.0) 3602 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:18:55.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:54 smithi062 bash[21479]: cluster 2024-02-13T15:18:53.710216+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-02-13T15:18:55.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:54 smithi062 bash[28859]: cluster 2024-02-13T15:18:53.710216+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-02-13T15:18:55.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:54 smithi111 bash[23388]: cluster 2024-02-13T15:18:53.710216+0000 mon.a (mon.0) 3603 : cluster 0 osdmap e807: 8 total, 8 up, 8 in 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: Running main() from gmock_main.cc 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [==========] Running 14 tests from 1 test suite. 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [----------] Global test environment set-up. 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.SetOpFlags 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.SetOpFlags (1816636 ms) 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertExists 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertExists (3477 ms) 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.AssertVersion 2024-02-13T15:18:55.758 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.AssertVersion (3023 ms) 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpXattr 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpXattr (3067 ms) 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Read 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Read (3041 ms) 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Checksum 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Checksum (3063 ms) 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.RWOrderedRead 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.RWOrderedRead (3046 ms) 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.ShortRead 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.ShortRead (3039 ms) 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Exec 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Exec (3027 ms) 2024-02-13T15:18:55.759 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Stat 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Stat (3037 ms) 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.Omap 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.Omap (3080 ms) 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.OmapNuls 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.OmapNuls (3062 ms) 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.GetXattrs 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.GetXattrs (3037 ms) 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ RUN ] NeoRadosReadOps.CmpExt 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ OK ] NeoRadosReadOps.CmpExt (3070 ms) 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [----------] 14 tests from NeoRadosReadOps (1856706 ms total) 2024-02-13T15:18:55.760 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: 2024-02-13T15:18:55.761 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [----------] Global test environment tear-down 2024-02-13T15:18:55.761 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [==========] 14 tests from 1 test suite ran. (1856706 ms total) 2024-02-13T15:18:55.761 INFO:tasks.workunit.client.0.smithi062.stdout: read_operations: [ PASSED ] 14 tests. 2024-02-13T15:18:55.763 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64816 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64816 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65235 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65235 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65453 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65453 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64758 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64758 2024-02-13T15:18:55.764 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65033 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65033 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65391 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65391 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65193 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65193 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65410 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65410 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.765 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64972 2024-02-13T15:18:55.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64972 2024-02-13T15:18:55.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64713 2024-02-13T15:18:55.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64713 2024-02-13T15:18:55.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65434 2024-02-13T15:18:55.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65434 2024-02-13T15:18:55.766 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64912 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64912 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64499 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64499 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64539 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64539 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64881 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64881 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.769 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64555 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64555 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64935 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64935 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=64951 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 64951 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65352 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65352 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ for t in "${!pids[@]}" 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=65486 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 65486 2024-02-13T15:18:55.770 INFO:tasks.workunit.client.0.smithi062.stderr:+ exit 0 2024-02-13T15:18:55.771 INFO:tasks.workunit.client.0.smithi062.stderr:+ cleanup 2024-02-13T15:18:55.771 INFO:tasks.workunit.client.0.smithi062.stderr:+ pkill -P 64494 2024-02-13T15:18:55.779 INFO:tasks.workunit.client.0.smithi062.stderr:+ true 2024-02-13T15:18:55.781 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-13T15:18:55.781 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-13T15:18:55.795 INFO:tasks.workunit:Running workunits matching rados/test_pool_quota.sh on client.0... 2024-02-13T15:18:55.796 INFO:tasks.workunit:Running workunit rados/test_pool_quota.sh... 2024-02-13T15:18:55.797 DEBUG:teuthology.orchestra.run.smithi062:workunit test rados/test_pool_quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e1b79d5a4193a484176863ab96c0ca28c00e1662 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_pool_quota.sh 2024-02-13T15:18:55.849 INFO:tasks.workunit.client.0.smithi062.stderr:+ uuidgen 2024-02-13T15:18:55.850 INFO:tasks.workunit.client.0.smithi062.stderr:+ p=38effd22-4604-428a-b9f7-cf7ee1ea6006 2024-02-13T15:18:55.850 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool create 38effd22-4604-428a-b9f7-cf7ee1ea6006 12 2024-02-13T15:18:55.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- 172.21.15.62:0/1663129074 >> v1:172.21.15.62:6790/0 conn(0x7fb42c1033e0 legacy=0x7fb42c1037c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:55.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- 172.21.15.62:0/1663129074 shutdown_connections 2024-02-13T15:18:55.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- 172.21.15.62:0/1663129074 >> 172.21.15.62:0/1663129074 conn(0x7fb42c0fec30 msgr2=0x7fb42c101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:18:55.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- 172.21.15.62:0/1663129074 shutdown_connections 2024-02-13T15:18:55.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- 172.21.15.62:0/1663129074 wait complete. 2024-02-13T15:18:55.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 Processor -- start 2024-02-13T15:18:55.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- start start 2024-02-13T15:18:55.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb42c1a7f10 con 0x7fb42c1033e0 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb42c1a90f0 con 0x7fb42c10c070 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb42c1aa2f0 con 0x7fb42c10fbe0 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4311f2640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb42c1033e0 0x7fb42c108530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37694/0 (socket says 172.21.15.62:37694) 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4311f2640 1 -- 172.21.15.62:0/3287878081 learned_addr learned my addr 172.21.15.62:0/3287878081 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2033567770 0 0) 0x7fb42c1aa2f0 con 0x7fb42c10fbe0 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb418003530 con 0x7fb42c10fbe0 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883448215 0 0) 0x7fb42c1a7f10 con 0x7fb42c1033e0 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb42c1aa2f0 con 0x7fb42c1033e0 2024-02-13T15:18:55.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2834697955 0 0) 0x7fb418003530 con 0x7fb42c10fbe0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb42c1a7f10 con 0x7fb42c10fbe0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb424001b80 con 0x7fb42c10fbe0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1448498661 0 0) 0x7fb42c1aa2f0 con 0x7fb42c1033e0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb418003530 con 0x7fb42c1033e0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 125107167 0 0) 0x7fb42c1a90f0 con 0x7fb42c10c070 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb42c1aa2f0 con 0x7fb42c10c070 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb4280043b0 con 0x7fb42c1033e0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 590672806 0 0) 0x7fb42c1a7f10 con 0x7fb42c10fbe0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 >> v1:172.21.15.111:6789/0 conn(0x7fb42c10c070 legacy=0x7fb42c1a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 >> v1:172.21.15.62:6789/0 conn(0x7fb42c1033e0 legacy=0x7fb42c108530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb42c1ab4f0 con 0x7fb42c10fbe0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42c1aa4e0 con 0x7fb42c10fbe0 2024-02-13T15:18:55.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42c1aa960 con 0x7fb42c10fbe0 2024-02-13T15:18:55.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fb424003e10 con 0x7fb42c10fbe0 2024-02-13T15:18:55.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.976+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb424004d60 con 0x7fb42c10fbe0 2024-02-13T15:18:55.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.980+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb410005090 con 0x7fb42c10fbe0 2024-02-13T15:18:55.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.980+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fb424003980 con 0x7fb42c10fbe0 2024-02-13T15:18:55.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.980+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(809..809 src has 269..809) v4 ==== 7356+0+0 (unknown 2619560219 0 0) 0x7fb424088480 con 0x7fb42c10fbe0 2024-02-13T15:18:55.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:55.984+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fb4240550e0 con 0x7fb42c10fbe0 2024-02-13T15:18:56.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:55 smithi062 bash[21479]: cluster 2024-02-13T15:18:54.714229+0000 mon.a (mon.0) 3604 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-02-13T15:18:56.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:55 smithi062 bash[21479]: cluster 2024-02-13T15:18:55.042841+0000 mgr.y (mgr.14613) 1313 : cluster 0 pgmap v1773: 196 pgs: 3 creating+activating, 29 creating+peering, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:55 smithi062 bash[28859]: cluster 2024-02-13T15:18:54.714229+0000 mon.a (mon.0) 3604 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-02-13T15:18:56.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:55 smithi062 bash[28859]: cluster 2024-02-13T15:18:55.042841+0000 mgr.y (mgr.14613) 1313 : cluster 0 pgmap v1773: 196 pgs: 3 creating+activating, 29 creating+peering, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:56.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:55 smithi111 bash[23388]: cluster 2024-02-13T15:18:54.714229+0000 mon.a (mon.0) 3604 : cluster 0 osdmap e808: 8 total, 8 up, 8 in 2024-02-13T15:18:56.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:55 smithi111 bash[23388]: cluster 2024-02-13T15:18:55.042841+0000 mgr.y (mgr.14613) 1313 : cluster 0 pgmap v1773: 196 pgs: 3 creating+activating, 29 creating+peering, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:56.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.160+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12} v 0) v1 -- 0x7fb4100058c0 con 0x7fb42c10fbe0 2024-02-13T15:18:56.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:18:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:18:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:18:56.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.744+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]=0 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' created v810) v1 ==== 176+0+0 (unknown 2695078029 0 0) 0x7fb424053450 con 0x7fb42c10fbe0 2024-02-13T15:18:56.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.856+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12} v 0) v1 -- 0x7fb4100053f0 con 0x7fb42c10fbe0 2024-02-13T15:18:56.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.860+0000 7fb4227fc640 1 -- 172.21.15.62:0/3287878081 <== mon.2 v1:172.21.15.62:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]=0 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' already exists v810) v1 ==== 183+0+0 (unknown 3803536081 0 0) 0x7fb4100053f0 con 0x7fb42c10fbe0 2024-02-13T15:18:56.862 INFO:tasks.workunit.client.0.smithi062.stderr:pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' already exists 2024-02-13T15:18:56.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.860+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 >> v1:172.21.15.62:6800/3802446050 conn(0x7fb41806eed0 legacy=0x7fb418071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:56.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.860+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 >> v1:172.21.15.62:6790/0 conn(0x7fb42c10fbe0 legacy=0x7fb42c1a6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:56.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.860+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 shutdown_connections 2024-02-13T15:18:56.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.860+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 >> 172.21.15.62:0/3287878081 conn(0x7fb42c0fec30 msgr2=0x7fb42c108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:18:56.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.860+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 shutdown_connections 2024-02-13T15:18:56.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:56.860+0000 7fb433456640 1 -- 172.21.15.62:0/3287878081 wait complete. 2024-02-13T15:18:56.879 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool set-quota 38effd22-4604-428a-b9f7-cf7ee1ea6006 max_objects 10 2024-02-13T15:18:57.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.000+0000 7f752dd54640 1 -- 172.21.15.62:0/3314913533 >> v1:172.21.15.62:6790/0 conn(0x7f7528114010 legacy=0x7f75281164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:57.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.000+0000 7f752dd54640 1 -- 172.21.15.62:0/3314913533 shutdown_connections 2024-02-13T15:18:57.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.000+0000 7f752dd54640 1 -- 172.21.15.62:0/3314913533 >> 172.21.15.62:0/3314913533 conn(0x7f7528076da0 msgr2=0x7f75280791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:18:57.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.000+0000 7f752dd54640 1 -- 172.21.15.62:0/3314913533 shutdown_connections 2024-02-13T15:18:57.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.000+0000 7f752dd54640 1 -- 172.21.15.62:0/3314913533 wait complete. 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f752dd54640 1 Processor -- start 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f752dd54640 1 -- start start 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f752dd54640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f75281ac3d0 con 0x7f7528110410 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f752dd54640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f75281ad5d0 con 0x7f752810d660 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f752dd54640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f75281ae7d0 con 0x7f7528114010 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7526ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7528110410 0x7f75281a7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37708/0 (socket says 172.21.15.62:37708) 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7526ffd640 1 -- 172.21.15.62:0/3521723432 learned_addr learned my addr 172.21.15.62:0/3521723432 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816871799 0 0) 0x7f75281ac3d0 con 0x7f7528110410 2024-02-13T15:18:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7514003530 con 0x7f7528110410 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1928512924 0 0) 0x7f75281ae7d0 con 0x7f7528114010 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75281ac3d0 con 0x7f7528114010 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3730525247 0 0) 0x7f7514003530 con 0x7f7528110410 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f75281ae7d0 con 0x7f7528110410 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f7510001d20 con 0x7f7528110410 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3066765711 0 0) 0x7f75281ac3d0 con 0x7f7528114010 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7514003530 con 0x7f7528114010 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364590147 0 0) 0x7f75281ad5d0 con 0x7f752810d660 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75281ac3d0 con 0x7f752810d660 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f75200018c0 con 0x7f7528114010 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 437850093 0 0) 0x7f75281ae7d0 con 0x7f7528110410 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 >> v1:172.21.15.62:6790/0 conn(0x7f7528114010 legacy=0x7f75281aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 >> v1:172.21.15.111:6789/0 conn(0x7f752810d660 legacy=0x7f752810c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:57.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75281af9d0 con 0x7f7528110410 2024-02-13T15:18:57.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75281ae9c0 con 0x7f7528110410 2024-02-13T15:18:57.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f75281aeec0 con 0x7f7528110410 2024-02-13T15:18:57.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f7510003e30 con 0x7f7528110410 2024-02-13T15:18:57.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f7510005f60 con 0x7f7528110410 2024-02-13T15:18:57.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7508005090 con 0x7f7528110410 2024-02-13T15:18:57.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.004+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f75100039a0 con 0x7f7528110410 2024-02-13T15:18:57.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.008+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(810..810 src has 269..810) v4 ==== 7731+0+0 (unknown 3830781239 0 0) 0x7f7510089880 con 0x7f7528110410 2024-02-13T15:18:57.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.012+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f7510056360 con 0x7f7528110410 2024-02-13T15:18:57.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:56 smithi062 bash[28859]: cluster 2024-02-13T15:18:55.745683+0000 mon.a (mon.0) 3605 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-02-13T15:18:57.061 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:56 smithi062 bash[28859]: audit 2024-02-13T15:18:56.163944+0000 mon.c (mon.2) 870 : audit 1 from='client.? v1:172.21.15.62:0/3287878081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:57.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:56 smithi062 bash[28859]: audit 2024-02-13T15:18:56.164524+0000 mon.a (mon.0) 3606 : audit 1 from='client.47135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:57.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:56 smithi062 bash[21479]: cluster 2024-02-13T15:18:55.745683+0000 mon.a (mon.0) 3605 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-02-13T15:18:57.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:56 smithi062 bash[21479]: audit 2024-02-13T15:18:56.163944+0000 mon.c (mon.2) 870 : audit 1 from='client.? v1:172.21.15.62:0/3287878081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:57.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:56 smithi062 bash[21479]: audit 2024-02-13T15:18:56.164524+0000 mon.a (mon.0) 3606 : audit 1 from='client.47135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:57.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:56 smithi111 bash[23388]: cluster 2024-02-13T15:18:55.745683+0000 mon.a (mon.0) 3605 : cluster 0 osdmap e809: 8 total, 8 up, 8 in 2024-02-13T15:18:57.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:56 smithi111 bash[23388]: audit 2024-02-13T15:18:56.163944+0000 mon.c (mon.2) 870 : audit 1 from='client.? v1:172.21.15.62:0/3287878081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:57.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:56 smithi111 bash[23388]: audit 2024-02-13T15:18:56.164524+0000 mon.a (mon.0) 3606 : audit 1 from='client.47135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:57.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.184+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f7508005340 con 0x7f7528110410 2024-02-13T15:18:57.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.736+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v811) v1 ==== 223+0+0 (unknown 3191003599 0 0) 0x7f75100546d0 con 0x7f7528110410 2024-02-13T15:18:57.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:57.856+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f75080010a0 con 0x7f7528110410 2024-02-13T15:18:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[21479]: audit 2024-02-13T15:18:56.736099+0000 mon.a (mon.0) 3607 : audit 1 from='client.47135 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]': finished 2024-02-13T15:18:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[21479]: cluster 2024-02-13T15:18:56.747667+0000 mon.a (mon.0) 3608 : cluster 0 osdmap e810: 8 total, 8 up, 8 in 2024-02-13T15:18:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[21479]: audit 2024-02-13T15:18:56.861955+0000 mon.c (mon.2) 871 : audit 1 from='client.? v1:172.21.15.62:0/3287878081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[21479]: audit 2024-02-13T15:18:56.862554+0000 mon.a (mon.0) 3609 : audit 1 from='client.47135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[21479]: cluster 2024-02-13T15:18:57.043352+0000 mgr.y (mgr.14613) 1314 : cluster 0 pgmap v1776: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[21479]: audit 2024-02-13T15:18:57.190748+0000 mon.a (mon.0) 3610 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:18:58.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[21479]: audit 2024-02-13T15:18:57.738674+0000 mon.a (mon.0) 3611 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:18:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[28859]: audit 2024-02-13T15:18:56.736099+0000 mon.a (mon.0) 3607 : audit 1 from='client.47135 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]': finished 2024-02-13T15:18:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[28859]: cluster 2024-02-13T15:18:56.747667+0000 mon.a (mon.0) 3608 : cluster 0 osdmap e810: 8 total, 8 up, 8 in 2024-02-13T15:18:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[28859]: audit 2024-02-13T15:18:56.861955+0000 mon.c (mon.2) 871 : audit 1 from='client.? v1:172.21.15.62:0/3287878081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[28859]: audit 2024-02-13T15:18:56.862554+0000 mon.a (mon.0) 3609 : audit 1 from='client.47135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[28859]: cluster 2024-02-13T15:18:57.043352+0000 mgr.y (mgr.14613) 1314 : cluster 0 pgmap v1776: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[28859]: audit 2024-02-13T15:18:57.190748+0000 mon.a (mon.0) 3610 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:18:58.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:57 smithi062 bash[28859]: audit 2024-02-13T15:18:57.738674+0000 mon.a (mon.0) 3611 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:18:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:57 smithi111 bash[23388]: audit 2024-02-13T15:18:56.736099+0000 mon.a (mon.0) 3607 : audit 1 from='client.47135 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]': finished 2024-02-13T15:18:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:57 smithi111 bash[23388]: cluster 2024-02-13T15:18:56.747667+0000 mon.a (mon.0) 3608 : cluster 0 osdmap e810: 8 total, 8 up, 8 in 2024-02-13T15:18:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:57 smithi111 bash[23388]: audit 2024-02-13T15:18:56.861955+0000 mon.c (mon.2) 871 : audit 1 from='client.? v1:172.21.15.62:0/3287878081' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:57 smithi111 bash[23388]: audit 2024-02-13T15:18:56.862554+0000 mon.a (mon.0) 3609 : audit 1 from='client.47135 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pg_num": 12}]: dispatch 2024-02-13T15:18:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:57 smithi111 bash[23388]: cluster 2024-02-13T15:18:57.043352+0000 mgr.y (mgr.14613) 1314 : cluster 0 pgmap v1776: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:18:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:57 smithi111 bash[23388]: audit 2024-02-13T15:18:57.190748+0000 mon.a (mon.0) 3610 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:18:58.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:57 smithi111 bash[23388]: audit 2024-02-13T15:18:57.738674+0000 mon.a (mon.0) 3611 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:18:58.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.764+0000 7f7524ff9640 1 -- 172.21.15.62:0/3521723432 <== mon.0 v1:172.21.15.62:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v812) v1 ==== 223+0+0 (unknown 1158075758 0 0) 0x7f7510055ef0 con 0x7f7528110410 2024-02-13T15:18:58.768 INFO:tasks.workunit.client.0.smithi062.stderr:set-quota max_objects = 10 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 2024-02-13T15:18:58.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.768+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 >> v1:172.21.15.62:6800/3802446050 conn(0x7f751406eeb0 legacy=0x7f7514071370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:58.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.768+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 >> v1:172.21.15.62:6789/0 conn(0x7f7528110410 legacy=0x7f75281a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:58.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.768+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 shutdown_connections 2024-02-13T15:18:58.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.768+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 >> 172.21.15.62:0/3521723432 conn(0x7f7528076da0 msgr2=0x7f7528116c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:18:58.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.772+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 shutdown_connections 2024-02-13T15:18:58.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.772+0000 7f752dd54640 1 -- 172.21.15.62:0/3521723432 wait complete. 2024-02-13T15:18:58.793 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool application enable 38effd22-4604-428a-b9f7-cf7ee1ea6006 rados 2024-02-13T15:18:58.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.908+0000 7fb0d454b640 1 -- 172.21.15.62:0/2038752629 >> v1:172.21.15.62:6789/0 conn(0x7fb0cc109e70 legacy=0x7fb0cc10c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:58.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.908+0000 7fb0d454b640 1 -- 172.21.15.62:0/2038752629 shutdown_connections 2024-02-13T15:18:58.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.908+0000 7fb0d454b640 1 -- 172.21.15.62:0/2038752629 >> 172.21.15.62:0/2038752629 conn(0x7fb0cc0fca50 msgr2=0x7fb0cc0fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:18:58.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- 172.21.15.62:0/2038752629 shutdown_connections 2024-02-13T15:18:58.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- 172.21.15.62:0/2038752629 wait complete. 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 Processor -- start 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- start start 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb0cc106870 con 0x7fb0cc1011e0 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb0cc106a60 con 0x7fb0cc10d9e0 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fb0cc1a84a0 con 0x7fb0cc109e70 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d22e7640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb0cc1011e0 0x7fb0cc103700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37734/0 (socket says 172.21.15.62:37734) 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d22e7640 1 -- 172.21.15.62:0/1833076325 learned_addr learned my addr 172.21.15.62:0/1833076325 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1297365379 0 0) 0x7fb0cc106870 con 0x7fb0cc1011e0 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b4001ff0 con 0x7fb0cc1011e0 2024-02-13T15:18:58.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172531282 0 0) 0x7fb0cc1a84a0 con 0x7fb0cc109e70 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0cc106870 con 0x7fb0cc109e70 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 127148003 0 0) 0x7fb0b4001ff0 con 0x7fb0cc1011e0 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb0cc1a84a0 con 0x7fb0cc1011e0 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb0c4001c60 con 0x7fb0cc1011e0 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 731950710 0 0) 0x7fb0cc106a60 con 0x7fb0cc10d9e0 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0b4001ff0 con 0x7fb0cc10d9e0 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1476966443 0 0) 0x7fb0cc106870 con 0x7fb0cc109e70 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fb0cc106a60 con 0x7fb0cc109e70 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb0c00015e0 con 0x7fb0cc109e70 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3622938743 0 0) 0x7fb0cc1a84a0 con 0x7fb0cc1011e0 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 >> v1:172.21.15.62:6790/0 conn(0x7fb0cc109e70 legacy=0x7fb0cc103e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 >> v1:172.21.15.111:6789/0 conn(0x7fb0cc10d9e0 legacy=0x7fb0cc1a4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc1a9640 con 0x7fb0cc1011e0 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc1a8690 con 0x7fb0cc1011e0 2024-02-13T15:18:58.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc1a8b10 con 0x7fb0cc1011e0 2024-02-13T15:18:58.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fb0c4003e10 con 0x7fb0cc1011e0 2024-02-13T15:18:58.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fb0c4005ec0 con 0x7fb0cc1011e0 2024-02-13T15:18:58.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.912+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b8005090 con 0x7fb0cc1011e0 2024-02-13T15:18:58.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.916+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fb0c4003980 con 0x7fb0cc1011e0 2024-02-13T15:18:58.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.916+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(812..812 src has 269..812) v4 ==== 7731+0+0 (unknown 3907156601 0 0) 0x7fb0c40896e0 con 0x7fb0cc1011e0 2024-02-13T15:18:58.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:58.920+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fb0c40562a0 con 0x7fb0cc1011e0 2024-02-13T15:18:59.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:58 smithi062 bash[21479]: cluster 2024-02-13T15:18:57.750965+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e811: 8 total, 8 up, 8 in 2024-02-13T15:18:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:58 smithi062 bash[21479]: audit 2024-02-13T15:18:57.860840+0000 mon.a (mon.0) 3613 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:18:59.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:58 smithi062 bash[21479]: audit 2024-02-13T15:18:58.768758+0000 mon.a (mon.0) 3614 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:18:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:58 smithi062 bash[28859]: cluster 2024-02-13T15:18:57.750965+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e811: 8 total, 8 up, 8 in 2024-02-13T15:18:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:58 smithi062 bash[28859]: audit 2024-02-13T15:18:57.860840+0000 mon.a (mon.0) 3613 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:18:59.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:58 smithi062 bash[28859]: audit 2024-02-13T15:18:58.768758+0000 mon.a (mon.0) 3614 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:18:59.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:58 smithi111 bash[23388]: cluster 2024-02-13T15:18:57.750965+0000 mon.a (mon.0) 3612 : cluster 0 osdmap e811: 8 total, 8 up, 8 in 2024-02-13T15:18:59.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:58 smithi111 bash[23388]: audit 2024-02-13T15:18:57.860840+0000 mon.a (mon.0) 3613 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:18:59.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:58 smithi111 bash[23388]: audit 2024-02-13T15:18:58.768758+0000 mon.a (mon.0) 3614 : audit 1 from='client.? v1:172.21.15.62:0/3521723432' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:18:59.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:59.100+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"} v 0) v1 -- 0x7fb0b8005340 con 0x7fb0cc1011e0 2024-02-13T15:18:59.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:59.784+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]=0 enabled application 'rados' on pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' v813) v1 ==== 213+0+0 (unknown 4289883646 0 0) 0x7fb0c4054610 con 0x7fb0cc1011e0 2024-02-13T15:18:59.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:18:59.896+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"} v 0) v1 -- 0x7fb0b80010a0 con 0x7fb0cc1011e0 2024-02-13T15:19:00.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:59 smithi062 bash[21479]: cluster 2024-02-13T15:18:58.773610+0000 mon.a (mon.0) 3615 : cluster 0 osdmap e812: 8 total, 8 up, 8 in 2024-02-13T15:19:00.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:59 smithi062 bash[21479]: cluster 2024-02-13T15:18:59.043869+0000 mgr.y (mgr.14613) 1315 : cluster 0 pgmap v1779: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:19:00.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:18:59 smithi062 bash[21479]: audit 2024-02-13T15:18:59.103057+0000 mon.a (mon.0) 3616 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]: dispatch 2024-02-13T15:19:00.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:59 smithi062 bash[28859]: cluster 2024-02-13T15:18:58.773610+0000 mon.a (mon.0) 3615 : cluster 0 osdmap e812: 8 total, 8 up, 8 in 2024-02-13T15:19:00.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:59 smithi062 bash[28859]: cluster 2024-02-13T15:18:59.043869+0000 mgr.y (mgr.14613) 1315 : cluster 0 pgmap v1779: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:19:00.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:18:59 smithi062 bash[28859]: audit 2024-02-13T15:18:59.103057+0000 mon.a (mon.0) 3616 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]: dispatch 2024-02-13T15:19:00.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:59 smithi111 bash[23388]: cluster 2024-02-13T15:18:58.773610+0000 mon.a (mon.0) 3615 : cluster 0 osdmap e812: 8 total, 8 up, 8 in 2024-02-13T15:19:00.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:59 smithi111 bash[23388]: cluster 2024-02-13T15:18:59.043869+0000 mgr.y (mgr.14613) 1315 : cluster 0 pgmap v1779: 176 pgs: 12 unknown, 164 active+clean; 582 KiB data, 842 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:19:00.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:18:59 smithi111 bash[23388]: audit 2024-02-13T15:18:59.103057+0000 mon.a (mon.0) 3616 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]: dispatch 2024-02-13T15:19:00.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:00.788+0000 7fb0cb7fe640 1 -- 172.21.15.62:0/1833076325 <== mon.0 v1:172.21.15.62:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]=0 enabled application 'rados' on pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' v814) v1 ==== 213+0+0 (unknown 2983229140 0 0) 0x7fb0c4055e30 con 0x7fb0cc1011e0 2024-02-13T15:19:00.794 INFO:tasks.workunit.client.0.smithi062.stderr:enabled application 'rados' on pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' 2024-02-13T15:19:00.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:00.796+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 >> v1:172.21.15.62:6800/3802446050 conn(0x7fb0b406ef00 legacy=0x7fb0b40713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:00.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:00.796+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 >> v1:172.21.15.62:6789/0 conn(0x7fb0cc1011e0 legacy=0x7fb0cc103700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:00.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:00.796+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 shutdown_connections 2024-02-13T15:19:00.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:00.796+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 >> 172.21.15.62:0/1833076325 conn(0x7fb0cc0fca50 msgr2=0x7fb0cc106da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:19:00.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:00.796+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 shutdown_connections 2024-02-13T15:19:00.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:00.796+0000 7fb0d454b640 1 -- 172.21.15.62:0/1833076325 wait complete. 2024-02-13T15:19:00.824 INFO:tasks.workunit.client.0.smithi062.stderr:+ seq 1 10 2024-02-13T15:19:00.834 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj1 /etc/passwd 2024-02-13T15:19:00.880 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj2 /etc/passwd 2024-02-13T15:19:00.916 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj3 /etc/passwd 2024-02-13T15:19:00.952 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj4 /etc/passwd 2024-02-13T15:19:00.988 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj5 /etc/passwd 2024-02-13T15:19:01.023 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj6 /etc/passwd 2024-02-13T15:19:01.059 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj7 /etc/passwd 2024-02-13T15:19:01.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:00 smithi062 bash[21479]: audit 2024-02-13T15:18:59.789610+0000 mon.a (mon.0) 3617 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]': finished 2024-02-13T15:19:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:00 smithi062 bash[21479]: cluster 2024-02-13T15:18:59.796579+0000 mon.a (mon.0) 3618 : cluster 0 osdmap e813: 8 total, 8 up, 8 in 2024-02-13T15:19:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:00 smithi062 bash[21479]: audit 2024-02-13T15:18:59.900450+0000 mon.a (mon.0) 3619 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]: dispatch 2024-02-13T15:19:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:00 smithi062 bash[28859]: audit 2024-02-13T15:18:59.789610+0000 mon.a (mon.0) 3617 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]': finished 2024-02-13T15:19:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:00 smithi062 bash[28859]: cluster 2024-02-13T15:18:59.796579+0000 mon.a (mon.0) 3618 : cluster 0 osdmap e813: 8 total, 8 up, 8 in 2024-02-13T15:19:01.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:00 smithi062 bash[28859]: audit 2024-02-13T15:18:59.900450+0000 mon.a (mon.0) 3619 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]: dispatch 2024-02-13T15:19:01.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:00 smithi111 bash[23388]: audit 2024-02-13T15:18:59.789610+0000 mon.a (mon.0) 3617 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]': finished 2024-02-13T15:19:01.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:00 smithi111 bash[23388]: cluster 2024-02-13T15:18:59.796579+0000 mon.a (mon.0) 3618 : cluster 0 osdmap e813: 8 total, 8 up, 8 in 2024-02-13T15:19:01.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:00 smithi111 bash[23388]: audit 2024-02-13T15:18:59.900450+0000 mon.a (mon.0) 3619 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]: dispatch 2024-02-13T15:19:01.094 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj8 /etc/passwd 2024-02-13T15:19:01.129 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj9 /etc/passwd 2024-02-13T15:19:01.164 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put obj10 /etc/passwd 2024-02-13T15:19:01.201 INFO:tasks.workunit.client.0.smithi062.stderr:+ sleep 30 2024-02-13T15:19:02.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:19:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:19:02.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:01 smithi111 bash[23388]: audit 2024-02-13T15:19:00.793806+0000 mon.a (mon.0) 3620 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]': finished 2024-02-13T15:19:02.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:01 smithi111 bash[23388]: cluster 2024-02-13T15:19:00.802564+0000 mon.a (mon.0) 3621 : cluster 0 osdmap e814: 8 total, 8 up, 8 in 2024-02-13T15:19:02.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:01 smithi111 bash[23388]: cluster 2024-02-13T15:19:01.044253+0000 mgr.y (mgr.14613) 1316 : cluster 0 pgmap v1782: 176 pgs: 176 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:01 smithi062 bash[21479]: audit 2024-02-13T15:19:00.793806+0000 mon.a (mon.0) 3620 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]': finished 2024-02-13T15:19:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:01 smithi062 bash[21479]: cluster 2024-02-13T15:19:00.802564+0000 mon.a (mon.0) 3621 : cluster 0 osdmap e814: 8 total, 8 up, 8 in 2024-02-13T15:19:02.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:01 smithi062 bash[21479]: cluster 2024-02-13T15:19:01.044253+0000 mgr.y (mgr.14613) 1316 : cluster 0 pgmap v1782: 176 pgs: 176 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:01 smithi062 bash[28859]: audit 2024-02-13T15:19:00.793806+0000 mon.a (mon.0) 3620 : audit 1 from='client.? v1:172.21.15.62:0/1833076325' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "app": "rados"}]': finished 2024-02-13T15:19:02.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:01 smithi062 bash[28859]: cluster 2024-02-13T15:19:00.802564+0000 mon.a (mon.0) 3621 : cluster 0 osdmap e814: 8 total, 8 up, 8 in 2024-02-13T15:19:02.313 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:01 smithi062 bash[28859]: cluster 2024-02-13T15:19:01.044253+0000 mgr.y (mgr.14613) 1316 : cluster 0 pgmap v1782: 176 pgs: 176 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:03.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:02 smithi111 bash[23388]: cluster 2024-02-13T15:19:01.806859+0000 mon.a (mon.0) 3622 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:19:03.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:02 smithi111 bash[23388]: audit 2024-02-13T15:19:01.815764+0000 mgr.y (mgr.14613) 1317 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:03.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:02 smithi062 bash[21479]: cluster 2024-02-13T15:19:01.806859+0000 mon.a (mon.0) 3622 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:19:03.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:02 smithi062 bash[21479]: audit 2024-02-13T15:19:01.815764+0000 mgr.y (mgr.14613) 1317 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:02 smithi062 bash[28859]: cluster 2024-02-13T15:19:01.806859+0000 mon.a (mon.0) 3622 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:19:03.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:02 smithi062 bash[28859]: audit 2024-02-13T15:19:01.815764+0000 mgr.y (mgr.14613) 1317 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:04.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:03 smithi111 bash[23388]: cluster 2024-02-13T15:19:03.044970+0000 mgr.y (mgr.14613) 1318 : cluster 0 pgmap v1783: 176 pgs: 176 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 965 B/s rd, 0 op/s 2024-02-13T15:19:04.312 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:03 smithi062 bash[21479]: cluster 2024-02-13T15:19:03.044970+0000 mgr.y (mgr.14613) 1318 : cluster 0 pgmap v1783: 176 pgs: 176 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 965 B/s rd, 0 op/s 2024-02-13T15:19:04.312 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:03 smithi062 bash[28859]: cluster 2024-02-13T15:19:03.044970+0000 mgr.y (mgr.14613) 1318 : cluster 0 pgmap v1783: 176 pgs: 176 active+clean; 582 KiB data, 860 MiB used, 714 GiB / 715 GiB avail; 965 B/s rd, 0 op/s 2024-02-13T15:19:06.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:06 smithi062 bash[21479]: cluster 2024-02-13T15:19:05.046771+0000 mgr.y (mgr.14613) 1319 : cluster 0 pgmap v1784: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 19 KiB/s wr, 3 op/s 2024-02-13T15:19:06.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:19:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:19:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:19:06.564 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:06 smithi062 bash[28859]: cluster 2024-02-13T15:19:05.046771+0000 mgr.y (mgr.14613) 1319 : cluster 0 pgmap v1784: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 19 KiB/s wr, 3 op/s 2024-02-13T15:19:06.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:06 smithi111 bash[23388]: cluster 2024-02-13T15:19:05.046771+0000 mgr.y (mgr.14613) 1319 : cluster 0 pgmap v1784: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.6 KiB/s rd, 19 KiB/s wr, 3 op/s 2024-02-13T15:19:08.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:08 smithi062 bash[21479]: cluster 2024-02-13T15:19:07.047564+0000 mgr.y (mgr.14613) 1320 : cluster 0 pgmap v1785: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-02-13T15:19:08.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:08 smithi062 bash[21479]: audit 2024-02-13T15:19:07.405056+0000 mon.b (mon.1) 392 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:08.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:08 smithi062 bash[28859]: cluster 2024-02-13T15:19:07.047564+0000 mgr.y (mgr.14613) 1320 : cluster 0 pgmap v1785: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-02-13T15:19:08.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:08 smithi062 bash[28859]: audit 2024-02-13T15:19:07.405056+0000 mon.b (mon.1) 392 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:08.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:08 smithi111 bash[23388]: cluster 2024-02-13T15:19:07.047564+0000 mgr.y (mgr.14613) 1320 : cluster 0 pgmap v1785: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 15 KiB/s wr, 2 op/s 2024-02-13T15:19:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:08 smithi111 bash[23388]: audit 2024-02-13T15:19:07.405056+0000 mon.b (mon.1) 392 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:09 smithi062 bash[21479]: cluster 2024-02-13T15:19:08.195147+0000 mon.a (mon.0) 3623 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (reached quota's max_objects: 10) 2024-02-13T15:19:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:09 smithi062 bash[21479]: cluster 2024-02-13T15:19:08.195911+0000 mon.a (mon.0) 3624 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:19:09.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:09 smithi062 bash[21479]: cluster 2024-02-13T15:19:08.206362+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e815: 8 total, 8 up, 8 in 2024-02-13T15:19:09.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:09 smithi062 bash[28859]: cluster 2024-02-13T15:19:08.195147+0000 mon.a (mon.0) 3623 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (reached quota's max_objects: 10) 2024-02-13T15:19:09.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:09 smithi062 bash[28859]: cluster 2024-02-13T15:19:08.195911+0000 mon.a (mon.0) 3624 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:19:09.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:09 smithi062 bash[28859]: cluster 2024-02-13T15:19:08.206362+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e815: 8 total, 8 up, 8 in 2024-02-13T15:19:09.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:09 smithi111 bash[23388]: cluster 2024-02-13T15:19:08.195147+0000 mon.a (mon.0) 3623 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (reached quota's max_objects: 10) 2024-02-13T15:19:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:09 smithi111 bash[23388]: cluster 2024-02-13T15:19:08.195911+0000 mon.a (mon.0) 3624 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:19:09.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:09 smithi111 bash[23388]: cluster 2024-02-13T15:19:08.206362+0000 mon.a (mon.0) 3625 : cluster 0 osdmap e815: 8 total, 8 up, 8 in 2024-02-13T15:19:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:10 smithi062 bash[21479]: cluster 2024-02-13T15:19:09.048394+0000 mgr.y (mgr.14613) 1321 : cluster 0 pgmap v1787: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 620 B/s rd, 15 KiB/s wr, 1 op/s 2024-02-13T15:19:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:10 smithi062 bash[28859]: cluster 2024-02-13T15:19:09.048394+0000 mgr.y (mgr.14613) 1321 : cluster 0 pgmap v1787: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 620 B/s rd, 15 KiB/s wr, 1 op/s 2024-02-13T15:19:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:10 smithi111 bash[23388]: cluster 2024-02-13T15:19:09.048394+0000 mgr.y (mgr.14613) 1321 : cluster 0 pgmap v1787: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 620 B/s rd, 15 KiB/s wr, 1 op/s 2024-02-13T15:19:12.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:19:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:19:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:12 smithi062 bash[21479]: cluster 2024-02-13T15:19:11.050289+0000 mgr.y (mgr.14613) 1322 : cluster 0 pgmap v1788: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:19:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:12 smithi062 bash[28859]: cluster 2024-02-13T15:19:11.050289+0000 mgr.y (mgr.14613) 1322 : cluster 0 pgmap v1788: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:19:12.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:12 smithi111 bash[23388]: cluster 2024-02-13T15:19:11.050289+0000 mgr.y (mgr.14613) 1322 : cluster 0 pgmap v1788: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:19:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:13 smithi062 bash[28859]: audit 2024-02-13T15:19:11.819214+0000 mgr.y (mgr.14613) 1323 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:13 smithi062 bash[21479]: audit 2024-02-13T15:19:11.819214+0000 mgr.y (mgr.14613) 1323 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:13.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:13 smithi111 bash[23388]: audit 2024-02-13T15:19:11.819214+0000 mgr.y (mgr.14613) 1323 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:14 smithi062 bash[21479]: cluster 2024-02-13T15:19:13.051101+0000 mgr.y (mgr.14613) 1324 : cluster 0 pgmap v1789: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:19:14.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:14 smithi062 bash[28859]: cluster 2024-02-13T15:19:13.051101+0000 mgr.y (mgr.14613) 1324 : cluster 0 pgmap v1789: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:19:14.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:14 smithi111 bash[23388]: cluster 2024-02-13T15:19:13.051101+0000 mgr.y (mgr.14613) 1324 : cluster 0 pgmap v1789: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:19:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:19:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:19:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:19:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:16 smithi062 bash[28859]: cluster 2024-02-13T15:19:15.052863+0000 mgr.y (mgr.14613) 1325 : cluster 0 pgmap v1790: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:16 smithi062 bash[21479]: cluster 2024-02-13T15:19:15.052863+0000 mgr.y (mgr.14613) 1325 : cluster 0 pgmap v1790: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:16.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:16 smithi111 bash[23388]: cluster 2024-02-13T15:19:15.052863+0000 mgr.y (mgr.14613) 1325 : cluster 0 pgmap v1790: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:18 smithi062 bash[28859]: cluster 2024-02-13T15:19:17.053677+0000 mgr.y (mgr.14613) 1326 : cluster 0 pgmap v1791: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:18 smithi062 bash[21479]: cluster 2024-02-13T15:19:17.053677+0000 mgr.y (mgr.14613) 1326 : cluster 0 pgmap v1791: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:18.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:18 smithi111 bash[23388]: cluster 2024-02-13T15:19:17.053677+0000 mgr.y (mgr.14613) 1326 : cluster 0 pgmap v1791: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:20.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:20 smithi062 bash[28859]: cluster 2024-02-13T15:19:19.054487+0000 mgr.y (mgr.14613) 1327 : cluster 0 pgmap v1792: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-02-13T15:19:20.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:20 smithi062 bash[21479]: cluster 2024-02-13T15:19:19.054487+0000 mgr.y (mgr.14613) 1327 : cluster 0 pgmap v1792: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-02-13T15:19:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:20 smithi111 bash[23388]: cluster 2024-02-13T15:19:19.054487+0000 mgr.y (mgr.14613) 1327 : cluster 0 pgmap v1792: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-02-13T15:19:22.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:19:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:19:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:22 smithi062 bash[21479]: cluster 2024-02-13T15:19:21.056317+0000 mgr.y (mgr.14613) 1328 : cluster 0 pgmap v1793: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:22.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:22 smithi062 bash[28859]: cluster 2024-02-13T15:19:21.056317+0000 mgr.y (mgr.14613) 1328 : cluster 0 pgmap v1793: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:22.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:22 smithi111 bash[23388]: cluster 2024-02-13T15:19:21.056317+0000 mgr.y (mgr.14613) 1328 : cluster 0 pgmap v1793: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:23 smithi062 bash[28859]: audit 2024-02-13T15:19:21.830615+0000 mgr.y (mgr.14613) 1329 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:23 smithi062 bash[28859]: audit 2024-02-13T15:19:22.444665+0000 mon.a (mon.0) 3626 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:23 smithi062 bash[28859]: audit 2024-02-13T15:19:22.448592+0000 mon.b (mon.1) 393 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:23 smithi062 bash[21479]: audit 2024-02-13T15:19:21.830615+0000 mgr.y (mgr.14613) 1329 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:23 smithi062 bash[21479]: audit 2024-02-13T15:19:22.444665+0000 mon.a (mon.0) 3626 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:23 smithi062 bash[21479]: audit 2024-02-13T15:19:22.448592+0000 mon.b (mon.1) 393 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:23.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:23 smithi111 bash[23388]: audit 2024-02-13T15:19:21.830615+0000 mgr.y (mgr.14613) 1329 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:23.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:23 smithi111 bash[23388]: audit 2024-02-13T15:19:22.444665+0000 mon.a (mon.0) 3626 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:23.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:23 smithi111 bash[23388]: audit 2024-02-13T15:19:22.448592+0000 mon.b (mon.1) 393 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:24 smithi062 bash[21479]: cluster 2024-02-13T15:19:23.057119+0000 mgr.y (mgr.14613) 1330 : cluster 0 pgmap v1794: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:24.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:24 smithi062 bash[28859]: cluster 2024-02-13T15:19:23.057119+0000 mgr.y (mgr.14613) 1330 : cluster 0 pgmap v1794: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:24.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:24 smithi111 bash[23388]: cluster 2024-02-13T15:19:23.057119+0000 mgr.y (mgr.14613) 1330 : cluster 0 pgmap v1794: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:26 smithi062 bash[28859]: cluster 2024-02-13T15:19:25.058940+0000 mgr.y (mgr.14613) 1331 : cluster 0 pgmap v1795: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:26.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:26 smithi062 bash[21479]: cluster 2024-02-13T15:19:25.058940+0000 mgr.y (mgr.14613) 1331 : cluster 0 pgmap v1795: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:19:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:19:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:19:26.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:26 smithi111 bash[23388]: cluster 2024-02-13T15:19:25.058940+0000 mgr.y (mgr.14613) 1331 : cluster 0 pgmap v1795: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:28.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:28 smithi062 bash[21479]: cluster 2024-02-13T15:19:27.059665+0000 mgr.y (mgr.14613) 1332 : cluster 0 pgmap v1796: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:28 smithi062 bash[28859]: cluster 2024-02-13T15:19:27.059665+0000 mgr.y (mgr.14613) 1332 : cluster 0 pgmap v1796: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:28.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:28 smithi111 bash[23388]: cluster 2024-02-13T15:19:27.059665+0000 mgr.y (mgr.14613) 1332 : cluster 0 pgmap v1796: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:30 smithi062 bash[21479]: cluster 2024-02-13T15:19:29.060473+0000 mgr.y (mgr.14613) 1333 : cluster 0 pgmap v1797: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:30 smithi062 bash[28859]: cluster 2024-02-13T15:19:29.060473+0000 mgr.y (mgr.14613) 1333 : cluster 0 pgmap v1797: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:30.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:30 smithi111 bash[23388]: cluster 2024-02-13T15:19:29.060473+0000 mgr.y (mgr.14613) 1333 : cluster 0 pgmap v1797: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:31.202 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=136107 2024-02-13T15:19:31.202 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool set-quota 38effd22-4604-428a-b9f7-cf7ee1ea6006 max_objects 100 2024-02-13T15:19:31.202 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put onemore /etc/passwd 2024-02-13T15:19:31.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- 172.21.15.62:0/440878732 >> v1:172.21.15.62:6789/0 conn(0x7fdf8010fbd0 legacy=0x7fdf80112070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:31.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- 172.21.15.62:0/440878732 shutdown_connections 2024-02-13T15:19:31.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- 172.21.15.62:0/440878732 >> 172.21.15.62:0/440878732 conn(0x7fdf800fec40 msgr2=0x7fdf80101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:19:31.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- 172.21.15.62:0/440878732 shutdown_connections 2024-02-13T15:19:31.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- 172.21.15.62:0/440878732 wait complete. 2024-02-13T15:19:31.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 Processor -- start 2024-02-13T15:19:31.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- start start 2024-02-13T15:19:31.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fdf801a8090 con 0x7fdf8010fbd0 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fdf801a9290 con 0x7fdf8010c060 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.327+0000 7fdf8651f640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fdf801aa490 con 0x7fdf801033d0 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7ffff640 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fdf801033d0 0x7fdf801086d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:55438/0 (socket says 172.21.15.62:55438) 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7ffff640 1 -- 172.21.15.62:0/1639224089 learned_addr learned my addr 172.21.15.62:0/1639224089 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1720396528 0 0) 0x7fdf801aa490 con 0x7fdf801033d0 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf6c003530 con 0x7fdf801033d0 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500269535 0 0) 0x7fdf801a8090 con 0x7fdf8010fbd0 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf801aa490 con 0x7fdf8010fbd0 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2803596027 0 0) 0x7fdf6c003530 con 0x7fdf801033d0 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdf801a8090 con 0x7fdf801033d0 2024-02-13T15:19:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fdf78001c60 con 0x7fdf801033d0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3111004125 0 0) 0x7fdf801aa490 con 0x7fdf8010fbd0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fdf6c003530 con 0x7fdf8010fbd0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fdf700010d0 con 0x7fdf8010fbd0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191832357 0 0) 0x7fdf801a9290 con 0x7fdf8010c060 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf801aa490 con 0x7fdf8010c060 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1047763617 0 0) 0x7fdf801a8090 con 0x7fdf801033d0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 >> v1:172.21.15.111:6789/0 conn(0x7fdf8010c060 legacy=0x7fdf801a2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 >> v1:172.21.15.62:6789/0 conn(0x7fdf8010fbd0 legacy=0x7fdf801a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf801ab690 con 0x7fdf801033d0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf801aa680 con 0x7fdf801033d0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf801aab00 con 0x7fdf801033d0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fdf78003e30 con 0x7fdf801033d0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fdf78005f30 con 0x7fdf801033d0 2024-02-13T15:19:31.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf60005090 con 0x7fdf801033d0 2024-02-13T15:19:31.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fdf780039a0 con 0x7fdf801033d0 2024-02-13T15:19:31.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(815..815 src has 269..815) v4 ==== 7744+0+0 (unknown 3951428532 0 0) 0x7fdf78089890 con 0x7fdf801033d0 2024-02-13T15:19:31.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.331+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=816}) v3 -- 0x7fdf801a8090 con 0x7fdf801033d0 2024-02-13T15:19:31.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.339+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fdf78056370 con 0x7fdf801033d0 2024-02-13T15:19:31.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:31.511+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fdf60005340 con 0x7fdf801033d0 2024-02-13T15:19:32.093 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:19:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:19:32.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:32.475+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 10 ==== osd_map(816..816 src has 269..816) v4 ==== 628+0+0 (unknown 763662490 0 0) 0x7fdf78056ca0 con 0x7fdf801033d0 2024-02-13T15:19:32.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:32.475+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=817}) v3 -- 0x7fdf801a9290 con 0x7fdf801033d0 2024-02-13T15:19:32.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:32.487+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v816) v1 ==== 225+0+0 (unknown 988597727 0 0) 0x7fdf780546e0 con 0x7fdf801033d0 2024-02-13T15:19:32.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:32.591+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"} v 0) v1 -- 0x7fdf600010d0 con 0x7fdf801033d0 2024-02-13T15:19:32.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:32 smithi062 bash[28859]: cluster 2024-02-13T15:19:31.062330+0000 mgr.y (mgr.14613) 1334 : cluster 0 pgmap v1798: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:32 smithi062 bash[28859]: audit 2024-02-13T15:19:31.517378+0000 mon.c (mon.2) 872 : audit 1 from='client.? v1:172.21.15.62:0/1639224089' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:32.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:32 smithi062 bash[28859]: audit 2024-02-13T15:19:31.517957+0000 mon.a (mon.0) 3627 : audit 1 from='client.47252 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:32 smithi062 bash[21479]: cluster 2024-02-13T15:19:31.062330+0000 mgr.y (mgr.14613) 1334 : cluster 0 pgmap v1798: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:32 smithi062 bash[21479]: audit 2024-02-13T15:19:31.517378+0000 mon.c (mon.2) 872 : audit 1 from='client.? v1:172.21.15.62:0/1639224089' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:32 smithi062 bash[21479]: audit 2024-02-13T15:19:31.517957+0000 mon.a (mon.0) 3627 : audit 1 from='client.47252 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:32 smithi111 bash[23388]: cluster 2024-02-13T15:19:31.062330+0000 mgr.y (mgr.14613) 1334 : cluster 0 pgmap v1798: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:32 smithi111 bash[23388]: audit 2024-02-13T15:19:31.517378+0000 mon.c (mon.2) 872 : audit 1 from='client.? v1:172.21.15.62:0/1639224089' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:32.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:32 smithi111 bash[23388]: audit 2024-02-13T15:19:31.517957+0000 mon.a (mon.0) 3627 : audit 1 from='client.47252 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:33.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.203+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 12 ==== osd_map(817..817 src has 269..817) v4 ==== 628+0+0 (unknown 4048669064 0 0) 0x7fdf7805a950 con 0x7fdf801033d0 2024-02-13T15:19:33.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.203+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=818}) v3 -- 0x7fdf6c07be00 con 0x7fdf801033d0 2024-02-13T15:19:33.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.207+0000 7fdf7d7fa640 1 -- 172.21.15.62:0/1639224089 <== mon.2 v1:172.21.15.62:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]=0 set-quota max_objects = 100 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v817) v1 ==== 225+0+0 (unknown 303034791 0 0) 0x7fdf78055f00 con 0x7fdf801033d0 2024-02-13T15:19:33.211 INFO:tasks.workunit.client.0.smithi062.stderr:set-quota max_objects = 100 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 2024-02-13T15:19:33.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.211+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 >> v1:172.21.15.62:6800/3802446050 conn(0x7fdf6c06ef20 legacy=0x7fdf6c0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:33.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.211+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 >> v1:172.21.15.62:6790/0 conn(0x7fdf801033d0 legacy=0x7fdf801086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:33.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.211+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 shutdown_connections 2024-02-13T15:19:33.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.211+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 >> 172.21.15.62:0/1639224089 conn(0x7fdf800fec40 msgr2=0x7fdf80100a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:19:33.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.211+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 shutdown_connections 2024-02-13T15:19:33.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.211+0000 7fdf8651f640 1 -- 172.21.15.62:0/1639224089 wait complete. 2024-02-13T15:19:33.233 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 136107 2024-02-13T15:19:33.233 INFO:tasks.workunit.client.0.smithi062.stderr:+ [ 0 -ne 0 ] 2024-02-13T15:19:33.234 INFO:tasks.workunit.client.0.smithi062.stderr:+ true 2024-02-13T15:19:33.234 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put twomore /etc/passwd 2024-02-13T15:19:33.271 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool set-quota 38effd22-4604-428a-b9f7-cf7ee1ea6006 max_bytes 100 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- 172.21.15.62:0/2370348876 >> v1:172.21.15.62:6790/0 conn(0x7ff1e010c070 legacy=0x7ff1e010e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- 172.21.15.62:0/2370348876 shutdown_connections 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- 172.21.15.62:0/2370348876 >> 172.21.15.62:0/2370348876 conn(0x7ff1e00fec30 msgr2=0x7ff1e0101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- 172.21.15.62:0/2370348876 shutdown_connections 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- 172.21.15.62:0/2370348876 wait complete. 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 Processor -- start 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- start start 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1e01a7f60 con 0x7ff1e010fbe0 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1e01a9160 con 0x7ff1e01033e0 2024-02-13T15:19:33.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ff1e01aa360 con 0x7ff1e010c070 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e5b3d640 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7ff1e010c070 0x7ff1e01a2f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:42826/0 (socket says 172.21.15.62:42826) 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e5b3d640 1 -- 172.21.15.62:0/3454359826 learned_addr learned my addr 172.21.15.62:0/3454359826 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2523907185 0 0) 0x7ff1e01a7f60 con 0x7ff1e010fbe0 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1cc003530 con 0x7ff1e010fbe0 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843741322 0 0) 0x7ff1e01aa360 con 0x7ff1e010c070 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1e01a7f60 con 0x7ff1e010c070 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2271010892 0 0) 0x7ff1cc003530 con 0x7ff1e010fbe0 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1e01aa360 con 0x7ff1e010fbe0 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff1d8001af0 con 0x7ff1e010fbe0 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830961458 0 0) 0x7ff1e01a9160 con 0x7ff1e01033e0 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1cc003530 con 0x7ff1e01033e0 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1818403307 0 0) 0x7ff1e01a7f60 con 0x7ff1e010c070 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff1e01a9160 con 0x7ff1e010c070 2024-02-13T15:19:33.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff1d0004440 con 0x7ff1e010c070 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1511586632 0 0) 0x7ff1e01aa360 con 0x7ff1e010fbe0 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 >> v1:172.21.15.62:6790/0 conn(0x7ff1e010c070 legacy=0x7ff1e01a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 >> v1:172.21.15.111:6789/0 conn(0x7ff1e01033e0 legacy=0x7ff1e01085a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e01ab560 con 0x7ff1e010fbe0 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e01a8150 con 0x7ff1e010fbe0 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e01a85d0 con 0x7ff1e010fbe0 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7ff1d8002060 con 0x7ff1e010fbe0 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.379+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ff1d8004bf0 con 0x7ff1e010fbe0 2024-02-13T15:19:33.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.383+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c4005090 con 0x7ff1e010fbe0 2024-02-13T15:19:33.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.383+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7ff1d8003980 con 0x7ff1e010fbe0 2024-02-13T15:19:33.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.383+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(817..817 src has 269..817) v4 ==== 7744+0+0 (unknown 1605783232 0 0) 0x7ff1d8088510 con 0x7ff1e010fbe0 2024-02-13T15:19:33.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.387+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7ff1d8054d60 con 0x7ff1e010fbe0 2024-02-13T15:19:33.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:33.563+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7ff1c4005340 con 0x7ff1e010fbe0 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:31.842024+0000 mgr.y (mgr.14613) 1335 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:32.478513+0000 mon.a (mon.0) 3628 : audit 1 from='client.47252 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]': finished 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: cluster 2024-02-13T15:19:32.484627+0000 mon.a (mon.0) 3629 : cluster 0 osdmap e816: 8 total, 8 up, 8 in 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:32.598699+0000 mon.c (mon.2) 873 : audit 1 from='client.? v1:172.21.15.62:0/1639224089' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:32.599597+0000 mon.a (mon.0) 3630 : audit 1 from='client.47252 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:32.615565+0000 mon.b (mon.1) 394 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: cluster 2024-02-13T15:19:33.202689+0000 mon.a (mon.0) 3631 : cluster 1 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' no longer out of quota; removing NO_QUOTA flag 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: cluster 2024-02-13T15:19:33.203125+0000 mon.a (mon.0) 3632 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:33.204760+0000 mon.a (mon.0) 3633 : audit 1 from='client.47252 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]': finished 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: cluster 2024-02-13T15:19:33.212701+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e817: 8 total, 8 up, 8 in 2024-02-13T15:19:33.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:33.296438+0000 mon.b (mon.1) 395 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:33.297913+0000 mon.b (mon.1) 396 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[21479]: audit 2024-02-13T15:19:33.302636+0000 mon.a (mon.0) 3635 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:31.842024+0000 mgr.y (mgr.14613) 1335 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:32.478513+0000 mon.a (mon.0) 3628 : audit 1 from='client.47252 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]': finished 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: cluster 2024-02-13T15:19:32.484627+0000 mon.a (mon.0) 3629 : cluster 0 osdmap e816: 8 total, 8 up, 8 in 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:32.598699+0000 mon.c (mon.2) 873 : audit 1 from='client.? v1:172.21.15.62:0/1639224089' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:32.599597+0000 mon.a (mon.0) 3630 : audit 1 from='client.47252 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:32.615565+0000 mon.b (mon.1) 394 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:19:33.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: cluster 2024-02-13T15:19:33.202689+0000 mon.a (mon.0) 3631 : cluster 1 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' no longer out of quota; removing NO_QUOTA flag 2024-02-13T15:19:33.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: cluster 2024-02-13T15:19:33.203125+0000 mon.a (mon.0) 3632 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T15:19:33.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:33.204760+0000 mon.a (mon.0) 3633 : audit 1 from='client.47252 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]': finished 2024-02-13T15:19:33.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: cluster 2024-02-13T15:19:33.212701+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e817: 8 total, 8 up, 8 in 2024-02-13T15:19:33.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:33.296438+0000 mon.b (mon.1) 395 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:19:33.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:33.297913+0000 mon.b (mon.1) 396 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:19:33.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:33 smithi062 bash[28859]: audit 2024-02-13T15:19:33.302636+0000 mon.a (mon.0) 3635 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:31.842024+0000 mgr.y (mgr.14613) 1335 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:32.478513+0000 mon.a (mon.0) 3628 : audit 1 from='client.47252 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]': finished 2024-02-13T15:19:33.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: cluster 2024-02-13T15:19:32.484627+0000 mon.a (mon.0) 3629 : cluster 0 osdmap e816: 8 total, 8 up, 8 in 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:32.598699+0000 mon.c (mon.2) 873 : audit 1 from='client.? v1:172.21.15.62:0/1639224089' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:32.599597+0000 mon.a (mon.0) 3630 : audit 1 from='client.47252 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]: dispatch 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:32.615565+0000 mon.b (mon.1) 394 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: cluster 2024-02-13T15:19:33.202689+0000 mon.a (mon.0) 3631 : cluster 1 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' no longer out of quota; removing NO_QUOTA flag 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: cluster 2024-02-13T15:19:33.203125+0000 mon.a (mon.0) 3632 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:33.204760+0000 mon.a (mon.0) 3633 : audit 1 from='client.47252 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "100"}]': finished 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: cluster 2024-02-13T15:19:33.212701+0000 mon.a (mon.0) 3634 : cluster 0 osdmap e817: 8 total, 8 up, 8 in 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:33.296438+0000 mon.b (mon.1) 395 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:33.297913+0000 mon.b (mon.1) 396 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:19:33.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:33 smithi111 bash[23388]: audit 2024-02-13T15:19:33.302636+0000 mon.a (mon.0) 3635 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:34.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:34.491+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v818) v1 ==== 221+0+0 (unknown 1430641172 0 0) 0x7ff1d8053360 con 0x7ff1e010fbe0 2024-02-13T15:19:34.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:34.611+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"} v 0) v1 -- 0x7ff1c4000c50 con 0x7ff1e010fbe0 2024-02-13T15:19:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:34 smithi062 bash[21479]: cluster 2024-02-13T15:19:33.063070+0000 mgr.y (mgr.14613) 1336 : cluster 0 pgmap v1800: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:34.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:34 smithi062 bash[21479]: audit 2024-02-13T15:19:33.568287+0000 mon.a (mon.0) 3636 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T15:19:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:34 smithi062 bash[28859]: cluster 2024-02-13T15:19:33.063070+0000 mgr.y (mgr.14613) 1336 : cluster 0 pgmap v1800: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:34.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:34 smithi062 bash[28859]: audit 2024-02-13T15:19:33.568287+0000 mon.a (mon.0) 3636 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T15:19:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:34 smithi111 bash[23388]: cluster 2024-02-13T15:19:33.063070+0000 mgr.y (mgr.14613) 1336 : cluster 0 pgmap v1800: 176 pgs: 176 active+clean; 699 KiB data, 861 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:34.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:34 smithi111 bash[23388]: audit 2024-02-13T15:19:33.568287+0000 mon.a (mon.0) 3636 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T15:19:35.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:35.503+0000 7ff1d77fe640 1 -- 172.21.15.62:0/3454359826 <== mon.0 v1:172.21.15.62:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]=0 set-quota max_bytes = 100 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v819) v1 ==== 221+0+0 (unknown 3574926325 0 0) 0x7ff1d8054b80 con 0x7ff1e010fbe0 2024-02-13T15:19:35.507 INFO:tasks.workunit.client.0.smithi062.stderr:set-quota max_bytes = 100 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 2024-02-13T15:19:35.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:35.507+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 >> v1:172.21.15.62:6800/3802446050 conn(0x7ff1cc06ef20 legacy=0x7ff1cc0713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:35.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:35.507+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 >> v1:172.21.15.62:6789/0 conn(0x7ff1e010fbe0 legacy=0x7ff1e01a6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:19:35.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:35.507+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 shutdown_connections 2024-02-13T15:19:35.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:35.507+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 >> 172.21.15.62:0/3454359826 conn(0x7ff1e00fec30 msgr2=0x7ff1e0108f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:19:35.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:35.511+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 shutdown_connections 2024-02-13T15:19:35.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:19:35.511+0000 7ff1e85a2640 1 -- 172.21.15.62:0/3454359826 wait complete. 2024-02-13T15:19:35.533 INFO:tasks.workunit.client.0.smithi062.stderr:+ sleep 30 2024-02-13T15:19:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:35 smithi062 bash[28859]: audit 2024-02-13T15:19:34.497916+0000 mon.a (mon.0) 3637 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T15:19:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:35 smithi062 bash[28859]: cluster 2024-02-13T15:19:34.505763+0000 mon.a (mon.0) 3638 : cluster 0 osdmap e818: 8 total, 8 up, 8 in 2024-02-13T15:19:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:35 smithi062 bash[28859]: audit 2024-02-13T15:19:34.618001+0000 mon.a (mon.0) 3639 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T15:19:35.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:35 smithi062 bash[21479]: audit 2024-02-13T15:19:34.497916+0000 mon.a (mon.0) 3637 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T15:19:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:35 smithi062 bash[21479]: cluster 2024-02-13T15:19:34.505763+0000 mon.a (mon.0) 3638 : cluster 0 osdmap e818: 8 total, 8 up, 8 in 2024-02-13T15:19:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:35 smithi062 bash[21479]: audit 2024-02-13T15:19:34.618001+0000 mon.a (mon.0) 3639 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T15:19:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:35 smithi111 bash[23388]: audit 2024-02-13T15:19:34.497916+0000 mon.a (mon.0) 3637 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T15:19:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:35 smithi111 bash[23388]: cluster 2024-02-13T15:19:34.505763+0000 mon.a (mon.0) 3638 : cluster 0 osdmap e818: 8 total, 8 up, 8 in 2024-02-13T15:19:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:35 smithi111 bash[23388]: audit 2024-02-13T15:19:34.618001+0000 mon.a (mon.0) 3639 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]: dispatch 2024-02-13T15:19:36.509 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:19:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:19:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:19:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:36 smithi062 bash[21479]: cluster 2024-02-13T15:19:35.064906+0000 mgr.y (mgr.14613) 1337 : cluster 0 pgmap v1803: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-13T15:19:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:36 smithi062 bash[21479]: audit 2024-02-13T15:19:35.506906+0000 mon.a (mon.0) 3640 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T15:19:36.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:36 smithi062 bash[21479]: cluster 2024-02-13T15:19:35.517501+0000 mon.a (mon.0) 3641 : cluster 0 osdmap e819: 8 total, 8 up, 8 in 2024-02-13T15:19:36.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:36 smithi062 bash[28859]: cluster 2024-02-13T15:19:35.064906+0000 mgr.y (mgr.14613) 1337 : cluster 0 pgmap v1803: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-13T15:19:36.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:36 smithi062 bash[28859]: audit 2024-02-13T15:19:35.506906+0000 mon.a (mon.0) 3640 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T15:19:36.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:36 smithi062 bash[28859]: cluster 2024-02-13T15:19:35.517501+0000 mon.a (mon.0) 3641 : cluster 0 osdmap e819: 8 total, 8 up, 8 in 2024-02-13T15:19:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:36 smithi111 bash[23388]: cluster 2024-02-13T15:19:35.064906+0000 mgr.y (mgr.14613) 1337 : cluster 0 pgmap v1803: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.7 KiB/s rd, 4.0 KiB/s wr, 1 op/s 2024-02-13T15:19:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:36 smithi111 bash[23388]: audit 2024-02-13T15:19:35.506906+0000 mon.a (mon.0) 3640 : audit 1 from='client.? v1:172.21.15.62:0/3454359826' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "100"}]': finished 2024-02-13T15:19:36.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:36 smithi111 bash[23388]: cluster 2024-02-13T15:19:35.517501+0000 mon.a (mon.0) 3641 : cluster 0 osdmap e819: 8 total, 8 up, 8 in 2024-02-13T15:19:38.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[28859]: cluster 2024-02-13T15:19:37.065692+0000 mgr.y (mgr.14613) 1338 : cluster 0 pgmap v1805: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 5.2 KiB/s wr, 1 op/s 2024-02-13T15:19:38.814 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[28859]: audit 2024-02-13T15:19:37.489340+0000 mon.a (mon.0) 3642 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:38.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[28859]: audit 2024-02-13T15:19:37.493431+0000 mon.b (mon.1) 397 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:38.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[28859]: cluster 2024-02-13T15:19:38.204634+0000 mon.a (mon.0) 3643 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (reached quota's max_bytes: 100 B) 2024-02-13T15:19:38.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[28859]: cluster 2024-02-13T15:19:38.205141+0000 mon.a (mon.0) 3644 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:19:38.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[28859]: cluster 2024-02-13T15:19:38.217113+0000 mon.a (mon.0) 3645 : cluster 0 osdmap e820: 8 total, 8 up, 8 in 2024-02-13T15:19:38.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[21479]: cluster 2024-02-13T15:19:37.065692+0000 mgr.y (mgr.14613) 1338 : cluster 0 pgmap v1805: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 5.2 KiB/s wr, 1 op/s 2024-02-13T15:19:38.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[21479]: audit 2024-02-13T15:19:37.489340+0000 mon.a (mon.0) 3642 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:38.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[21479]: audit 2024-02-13T15:19:37.493431+0000 mon.b (mon.1) 397 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:38.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[21479]: cluster 2024-02-13T15:19:38.204634+0000 mon.a (mon.0) 3643 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (reached quota's max_bytes: 100 B) 2024-02-13T15:19:38.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[21479]: cluster 2024-02-13T15:19:38.205141+0000 mon.a (mon.0) 3644 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:19:38.816 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:38 smithi062 bash[21479]: cluster 2024-02-13T15:19:38.217113+0000 mon.a (mon.0) 3645 : cluster 0 osdmap e820: 8 total, 8 up, 8 in 2024-02-13T15:19:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:38 smithi111 bash[23388]: cluster 2024-02-13T15:19:37.065692+0000 mgr.y (mgr.14613) 1338 : cluster 0 pgmap v1805: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.1 KiB/s rd, 5.2 KiB/s wr, 1 op/s 2024-02-13T15:19:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:38 smithi111 bash[23388]: audit 2024-02-13T15:19:37.489340+0000 mon.a (mon.0) 3642 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:38 smithi111 bash[23388]: audit 2024-02-13T15:19:37.493431+0000 mon.b (mon.1) 397 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:38 smithi111 bash[23388]: cluster 2024-02-13T15:19:38.204634+0000 mon.a (mon.0) 3643 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (reached quota's max_bytes: 100 B) 2024-02-13T15:19:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:38 smithi111 bash[23388]: cluster 2024-02-13T15:19:38.205141+0000 mon.a (mon.0) 3644 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:19:38.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:38 smithi111 bash[23388]: cluster 2024-02-13T15:19:38.217113+0000 mon.a (mon.0) 3645 : cluster 0 osdmap e820: 8 total, 8 up, 8 in 2024-02-13T15:19:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:40 smithi062 bash[28859]: cluster 2024-02-13T15:19:39.066496+0000 mgr.y (mgr.14613) 1339 : cluster 0 pgmap v1807: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 873 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-02-13T15:19:40.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:40 smithi062 bash[21479]: cluster 2024-02-13T15:19:39.066496+0000 mgr.y (mgr.14613) 1339 : cluster 0 pgmap v1807: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 873 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-02-13T15:19:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:40 smithi111 bash[23388]: cluster 2024-02-13T15:19:39.066496+0000 mgr.y (mgr.14613) 1339 : cluster 0 pgmap v1807: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 873 B/s rd, 4.1 KiB/s wr, 1 op/s 2024-02-13T15:19:42.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:19:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:19:42.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:42 smithi062 bash[21479]: cluster 2024-02-13T15:19:41.068336+0000 mgr.y (mgr.14613) 1340 : cluster 0 pgmap v1808: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 1 op/s 2024-02-13T15:19:42.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:42 smithi062 bash[28859]: cluster 2024-02-13T15:19:41.068336+0000 mgr.y (mgr.14613) 1340 : cluster 0 pgmap v1808: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 1 op/s 2024-02-13T15:19:42.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:42 smithi111 bash[23388]: cluster 2024-02-13T15:19:41.068336+0000 mgr.y (mgr.14613) 1340 : cluster 0 pgmap v1808: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.5 KiB/s rd, 3.7 KiB/s wr, 1 op/s 2024-02-13T15:19:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:43 smithi062 bash[21479]: audit 2024-02-13T15:19:41.853475+0000 mgr.y (mgr.14613) 1341 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:43 smithi062 bash[28859]: audit 2024-02-13T15:19:41.853475+0000 mgr.y (mgr.14613) 1341 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:43.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:43 smithi111 bash[23388]: audit 2024-02-13T15:19:41.853475+0000 mgr.y (mgr.14613) 1341 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:44 smithi062 bash[21479]: cluster 2024-02-13T15:19:43.069308+0000 mgr.y (mgr.14613) 1342 : cluster 0 pgmap v1809: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T15:19:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:44 smithi062 bash[28859]: cluster 2024-02-13T15:19:43.069308+0000 mgr.y (mgr.14613) 1342 : cluster 0 pgmap v1809: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T15:19:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:44 smithi111 bash[23388]: cluster 2024-02-13T15:19:43.069308+0000 mgr.y (mgr.14613) 1342 : cluster 0 pgmap v1809: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-02-13T15:19:46.514 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:19:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:19:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:19:46.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:46 smithi062 bash[21479]: cluster 2024-02-13T15:19:45.071262+0000 mgr.y (mgr.14613) 1343 : cluster 0 pgmap v1810: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:19:46.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:46 smithi062 bash[28859]: cluster 2024-02-13T15:19:45.071262+0000 mgr.y (mgr.14613) 1343 : cluster 0 pgmap v1810: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:19:46.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:46 smithi111 bash[23388]: cluster 2024-02-13T15:19:45.071262+0000 mgr.y (mgr.14613) 1343 : cluster 0 pgmap v1810: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:19:48.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:48 smithi062 bash[21479]: cluster 2024-02-13T15:19:47.072079+0000 mgr.y (mgr.14613) 1344 : cluster 0 pgmap v1811: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:48 smithi062 bash[28859]: cluster 2024-02-13T15:19:47.072079+0000 mgr.y (mgr.14613) 1344 : cluster 0 pgmap v1811: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:48 smithi111 bash[23388]: cluster 2024-02-13T15:19:47.072079+0000 mgr.y (mgr.14613) 1344 : cluster 0 pgmap v1811: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:19:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:50 smithi062 bash[21479]: cluster 2024-02-13T15:19:49.072979+0000 mgr.y (mgr.14613) 1345 : cluster 0 pgmap v1812: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-02-13T15:19:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:50 smithi062 bash[28859]: cluster 2024-02-13T15:19:49.072979+0000 mgr.y (mgr.14613) 1345 : cluster 0 pgmap v1812: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-02-13T15:19:50.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:50 smithi111 bash[23388]: cluster 2024-02-13T15:19:49.072979+0000 mgr.y (mgr.14613) 1345 : cluster 0 pgmap v1812: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 942 B/s rd, 0 op/s 2024-02-13T15:19:52.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:19:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:19:52.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:52 smithi062 bash[21479]: cluster 2024-02-13T15:19:51.074938+0000 mgr.y (mgr.14613) 1346 : cluster 0 pgmap v1813: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:52.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:52 smithi062 bash[28859]: cluster 2024-02-13T15:19:51.074938+0000 mgr.y (mgr.14613) 1346 : cluster 0 pgmap v1813: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:52.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:52 smithi111 bash[23388]: cluster 2024-02-13T15:19:51.074938+0000 mgr.y (mgr.14613) 1346 : cluster 0 pgmap v1813: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:53.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:53 smithi062 bash[21479]: audit 2024-02-13T15:19:51.856092+0000 mgr.y (mgr.14613) 1347 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:53.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:53 smithi062 bash[21479]: audit 2024-02-13T15:19:52.541131+0000 mon.a (mon.0) 3646 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:53.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:53 smithi062 bash[21479]: audit 2024-02-13T15:19:52.545351+0000 mon.b (mon.1) 398 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:53.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:53 smithi062 bash[28859]: audit 2024-02-13T15:19:51.856092+0000 mgr.y (mgr.14613) 1347 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:53.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:53 smithi062 bash[28859]: audit 2024-02-13T15:19:52.541131+0000 mon.a (mon.0) 3646 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:53.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:53 smithi062 bash[28859]: audit 2024-02-13T15:19:52.545351+0000 mon.b (mon.1) 398 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:53.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:53 smithi111 bash[23388]: audit 2024-02-13T15:19:51.856092+0000 mgr.y (mgr.14613) 1347 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:19:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:53 smithi111 bash[23388]: audit 2024-02-13T15:19:52.541131+0000 mon.a (mon.0) 3646 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:19:53.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:53 smithi111 bash[23388]: audit 2024-02-13T15:19:52.545351+0000 mon.b (mon.1) 398 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:19:54.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:54 smithi062 bash[21479]: cluster 2024-02-13T15:19:53.075726+0000 mgr.y (mgr.14613) 1348 : cluster 0 pgmap v1814: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:54.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:54 smithi062 bash[28859]: cluster 2024-02-13T15:19:53.075726+0000 mgr.y (mgr.14613) 1348 : cluster 0 pgmap v1814: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:54.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:54 smithi111 bash[23388]: cluster 2024-02-13T15:19:53.075726+0000 mgr.y (mgr.14613) 1348 : cluster 0 pgmap v1814: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:56.554 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:19:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:19:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:19:56.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:56 smithi062 bash[21479]: cluster 2024-02-13T15:19:55.077493+0000 mgr.y (mgr.14613) 1349 : cluster 0 pgmap v1815: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:56.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:56 smithi062 bash[28859]: cluster 2024-02-13T15:19:55.077493+0000 mgr.y (mgr.14613) 1349 : cluster 0 pgmap v1815: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:56.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:56 smithi111 bash[23388]: cluster 2024-02-13T15:19:55.077493+0000 mgr.y (mgr.14613) 1349 : cluster 0 pgmap v1815: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:19:58.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:19:58 smithi062 bash[21479]: cluster 2024-02-13T15:19:57.078269+0000 mgr.y (mgr.14613) 1350 : cluster 0 pgmap v1816: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:58.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:19:58 smithi062 bash[28859]: cluster 2024-02-13T15:19:57.078269+0000 mgr.y (mgr.14613) 1350 : cluster 0 pgmap v1816: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:19:58.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:19:58 smithi111 bash[23388]: cluster 2024-02-13T15:19:57.078269+0000 mgr.y (mgr.14613) 1350 : cluster 0 pgmap v1816: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:00 smithi111 bash[23388]: cluster 2024-02-13T15:19:59.079110+0000 mgr.y (mgr.14613) 1351 : cluster 0 pgmap v1817: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:00 smithi111 bash[23388]: cluster 2024-02-13T15:20:00.000170+0000 mon.a (mon.0) 3647 : cluster 3 Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled; 1 pool(s) full 2024-02-13T15:20:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:00 smithi111 bash[23388]: cluster 2024-02-13T15:20:00.000214+0000 mon.a (mon.0) 3648 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-02-13T15:20:00.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:00 smithi111 bash[23388]: cluster 2024-02-13T15:20:00.000237+0000 mon.a (mon.0) 3649 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:20:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:00 smithi111 bash[23388]: cluster 2024-02-13T15:20:00.000256+0000 mon.a (mon.0) 3650 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:20:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:00 smithi111 bash[23388]: cluster 2024-02-13T15:20:00.000291+0000 mon.a (mon.0) 3651 : cluster 3 [WRN] POOL_FULL: 1 pool(s) full 2024-02-13T15:20:00.845 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:00 smithi111 bash[23388]: cluster 2024-02-13T15:20:00.000340+0000 mon.a (mon.0) 3652 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (running out of quota) 2024-02-13T15:20:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[21479]: cluster 2024-02-13T15:19:59.079110+0000 mgr.y (mgr.14613) 1351 : cluster 0 pgmap v1817: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[21479]: cluster 2024-02-13T15:20:00.000170+0000 mon.a (mon.0) 3647 : cluster 3 Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled; 1 pool(s) full 2024-02-13T15:20:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[21479]: cluster 2024-02-13T15:20:00.000214+0000 mon.a (mon.0) 3648 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-02-13T15:20:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[21479]: cluster 2024-02-13T15:20:00.000237+0000 mon.a (mon.0) 3649 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:20:01.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[21479]: cluster 2024-02-13T15:20:00.000256+0000 mon.a (mon.0) 3650 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[21479]: cluster 2024-02-13T15:20:00.000291+0000 mon.a (mon.0) 3651 : cluster 3 [WRN] POOL_FULL: 1 pool(s) full 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[21479]: cluster 2024-02-13T15:20:00.000340+0000 mon.a (mon.0) 3652 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (running out of quota) 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[28859]: cluster 2024-02-13T15:19:59.079110+0000 mgr.y (mgr.14613) 1351 : cluster 0 pgmap v1817: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[28859]: cluster 2024-02-13T15:20:00.000170+0000 mon.a (mon.0) 3647 : cluster 3 Health detail: HEALTH_WARN 1 pool(s) do not have an application enabled; 1 pool(s) full 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[28859]: cluster 2024-02-13T15:20:00.000214+0000 mon.a (mon.0) 3648 : cluster 3 [WRN] POOL_APP_NOT_ENABLED: 1 pool(s) do not have an application enabled 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[28859]: cluster 2024-02-13T15:20:00.000237+0000 mon.a (mon.0) 3649 : cluster 3 application not enabled on pool 'ceph_test_rados_api_asio' 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[28859]: cluster 2024-02-13T15:20:00.000256+0000 mon.a (mon.0) 3650 : cluster 3 use 'ceph osd pool application enable ', where is 'cephfs', 'rbd', 'rgw', or freeform for custom applications. 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[28859]: cluster 2024-02-13T15:20:00.000291+0000 mon.a (mon.0) 3651 : cluster 3 [WRN] POOL_FULL: 1 pool(s) full 2024-02-13T15:20:01.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:00 smithi062 bash[28859]: cluster 2024-02-13T15:20:00.000340+0000 mon.a (mon.0) 3652 : cluster 3 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' is full (running out of quota) 2024-02-13T15:20:02.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:20:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:20:02.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:02 smithi111 bash[23388]: cluster 2024-02-13T15:20:01.080970+0000 mgr.y (mgr.14613) 1352 : cluster 0 pgmap v1818: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:03.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:02 smithi062 bash[21479]: cluster 2024-02-13T15:20:01.080970+0000 mgr.y (mgr.14613) 1352 : cluster 0 pgmap v1818: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:03.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:02 smithi062 bash[28859]: cluster 2024-02-13T15:20:01.080970+0000 mgr.y (mgr.14613) 1352 : cluster 0 pgmap v1818: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:03.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:03 smithi111 bash[23388]: audit 2024-02-13T15:20:01.867499+0000 mgr.y (mgr.14613) 1353 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:04.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:03 smithi062 bash[21479]: audit 2024-02-13T15:20:01.867499+0000 mgr.y (mgr.14613) 1353 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:04.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:03 smithi062 bash[28859]: audit 2024-02-13T15:20:01.867499+0000 mgr.y (mgr.14613) 1353 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:04.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:04 smithi111 bash[23388]: cluster 2024-02-13T15:20:03.081753+0000 mgr.y (mgr.14613) 1354 : cluster 0 pgmap v1819: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:05.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:04 smithi062 bash[21479]: cluster 2024-02-13T15:20:03.081753+0000 mgr.y (mgr.14613) 1354 : cluster 0 pgmap v1819: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:05.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:04 smithi062 bash[28859]: cluster 2024-02-13T15:20:03.081753+0000 mgr.y (mgr.14613) 1354 : cluster 0 pgmap v1819: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:05.534 INFO:tasks.workunit.client.0.smithi062.stderr:+ pid=136208 2024-02-13T15:20:05.534 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool set-quota 38effd22-4604-428a-b9f7-cf7ee1ea6006 max_bytes 0 2024-02-13T15:20:05.535 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put two /etc/passwd 2024-02-13T15:20:05.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- 172.21.15.62:0/3382505686 >> v1:172.21.15.62:6790/0 conn(0x7fbff0110410 legacy=0x7fbff0112800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:05.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- 172.21.15.62:0/3382505686 shutdown_connections 2024-02-13T15:20:05.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- 172.21.15.62:0/3382505686 >> 172.21.15.62:0/3382505686 conn(0x7fbff0076da0 msgr2=0x7fbff00791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:05.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- 172.21.15.62:0/3382505686 shutdown_connections 2024-02-13T15:20:05.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- 172.21.15.62:0/3382505686 wait complete. 2024-02-13T15:20:05.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 Processor -- start 2024-02-13T15:20:05.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- start start 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbff01ac3b0 con 0x7fbff010d660 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbff01ad5b0 con 0x7fbff0110410 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fbff01ae7b0 con 0x7fbff0114010 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff5a88640 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7fbff0114010 0x7fbff01aaab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:56888/0 (socket says 172.21.15.62:56888) 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff5a88640 1 -- 172.21.15.62:0/3498890877 learned_addr learned my addr 172.21.15.62:0/3498890877 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384844151 0 0) 0x7fbff01ac3b0 con 0x7fbff010d660 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfdc003170 con 0x7fbff010d660 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4002289449 0 0) 0x7fbff01ae7b0 con 0x7fbff0114010 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff01ac3b0 con 0x7fbff0114010 2024-02-13T15:20:05.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2768500589 0 0) 0x7fbfdc003170 con 0x7fbff010d660 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbff01ae7b0 con 0x7fbff010d660 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2437471840 0 0) 0x7fbff01ac3b0 con 0x7fbff0114010 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fbfdc003170 con 0x7fbff0114010 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fbfec001840 con 0x7fbff010d660 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fbfe8001d80 con 0x7fbff0114010 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699333948 0 0) 0x7fbff01ad5b0 con 0x7fbff0110410 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff01ac3b0 con 0x7fbff0110410 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 3983433633 0 0) 0x7fbff01ae7b0 con 0x7fbff010d660 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 >> v1:172.21.15.62:6790/0 conn(0x7fbff0114010 legacy=0x7fbff01aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 >> v1:172.21.15.111:6789/0 conn(0x7fbff0110410 legacy=0x7fbff01a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff01af9b0 con 0x7fbff010d660 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff01ac5a0 con 0x7fbff010d660 2024-02-13T15:20:05.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff01aca20 con 0x7fbff010d660 2024-02-13T15:20:05.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fbfec0019f0 con 0x7fbff010d660 2024-02-13T15:20:05.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fbfec0049b0 con 0x7fbff010d660 2024-02-13T15:20:05.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.667+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd4005090 con 0x7fbff010d660 2024-02-13T15:20:05.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.671+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fbfec003600 con 0x7fbff010d660 2024-02-13T15:20:05.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.671+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(820..820 src has 269..820) v4 ==== 7744+0+0 (unknown 2501541625 0 0) 0x7fbfec088100 con 0x7fbff010d660 2024-02-13T15:20:05.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.671+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=821}) v3 -- 0x7fbff01ae7b0 con 0x7fbff010d660 2024-02-13T15:20:05.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.675+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fbfec054be0 con 0x7fbff010d660 2024-02-13T15:20:05.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:05.847+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fbfd4005340 con 0x7fbff010d660 2024-02-13T15:20:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:20:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:20:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:20:06.589 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:06.587+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v821) v1 ==== 217+0+0 (unknown 3550394446 0 0) 0x7fbfec052f50 con 0x7fbff010d660 2024-02-13T15:20:06.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:06.587+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 11 ==== osd_map(821..821 src has 269..821) v4 ==== 628+0+0 (unknown 588289614 0 0) 0x7fbfec055510 con 0x7fbff010d660 2024-02-13T15:20:06.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:06.587+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=822}) v3 -- 0x7fbff01ad5b0 con 0x7fbff010d660 2024-02-13T15:20:06.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:06.699+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fbfd4000c50 con 0x7fbff010d660 2024-02-13T15:20:06.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:06 smithi111 bash[23388]: cluster 2024-02-13T15:20:05.083579+0000 mgr.y (mgr.14613) 1355 : cluster 0 pgmap v1820: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:06.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:06 smithi111 bash[23388]: audit 2024-02-13T15:20:05.851037+0000 mon.a (mon.0) 3653 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:20:07.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:06 smithi062 bash[21479]: cluster 2024-02-13T15:20:05.083579+0000 mgr.y (mgr.14613) 1355 : cluster 0 pgmap v1820: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:07.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:06 smithi062 bash[21479]: audit 2024-02-13T15:20:05.851037+0000 mon.a (mon.0) 3653 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:20:07.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:06 smithi062 bash[28859]: cluster 2024-02-13T15:20:05.083579+0000 mgr.y (mgr.14613) 1355 : cluster 0 pgmap v1820: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:07.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:06 smithi062 bash[28859]: audit 2024-02-13T15:20:05.851037+0000 mon.a (mon.0) 3653 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:20:07.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.587+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v822) v1 ==== 217+0+0 (unknown 2778716397 0 0) 0x7fbfec054770 con 0x7fbff010d660 2024-02-13T15:20:07.593 INFO:tasks.workunit.client.0.smithi062.stderr:set-quota max_bytes = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 2024-02-13T15:20:07.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.587+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 <== mon.0 v1:172.21.15.62:6789/0 13 ==== osd_map(822..822 src has 269..822) v4 ==== 628+0+0 (unknown 184674651 0 0) 0x7fbfec0591c0 con 0x7fbff010d660 2024-02-13T15:20:07.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.587+0000 7fbfe67fc640 1 -- 172.21.15.62:0/3498890877 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=823}) v3 -- 0x7fbfdc07c030 con 0x7fbff010d660 2024-02-13T15:20:07.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.595+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 >> v1:172.21.15.62:6800/3802446050 conn(0x7fbfdc06ef50 legacy=0x7fbfdc071410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.595+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 >> v1:172.21.15.62:6789/0 conn(0x7fbff010d660 legacy=0x7fbff010c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.595+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 shutdown_connections 2024-02-13T15:20:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.595+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 >> 172.21.15.62:0/3498890877 conn(0x7fbff0076da0 msgr2=0x7fbff0117510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:07.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.599+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 shutdown_connections 2024-02-13T15:20:07.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.599+0000 7fbff74eb640 1 -- 172.21.15.62:0/3498890877 wait complete. 2024-02-13T15:20:07.627 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool set-quota 38effd22-4604-428a-b9f7-cf7ee1ea6006 max_objects 0 2024-02-13T15:20:07.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- 172.21.15.62:0/748121513 >> v1:172.21.15.62:6789/0 conn(0x7f0b3c109f60 legacy=0x7f0b3c10c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:07.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- 172.21.15.62:0/748121513 shutdown_connections 2024-02-13T15:20:07.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- 172.21.15.62:0/748121513 >> 172.21.15.62:0/748121513 conn(0x7f0b3c0fb9c0 msgr2=0x7f0b3c0fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:07.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- 172.21.15.62:0/748121513 shutdown_connections 2024-02-13T15:20:07.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- 172.21.15.62:0/748121513 wait complete. 2024-02-13T15:20:07.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 Processor -- start 2024-02-13T15:20:07.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- start start 2024-02-13T15:20:07.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0b3c1a5d50 con 0x7f0b3c102150 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0b3c1a6f50 con 0x7f0b3c109f60 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f0b3c1a8150 con 0x7f0b3c10da70 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b3a59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0b3c102150 0x7f0b3c1095e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39084/0 (socket says 172.21.15.62:39084) 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b3a59c640 1 -- 172.21.15.62:0/3445819563 learned_addr learned my addr 172.21.15.62:0/3445819563 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968410105 0 0) 0x7f0b3c1a5d50 con 0x7f0b3c102150 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b28003250 con 0x7f0b3c102150 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243315518 0 0) 0x7f0b3c1a8150 con 0x7f0b3c10da70 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b3c1a5d50 con 0x7f0b3c10da70 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3299476649 0 0) 0x7f0b3c1a5d50 con 0x7f0b3c10da70 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b3c1a8150 con 0x7f0b3c10da70 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4031227977 0 0) 0x7f0b28003250 con 0x7f0b3c102150 2024-02-13T15:20:07.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f0b3c1a5d50 con 0x7f0b3c102150 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f0b34001400 con 0x7f0b3c10da70 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f0b24001940 con 0x7f0b3c102150 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910109925 0 0) 0x7f0b3c1a6f50 con 0x7f0b3c109f60 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b28003250 con 0x7f0b3c109f60 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2759672638 0 0) 0x7f0b3c1a8150 con 0x7f0b3c10da70 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 >> v1:172.21.15.111:6789/0 conn(0x7f0b3c109f60 legacy=0x7f0b3c1a0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 >> v1:172.21.15.62:6789/0 conn(0x7f0b3c102150 legacy=0x7f0b3c1095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c1a9350 con 0x7f0b3c10da70 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3c1a8340 con 0x7f0b3c10da70 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b3c1a87c0 con 0x7f0b3c10da70 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f0b340015b0 con 0x7f0b3c10da70 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f0b34004c60 con 0x7f0b3c10da70 2024-02-13T15:20:07.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.747+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b1c005090 con 0x7f0b3c10da70 2024-02-13T15:20:07.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.751+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f0b34003980 con 0x7f0b3c10da70 2024-02-13T15:20:07.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.751+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(822..822 src has 269..822) v4 ==== 7744+0+0 (unknown 1181067305 0 0) 0x7f0b340884c0 con 0x7f0b3c10da70 2024-02-13T15:20:07.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.751+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=823}) v3 -- 0x7f0b3c1a8150 con 0x7f0b3c10da70 2024-02-13T15:20:07.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.755+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f0b34054fa0 con 0x7f0b3c10da70 2024-02-13T15:20:07.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:07.931+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f0b1c005340 con 0x7f0b3c10da70 2024-02-13T15:20:08.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:07 smithi062 bash[28859]: audit 2024-02-13T15:20:06.590170+0000 mon.a (mon.0) 3654 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:20:08.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:07 smithi062 bash[28859]: cluster 2024-02-13T15:20:06.596860+0000 mon.a (mon.0) 3655 : cluster 0 osdmap e821: 8 total, 8 up, 8 in 2024-02-13T15:20:08.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:07 smithi062 bash[28859]: audit 2024-02-13T15:20:06.703466+0000 mon.a (mon.0) 3656 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:20:08.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:07 smithi062 bash[28859]: audit 2024-02-13T15:20:07.578785+0000 mon.b (mon.1) 399 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:08.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:07 smithi062 bash[21479]: audit 2024-02-13T15:20:06.590170+0000 mon.a (mon.0) 3654 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:20:08.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:07 smithi062 bash[21479]: cluster 2024-02-13T15:20:06.596860+0000 mon.a (mon.0) 3655 : cluster 0 osdmap e821: 8 total, 8 up, 8 in 2024-02-13T15:20:08.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:07 smithi062 bash[21479]: audit 2024-02-13T15:20:06.703466+0000 mon.a (mon.0) 3656 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:20:08.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:07 smithi062 bash[21479]: audit 2024-02-13T15:20:07.578785+0000 mon.b (mon.1) 399 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:08.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:07 smithi111 bash[23388]: audit 2024-02-13T15:20:06.590170+0000 mon.a (mon.0) 3654 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:20:08.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:07 smithi111 bash[23388]: cluster 2024-02-13T15:20:06.596860+0000 mon.a (mon.0) 3655 : cluster 0 osdmap e821: 8 total, 8 up, 8 in 2024-02-13T15:20:08.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:07 smithi111 bash[23388]: audit 2024-02-13T15:20:06.703466+0000 mon.a (mon.0) 3656 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:20:08.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:07 smithi111 bash[23388]: audit 2024-02-13T15:20:07.578785+0000 mon.b (mon.1) 399 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:08.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:08.211+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 10 ==== osd_map(823..823 src has 269..823) v4 ==== 628+0+0 (unknown 2662336888 0 0) 0x7f0b340558d0 con 0x7f0b3c10da70 2024-02-13T15:20:08.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:08.211+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=824}) v3 -- 0x7f0b3c1a5d50 con 0x7f0b3c10da70 2024-02-13T15:20:08.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:08.219+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v823) v1 ==== 221+0+0 (unknown 3098812797 0 0) 0x7f0b34053310 con 0x7f0b3c10da70 2024-02-13T15:20:08.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:08.331+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f0b1c000c50 con 0x7f0b3c10da70 2024-02-13T15:20:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: cluster 2024-02-13T15:20:07.084397+0000 mgr.y (mgr.14613) 1356 : cluster 0 pgmap v1822: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:20:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: audit 2024-02-13T15:20:07.592844+0000 mon.a (mon.0) 3657 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:20:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: cluster 2024-02-13T15:20:07.601088+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e822: 8 total, 8 up, 8 in 2024-02-13T15:20:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: audit 2024-02-13T15:20:07.935389+0000 mon.c (mon.2) 874 : audit 1 from='client.? v1:172.21.15.62:0/3445819563' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: audit 2024-02-13T15:20:07.936034+0000 mon.a (mon.0) 3659 : audit 1 from='client.47288 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: cluster 2024-02-13T15:20:08.212853+0000 mon.a (mon.0) 3660 : cluster 1 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' no longer out of quota; removing NO_QUOTA flag 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: cluster 2024-02-13T15:20:08.213340+0000 mon.a (mon.0) 3661 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: audit 2024-02-13T15:20:08.215686+0000 mon.a (mon.0) 3662 : audit 1 from='client.47288 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: cluster 2024-02-13T15:20:08.223382+0000 mon.a (mon.0) 3663 : cluster 0 osdmap e823: 8 total, 8 up, 8 in 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: audit 2024-02-13T15:20:08.335742+0000 mon.c (mon.2) 875 : audit 1 from='client.? v1:172.21.15.62:0/3445819563' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[21479]: audit 2024-02-13T15:20:08.336435+0000 mon.a (mon.0) 3664 : audit 1 from='client.47288 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: cluster 2024-02-13T15:20:07.084397+0000 mgr.y (mgr.14613) 1356 : cluster 0 pgmap v1822: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: audit 2024-02-13T15:20:07.592844+0000 mon.a (mon.0) 3657 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: cluster 2024-02-13T15:20:07.601088+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e822: 8 total, 8 up, 8 in 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: audit 2024-02-13T15:20:07.935389+0000 mon.c (mon.2) 874 : audit 1 from='client.? v1:172.21.15.62:0/3445819563' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: audit 2024-02-13T15:20:07.936034+0000 mon.a (mon.0) 3659 : audit 1 from='client.47288 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: cluster 2024-02-13T15:20:08.212853+0000 mon.a (mon.0) 3660 : cluster 1 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' no longer out of quota; removing NO_QUOTA flag 2024-02-13T15:20:09.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: cluster 2024-02-13T15:20:08.213340+0000 mon.a (mon.0) 3661 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T15:20:09.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: audit 2024-02-13T15:20:08.215686+0000 mon.a (mon.0) 3662 : audit 1 from='client.47288 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:20:09.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: cluster 2024-02-13T15:20:08.223382+0000 mon.a (mon.0) 3663 : cluster 0 osdmap e823: 8 total, 8 up, 8 in 2024-02-13T15:20:09.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: audit 2024-02-13T15:20:08.335742+0000 mon.c (mon.2) 875 : audit 1 from='client.? v1:172.21.15.62:0/3445819563' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.064 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:08 smithi062 bash[28859]: audit 2024-02-13T15:20:08.336435+0000 mon.a (mon.0) 3664 : audit 1 from='client.47288 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: cluster 2024-02-13T15:20:07.084397+0000 mgr.y (mgr.14613) 1356 : cluster 0 pgmap v1822: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: audit 2024-02-13T15:20:07.592844+0000 mon.a (mon.0) 3657 : audit 1 from='client.? v1:172.21.15.62:0/3498890877' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: cluster 2024-02-13T15:20:07.601088+0000 mon.a (mon.0) 3658 : cluster 0 osdmap e822: 8 total, 8 up, 8 in 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: audit 2024-02-13T15:20:07.935389+0000 mon.c (mon.2) 874 : audit 1 from='client.? v1:172.21.15.62:0/3445819563' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: audit 2024-02-13T15:20:07.936034+0000 mon.a (mon.0) 3659 : audit 1 from='client.47288 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: cluster 2024-02-13T15:20:08.212853+0000 mon.a (mon.0) 3660 : cluster 1 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' no longer out of quota; removing NO_QUOTA flag 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: cluster 2024-02-13T15:20:08.213340+0000 mon.a (mon.0) 3661 : cluster 1 Health check cleared: POOL_FULL (was: 1 pool(s) full) 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: audit 2024-02-13T15:20:08.215686+0000 mon.a (mon.0) 3662 : audit 1 from='client.47288 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: cluster 2024-02-13T15:20:08.223382+0000 mon.a (mon.0) 3663 : cluster 0 osdmap e823: 8 total, 8 up, 8 in 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: audit 2024-02-13T15:20:08.335742+0000 mon.c (mon.2) 875 : audit 1 from='client.? v1:172.21.15.62:0/3445819563' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:08 smithi111 bash[23388]: audit 2024-02-13T15:20:08.336435+0000 mon.a (mon.0) 3664 : audit 1 from='client.47288 ' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:20:09.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.215+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 12 ==== osd_map(824..824 src has 269..824) v4 ==== 628+0+0 (unknown 1728916866 0 0) 0x7f0b3405dbd0 con 0x7f0b3c10da70 2024-02-13T15:20:09.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.223+0000 7f0b337fe640 1 -- 172.21.15.62:0/3445819563 <== mon.2 v1:172.21.15.62:6790/0 13 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v824) v1 ==== 221+0+0 (unknown 570809093 0 0) 0x7f0b34054b30 con 0x7f0b3c10da70 2024-02-13T15:20:09.229 INFO:tasks.workunit.client.0.smithi062.stderr:set-quota max_objects = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 2024-02-13T15:20:09.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.227+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 >> v1:172.21.15.62:6800/3802446050 conn(0x7f0b2806ef00 legacy=0x7f0b280713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:09.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.227+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 >> v1:172.21.15.62:6790/0 conn(0x7f0b3c10da70 legacy=0x7f0b3c1a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:09.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.227+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 shutdown_connections 2024-02-13T15:20:09.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.227+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 >> 172.21.15.62:0/3445819563 conn(0x7f0b3c0fb9c0 msgr2=0x7f0b3c0fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:09.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.227+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 shutdown_connections 2024-02-13T15:20:09.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.227+0000 7f0b40b90640 1 -- 172.21.15.62:0/3445819563 wait complete. 2024-02-13T15:20:09.251 INFO:tasks.workunit.client.0.smithi062.stderr:+ wait 136208 2024-02-13T15:20:09.251 INFO:tasks.workunit.client.0.smithi062.stderr:+ [ 0 -ne 0 ] 2024-02-13T15:20:09.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ true 2024-02-13T15:20:09.252 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put three /etc/passwd 2024-02-13T15:20:09.292 INFO:tasks.workunit.client.0.smithi062.stderr:+ uuidgen 2024-02-13T15:20:09.292 INFO:tasks.workunit.client.0.smithi062.stderr:+ pp=7437e2a3-873d-4a78-a266-b034849c891e 2024-02-13T15:20:09.293 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool create 7437e2a3-873d-4a78-a266-b034849c891e 12 2024-02-13T15:20:09.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- 172.21.15.62:0/3429106687 >> v1:172.21.15.62:6789/0 conn(0x7f14b4109e70 legacy=0x7f14b410c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:09.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- 172.21.15.62:0/3429106687 shutdown_connections 2024-02-13T15:20:09.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- 172.21.15.62:0/3429106687 >> 172.21.15.62:0/3429106687 conn(0x7f14b40fca50 msgr2=0x7f14b40fee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:09.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- 172.21.15.62:0/3429106687 shutdown_connections 2024-02-13T15:20:09.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- 172.21.15.62:0/3429106687 wait complete. 2024-02-13T15:20:09.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 Processor -- start 2024-02-13T15:20:09.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- start start 2024-02-13T15:20:09.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f14b41a5ee0 con 0x7f14b4109e70 2024-02-13T15:20:09.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f14b41a70e0 con 0x7f14b41011e0 2024-02-13T15:20:09.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14bb8b3640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f14b41a82e0 con 0x7f14b410d9e0 2024-02-13T15:20:09.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14b8e4e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f14b4109e70 0x7f14b41a0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39126/0 (socket says 172.21.15.62:39126) 2024-02-13T15:20:09.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14b8e4e640 1 -- 172.21.15.62:0/2205326949 learned_addr learned my addr 172.21.15.62:0/2205326949 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:20:09.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.403+0000 7f14b9e50640 1 --1- 172.21.15.62:0/2205326949 >> v1:172.21.15.62:6790/0 conn(0x7f14b410d9e0 0x7f14b41a45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:56954/0 (socket says 172.21.15.62:56954) 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484464901 0 0) 0x7f14b41a5ee0 con 0x7f14b4109e70 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14a0001ff0 con 0x7f14b4109e70 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3852576300 0 0) 0x7f14b41a82e0 con 0x7f14b410d9e0 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14b41a5ee0 con 0x7f14b410d9e0 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3864951766 0 0) 0x7f14b41a5ee0 con 0x7f14b410d9e0 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f14b41a82e0 con 0x7f14b410d9e0 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2667936794 0 0) 0x7f14a0001ff0 con 0x7f14b4109e70 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f14b41a5ee0 con 0x7f14b4109e70 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f14ac004180 con 0x7f14b410d9e0 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f14a4004370 con 0x7f14b4109e70 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1386635401 0 0) 0x7f14b41a82e0 con 0x7f14b410d9e0 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 >> v1:172.21.15.111:6789/0 conn(0x7f14b41011e0 legacy=0x7f14b4106530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 >> v1:172.21.15.62:6789/0 conn(0x7f14b4109e70 legacy=0x7f14b41a0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:09.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b41a94e0 con 0x7f14b410d9e0 2024-02-13T15:20:09.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b41a84d0 con 0x7f14b410d9e0 2024-02-13T15:20:09.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b41a8990 con 0x7f14b410d9e0 2024-02-13T15:20:09.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f14ac004330 con 0x7f14b410d9e0 2024-02-13T15:20:09.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f14ac005d10 con 0x7f14b410d9e0 2024-02-13T15:20:09.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1498005090 con 0x7f14b410d9e0 2024-02-13T15:20:09.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f14ac001260 con 0x7f14b410d9e0 2024-02-13T15:20:09.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.407+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(824..824 src has 269..824) v4 ==== 7744+0+0 (unknown 1975674363 0 0) 0x7f14ac089560 con 0x7f14b410d9e0 2024-02-13T15:20:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.411+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f14ac055db0 con 0x7f14b410d9e0 2024-02-13T15:20:09.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:09.587+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12} v 0) v1 -- 0x7f14980058c0 con 0x7f14b410d9e0 2024-02-13T15:20:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.235+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]=0 pool '7437e2a3-873d-4a78-a266-b034849c891e' created v825) v1 ==== 176+0+0 (unknown 2517933903 0 0) 0x7f14ac004830 con 0x7f14b410d9e0 2024-02-13T15:20:10.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.351+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12} v 0) v1 -- 0x7f14980053f0 con 0x7f14b410d9e0 2024-02-13T15:20:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.351+0000 7f14aa7fc640 1 -- 172.21.15.62:0/2205326949 <== mon.2 v1:172.21.15.62:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]=0 pool '7437e2a3-873d-4a78-a266-b034849c891e' already exists v825) v1 ==== 183+0+0 (unknown 310665713 0 0) 0x7f14980053f0 con 0x7f14b410d9e0 2024-02-13T15:20:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:pool '7437e2a3-873d-4a78-a266-b034849c891e' already exists 2024-02-13T15:20:10.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.355+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 >> v1:172.21.15.62:6800/3802446050 conn(0x7f14a006ee10 legacy=0x7f14a00712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.355+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 >> v1:172.21.15.62:6790/0 conn(0x7f14b410d9e0 legacy=0x7f14b41a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.355+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 shutdown_connections 2024-02-13T15:20:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.355+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 >> 172.21.15.62:0/2205326949 conn(0x7f14b40fca50 msgr2=0x7f14b40fce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.355+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 shutdown_connections 2024-02-13T15:20:10.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.355+0000 7f14bb8b3640 1 -- 172.21.15.62:0/2205326949 wait complete. 2024-02-13T15:20:10.374 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool application enable 7437e2a3-873d-4a78-a266-b034849c891e rados 2024-02-13T15:20:10.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- 172.21.15.62:0/2089225099 >> v1:172.21.15.62:6789/0 conn(0x7f4de4110410 legacy=0x7f4de4112800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:10.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- 172.21.15.62:0/2089225099 shutdown_connections 2024-02-13T15:20:10.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- 172.21.15.62:0/2089225099 >> 172.21.15.62:0/2089225099 conn(0x7f4de4076da0 msgr2=0x7f4de40791c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:10.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- 172.21.15.62:0/2089225099 shutdown_connections 2024-02-13T15:20:10.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- 172.21.15.62:0/2089225099 wait complete. 2024-02-13T15:20:10.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 Processor -- start 2024-02-13T15:20:10.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- start start 2024-02-13T15:20:10.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4de41ac460 con 0x7f4de4114010 2024-02-13T15:20:10.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4de41ad660 con 0x7f4de410d660 2024-02-13T15:20:10.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4de41ae860 con 0x7f4de4110410 2024-02-13T15:20:10.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de259c640 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f4de4110410 0x7f4de41a7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:56970/0 (socket says 172.21.15.62:56970) 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de259c640 1 -- 172.21.15.62:0/3771382109 learned_addr learned my addr 172.21.15.62:0/3771382109 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3659500369 0 0) 0x7f4de41ac460 con 0x7f4de4114010 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dcc003530 con 0x7f4de4114010 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058762255 0 0) 0x7f4de41ae860 con 0x7f4de4110410 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de41ac460 con 0x7f4de4110410 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1893814643 0 0) 0x7f4dcc003530 con 0x7f4de4114010 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4de41ae860 con 0x7f4de4114010 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4232225794 0 0) 0x7f4de41ac460 con 0x7f4de4110410 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4dcc003530 con 0x7f4de4110410 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f4ddc001c60 con 0x7f4de4114010 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489189546 0 0) 0x7f4de41ad660 con 0x7f4de410d660 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4de41ac460 con 0x7f4de410d660 2024-02-13T15:20:10.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f4dd80043c0 con 0x7f4de4110410 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2592352244 0 0) 0x7f4de41ae860 con 0x7f4de4114010 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 >> v1:172.21.15.62:6790/0 conn(0x7f4de4110410 legacy=0x7f4de41a7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 >> v1:172.21.15.111:6789/0 conn(0x7f4de410d660 legacy=0x7f4de410c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de41afa60 con 0x7f4de4114010 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de41aea50 con 0x7f4de4114010 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de41aeed0 con 0x7f4de4114010 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f4ddc003e30 con 0x7f4de4114010 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f4ddc004cc0 con 0x7f4de4114010 2024-02-13T15:20:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.495+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dd0005090 con 0x7f4de4114010 2024-02-13T15:20:10.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.499+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f4ddc003980 con 0x7f4de4114010 2024-02-13T15:20:10.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.499+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(825..825 src has 269..825) v4 ==== 8119+0+0 (unknown 4246290529 0 0) 0x7f4ddc088590 con 0x7f4de4114010 2024-02-13T15:20:10.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.503+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f4ddc054ef0 con 0x7f4de4114010 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[21479]: cluster 2024-02-13T15:20:09.085166+0000 mgr.y (mgr.14613) 1357 : cluster 0 pgmap v1825: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[21479]: audit 2024-02-13T15:20:09.218111+0000 mon.a (mon.0) 3665 : audit 1 from='client.47288 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[21479]: cluster 2024-02-13T15:20:09.225734+0000 mon.a (mon.0) 3666 : cluster 0 osdmap e824: 8 total, 8 up, 8 in 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[21479]: audit 2024-02-13T15:20:09.591994+0000 mon.c (mon.2) 876 : audit 1 from='client.? v1:172.21.15.62:0/2205326949' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[21479]: audit 2024-02-13T15:20:09.592428+0000 mon.a (mon.0) 3667 : audit 1 from='client.47303 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[28859]: cluster 2024-02-13T15:20:09.085166+0000 mgr.y (mgr.14613) 1357 : cluster 0 pgmap v1825: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[28859]: audit 2024-02-13T15:20:09.218111+0000 mon.a (mon.0) 3665 : audit 1 from='client.47288 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[28859]: cluster 2024-02-13T15:20:09.225734+0000 mon.a (mon.0) 3666 : cluster 0 osdmap e824: 8 total, 8 up, 8 in 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[28859]: audit 2024-02-13T15:20:09.591994+0000 mon.c (mon.2) 876 : audit 1 from='client.? v1:172.21.15.62:0/2205326949' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:10 smithi062 bash[28859]: audit 2024-02-13T15:20:09.592428+0000 mon.a (mon.0) 3667 : audit 1 from='client.47303 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:10 smithi111 bash[23388]: cluster 2024-02-13T15:20:09.085166+0000 mgr.y (mgr.14613) 1357 : cluster 0 pgmap v1825: 176 pgs: 176 active+clean; 722 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:10 smithi111 bash[23388]: audit 2024-02-13T15:20:09.218111+0000 mon.a (mon.0) 3665 : audit 1 from='client.47288 ' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:20:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:10 smithi111 bash[23388]: cluster 2024-02-13T15:20:09.225734+0000 mon.a (mon.0) 3666 : cluster 0 osdmap e824: 8 total, 8 up, 8 in 2024-02-13T15:20:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:10 smithi111 bash[23388]: audit 2024-02-13T15:20:09.591994+0000 mon.c (mon.2) 876 : audit 1 from='client.? v1:172.21.15.62:0/2205326949' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:10.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:10 smithi111 bash[23388]: audit 2024-02-13T15:20:09.592428+0000 mon.a (mon.0) 3667 : audit 1 from='client.47303 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:10.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:10.679+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"} v 0) v1 -- 0x7f4dd0005340 con 0x7f4de4114010 2024-02-13T15:20:11.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:11.235+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]=0 enabled application 'rados' on pool '7437e2a3-873d-4a78-a266-b034849c891e' v826) v1 ==== 213+0+0 (unknown 2945159570 0 0) 0x7f4ddc053260 con 0x7f4de4114010 2024-02-13T15:20:11.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:11.359+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"} v 0) v1 -- 0x7f4dd00010a0 con 0x7f4de4114010 2024-02-13T15:20:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[28859]: audit 2024-02-13T15:20:10.231681+0000 mon.a (mon.0) 3668 : audit 1 from='client.47303 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]': finished 2024-02-13T15:20:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[28859]: cluster 2024-02-13T15:20:10.241206+0000 mon.a (mon.0) 3669 : cluster 0 osdmap e825: 8 total, 8 up, 8 in 2024-02-13T15:20:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[28859]: audit 2024-02-13T15:20:10.355783+0000 mon.c (mon.2) 877 : audit 1 from='client.? v1:172.21.15.62:0/2205326949' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[28859]: audit 2024-02-13T15:20:10.356428+0000 mon.a (mon.0) 3670 : audit 1 from='client.47303 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:11.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[28859]: audit 2024-02-13T15:20:10.685964+0000 mon.a (mon.0) 3671 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]: dispatch 2024-02-13T15:20:11.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[21479]: audit 2024-02-13T15:20:10.231681+0000 mon.a (mon.0) 3668 : audit 1 from='client.47303 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]': finished 2024-02-13T15:20:11.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[21479]: cluster 2024-02-13T15:20:10.241206+0000 mon.a (mon.0) 3669 : cluster 0 osdmap e825: 8 total, 8 up, 8 in 2024-02-13T15:20:11.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[21479]: audit 2024-02-13T15:20:10.355783+0000 mon.c (mon.2) 877 : audit 1 from='client.? v1:172.21.15.62:0/2205326949' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:11.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[21479]: audit 2024-02-13T15:20:10.356428+0000 mon.a (mon.0) 3670 : audit 1 from='client.47303 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:11.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:11 smithi062 bash[21479]: audit 2024-02-13T15:20:10.685964+0000 mon.a (mon.0) 3671 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]: dispatch 2024-02-13T15:20:11.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:11 smithi111 bash[23388]: audit 2024-02-13T15:20:10.231681+0000 mon.a (mon.0) 3668 : audit 1 from='client.47303 ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]': finished 2024-02-13T15:20:11.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:11 smithi111 bash[23388]: cluster 2024-02-13T15:20:10.241206+0000 mon.a (mon.0) 3669 : cluster 0 osdmap e825: 8 total, 8 up, 8 in 2024-02-13T15:20:11.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:11 smithi111 bash[23388]: audit 2024-02-13T15:20:10.355783+0000 mon.c (mon.2) 877 : audit 1 from='client.? v1:172.21.15.62:0/2205326949' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:11.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:11 smithi111 bash[23388]: audit 2024-02-13T15:20:10.356428+0000 mon.a (mon.0) 3670 : audit 1 from='client.47303 ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pg_num": 12}]: dispatch 2024-02-13T15:20:11.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:11 smithi111 bash[23388]: audit 2024-02-13T15:20:10.685964+0000 mon.a (mon.0) 3671 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]: dispatch 2024-02-13T15:20:12.244 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:20:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:20:12.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.247+0000 7f4dcbfff640 1 -- 172.21.15.62:0/3771382109 <== mon.0 v1:172.21.15.62:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]=0 enabled application 'rados' on pool '7437e2a3-873d-4a78-a266-b034849c891e' v827) v1 ==== 213+0+0 (unknown 2510972788 0 0) 0x7f4ddc054a80 con 0x7f4de4114010 2024-02-13T15:20:12.253 INFO:tasks.workunit.client.0.smithi062.stderr:enabled application 'rados' on pool '7437e2a3-873d-4a78-a266-b034849c891e' 2024-02-13T15:20:12.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.251+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 >> v1:172.21.15.62:6800/3802446050 conn(0x7f4dcc06ee90 legacy=0x7f4dcc071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:12.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.251+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 >> v1:172.21.15.62:6789/0 conn(0x7f4de4114010 legacy=0x7f4de41aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:12.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.251+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 shutdown_connections 2024-02-13T15:20:12.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.255+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 >> 172.21.15.62:0/3771382109 conn(0x7f4de4076da0 msgr2=0x7f4de41174f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:12.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.255+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 shutdown_connections 2024-02-13T15:20:12.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.255+0000 7f4de90bf640 1 -- 172.21.15.62:0/3771382109 wait complete. 2024-02-13T15:20:12.280 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool set-quota 7437e2a3-873d-4a78-a266-b034849c891e max_objects 10 2024-02-13T15:20:12.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- 172.21.15.62:0/1851409021 >> v1:172.21.15.62:6790/0 conn(0x7f5d3010c070 legacy=0x7f5d3010e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:12.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- 172.21.15.62:0/1851409021 shutdown_connections 2024-02-13T15:20:12.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- 172.21.15.62:0/1851409021 >> 172.21.15.62:0/1851409021 conn(0x7f5d300fec30 msgr2=0x7f5d30101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:12.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- 172.21.15.62:0/1851409021 shutdown_connections 2024-02-13T15:20:12.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- 172.21.15.62:0/1851409021 wait complete. 2024-02-13T15:20:12.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 Processor -- start 2024-02-13T15:20:12.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- start start 2024-02-13T15:20:12.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5d301a80e0 con 0x7f5d301033e0 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5d301a92e0 con 0x7f5d3010c070 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f5d301aa4e0 con 0x7f5d3010fbe0 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d35516640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5d301033e0 0x7f5d30108730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:52262/0 (socket says 172.21.15.62:52262) 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d35516640 1 -- 172.21.15.62:0/1155901939 learned_addr learned my addr 172.21.15.62:0/1155901939 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161001768 0 0) 0x7f5d301a80e0 con 0x7f5d301033e0 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d1c003530 con 0x7f5d301033e0 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2282074514 0 0) 0x7f5d301aa4e0 con 0x7f5d3010fbe0 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d301a80e0 con 0x7f5d3010fbe0 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210222025 0 0) 0x7f5d301a92e0 con 0x7f5d3010c070 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d301aa4e0 con 0x7f5d3010c070 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2750306044 0 0) 0x7f5d1c003530 con 0x7f5d301033e0 2024-02-13T15:20:12.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5d301a92e0 con 0x7f5d301033e0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1356720749 0 0) 0x7f5d301a80e0 con 0x7f5d3010fbe0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f5d1c003530 con 0x7f5d3010fbe0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f5d24001940 con 0x7f5d301033e0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f5d28001860 con 0x7f5d3010fbe0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 989300471 0 0) 0x7f5d301a92e0 con 0x7f5d301033e0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 >> v1:172.21.15.62:6790/0 conn(0x7f5d3010fbe0 legacy=0x7f5d301a67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 >> v1:172.21.15.111:6789/0 conn(0x7f5d3010c070 legacy=0x7f5d301a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d301ab6e0 con 0x7f5d301033e0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d301a82d0 con 0x7f5d301033e0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d301a8750 con 0x7f5d301033e0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f5d24001c80 con 0x7f5d301033e0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f5d24005c20 con 0x7f5d301033e0 2024-02-13T15:20:12.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.403+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d14005090 con 0x7f5d301033e0 2024-02-13T15:20:12.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.407+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f5d240038d0 con 0x7f5d301033e0 2024-02-13T15:20:12.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.407+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(827..827 src has 269..827) v4 ==== 8132+0+0 (unknown 2869070806 0 0) 0x7f5d24089550 con 0x7f5d301033e0 2024-02-13T15:20:12.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.411+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f5d24055f80 con 0x7f5d301033e0 2024-02-13T15:20:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[21479]: cluster 2024-02-13T15:20:11.085972+0000 mgr.y (mgr.14613) 1358 : cluster 0 pgmap v1828: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T15:20:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[21479]: cluster 2024-02-13T15:20:11.231555+0000 mon.a (mon.0) 3672 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:20:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[21479]: audit 2024-02-13T15:20:11.240771+0000 mon.a (mon.0) 3673 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]': finished 2024-02-13T15:20:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[21479]: cluster 2024-02-13T15:20:11.251900+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e826: 8 total, 8 up, 8 in 2024-02-13T15:20:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[21479]: audit 2024-02-13T15:20:11.365550+0000 mon.a (mon.0) 3675 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]: dispatch 2024-02-13T15:20:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[28859]: cluster 2024-02-13T15:20:11.085972+0000 mgr.y (mgr.14613) 1358 : cluster 0 pgmap v1828: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T15:20:12.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[28859]: cluster 2024-02-13T15:20:11.231555+0000 mon.a (mon.0) 3672 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:20:12.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[28859]: audit 2024-02-13T15:20:11.240771+0000 mon.a (mon.0) 3673 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]': finished 2024-02-13T15:20:12.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[28859]: cluster 2024-02-13T15:20:11.251900+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e826: 8 total, 8 up, 8 in 2024-02-13T15:20:12.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:12 smithi062 bash[28859]: audit 2024-02-13T15:20:11.365550+0000 mon.a (mon.0) 3675 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]: dispatch 2024-02-13T15:20:12.589 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:12.583+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f5d14005340 con 0x7f5d301033e0 2024-02-13T15:20:12.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:12 smithi111 bash[23388]: cluster 2024-02-13T15:20:11.085972+0000 mgr.y (mgr.14613) 1358 : cluster 0 pgmap v1828: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T15:20:12.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:12 smithi111 bash[23388]: cluster 2024-02-13T15:20:11.231555+0000 mon.a (mon.0) 3672 : cluster 3 Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:20:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:12 smithi111 bash[23388]: audit 2024-02-13T15:20:11.240771+0000 mon.a (mon.0) 3673 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]': finished 2024-02-13T15:20:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:12 smithi111 bash[23388]: cluster 2024-02-13T15:20:11.251900+0000 mon.a (mon.0) 3674 : cluster 0 osdmap e826: 8 total, 8 up, 8 in 2024-02-13T15:20:12.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:12 smithi111 bash[23388]: audit 2024-02-13T15:20:11.365550+0000 mon.a (mon.0) 3675 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]: dispatch 2024-02-13T15:20:13.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:13.251+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 7437e2a3-873d-4a78-a266-b034849c891e v828) v1 ==== 223+0+0 (unknown 1345692651 0 0) 0x7f5d240542f0 con 0x7f5d301033e0 2024-02-13T15:20:13.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:13.367+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"} v 0) v1 -- 0x7f5d140010a0 con 0x7f5d301033e0 2024-02-13T15:20:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:13 smithi062 bash[21479]: audit 2024-02-13T15:20:11.878936+0000 mgr.y (mgr.14613) 1359 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:13 smithi062 bash[21479]: audit 2024-02-13T15:20:12.253346+0000 mon.a (mon.0) 3676 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]': finished 2024-02-13T15:20:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:13 smithi062 bash[21479]: cluster 2024-02-13T15:20:12.261102+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e827: 8 total, 8 up, 8 in 2024-02-13T15:20:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:13 smithi062 bash[21479]: audit 2024-02-13T15:20:12.590435+0000 mon.a (mon.0) 3678 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:20:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:13 smithi062 bash[28859]: audit 2024-02-13T15:20:11.878936+0000 mgr.y (mgr.14613) 1359 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:13 smithi062 bash[28859]: audit 2024-02-13T15:20:12.253346+0000 mon.a (mon.0) 3676 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]': finished 2024-02-13T15:20:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:13 smithi062 bash[28859]: cluster 2024-02-13T15:20:12.261102+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e827: 8 total, 8 up, 8 in 2024-02-13T15:20:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:13 smithi062 bash[28859]: audit 2024-02-13T15:20:12.590435+0000 mon.a (mon.0) 3678 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:20:13.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:13 smithi111 bash[23388]: audit 2024-02-13T15:20:11.878936+0000 mgr.y (mgr.14613) 1359 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:13.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:13 smithi111 bash[23388]: audit 2024-02-13T15:20:12.253346+0000 mon.a (mon.0) 3676 : audit 1 from='client.? v1:172.21.15.62:0/3771382109' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "app": "rados"}]': finished 2024-02-13T15:20:13.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:13 smithi111 bash[23388]: cluster 2024-02-13T15:20:12.261102+0000 mon.a (mon.0) 3677 : cluster 0 osdmap e827: 8 total, 8 up, 8 in 2024-02-13T15:20:13.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:13 smithi111 bash[23388]: audit 2024-02-13T15:20:12.590435+0000 mon.a (mon.0) 3678 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:20:14.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:14.267+0000 7f5d227fc640 1 -- 172.21.15.62:0/1155901939 <== mon.0 v1:172.21.15.62:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]=0 set-quota max_objects = 10 for pool 7437e2a3-873d-4a78-a266-b034849c891e v829) v1 ==== 223+0+0 (unknown 426772123 0 0) 0x7f5d24055b10 con 0x7f5d301033e0 2024-02-13T15:20:14.271 INFO:tasks.workunit.client.0.smithi062.stderr:set-quota max_objects = 10 for pool 7437e2a3-873d-4a78-a266-b034849c891e 2024-02-13T15:20:14.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:14.271+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 >> v1:172.21.15.62:6800/3802446050 conn(0x7f5d1c06ee90 legacy=0x7f5d1c071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:14.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:14.271+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 >> v1:172.21.15.62:6789/0 conn(0x7f5d301033e0 legacy=0x7f5d30108730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:20:14.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:14.271+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 shutdown_connections 2024-02-13T15:20:14.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:14.271+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 >> 172.21.15.62:0/1155901939 conn(0x7f5d300fec30 msgr2=0x7f5d30112830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:20:14.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:14.275+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 shutdown_connections 2024-02-13T15:20:14.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:20:14.275+0000 7f5d3777a640 1 -- 172.21.15.62:0/1155901939 wait complete. 2024-02-13T15:20:14.298 INFO:tasks.workunit.client.0.smithi062.stderr:+ sleep 30 2024-02-13T15:20:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:14 smithi062 bash[21479]: cluster 2024-02-13T15:20:13.086800+0000 mgr.y (mgr.14613) 1360 : cluster 0 pgmap v1831: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T15:20:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:14 smithi062 bash[21479]: audit 2024-02-13T15:20:13.255923+0000 mon.a (mon.0) 3679 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:20:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:14 smithi062 bash[21479]: cluster 2024-02-13T15:20:13.260951+0000 mon.a (mon.0) 3680 : cluster 0 osdmap e828: 8 total, 8 up, 8 in 2024-02-13T15:20:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:14 smithi062 bash[21479]: audit 2024-02-13T15:20:13.371874+0000 mon.a (mon.0) 3681 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:20:14.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:14 smithi062 bash[28859]: cluster 2024-02-13T15:20:13.086800+0000 mgr.y (mgr.14613) 1360 : cluster 0 pgmap v1831: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T15:20:14.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:14 smithi062 bash[28859]: audit 2024-02-13T15:20:13.255923+0000 mon.a (mon.0) 3679 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:20:14.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:14 smithi062 bash[28859]: cluster 2024-02-13T15:20:13.260951+0000 mon.a (mon.0) 3680 : cluster 0 osdmap e828: 8 total, 8 up, 8 in 2024-02-13T15:20:14.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:14 smithi062 bash[28859]: audit 2024-02-13T15:20:13.371874+0000 mon.a (mon.0) 3681 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:20:14.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:14 smithi111 bash[23388]: cluster 2024-02-13T15:20:13.086800+0000 mgr.y (mgr.14613) 1360 : cluster 0 pgmap v1831: 188 pgs: 12 unknown, 176 active+clean; 745 KiB data, 879 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 6.0 KiB/s wr, 1 op/s 2024-02-13T15:20:14.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:14 smithi111 bash[23388]: audit 2024-02-13T15:20:13.255923+0000 mon.a (mon.0) 3679 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:20:14.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:14 smithi111 bash[23388]: cluster 2024-02-13T15:20:13.260951+0000 mon.a (mon.0) 3680 : cluster 0 osdmap e828: 8 total, 8 up, 8 in 2024-02-13T15:20:14.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:14 smithi111 bash[23388]: audit 2024-02-13T15:20:13.371874+0000 mon.a (mon.0) 3681 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]: dispatch 2024-02-13T15:20:15.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:15 smithi062 bash[21479]: audit 2024-02-13T15:20:14.271352+0000 mon.a (mon.0) 3682 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:20:15.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:15 smithi062 bash[21479]: cluster 2024-02-13T15:20:14.279956+0000 mon.a (mon.0) 3683 : cluster 0 osdmap e829: 8 total, 8 up, 8 in 2024-02-13T15:20:15.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:15 smithi062 bash[28859]: audit 2024-02-13T15:20:14.271352+0000 mon.a (mon.0) 3682 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:20:15.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:15 smithi062 bash[28859]: cluster 2024-02-13T15:20:14.279956+0000 mon.a (mon.0) 3683 : cluster 0 osdmap e829: 8 total, 8 up, 8 in 2024-02-13T15:20:15.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:15 smithi111 bash[23388]: audit 2024-02-13T15:20:14.271352+0000 mon.a (mon.0) 3682 : audit 1 from='client.? v1:172.21.15.62:0/1155901939' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "field": "max_objects", "val": "10"}]': finished 2024-02-13T15:20:15.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:15 smithi111 bash[23388]: cluster 2024-02-13T15:20:14.279956+0000 mon.a (mon.0) 3683 : cluster 0 osdmap e829: 8 total, 8 up, 8 in 2024-02-13T15:20:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:16 smithi062 bash[21479]: cluster 2024-02-13T15:20:15.088687+0000 mgr.y (mgr.14613) 1361 : cluster 0 pgmap v1834: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:20:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:20:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:20:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:16 smithi062 bash[28859]: cluster 2024-02-13T15:20:15.088687+0000 mgr.y (mgr.14613) 1361 : cluster 0 pgmap v1834: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:16.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:16 smithi111 bash[23388]: cluster 2024-02-13T15:20:15.088687+0000 mgr.y (mgr.14613) 1361 : cluster 0 pgmap v1834: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:18 smithi062 bash[21479]: cluster 2024-02-13T15:20:17.089490+0000 mgr.y (mgr.14613) 1362 : cluster 0 pgmap v1835: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 875 B/s rd, 0 op/s 2024-02-13T15:20:18.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:18 smithi062 bash[21479]: cluster 2024-02-13T15:20:18.216049+0000 mon.a (mon.0) 3684 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:20:18.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:18 smithi062 bash[28859]: cluster 2024-02-13T15:20:17.089490+0000 mgr.y (mgr.14613) 1362 : cluster 0 pgmap v1835: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 875 B/s rd, 0 op/s 2024-02-13T15:20:18.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:18 smithi062 bash[28859]: cluster 2024-02-13T15:20:18.216049+0000 mon.a (mon.0) 3684 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:20:18.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:18 smithi111 bash[23388]: cluster 2024-02-13T15:20:17.089490+0000 mgr.y (mgr.14613) 1362 : cluster 0 pgmap v1835: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 875 B/s rd, 0 op/s 2024-02-13T15:20:18.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:18 smithi111 bash[23388]: cluster 2024-02-13T15:20:18.216049+0000 mon.a (mon.0) 3684 : cluster 3 Health check update: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-02-13T15:20:20.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:20 smithi062 bash[21479]: cluster 2024-02-13T15:20:19.090228+0000 mgr.y (mgr.14613) 1363 : cluster 0 pgmap v1836: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 749 B/s rd, 0 op/s 2024-02-13T15:20:20.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:20 smithi062 bash[28859]: cluster 2024-02-13T15:20:19.090228+0000 mgr.y (mgr.14613) 1363 : cluster 0 pgmap v1836: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 749 B/s rd, 0 op/s 2024-02-13T15:20:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:20 smithi111 bash[23388]: cluster 2024-02-13T15:20:19.090228+0000 mgr.y (mgr.14613) 1363 : cluster 0 pgmap v1836: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 749 B/s rd, 0 op/s 2024-02-13T15:20:22.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:20:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:20:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:22 smithi062 bash[28859]: cluster 2024-02-13T15:20:21.092238+0000 mgr.y (mgr.14613) 1364 : cluster 0 pgmap v1837: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:22 smithi062 bash[21479]: cluster 2024-02-13T15:20:21.092238+0000 mgr.y (mgr.14613) 1364 : cluster 0 pgmap v1837: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:22.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:22 smithi111 bash[23388]: cluster 2024-02-13T15:20:21.092238+0000 mgr.y (mgr.14613) 1364 : cluster 0 pgmap v1837: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:24.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:23 smithi062 bash[28859]: audit 2024-02-13T15:20:21.886805+0000 mgr.y (mgr.14613) 1365 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:24.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:23 smithi062 bash[28859]: audit 2024-02-13T15:20:22.616425+0000 mon.a (mon.0) 3685 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:24.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:23 smithi062 bash[28859]: audit 2024-02-13T15:20:22.620746+0000 mon.b (mon.1) 400 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:24.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:23 smithi062 bash[21479]: audit 2024-02-13T15:20:21.886805+0000 mgr.y (mgr.14613) 1365 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:24.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:23 smithi062 bash[21479]: audit 2024-02-13T15:20:22.616425+0000 mon.a (mon.0) 3685 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:24.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:23 smithi062 bash[21479]: audit 2024-02-13T15:20:22.620746+0000 mon.b (mon.1) 400 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:24.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:23 smithi111 bash[23388]: audit 2024-02-13T15:20:21.886805+0000 mgr.y (mgr.14613) 1365 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:24.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:23 smithi111 bash[23388]: audit 2024-02-13T15:20:22.616425+0000 mon.a (mon.0) 3685 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:24.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:23 smithi111 bash[23388]: audit 2024-02-13T15:20:22.620746+0000 mon.b (mon.1) 400 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:25.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:24 smithi062 bash[21479]: cluster 2024-02-13T15:20:23.093033+0000 mgr.y (mgr.14613) 1366 : cluster 0 pgmap v1838: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:20:25.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:24 smithi062 bash[28859]: cluster 2024-02-13T15:20:23.093033+0000 mgr.y (mgr.14613) 1366 : cluster 0 pgmap v1838: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:20:25.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:24 smithi111 bash[23388]: cluster 2024-02-13T15:20:23.093033+0000 mgr.y (mgr.14613) 1366 : cluster 0 pgmap v1838: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:20:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:20:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:20:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:20:27.061 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:26 smithi062 bash[21479]: cluster 2024-02-13T15:20:25.095021+0000 mgr.y (mgr.14613) 1367 : cluster 0 pgmap v1839: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T15:20:27.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:26 smithi062 bash[28859]: cluster 2024-02-13T15:20:25.095021+0000 mgr.y (mgr.14613) 1367 : cluster 0 pgmap v1839: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T15:20:27.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:26 smithi111 bash[23388]: cluster 2024-02-13T15:20:25.095021+0000 mgr.y (mgr.14613) 1367 : cluster 0 pgmap v1839: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-02-13T15:20:29.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:28 smithi062 bash[21479]: cluster 2024-02-13T15:20:27.095937+0000 mgr.y (mgr.14613) 1368 : cluster 0 pgmap v1840: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:29.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:28 smithi062 bash[28859]: cluster 2024-02-13T15:20:27.095937+0000 mgr.y (mgr.14613) 1368 : cluster 0 pgmap v1840: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:29.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:28 smithi111 bash[23388]: cluster 2024-02-13T15:20:27.095937+0000 mgr.y (mgr.14613) 1368 : cluster 0 pgmap v1840: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:31.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:30 smithi062 bash[21479]: cluster 2024-02-13T15:20:29.096867+0000 mgr.y (mgr.14613) 1369 : cluster 0 pgmap v1841: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:31.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:30 smithi062 bash[28859]: cluster 2024-02-13T15:20:29.096867+0000 mgr.y (mgr.14613) 1369 : cluster 0 pgmap v1841: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:31.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:30 smithi111 bash[23388]: cluster 2024-02-13T15:20:29.096867+0000 mgr.y (mgr.14613) 1369 : cluster 0 pgmap v1841: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:32.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:20:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:20:33.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:32 smithi062 bash[28859]: cluster 2024-02-13T15:20:31.098936+0000 mgr.y (mgr.14613) 1370 : cluster 0 pgmap v1842: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:33.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:32 smithi062 bash[21479]: cluster 2024-02-13T15:20:31.098936+0000 mgr.y (mgr.14613) 1370 : cluster 0 pgmap v1842: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:33.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:32 smithi111 bash[23388]: cluster 2024-02-13T15:20:31.098936+0000 mgr.y (mgr.14613) 1370 : cluster 0 pgmap v1842: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:33 smithi062 bash[28859]: audit 2024-02-13T15:20:31.897607+0000 mgr.y (mgr.14613) 1371 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:34.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:33 smithi062 bash[28859]: audit 2024-02-13T15:20:33.366094+0000 mon.b (mon.1) 401 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:20:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:33 smithi062 bash[21479]: audit 2024-02-13T15:20:31.897607+0000 mgr.y (mgr.14613) 1371 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:34.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:33 smithi062 bash[21479]: audit 2024-02-13T15:20:33.366094+0000 mon.b (mon.1) 401 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:20:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:33 smithi111 bash[23388]: audit 2024-02-13T15:20:31.897607+0000 mgr.y (mgr.14613) 1371 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:34.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:33 smithi111 bash[23388]: audit 2024-02-13T15:20:33.366094+0000 mon.b (mon.1) 401 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:20:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:34 smithi062 bash[28859]: cluster 2024-02-13T15:20:33.099724+0000 mgr.y (mgr.14613) 1372 : cluster 0 pgmap v1843: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:34 smithi062 bash[28859]: audit 2024-02-13T15:20:34.096808+0000 mon.b (mon.1) 402 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:20:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:34 smithi062 bash[28859]: audit 2024-02-13T15:20:34.098690+0000 mon.b (mon.1) 403 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:20:35.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:34 smithi062 bash[28859]: audit 2024-02-13T15:20:34.107550+0000 mon.a (mon.0) 3686 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:35.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:34 smithi062 bash[21479]: cluster 2024-02-13T15:20:33.099724+0000 mgr.y (mgr.14613) 1372 : cluster 0 pgmap v1843: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:35.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:34 smithi062 bash[21479]: audit 2024-02-13T15:20:34.096808+0000 mon.b (mon.1) 402 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:20:35.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:34 smithi062 bash[21479]: audit 2024-02-13T15:20:34.098690+0000 mon.b (mon.1) 403 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:20:35.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:34 smithi062 bash[21479]: audit 2024-02-13T15:20:34.107550+0000 mon.a (mon.0) 3686 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:35.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:34 smithi111 bash[23388]: cluster 2024-02-13T15:20:33.099724+0000 mgr.y (mgr.14613) 1372 : cluster 0 pgmap v1843: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:35.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:34 smithi111 bash[23388]: audit 2024-02-13T15:20:34.096808+0000 mon.b (mon.1) 402 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:20:35.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:34 smithi111 bash[23388]: audit 2024-02-13T15:20:34.098690+0000 mon.b (mon.1) 403 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:20:35.094 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:34 smithi111 bash[23388]: audit 2024-02-13T15:20:34.107550+0000 mon.a (mon.0) 3686 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:20:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:20:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:20:37.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:36 smithi062 bash[21479]: cluster 2024-02-13T15:20:35.101600+0000 mgr.y (mgr.14613) 1373 : cluster 0 pgmap v1844: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:37.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:36 smithi062 bash[28859]: cluster 2024-02-13T15:20:35.101600+0000 mgr.y (mgr.14613) 1373 : cluster 0 pgmap v1844: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:37.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:36 smithi111 bash[23388]: cluster 2024-02-13T15:20:35.101600+0000 mgr.y (mgr.14613) 1373 : cluster 0 pgmap v1844: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:38.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:37 smithi062 bash[21479]: audit 2024-02-13T15:20:37.654350+0000 mon.b (mon.1) 404 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:38.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:37 smithi062 bash[28859]: audit 2024-02-13T15:20:37.654350+0000 mon.b (mon.1) 404 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:38.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:37 smithi111 bash[23388]: audit 2024-02-13T15:20:37.654350+0000 mon.b (mon.1) 404 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:39.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:38 smithi062 bash[21479]: cluster 2024-02-13T15:20:37.102495+0000 mgr.y (mgr.14613) 1374 : cluster 0 pgmap v1845: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:39.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:38 smithi062 bash[28859]: cluster 2024-02-13T15:20:37.102495+0000 mgr.y (mgr.14613) 1374 : cluster 0 pgmap v1845: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:39.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:38 smithi111 bash[23388]: cluster 2024-02-13T15:20:37.102495+0000 mgr.y (mgr.14613) 1374 : cluster 0 pgmap v1845: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:41.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:40 smithi062 bash[21479]: cluster 2024-02-13T15:20:39.103284+0000 mgr.y (mgr.14613) 1375 : cluster 0 pgmap v1846: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:41.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:40 smithi062 bash[28859]: cluster 2024-02-13T15:20:39.103284+0000 mgr.y (mgr.14613) 1375 : cluster 0 pgmap v1846: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:41.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:40 smithi111 bash[23388]: cluster 2024-02-13T15:20:39.103284+0000 mgr.y (mgr.14613) 1375 : cluster 0 pgmap v1846: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:42.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:20:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:20:43.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:42 smithi062 bash[21479]: cluster 2024-02-13T15:20:41.105316+0000 mgr.y (mgr.14613) 1376 : cluster 0 pgmap v1847: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:43.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:42 smithi062 bash[28859]: cluster 2024-02-13T15:20:41.105316+0000 mgr.y (mgr.14613) 1376 : cluster 0 pgmap v1847: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:43.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:42 smithi111 bash[23388]: cluster 2024-02-13T15:20:41.105316+0000 mgr.y (mgr.14613) 1376 : cluster 0 pgmap v1847: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:20:44.063 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:43 smithi062 bash[21479]: audit 2024-02-13T15:20:41.902458+0000 mgr.y (mgr.14613) 1377 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:44.063 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:43 smithi062 bash[28859]: audit 2024-02-13T15:20:41.902458+0000 mgr.y (mgr.14613) 1377 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:44.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:43 smithi111 bash[23388]: audit 2024-02-13T15:20:41.902458+0000 mgr.y (mgr.14613) 1377 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:44.300 INFO:tasks.workunit.client.0.smithi062.stderr:+ seq 1 10 2024-02-13T15:20:44.300 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj1 /etc/passwd 2024-02-13T15:20:44.347 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj2 /etc/passwd 2024-02-13T15:20:44.385 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj3 /etc/passwd 2024-02-13T15:20:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj4 /etc/passwd 2024-02-13T15:20:44.457 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj5 /etc/passwd 2024-02-13T15:20:44.493 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj6 /etc/passwd 2024-02-13T15:20:44.528 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj7 /etc/passwd 2024-02-13T15:20:44.563 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj8 /etc/passwd 2024-02-13T15:20:44.598 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj9 /etc/passwd 2024-02-13T15:20:44.632 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 7437e2a3-873d-4a78-a266-b034849c891e put obj10 /etc/passwd 2024-02-13T15:20:44.666 INFO:tasks.workunit.client.0.smithi062.stderr:+ sleep 30 2024-02-13T15:20:45.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:44 smithi062 bash[28859]: cluster 2024-02-13T15:20:43.106244+0000 mgr.y (mgr.14613) 1378 : cluster 0 pgmap v1848: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:45.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:44 smithi062 bash[21479]: cluster 2024-02-13T15:20:43.106244+0000 mgr.y (mgr.14613) 1378 : cluster 0 pgmap v1848: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:45.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:44 smithi111 bash[23388]: cluster 2024-02-13T15:20:43.106244+0000 mgr.y (mgr.14613) 1378 : cluster 0 pgmap v1848: 188 pgs: 188 active+clean; 745 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:20:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:20:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:20:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:20:47.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:46 smithi062 bash[21479]: cluster 2024-02-13T15:20:45.108352+0000 mgr.y (mgr.14613) 1379 : cluster 0 pgmap v1849: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-13T15:20:47.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:46 smithi062 bash[28859]: cluster 2024-02-13T15:20:45.108352+0000 mgr.y (mgr.14613) 1379 : cluster 0 pgmap v1849: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-13T15:20:47.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:46 smithi111 bash[23388]: cluster 2024-02-13T15:20:45.108352+0000 mgr.y (mgr.14613) 1379 : cluster 0 pgmap v1849: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 10 KiB/s wr, 2 op/s 2024-02-13T15:20:48.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:47 smithi062 bash[28859]: cluster 2024-02-13T15:20:47.109211+0000 mgr.y (mgr.14613) 1380 : cluster 0 pgmap v1850: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T15:20:48.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:47 smithi062 bash[21479]: cluster 2024-02-13T15:20:47.109211+0000 mgr.y (mgr.14613) 1380 : cluster 0 pgmap v1850: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T15:20:48.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:47 smithi111 bash[23388]: cluster 2024-02-13T15:20:47.109211+0000 mgr.y (mgr.14613) 1380 : cluster 0 pgmap v1850: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 10 KiB/s wr, 1 op/s 2024-02-13T15:20:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:48 smithi062 bash[28859]: cluster 2024-02-13T15:20:48.223304+0000 mon.a (mon.0) 3687 : cluster 3 pool '7437e2a3-873d-4a78-a266-b034849c891e' is full (reached quota's max_objects: 10) 2024-02-13T15:20:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:48 smithi062 bash[28859]: cluster 2024-02-13T15:20:48.223783+0000 mon.a (mon.0) 3688 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:20:49.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:48 smithi062 bash[28859]: cluster 2024-02-13T15:20:48.234987+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e830: 8 total, 8 up, 8 in 2024-02-13T15:20:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:48 smithi062 bash[21479]: cluster 2024-02-13T15:20:48.223304+0000 mon.a (mon.0) 3687 : cluster 3 pool '7437e2a3-873d-4a78-a266-b034849c891e' is full (reached quota's max_objects: 10) 2024-02-13T15:20:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:48 smithi062 bash[21479]: cluster 2024-02-13T15:20:48.223783+0000 mon.a (mon.0) 3688 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:20:49.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:48 smithi062 bash[21479]: cluster 2024-02-13T15:20:48.234987+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e830: 8 total, 8 up, 8 in 2024-02-13T15:20:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:48 smithi111 bash[23388]: cluster 2024-02-13T15:20:48.223304+0000 mon.a (mon.0) 3687 : cluster 3 pool '7437e2a3-873d-4a78-a266-b034849c891e' is full (reached quota's max_objects: 10) 2024-02-13T15:20:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:48 smithi111 bash[23388]: cluster 2024-02-13T15:20:48.223783+0000 mon.a (mon.0) 3688 : cluster 3 Health check failed: 1 pool(s) full (POOL_FULL) 2024-02-13T15:20:49.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:48 smithi111 bash[23388]: cluster 2024-02-13T15:20:48.234987+0000 mon.a (mon.0) 3689 : cluster 0 osdmap e830: 8 total, 8 up, 8 in 2024-02-13T15:20:50.062 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:49 smithi062 bash[21479]: cluster 2024-02-13T15:20:49.110012+0000 mgr.y (mgr.14613) 1381 : cluster 0 pgmap v1852: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:50.062 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:49 smithi062 bash[28859]: cluster 2024-02-13T15:20:49.110012+0000 mgr.y (mgr.14613) 1381 : cluster 0 pgmap v1852: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:50.093 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:49 smithi111 bash[23388]: cluster 2024-02-13T15:20:49.110012+0000 mgr.y (mgr.14613) 1381 : cluster 0 pgmap v1852: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:52.169 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:20:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:20:52.561 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:52 smithi062 bash[21479]: cluster 2024-02-13T15:20:51.112032+0000 mgr.y (mgr.14613) 1382 : cluster 0 pgmap v1853: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:52.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:52 smithi062 bash[28859]: cluster 2024-02-13T15:20:51.112032+0000 mgr.y (mgr.14613) 1382 : cluster 0 pgmap v1853: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:52.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:52 smithi111 bash[23388]: cluster 2024-02-13T15:20:51.112032+0000 mgr.y (mgr.14613) 1382 : cluster 0 pgmap v1853: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:53 smithi062 bash[28859]: audit 2024-02-13T15:20:51.913904+0000 mgr.y (mgr.14613) 1383 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:53 smithi062 bash[28859]: audit 2024-02-13T15:20:52.696939+0000 mon.a (mon.0) 3690 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:53.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:53 smithi062 bash[28859]: audit 2024-02-13T15:20:52.701346+0000 mon.b (mon.1) 405 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:53.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:53 smithi062 bash[21479]: audit 2024-02-13T15:20:51.913904+0000 mgr.y (mgr.14613) 1383 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:53.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:53 smithi062 bash[21479]: audit 2024-02-13T15:20:52.696939+0000 mon.a (mon.0) 3690 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:53.564 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:53 smithi062 bash[21479]: audit 2024-02-13T15:20:52.701346+0000 mon.b (mon.1) 405 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:53 smithi111 bash[23388]: audit 2024-02-13T15:20:51.913904+0000 mgr.y (mgr.14613) 1383 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:20:53.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:53 smithi111 bash[23388]: audit 2024-02-13T15:20:52.696939+0000 mon.a (mon.0) 3690 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:20:53.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:53 smithi111 bash[23388]: audit 2024-02-13T15:20:52.701346+0000 mon.b (mon.1) 405 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:20:54.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:54 smithi062 bash[21479]: cluster 2024-02-13T15:20:53.112835+0000 mgr.y (mgr.14613) 1384 : cluster 0 pgmap v1854: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:54.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:54 smithi062 bash[28859]: cluster 2024-02-13T15:20:53.112835+0000 mgr.y (mgr.14613) 1384 : cluster 0 pgmap v1854: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:54.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:54 smithi111 bash[23388]: cluster 2024-02-13T15:20:53.112835+0000 mgr.y (mgr.14613) 1384 : cluster 0 pgmap v1854: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 12 KiB/s wr, 1 op/s 2024-02-13T15:20:56.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:56 smithi062 bash[28859]: cluster 2024-02-13T15:20:55.114793+0000 mgr.y (mgr.14613) 1385 : cluster 0 pgmap v1855: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:20:56.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:56 smithi062 bash[21479]: cluster 2024-02-13T15:20:55.114793+0000 mgr.y (mgr.14613) 1385 : cluster 0 pgmap v1855: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:20:56.563 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:20:56 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:20:56] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:20:56.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:56 smithi111 bash[23388]: cluster 2024-02-13T15:20:55.114793+0000 mgr.y (mgr.14613) 1385 : cluster 0 pgmap v1855: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:20:58.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:20:58 smithi062 bash[28859]: cluster 2024-02-13T15:20:57.115636+0000 mgr.y (mgr.14613) 1386 : cluster 0 pgmap v1856: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:20:58.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:20:58 smithi062 bash[21479]: cluster 2024-02-13T15:20:57.115636+0000 mgr.y (mgr.14613) 1386 : cluster 0 pgmap v1856: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:20:58.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:20:58 smithi111 bash[23388]: cluster 2024-02-13T15:20:57.115636+0000 mgr.y (mgr.14613) 1386 : cluster 0 pgmap v1856: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-02-13T15:21:00.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:00 smithi062 bash[28859]: cluster 2024-02-13T15:20:59.116466+0000 mgr.y (mgr.14613) 1387 : cluster 0 pgmap v1857: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 940 B/s rd, 0 op/s 2024-02-13T15:21:00.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:00 smithi062 bash[21479]: cluster 2024-02-13T15:20:59.116466+0000 mgr.y (mgr.14613) 1387 : cluster 0 pgmap v1857: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 940 B/s rd, 0 op/s 2024-02-13T15:21:00.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:00 smithi111 bash[23388]: cluster 2024-02-13T15:20:59.116466+0000 mgr.y (mgr.14613) 1387 : cluster 0 pgmap v1857: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 940 B/s rd, 0 op/s 2024-02-13T15:21:02.193 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:21:01 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:21:02.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:02 smithi062 bash[28859]: cluster 2024-02-13T15:21:01.118526+0000 mgr.y (mgr.14613) 1388 : cluster 0 pgmap v1858: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:02.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:02 smithi062 bash[21479]: cluster 2024-02-13T15:21:01.118526+0000 mgr.y (mgr.14613) 1388 : cluster 0 pgmap v1858: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:02.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:02 smithi111 bash[23388]: cluster 2024-02-13T15:21:01.118526+0000 mgr.y (mgr.14613) 1388 : cluster 0 pgmap v1858: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:03.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:03 smithi062 bash[28859]: audit 2024-02-13T15:21:01.917572+0000 mgr.y (mgr.14613) 1389 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:03.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:03 smithi062 bash[21479]: audit 2024-02-13T15:21:01.917572+0000 mgr.y (mgr.14613) 1389 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:03.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:03 smithi111 bash[23388]: audit 2024-02-13T15:21:01.917572+0000 mgr.y (mgr.14613) 1389 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:04.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:04 smithi062 bash[21479]: cluster 2024-02-13T15:21:03.119277+0000 mgr.y (mgr.14613) 1390 : cluster 0 pgmap v1859: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:04.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:04 smithi062 bash[28859]: cluster 2024-02-13T15:21:03.119277+0000 mgr.y (mgr.14613) 1390 : cluster 0 pgmap v1859: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:04.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:04 smithi111 bash[23388]: cluster 2024-02-13T15:21:03.119277+0000 mgr.y (mgr.14613) 1390 : cluster 0 pgmap v1859: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:06.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:06 smithi062 bash[21479]: cluster 2024-02-13T15:21:05.121208+0000 mgr.y (mgr.14613) 1391 : cluster 0 pgmap v1860: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:06.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:06 smithi062 bash[28859]: cluster 2024-02-13T15:21:05.121208+0000 mgr.y (mgr.14613) 1391 : cluster 0 pgmap v1860: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:06.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:21:06 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:21:06] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:21:06.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:06 smithi111 bash[23388]: cluster 2024-02-13T15:21:05.121208+0000 mgr.y (mgr.14613) 1391 : cluster 0 pgmap v1860: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:08.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:08 smithi062 bash[21479]: cluster 2024-02-13T15:21:07.121991+0000 mgr.y (mgr.14613) 1392 : cluster 0 pgmap v1861: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:08.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:08 smithi062 bash[21479]: audit 2024-02-13T15:21:07.733703+0000 mon.b (mon.1) 406 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:08.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:08 smithi062 bash[28859]: cluster 2024-02-13T15:21:07.121991+0000 mgr.y (mgr.14613) 1392 : cluster 0 pgmap v1861: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:08.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:08 smithi062 bash[28859]: audit 2024-02-13T15:21:07.733703+0000 mon.b (mon.1) 406 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:08.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:08 smithi111 bash[23388]: cluster 2024-02-13T15:21:07.121991+0000 mgr.y (mgr.14613) 1392 : cluster 0 pgmap v1861: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:08.595 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:08 smithi111 bash[23388]: audit 2024-02-13T15:21:07.733703+0000 mon.b (mon.1) 406 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:10.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:10 smithi062 bash[21479]: cluster 2024-02-13T15:21:09.122803+0000 mgr.y (mgr.14613) 1393 : cluster 0 pgmap v1862: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:10.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:10 smithi062 bash[28859]: cluster 2024-02-13T15:21:09.122803+0000 mgr.y (mgr.14613) 1393 : cluster 0 pgmap v1862: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:10.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:10 smithi111 bash[23388]: cluster 2024-02-13T15:21:09.122803+0000 mgr.y (mgr.14613) 1393 : cluster 0 pgmap v1862: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:12.223 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:21:11 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:21:12.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:12 smithi062 bash[21479]: cluster 2024-02-13T15:21:11.124788+0000 mgr.y (mgr.14613) 1394 : cluster 0 pgmap v1863: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:12.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:12 smithi062 bash[28859]: cluster 2024-02-13T15:21:11.124788+0000 mgr.y (mgr.14613) 1394 : cluster 0 pgmap v1863: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:12.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:12 smithi111 bash[23388]: cluster 2024-02-13T15:21:11.124788+0000 mgr.y (mgr.14613) 1394 : cluster 0 pgmap v1863: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:13.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:13 smithi062 bash[28859]: audit 2024-02-13T15:21:11.928937+0000 mgr.y (mgr.14613) 1395 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:13.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:13 smithi062 bash[21479]: audit 2024-02-13T15:21:11.928937+0000 mgr.y (mgr.14613) 1395 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:13.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:13 smithi111 bash[23388]: audit 2024-02-13T15:21:11.928937+0000 mgr.y (mgr.14613) 1395 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:14.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:14 smithi062 bash[28859]: cluster 2024-02-13T15:21:13.125587+0000 mgr.y (mgr.14613) 1396 : cluster 0 pgmap v1864: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:14.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:14 smithi062 bash[21479]: cluster 2024-02-13T15:21:13.125587+0000 mgr.y (mgr.14613) 1396 : cluster 0 pgmap v1864: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:14.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:14 smithi111 bash[23388]: cluster 2024-02-13T15:21:13.125587+0000 mgr.y (mgr.14613) 1396 : cluster 0 pgmap v1864: 188 pgs: 188 active+clean; 862 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:14.668 INFO:tasks.workunit.client.0.smithi062.stderr:+ rados -p 38effd22-4604-428a-b9f7-cf7ee1ea6006 put threemore /etc/passwd 2024-02-13T15:21:14.714 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool set-quota 38effd22-4604-428a-b9f7-cf7ee1ea6006 max_bytes 0 2024-02-13T15:21:14.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- 172.21.15.62:0/89696080 >> v1:172.21.15.62:6789/0 conn(0x7fcb0010daf0 legacy=0x7fcb0010fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:14.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- 172.21.15.62:0/89696080 shutdown_connections 2024-02-13T15:21:14.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- 172.21.15.62:0/89696080 >> 172.21.15.62:0/89696080 conn(0x7fcb000fb9a0 msgr2=0x7fcb000fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- 172.21.15.62:0/89696080 shutdown_connections 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- 172.21.15.62:0/89696080 wait complete. 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 Processor -- start 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- start start 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcb0019dd10 con 0x7fcb00109fe0 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcb001a8fb0 con 0x7fcb001021d0 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7fcb001aa150 con 0x7fcb0010daf0 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcaf6ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcb00109fe0 0x7fcb001a3150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:43408/0 (socket says 172.21.15.62:43408) 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcaf6ffd640 1 -- 172.21.15.62:0/4116341402 learned_addr learned my addr 172.21.15.62:0/4116341402 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:21:14.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921988134 0 0) 0x7fcb0019dd10 con 0x7fcb00109fe0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaec001ff0 con 0x7fcb00109fe0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066182638 0 0) 0x7fcb001aa150 con 0x7fcb0010daf0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb0019dd10 con 0x7fcb0010daf0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 1507560486 0 0) 0x7fcaec001ff0 con 0x7fcb00109fe0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcb001aa150 con 0x7fcb00109fe0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fcae8001a00 con 0x7fcb00109fe0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2566108189 0 0) 0x7fcb0019dd10 con 0x7fcb0010daf0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fcaec001ff0 con 0x7fcb0010daf0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fcaf80017c0 con 0x7fcb0010daf0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1040003001 0 0) 0x7fcb001a8fb0 con 0x7fcb001021d0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb0019dd10 con 0x7fcb001021d0 2024-02-13T15:21:14.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 528020745 0 0) 0x7fcb001aa150 con 0x7fcb00109fe0 2024-02-13T15:21:14.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 >> v1:172.21.15.62:6790/0 conn(0x7fcb0010daf0 legacy=0x7fcb001a6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:14.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 >> v1:172.21.15.111:6789/0 conn(0x7fcb001021d0 legacy=0x7fcb0019d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:14.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb001ab350 con 0x7fcb00109fe0 2024-02-13T15:21:14.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb001aa340 con 0x7fcb00109fe0 2024-02-13T15:21:14.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb001aa800 con 0x7fcb00109fe0 2024-02-13T15:21:14.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7fcae8003a90 con 0x7fcb00109fe0 2024-02-13T15:21:14.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7fcae8005be0 con 0x7fcb00109fe0 2024-02-13T15:21:14.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.834+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae0005090 con 0x7fcb00109fe0 2024-02-13T15:21:14.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.838+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7fcae8003600 con 0x7fcb00109fe0 2024-02-13T15:21:14.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.838+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(830..830 src has 269..830) v4 ==== 8132+0+0 (unknown 3985426090 0 0) 0x7fcae80895f0 con 0x7fcb00109fe0 2024-02-13T15:21:14.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.838+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=831}) v3 -- 0x7fcb001aa150 con 0x7fcb00109fe0 2024-02-13T15:21:14.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:14.842+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7fcae8055ee0 con 0x7fcb00109fe0 2024-02-13T15:21:15.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:15.014+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fcae0005340 con 0x7fcb00109fe0 2024-02-13T15:21:15.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:15.242+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v831) v1 ==== 217+0+0 (unknown 3799354741 0 0) 0x7fcae8054250 con 0x7fcb00109fe0 2024-02-13T15:21:15.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:15.246+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 11 ==== osd_map(831..831 src has 269..831) v4 ==== 628+0+0 (unknown 2274115048 0 0) 0x7fcae8056810 con 0x7fcb00109fe0 2024-02-13T15:21:15.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:15.246+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=832}) v3 -- 0x7fcaec001ff0 con 0x7fcb00109fe0 2024-02-13T15:21:15.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:15.358+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"} v 0) v1 -- 0x7fcae0000c50 con 0x7fcb00109fe0 2024-02-13T15:21:15.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:15 smithi062 bash[28859]: audit 2024-02-13T15:21:15.018256+0000 mon.a (mon.0) 3691 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:21:15.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:15 smithi062 bash[21479]: audit 2024-02-13T15:21:15.018256+0000 mon.a (mon.0) 3691 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:21:15.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:15 smithi111 bash[23388]: audit 2024-02-13T15:21:15.018256+0000 mon.a (mon.0) 3691 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:21:16.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.246+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]=0 set-quota max_bytes = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v832) v1 ==== 217+0+0 (unknown 2452965944 0 0) 0x7fcae8055a70 con 0x7fcb00109fe0 2024-02-13T15:21:16.248 INFO:tasks.workunit.client.0.smithi062.stderr:set-quota max_bytes = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 2024-02-13T15:21:16.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.246+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 <== mon.0 v1:172.21.15.62:6789/0 13 ==== osd_map(832..832 src has 269..832) v4 ==== 628+0+0 (unknown 763931978 0 0) 0x7fcae805eb10 con 0x7fcb00109fe0 2024-02-13T15:21:16.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.246+0000 7fcafd7fa640 1 -- 172.21.15.62:0/4116341402 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=833}) v3 -- 0x7fcb001a8fb0 con 0x7fcb00109fe0 2024-02-13T15:21:16.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.250+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 >> v1:172.21.15.62:6800/3802446050 conn(0x7fcaec06f060 legacy=0x7fcaec071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:16.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.250+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 >> v1:172.21.15.62:6789/0 conn(0x7fcb00109fe0 legacy=0x7fcb001a3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:16.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.254+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 shutdown_connections 2024-02-13T15:21:16.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.254+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 >> 172.21.15.62:0/4116341402 conn(0x7fcb000fb9a0 msgr2=0x7fcb0010fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:21:16.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.254+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 shutdown_connections 2024-02-13T15:21:16.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.254+0000 7fcb05d7c640 1 -- 172.21.15.62:0/4116341402 wait complete. 2024-02-13T15:21:16.278 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool set-quota 38effd22-4604-428a-b9f7-cf7ee1ea6006 max_objects 0 2024-02-13T15:21:16.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.398+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3757523467 >> v1:172.21.15.62:6789/0 conn(0x7f4eac10fbd0 legacy=0x7f4eac112070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3757523467 shutdown_connections 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3757523467 >> 172.21.15.62:0/3757523467 conn(0x7f4eac0feca0 msgr2=0x7f4eac1010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3757523467 shutdown_connections 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3757523467 wait complete. 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 Processor -- start 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- start start 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4eac1a7f00 con 0x7f4eac10fbd0 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4eac1a9100 con 0x7f4eac1033d0 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f4eac1aa300 con 0x7f4eac10c060 2024-02-13T15:21:16.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb1074640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4eac10fbd0 0x7f4eac1a6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:43424/0 (socket says 172.21.15.62:43424) 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb1074640 1 -- 172.21.15.62:0/3492398456 learned_addr learned my addr 172.21.15.62:0/3492398456 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466226588 0 0) 0x7f4eac1a7f00 con 0x7f4eac10fbd0 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e94003250 con 0x7f4eac10fbd0 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612354009 0 0) 0x7f4eac1aa300 con 0x7f4eac10c060 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eac1a7f00 con 0x7f4eac10c060 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3631587839 0 0) 0x7f4e94003250 con 0x7f4eac10fbd0 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4eac1aa300 con 0x7f4eac10fbd0 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3937675309 0 0) 0x7f4eac1a7f00 con 0x7f4eac10c060 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f4e94003250 con 0x7f4eac10c060 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f4ea4004810 con 0x7f4eac10fbd0 2024-02-13T15:21:16.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f4ea00019d0 con 0x7f4eac10c060 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699788277 0 0) 0x7f4eac1a9100 con 0x7f4eac1033d0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eac1a7f00 con 0x7f4eac1033d0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 4160117905 0 0) 0x7f4eac1aa300 con 0x7f4eac10fbd0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 >> v1:172.21.15.62:6790/0 conn(0x7f4eac10c060 legacy=0x7f4eac1a2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 >> v1:172.21.15.111:6789/0 conn(0x7f4eac1033d0 legacy=0x7f4eac108530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac1ab500 con 0x7f4eac10fbd0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac1aa4f0 con 0x7f4eac10fbd0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac1aa970 con 0x7f4eac10fbd0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f4ea4001ab0 con 0x7f4eac10fbd0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f4ea40051b0 con 0x7f4eac10fbd0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e98005090 con 0x7f4eac10fbd0 2024-02-13T15:21:16.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.402+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f4ea40053f0 con 0x7f4eac10fbd0 2024-02-13T15:21:16.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.406+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(832..832 src has 269..832) v4 ==== 8132+0+0 (unknown 719120555 0 0) 0x7f4ea4089bf0 con 0x7f4eac10fbd0 2024-02-13T15:21:16.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.406+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=833}) v3 -- 0x7f4eac1aa300 con 0x7f4eac10fbd0 2024-02-13T15:21:16.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.410+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f4ea4056620 con 0x7f4eac10fbd0 2024-02-13T15:21:16.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:21:16] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:21:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[28859]: cluster 2024-02-13T15:21:15.127553+0000 mgr.y (mgr.14613) 1397 : cluster 0 pgmap v1865: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 1 op/s 2024-02-13T15:21:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[28859]: audit 2024-02-13T15:21:15.245501+0000 mon.a (mon.0) 3692 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:21:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[28859]: cluster 2024-02-13T15:21:15.253331+0000 mon.a (mon.0) 3693 : cluster 0 osdmap e831: 8 total, 8 up, 8 in 2024-02-13T15:21:16.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[28859]: audit 2024-02-13T15:21:15.361681+0000 mon.a (mon.0) 3694 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:21:16.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[21479]: cluster 2024-02-13T15:21:15.127553+0000 mgr.y (mgr.14613) 1397 : cluster 0 pgmap v1865: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 1 op/s 2024-02-13T15:21:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[21479]: audit 2024-02-13T15:21:15.245501+0000 mon.a (mon.0) 3692 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:21:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[21479]: cluster 2024-02-13T15:21:15.253331+0000 mon.a (mon.0) 3693 : cluster 0 osdmap e831: 8 total, 8 up, 8 in 2024-02-13T15:21:16.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:16 smithi062 bash[21479]: audit 2024-02-13T15:21:15.361681+0000 mon.a (mon.0) 3694 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:21:16.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:16.582+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f4e98005340 con 0x7f4eac10fbd0 2024-02-13T15:21:16.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:16 smithi111 bash[23388]: cluster 2024-02-13T15:21:15.127553+0000 mgr.y (mgr.14613) 1397 : cluster 0 pgmap v1865: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1023 B/s wr, 1 op/s 2024-02-13T15:21:16.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:16 smithi111 bash[23388]: audit 2024-02-13T15:21:15.245501+0000 mon.a (mon.0) 3692 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:21:16.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:16 smithi111 bash[23388]: cluster 2024-02-13T15:21:15.253331+0000 mon.a (mon.0) 3693 : cluster 0 osdmap e831: 8 total, 8 up, 8 in 2024-02-13T15:21:16.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:16 smithi111 bash[23388]: audit 2024-02-13T15:21:15.361681+0000 mon.a (mon.0) 3694 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]: dispatch 2024-02-13T15:21:17.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:17.274+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v833) v1 ==== 221+0+0 (unknown 1617625824 0 0) 0x7f4ea4054990 con 0x7f4eac10fbd0 2024-02-13T15:21:17.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:17.274+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 11 ==== osd_map(833..833 src has 269..833) v4 ==== 628+0+0 (unknown 1004615523 0 0) 0x7f4ea4056f50 con 0x7f4eac10fbd0 2024-02-13T15:21:17.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:17.274+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=834}) v3 -- 0x7f4e94003250 con 0x7f4eac10fbd0 2024-02-13T15:21:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:17.382+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"} v 0) v1 -- 0x7f4e98000c50 con 0x7f4eac10fbd0 2024-02-13T15:21:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:17 smithi062 bash[28859]: audit 2024-02-13T15:21:16.248180+0000 mon.a (mon.0) 3695 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:21:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:17 smithi062 bash[28859]: cluster 2024-02-13T15:21:16.256361+0000 mon.a (mon.0) 3696 : cluster 0 osdmap e832: 8 total, 8 up, 8 in 2024-02-13T15:21:17.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:17 smithi062 bash[28859]: audit 2024-02-13T15:21:16.585593+0000 mon.a (mon.0) 3697 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:21:17.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:17 smithi062 bash[21479]: audit 2024-02-13T15:21:16.248180+0000 mon.a (mon.0) 3695 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:21:17.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:17 smithi062 bash[21479]: cluster 2024-02-13T15:21:16.256361+0000 mon.a (mon.0) 3696 : cluster 0 osdmap e832: 8 total, 8 up, 8 in 2024-02-13T15:21:17.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:17 smithi062 bash[21479]: audit 2024-02-13T15:21:16.585593+0000 mon.a (mon.0) 3697 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:21:17.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:17 smithi111 bash[23388]: audit 2024-02-13T15:21:16.248180+0000 mon.a (mon.0) 3695 : audit 1 from='client.? v1:172.21.15.62:0/4116341402' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_bytes", "val": "0"}]': finished 2024-02-13T15:21:17.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:17 smithi111 bash[23388]: cluster 2024-02-13T15:21:16.256361+0000 mon.a (mon.0) 3696 : cluster 0 osdmap e832: 8 total, 8 up, 8 in 2024-02-13T15:21:17.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:17 smithi111 bash[23388]: audit 2024-02-13T15:21:16.585593+0000 mon.a (mon.0) 3697 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:21:18.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.274+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]=0 set-quota max_objects = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 v834) v1 ==== 221+0+0 (unknown 3849717298 0 0) 0x7f4ea40561b0 con 0x7f4eac10fbd0 2024-02-13T15:21:18.277 INFO:tasks.workunit.client.0.smithi062.stderr:set-quota max_objects = 0 for pool 38effd22-4604-428a-b9f7-cf7ee1ea6006 2024-02-13T15:21:18.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.274+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 <== mon.0 v1:172.21.15.62:6789/0 13 ==== osd_map(834..834 src has 269..834) v4 ==== 628+0+0 (unknown 935139630 0 0) 0x7f4ea405f250 con 0x7f4eac10fbd0 2024-02-13T15:21:18.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.278+0000 7f4ea9ffb640 1 -- 172.21.15.62:0/3492398456 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=835}) v3 -- 0x7f4eac1a9100 con 0x7f4eac10fbd0 2024-02-13T15:21:18.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.282+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 >> v1:172.21.15.62:6800/3802446050 conn(0x7f4e9406ef70 legacy=0x7f4e94071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:18.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.282+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 >> v1:172.21.15.62:6789/0 conn(0x7f4eac10fbd0 legacy=0x7f4eac1a6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:18.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.282+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 shutdown_connections 2024-02-13T15:21:18.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.282+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 >> 172.21.15.62:0/3492398456 conn(0x7f4eac0feca0 msgr2=0x7f4eac108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:21:18.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.282+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 shutdown_connections 2024-02-13T15:21:18.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:18.282+0000 7f4eb2ad7640 1 -- 172.21.15.62:0/3492398456 wait complete. 2024-02-13T15:21:18.307 INFO:tasks.workunit.client.0.smithi062.stderr:+ sleep 30 2024-02-13T15:21:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:18 smithi062 bash[28859]: cluster 2024-02-13T15:21:17.128418+0000 mgr.y (mgr.14613) 1398 : cluster 0 pgmap v1868: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-02-13T15:21:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:18 smithi062 bash[28859]: audit 2024-02-13T15:21:17.274400+0000 mon.a (mon.0) 3698 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:21:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:18 smithi062 bash[28859]: cluster 2024-02-13T15:21:17.282427+0000 mon.a (mon.0) 3699 : cluster 0 osdmap e833: 8 total, 8 up, 8 in 2024-02-13T15:21:18.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:18 smithi062 bash[28859]: audit 2024-02-13T15:21:17.386726+0000 mon.a (mon.0) 3700 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:21:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:18 smithi062 bash[21479]: cluster 2024-02-13T15:21:17.128418+0000 mgr.y (mgr.14613) 1398 : cluster 0 pgmap v1868: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-02-13T15:21:18.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:18 smithi062 bash[21479]: audit 2024-02-13T15:21:17.274400+0000 mon.a (mon.0) 3698 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:21:18.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:18 smithi062 bash[21479]: cluster 2024-02-13T15:21:17.282427+0000 mon.a (mon.0) 3699 : cluster 0 osdmap e833: 8 total, 8 up, 8 in 2024-02-13T15:21:18.563 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:18 smithi062 bash[21479]: audit 2024-02-13T15:21:17.386726+0000 mon.a (mon.0) 3700 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:21:18.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:18 smithi111 bash[23388]: cluster 2024-02-13T15:21:17.128418+0000 mgr.y (mgr.14613) 1398 : cluster 0 pgmap v1868: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.5 KiB/s wr, 1 op/s 2024-02-13T15:21:18.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:18 smithi111 bash[23388]: audit 2024-02-13T15:21:17.274400+0000 mon.a (mon.0) 3698 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:21:18.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:18 smithi111 bash[23388]: cluster 2024-02-13T15:21:17.282427+0000 mon.a (mon.0) 3699 : cluster 0 osdmap e833: 8 total, 8 up, 8 in 2024-02-13T15:21:18.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:18 smithi111 bash[23388]: audit 2024-02-13T15:21:17.386726+0000 mon.a (mon.0) 3700 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd=[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]: dispatch 2024-02-13T15:21:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:19 smithi062 bash[28859]: audit 2024-02-13T15:21:18.276845+0000 mon.a (mon.0) 3701 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:21:19.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:19 smithi062 bash[28859]: cluster 2024-02-13T15:21:18.287054+0000 mon.a (mon.0) 3702 : cluster 0 osdmap e834: 8 total, 8 up, 8 in 2024-02-13T15:21:19.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:19 smithi062 bash[21479]: audit 2024-02-13T15:21:18.276845+0000 mon.a (mon.0) 3701 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:21:19.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:19 smithi062 bash[21479]: cluster 2024-02-13T15:21:18.287054+0000 mon.a (mon.0) 3702 : cluster 0 osdmap e834: 8 total, 8 up, 8 in 2024-02-13T15:21:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:19 smithi111 bash[23388]: audit 2024-02-13T15:21:18.276845+0000 mon.a (mon.0) 3701 : audit 1 from='client.? v1:172.21.15.62:0/3492398456' entity='client.admin' cmd='[{"prefix": "osd pool set-quota", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "field": "max_objects", "val": "0"}]': finished 2024-02-13T15:21:19.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:19 smithi111 bash[23388]: cluster 2024-02-13T15:21:18.287054+0000 mon.a (mon.0) 3702 : cluster 0 osdmap e834: 8 total, 8 up, 8 in 2024-02-13T15:21:20.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:20 smithi062 bash[28859]: cluster 2024-02-13T15:21:19.129229+0000 mgr.y (mgr.14613) 1399 : cluster 0 pgmap v1871: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:21:20.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:20 smithi062 bash[21479]: cluster 2024-02-13T15:21:19.129229+0000 mgr.y (mgr.14613) 1399 : cluster 0 pgmap v1871: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:21:20.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:20 smithi111 bash[23388]: cluster 2024-02-13T15:21:19.129229+0000 mgr.y (mgr.14613) 1399 : cluster 0 pgmap v1871: 188 pgs: 188 active+clean; 874 KiB data, 880 MiB used, 714 GiB / 715 GiB avail 2024-02-13T15:21:22.311 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:21:21 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:21:22.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:22 smithi062 bash[28859]: cluster 2024-02-13T15:21:21.131227+0000 mgr.y (mgr.14613) 1400 : cluster 0 pgmap v1872: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-02-13T15:21:22.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:22 smithi062 bash[21479]: cluster 2024-02-13T15:21:21.131227+0000 mgr.y (mgr.14613) 1400 : cluster 0 pgmap v1872: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-02-13T15:21:22.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:22 smithi111 bash[23388]: cluster 2024-02-13T15:21:21.131227+0000 mgr.y (mgr.14613) 1400 : cluster 0 pgmap v1872: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 871 B/s rd, 0 op/s 2024-02-13T15:21:23.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:23 smithi111 bash[23388]: audit 2024-02-13T15:21:21.940369+0000 mgr.y (mgr.14613) 1401 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:23.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:23 smithi111 bash[23388]: audit 2024-02-13T15:21:22.767112+0000 mon.b (mon.1) 407 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:23 smithi062 bash[28859]: audit 2024-02-13T15:21:21.940369+0000 mgr.y (mgr.14613) 1401 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:23.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:23 smithi062 bash[28859]: audit 2024-02-13T15:21:22.767112+0000 mon.b (mon.1) 407 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:23 smithi062 bash[21479]: audit 2024-02-13T15:21:21.940369+0000 mgr.y (mgr.14613) 1401 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:23.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:23 smithi062 bash[21479]: audit 2024-02-13T15:21:22.767112+0000 mon.b (mon.1) 407 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:24.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:24 smithi111 bash[23388]: cluster 2024-02-13T15:21:23.132010+0000 mgr.y (mgr.14613) 1402 : cluster 0 pgmap v1873: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 745 B/s rd, 0 op/s 2024-02-13T15:21:24.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:24 smithi062 bash[28859]: cluster 2024-02-13T15:21:23.132010+0000 mgr.y (mgr.14613) 1402 : cluster 0 pgmap v1873: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 745 B/s rd, 0 op/s 2024-02-13T15:21:24.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:24 smithi062 bash[21479]: cluster 2024-02-13T15:21:23.132010+0000 mgr.y (mgr.14613) 1402 : cluster 0 pgmap v1873: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 745 B/s rd, 0 op/s 2024-02-13T15:21:26.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:26 smithi062 bash[21479]: cluster 2024-02-13T15:21:25.134024+0000 mgr.y (mgr.14613) 1403 : cluster 0 pgmap v1874: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:26.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:21:26 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:21:26] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:21:26.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:26 smithi062 bash[28859]: cluster 2024-02-13T15:21:25.134024+0000 mgr.y (mgr.14613) 1403 : cluster 0 pgmap v1874: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:26.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:26 smithi111 bash[23388]: cluster 2024-02-13T15:21:25.134024+0000 mgr.y (mgr.14613) 1403 : cluster 0 pgmap v1874: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:28.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:28 smithi111 bash[23388]: cluster 2024-02-13T15:21:27.134859+0000 mgr.y (mgr.14613) 1404 : cluster 0 pgmap v1875: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:21:28.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:28 smithi062 bash[21479]: cluster 2024-02-13T15:21:27.134859+0000 mgr.y (mgr.14613) 1404 : cluster 0 pgmap v1875: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:21:28.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:28 smithi062 bash[28859]: cluster 2024-02-13T15:21:27.134859+0000 mgr.y (mgr.14613) 1404 : cluster 0 pgmap v1875: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-13T15:21:30.593 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:30 smithi111 bash[23388]: cluster 2024-02-13T15:21:29.135608+0000 mgr.y (mgr.14613) 1405 : cluster 0 pgmap v1876: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-02-13T15:21:30.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:30 smithi062 bash[21479]: cluster 2024-02-13T15:21:29.135608+0000 mgr.y (mgr.14613) 1405 : cluster 0 pgmap v1876: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-02-13T15:21:30.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:30 smithi062 bash[28859]: cluster 2024-02-13T15:21:29.135608+0000 mgr.y (mgr.14613) 1405 : cluster 0 pgmap v1876: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 943 B/s rd, 0 op/s 2024-02-13T15:21:32.341 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:21:31 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:21:32.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:32 smithi111 bash[23388]: cluster 2024-02-13T15:21:31.137531+0000 mgr.y (mgr.14613) 1406 : cluster 0 pgmap v1877: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:32.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:32 smithi062 bash[21479]: cluster 2024-02-13T15:21:31.137531+0000 mgr.y (mgr.14613) 1406 : cluster 0 pgmap v1877: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:32.893 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:32 smithi062 bash[28859]: cluster 2024-02-13T15:21:31.137531+0000 mgr.y (mgr.14613) 1406 : cluster 0 pgmap v1877: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:33.594 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:33 smithi111 bash[23388]: audit 2024-02-13T15:21:31.951846+0000 mgr.y (mgr.14613) 1407 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:33.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:33 smithi062 bash[28859]: audit 2024-02-13T15:21:31.951846+0000 mgr.y (mgr.14613) 1407 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:33.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:33 smithi062 bash[21479]: audit 2024-02-13T15:21:31.951846+0000 mgr.y (mgr.14613) 1407 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:34.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:34 smithi062 bash[28859]: cluster 2024-02-13T15:21:33.138284+0000 mgr.y (mgr.14613) 1408 : cluster 0 pgmap v1878: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:34.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:34 smithi062 bash[28859]: audit 2024-02-13T15:21:34.202577+0000 mon.b (mon.1) 408 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:21:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:34 smithi062 bash[21479]: cluster 2024-02-13T15:21:33.138284+0000 mgr.y (mgr.14613) 1408 : cluster 0 pgmap v1878: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:34.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:34 smithi062 bash[21479]: audit 2024-02-13T15:21:34.202577+0000 mon.b (mon.1) 408 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:21:34.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:34 smithi111 bash[23388]: cluster 2024-02-13T15:21:33.138284+0000 mgr.y (mgr.14613) 1408 : cluster 0 pgmap v1878: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:34.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:34 smithi111 bash[23388]: audit 2024-02-13T15:21:34.202577+0000 mon.b (mon.1) 408 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-13T15:21:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:35 smithi062 bash[28859]: audit 2024-02-13T15:21:34.931727+0000 mon.b (mon.1) 409 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:21:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:35 smithi062 bash[28859]: audit 2024-02-13T15:21:34.933539+0000 mon.b (mon.1) 410 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:21:35.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:35 smithi062 bash[28859]: audit 2024-02-13T15:21:34.943880+0000 mon.a (mon.0) 3703 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:21:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:35 smithi062 bash[21479]: audit 2024-02-13T15:21:34.931727+0000 mon.b (mon.1) 409 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:21:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:35 smithi062 bash[21479]: audit 2024-02-13T15:21:34.933539+0000 mon.b (mon.1) 410 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:21:35.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:35 smithi062 bash[21479]: audit 2024-02-13T15:21:34.943880+0000 mon.a (mon.0) 3703 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:21:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:35 smithi111 bash[23388]: audit 2024-02-13T15:21:34.931727+0000 mon.b (mon.1) 409 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-13T15:21:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:35 smithi111 bash[23388]: audit 2024-02-13T15:21:34.933539+0000 mon.b (mon.1) 410 : audit 1 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-13T15:21:35.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:35 smithi111 bash[23388]: audit 2024-02-13T15:21:34.943880+0000 mon.a (mon.0) 3703 : audit 1 from='mgr.14613 ' entity='mgr.y' 2024-02-13T15:21:36.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:36 smithi062 bash[21479]: cluster 2024-02-13T15:21:35.140289+0000 mgr.y (mgr.14613) 1409 : cluster 0 pgmap v1879: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:36.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:21:36 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:21:36] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:21:36.563 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:36 smithi062 bash[28859]: cluster 2024-02-13T15:21:35.140289+0000 mgr.y (mgr.14613) 1409 : cluster 0 pgmap v1879: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:36.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:36 smithi111 bash[23388]: cluster 2024-02-13T15:21:35.140289+0000 mgr.y (mgr.14613) 1409 : cluster 0 pgmap v1879: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:38.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:38 smithi062 bash[21479]: cluster 2024-02-13T15:21:37.141111+0000 mgr.y (mgr.14613) 1410 : cluster 0 pgmap v1880: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:38.815 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:38 smithi062 bash[21479]: audit 2024-02-13T15:21:37.801586+0000 mon.b (mon.1) 411 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:38.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:38 smithi062 bash[28859]: cluster 2024-02-13T15:21:37.141111+0000 mgr.y (mgr.14613) 1410 : cluster 0 pgmap v1880: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:38.815 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:38 smithi062 bash[28859]: audit 2024-02-13T15:21:37.801586+0000 mon.b (mon.1) 411 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:38 smithi111 bash[23388]: cluster 2024-02-13T15:21:37.141111+0000 mgr.y (mgr.14613) 1410 : cluster 0 pgmap v1880: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:38.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:38 smithi111 bash[23388]: audit 2024-02-13T15:21:37.801586+0000 mon.b (mon.1) 411 : audit 0 from='mgr.14613 v1:172.21.15.62:0/1983038449' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-13T15:21:40.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:40 smithi062 bash[28859]: cluster 2024-02-13T15:21:39.141927+0000 mgr.y (mgr.14613) 1411 : cluster 0 pgmap v1881: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:40.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:40 smithi062 bash[21479]: cluster 2024-02-13T15:21:39.141927+0000 mgr.y (mgr.14613) 1411 : cluster 0 pgmap v1881: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:40.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:40 smithi111 bash[23388]: cluster 2024-02-13T15:21:39.141927+0000 mgr.y (mgr.14613) 1411 : cluster 0 pgmap v1881: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:42.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:21:41 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:21:42.813 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:42 smithi062 bash[21479]: cluster 2024-02-13T15:21:41.143917+0000 mgr.y (mgr.14613) 1412 : cluster 0 pgmap v1882: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:42.813 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:42 smithi062 bash[28859]: cluster 2024-02-13T15:21:41.143917+0000 mgr.y (mgr.14613) 1412 : cluster 0 pgmap v1882: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:42.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:42 smithi111 bash[23388]: cluster 2024-02-13T15:21:41.143917+0000 mgr.y (mgr.14613) 1412 : cluster 0 pgmap v1882: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:43.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:43 smithi062 bash[21479]: audit 2024-02-13T15:21:41.956724+0000 mgr.y (mgr.14613) 1413 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:43.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:43 smithi062 bash[28859]: audit 2024-02-13T15:21:41.956724+0000 mgr.y (mgr.14613) 1413 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:43.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:43 smithi111 bash[23388]: audit 2024-02-13T15:21:41.956724+0000 mgr.y (mgr.14613) 1413 : audit 0 from='client.24493 v1:172.21.15.111:0/12365018' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-02-13T15:21:44.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:44 smithi062 bash[21479]: cluster 2024-02-13T15:21:43.145002+0000 mgr.y (mgr.14613) 1414 : cluster 0 pgmap v1883: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:44.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:44 smithi062 bash[28859]: cluster 2024-02-13T15:21:43.145002+0000 mgr.y (mgr.14613) 1414 : cluster 0 pgmap v1883: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:44.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:44 smithi111 bash[23388]: cluster 2024-02-13T15:21:43.145002+0000 mgr.y (mgr.14613) 1414 : cluster 0 pgmap v1883: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:46.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:46 smithi062 bash[21479]: cluster 2024-02-13T15:21:45.147061+0000 mgr.y (mgr.14613) 1415 : cluster 0 pgmap v1884: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:46.562 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:21:46 smithi062 bash[21731]: ::ffff:172.21.15.111 - - [13/Feb/2024:15:21:46] "GET /metrics HTTP/1.1" 503 1620 "" "Prometheus/2.43.0" 2024-02-13T15:21:46.562 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:46 smithi062 bash[28859]: cluster 2024-02-13T15:21:45.147061+0000 mgr.y (mgr.14613) 1415 : cluster 0 pgmap v1884: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:46.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:46 smithi111 bash[23388]: cluster 2024-02-13T15:21:45.147061+0000 mgr.y (mgr.14613) 1415 : cluster 0 pgmap v1884: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-13T15:21:48.309 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool delete 38effd22-4604-428a-b9f7-cf7ee1ea6006 38effd22-4604-428a-b9f7-cf7ee1ea6006 --yes-i-really-really-mean-it 2024-02-13T15:21:48.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- 172.21.15.62:0/392426812 >> v1:172.21.15.62:6789/0 conn(0x7f51e010c070 legacy=0x7f51e010e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:48.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- 172.21.15.62:0/392426812 shutdown_connections 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- 172.21.15.62:0/392426812 >> 172.21.15.62:0/392426812 conn(0x7f51e00fec30 msgr2=0x7f51e0101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- 172.21.15.62:0/392426812 shutdown_connections 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- 172.21.15.62:0/392426812 wait complete. 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 Processor -- start 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- start start 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f51e01061a0 con 0x7f51e01033e0 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f51e01a8fd0 con 0x7f51e010c070 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51e4a60640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7f51e01aa170 con 0x7f51e010fbe0 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51de59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f51e01033e0 0x7f51e01055f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60614/0 (socket says 172.21.15.62:60614) 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51ded9d640 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7f51e010fbe0 0x7f51e01a68a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:58682/0 (socket says 172.21.15.62:58682) 2024-02-13T15:21:48.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51de59c640 1 -- 172.21.15.62:0/2069367663 learned_addr learned my addr 172.21.15.62:0/2069367663 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:21:48.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277810157 0 0) 0x7f51e01061a0 con 0x7f51e01033e0 2024-02-13T15:21:48.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51c8003250 con 0x7f51e01033e0 2024-02-13T15:21:48.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1147346853 0 0) 0x7f51e01aa170 con 0x7f51e010fbe0 2024-02-13T15:21:48.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.441+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e01061a0 con 0x7f51e010fbe0 2024-02-13T15:21:48.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 3774422242 0 0) 0x7f51c8003250 con 0x7f51e01033e0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f51e01aa170 con 0x7f51e01033e0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f51d0001d50 con 0x7f51e01033e0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 2686535266 0 0) 0x7f51e01061a0 con 0x7f51e010fbe0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f51c8003250 con 0x7f51e010fbe0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f51d8001860 con 0x7f51e010fbe0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675175143 0 0) 0x7f51e01a8fd0 con 0x7f51e010c070 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51e01061a0 con 0x7f51e010c070 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 2459308743 0 0) 0x7f51c8003250 con 0x7f51e010fbe0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 >> v1:172.21.15.111:6789/0 conn(0x7f51e010c070 legacy=0x7f51e01a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 >> v1:172.21.15.62:6789/0 conn(0x7f51e01033e0 legacy=0x7f51e01055f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e01ab350 con 0x7f51e010fbe0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e01a8020 con 0x7f51e010fbe0 2024-02-13T15:21:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e01a84a0 con 0x7f51e010fbe0 2024-02-13T15:21:48.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7f51d8003a90 con 0x7f51e010fbe0 2024-02-13T15:21:48.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7f51d80059a0 con 0x7f51e010fbe0 2024-02-13T15:21:48.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c0005090 con 0x7f51e010fbe0 2024-02-13T15:21:48.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7f51d8003600 con 0x7f51e010fbe0 2024-02-13T15:21:48.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 8 ==== osd_map(834..834 src has 269..834) v4 ==== 8132+0+0 (unknown 2870847225 0 0) 0x7f51d80893b0 con 0x7f51e010fbe0 2024-02-13T15:21:48.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.445+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=835}) v3 -- 0x7f51c8003250 con 0x7f51e010fbe0 2024-02-13T15:21:48.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.449+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7f51d8055ca0 con 0x7f51e010fbe0 2024-02-13T15:21:48.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:48.625+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51c0005340 con 0x7f51e010fbe0 2024-02-13T15:21:48.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:48 smithi062 bash[21479]: cluster 2024-02-13T15:21:47.147893+0000 mgr.y (mgr.14613) 1416 : cluster 0 pgmap v1885: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:48.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:48 smithi062 bash[28859]: cluster 2024-02-13T15:21:47.147893+0000 mgr.y (mgr.14613) 1416 : cluster 0 pgmap v1885: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:48.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:48 smithi111 bash[23388]: cluster 2024-02-13T15:21:47.147893+0000 mgr.y (mgr.14613) 1416 : cluster 0 pgmap v1885: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:49.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.409+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 10 ==== osd_map(835..835 src has 269..835) v4 ==== 296+0+0 (unknown 715598413 0 0) 0x7f51d80565d0 con 0x7f51e010fbe0 2024-02-13T15:21:49.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.409+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- mon_subscribe({osdmap=836}) v3 -- 0x7f51e01aa170 con 0x7f51e010fbe0 2024-02-13T15:21:49.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.417+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]=0 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' removed v835) v1 ==== 248+0+0 (unknown 4125214753 0 0) 0x7f51d8054010 con 0x7f51e010fbe0 2024-02-13T15:21:49.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.533+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 --> v1:172.21.15.62:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51c0001150 con 0x7f51e010fbe0 2024-02-13T15:21:49.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.533+0000 7f51cf7fe640 1 -- 172.21.15.62:0/2069367663 <== mon.2 v1:172.21.15.62:6790/0 12 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]=0 pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' does not exist v835) v1 ==== 255+0+0 (unknown 742418217 0 0) 0x7f51d8055830 con 0x7f51e010fbe0 2024-02-13T15:21:49.536 INFO:tasks.workunit.client.0.smithi062.stderr:pool '38effd22-4604-428a-b9f7-cf7ee1ea6006' does not exist 2024-02-13T15:21:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.537+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 >> v1:172.21.15.62:6800/3802446050 conn(0x7f51c806ef00 legacy=0x7f51c80713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.537+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 >> v1:172.21.15.62:6790/0 conn(0x7f51e010fbe0 legacy=0x7f51e01a68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.537+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 shutdown_connections 2024-02-13T15:21:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.537+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 >> 172.21.15.62:0/2069367663 conn(0x7f51e00fec30 msgr2=0x7f51e00ff010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:21:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.537+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 shutdown_connections 2024-02-13T15:21:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.537+0000 7f51e4a60640 1 -- 172.21.15.62:0/2069367663 wait complete. 2024-02-13T15:21:49.554 INFO:tasks.workunit.client.0.smithi062.stderr:+ ceph osd pool delete 7437e2a3-873d-4a78-a266-b034849c891e 7437e2a3-873d-4a78-a266-b034849c891e --yes-i-really-really-mean-it 2024-02-13T15:21:49.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- 172.21.15.62:0/3075167051 >> v1:172.21.15.62:6790/0 conn(0x7ffbe810fbf0 legacy=0x7ffbe8112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:49.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- 172.21.15.62:0/3075167051 shutdown_connections 2024-02-13T15:21:49.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- 172.21.15.62:0/3075167051 >> 172.21.15.62:0/3075167051 conn(0x7ffbe80feca0 msgr2=0x7ffbe81010c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:21:49.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- 172.21.15.62:0/3075167051 shutdown_connections 2024-02-13T15:21:49.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- 172.21.15.62:0/3075167051 wait complete. 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 Processor -- start 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- start start 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffbe81a80f0 con 0x7ffbe810c080 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffbe81a92f0 con 0x7ffbe810fbf0 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- --> v1:172.21.15.62:6790/0 -- auth(proto 0 34 bytes epoch 0) v1 -- 0x7ffbe81aa4f0 con 0x7ffbe81033f0 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbedc2b640 1 --1- >> v1:172.21.15.62:6790/0 conn(0x7ffbe81033f0 0x7ffbe8108740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.62:6790/0 says I am v1:172.21.15.62:58694/0 (socket says 172.21.15.62:58694) 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbedc2b640 1 -- 172.21.15.62:0/134747371 learned_addr learned my addr 172.21.15.62:0/134747371 (peer_addr_for_me v1:172.21.15.62:0/0) 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226567351 0 0) 0x7ffbe81a80f0 con 0x7ffbe810c080 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd4003770 con 0x7ffbe810c080 2024-02-13T15:21:49.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.2 v1:172.21.15.62:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1149943749 0 0) 0x7ffbe81aa4f0 con 0x7ffbe81033f0 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6790/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbe81a80f0 con 0x7ffbe81033f0 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4232351393 0 0) 0x7ffbd4003770 con 0x7ffbe810c080 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffbe81aa4f0 con 0x7ffbe810c080 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ffbd8001840 con 0x7ffbe810c080 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.1 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599202552 0 0) 0x7ffbe81a92f0 con 0x7ffbe810fbf0 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffbd4003770 con 0x7ffbe810fbf0 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.2 v1:172.21.15.62:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 764+0+0 (unknown 4160486865 0 0) 0x7ffbe81a80f0 con 0x7ffbe81033f0 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6790/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ffbe81a92f0 con 0x7ffbe81033f0 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.2 v1:172.21.15.62:6790/0 3 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ffbe4001900 con 0x7ffbe81033f0 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 580+0+0 (unknown 1458005599 0 0) 0x7ffbe81aa4f0 con 0x7ffbe810c080 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 >> v1:172.21.15.62:6790/0 conn(0x7ffbe81033f0 legacy=0x7ffbe8108740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:49.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 >> v1:172.21.15.111:6789/0 conn(0x7ffbe810fbf0 legacy=0x7ffbe81a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:49.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbe81ab6f0 con 0x7ffbe810c080 2024-02-13T15:21:49.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbe81aa6e0 con 0x7ffbe810c080 2024-02-13T15:21:49.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbe81aab60 con 0x7ffbe810c080 2024-02-13T15:21:49.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 5 ==== config(25 keys) v1 ==== 1068+0+0 (unknown 1647622248 0 0) 0x7ffbd8003a90 con 0x7ffbe810c080 2024-02-13T15:21:49.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.673+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 6 ==== mon_map magic: 0 v1 ==== 308+0+0 (unknown 21923663 0 0) 0x7ffbd80049d0 con 0x7ffbe810c080 2024-02-13T15:21:49.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.677+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbcc005090 con 0x7ffbe810c080 2024-02-13T15:21:49.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.677+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 7 ==== mgrmap(e 22) v1 ==== 91772+0+0 (unknown 654471584 0 0) 0x7ffbd8003600 con 0x7ffbe810c080 2024-02-13T15:21:49.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.677+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 8 ==== osd_map(835..835 src has 269..835) v4 ==== 7744+0+0 (unknown 337346673 0 0) 0x7ffbd8088320 con 0x7ffbe810c080 2024-02-13T15:21:49.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.677+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=836}) v3 -- 0x7ffbe81aa4f0 con 0x7ffbe810c080 2024-02-13T15:21:49.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.681+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+184365 (unknown 1092875540 0 3115750367) 0x7ffbd8054e00 con 0x7ffbe810c080 2024-02-13T15:21:49.811 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:49 smithi062 bash[21479]: audit 2024-02-13T15:21:48.628175+0000 mon.c (mon.2) 878 : audit 1 from='client.? v1:172.21.15.62:0/2069367663' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:49.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:49 smithi062 bash[21479]: audit 2024-02-13T15:21:48.628815+0000 mon.a (mon.0) 3704 : audit 1 from='client.47432 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:49 smithi062 bash[28859]: audit 2024-02-13T15:21:48.628175+0000 mon.c (mon.2) 878 : audit 1 from='client.? v1:172.21.15.62:0/2069367663' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:49.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:49 smithi062 bash[28859]: audit 2024-02-13T15:21:48.628815+0000 mon.a (mon.0) 3704 : audit 1 from='client.47432 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:49 smithi111 bash[23388]: audit 2024-02-13T15:21:48.628175+0000 mon.c (mon.2) 878 : audit 1 from='client.? v1:172.21.15.62:0/2069367663' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:49.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:49 smithi111 bash[23388]: audit 2024-02-13T15:21:48.628815+0000 mon.a (mon.0) 3704 : audit 1 from='client.47432 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:49.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:49.853+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pool2": "7437e2a3-873d-4a78-a266-b034849c891e", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffbcc005340 con 0x7ffbe810c080 2024-02-13T15:21:50.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.405+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pool2": "7437e2a3-873d-4a78-a266-b034849c891e", "yes_i_really_really_mean_it": true}]=0 pool '7437e2a3-873d-4a78-a266-b034849c891e' removed v836) v1 ==== 248+0+0 (unknown 340566767 0 0) 0x7ffbd8053170 con 0x7ffbe810c080 2024-02-13T15:21:50.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.409+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 11 ==== osd_map(836..836 src has 269..836) v4 ==== 296+0+0 (unknown 2052051736 0 0) 0x7ffbd8055730 con 0x7ffbe810c080 2024-02-13T15:21:50.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.409+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- mon_subscribe({osdmap=837}) v3 -- 0x7ffbe81a80f0 con 0x7ffbe810c080 2024-02-13T15:21:50.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.533+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 --> v1:172.21.15.62:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pool2": "7437e2a3-873d-4a78-a266-b034849c891e", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffbcc001190 con 0x7ffbe810c080 2024-02-13T15:21:50.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.533+0000 7ffbdeffd640 1 -- 172.21.15.62:0/134747371 <== mon.0 v1:172.21.15.62:6789/0 12 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pool2": "7437e2a3-873d-4a78-a266-b034849c891e", "yes_i_really_really_mean_it": true}]=0 pool '7437e2a3-873d-4a78-a266-b034849c891e' does not exist v836) v1 ==== 255+0+0 (unknown 2889996560 0 0) 0x7ffbd8054990 con 0x7ffbe810c080 2024-02-13T15:21:50.536 INFO:tasks.workunit.client.0.smithi062.stderr:pool '7437e2a3-873d-4a78-a266-b034849c891e' does not exist 2024-02-13T15:21:50.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.537+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 >> v1:172.21.15.62:6800/3802446050 conn(0x7ffbd406f000 legacy=0x7ffbd40714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:50.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.537+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 >> v1:172.21.15.62:6789/0 conn(0x7ffbe810c080 legacy=0x7ffbe81a2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-13T15:21:50.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.537+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 shutdown_connections 2024-02-13T15:21:50.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.537+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 >> 172.21.15.62:0/134747371 conn(0x7ffbe80feca0 msgr2=0x7ffbe8112860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-13T15:21:50.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.537+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 shutdown_connections 2024-02-13T15:21:50.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-02-13T15:21:50.537+0000 7ffbefe8f640 1 -- 172.21.15.62:0/134747371 wait complete. 2024-02-13T15:21:50.553 INFO:tasks.workunit.client.0.smithi062.stdout:OK 2024-02-13T15:21:50.554 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo OK 2024-02-13T15:21:50.554 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-13T15:21:50.554 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-13T15:21:50.609 INFO:tasks.workunit:Stopping ['rados/test.sh', 'rados/test_pool_quota.sh'] on client.0... 2024-02-13T15:21:50.610 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-13T15:21:50.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[28859]: cluster 2024-02-13T15:21:49.148672+0000 mgr.y (mgr.14613) 1417 : cluster 0 pgmap v1886: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:50.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[28859]: audit 2024-02-13T15:21:49.407348+0000 mon.a (mon.0) 3705 : audit 1 from='client.47432 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T15:21:50.811 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[28859]: cluster 2024-02-13T15:21:49.414590+0000 mon.a (mon.0) 3706 : cluster 0 osdmap e835: 8 total, 8 up, 8 in 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[28859]: audit 2024-02-13T15:21:49.536260+0000 mon.c (mon.2) 879 : audit 1 from='client.? v1:172.21.15.62:0/2069367663' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[28859]: audit 2024-02-13T15:21:49.536852+0000 mon.a (mon.0) 3707 : audit 1 from='client.47432 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[28859]: audit 2024-02-13T15:21:49.858837+0000 mon.a (mon.0) 3708 : audit 1 from='client.? v1:172.21.15.62:0/134747371' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pool2": "7437e2a3-873d-4a78-a266-b034849c891e", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[21479]: cluster 2024-02-13T15:21:49.148672+0000 mgr.y (mgr.14613) 1417 : cluster 0 pgmap v1886: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[21479]: audit 2024-02-13T15:21:49.407348+0000 mon.a (mon.0) 3705 : audit 1 from='client.47432 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[21479]: cluster 2024-02-13T15:21:49.414590+0000 mon.a (mon.0) 3706 : cluster 0 osdmap e835: 8 total, 8 up, 8 in 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[21479]: audit 2024-02-13T15:21:49.536260+0000 mon.c (mon.2) 879 : audit 1 from='client.? v1:172.21.15.62:0/2069367663' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[21479]: audit 2024-02-13T15:21:49.536852+0000 mon.a (mon.0) 3707 : audit 1 from='client.47432 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.812 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:50 smithi062 bash[21479]: audit 2024-02-13T15:21:49.858837+0000 mon.a (mon.0) 3708 : audit 1 from='client.? v1:172.21.15.62:0/134747371' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pool2": "7437e2a3-873d-4a78-a266-b034849c891e", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:50 smithi111 bash[23388]: cluster 2024-02-13T15:21:49.148672+0000 mgr.y (mgr.14613) 1417 : cluster 0 pgmap v1886: 188 pgs: 188 active+clean; 874 KiB data, 881 MiB used, 714 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-02-13T15:21:50.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:50 smithi111 bash[23388]: audit 2024-02-13T15:21:49.407348+0000 mon.a (mon.0) 3705 : audit 1 from='client.47432 ' entity='client.admin' cmd='[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]': finished 2024-02-13T15:21:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:50 smithi111 bash[23388]: cluster 2024-02-13T15:21:49.414590+0000 mon.a (mon.0) 3706 : cluster 0 osdmap e835: 8 total, 8 up, 8 in 2024-02-13T15:21:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:50 smithi111 bash[23388]: audit 2024-02-13T15:21:49.536260+0000 mon.c (mon.2) 879 : audit 1 from='client.? v1:172.21.15.62:0/2069367663' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:50 smithi111 bash[23388]: audit 2024-02-13T15:21:49.536852+0000 mon.a (mon.0) 3707 : audit 1 from='client.47432 ' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "pool2": "38effd22-4604-428a-b9f7-cf7ee1ea6006", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.844 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:50 smithi111 bash[23388]: audit 2024-02-13T15:21:49.858837+0000 mon.a (mon.0) 3708 : audit 1 from='client.? v1:172.21.15.62:0/134747371' entity='client.admin' cmd=[{"prefix": "osd pool delete", "pool": "7437e2a3-873d-4a78-a266-b034849c891e", "pool2": "7437e2a3-873d-4a78-a266-b034849c891e", "yes_i_really_really_mean_it": true}]: dispatch 2024-02-13T15:21:50.935 DEBUG:teuthology.parallel:result is None 2024-02-13T15:21:50.936 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-13T15:21:50.948 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-13T15:21:50.949 DEBUG:teuthology.orchestra.run.smithi062:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-02-13T15:21:51.004 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-02-13T15:21:51.004 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-13T15:21:51.014 INFO:tasks.cephadm:Teardown begin 2024-02-13T15:21:51.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-13T15:21:51.057 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-13T15:21:51.072 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-13T15:21:51.072 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-13T15:21:51.109 DEBUG:teuthology.orchestra.run.smithi111:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-13T15:21:51.125 INFO:tasks.cephadm:Stopping all daemons... 2024-02-13T15:21:51.125 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-13T15:21:51.125 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.a 2024-02-13T15:21:51.295 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:51 smithi062 systemd[1]: Stopping Ceph mon.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:21:51.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:51 smithi062 bash[21479]: debug 2024-02-13T15:21:51.293+0000 7f258d6d3700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-13T15:21:51.562 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:51 smithi062 bash[21479]: debug 2024-02-13T15:21:51.293+0000 7f258d6d3700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-13T15:21:52.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:21:51 smithi111 bash[47639]: debug there is no tcmu-runner data available 2024-02-13T15:21:52.934 INFO:journalctl@ceph.mon.a.smithi062.stdout:Feb 13 15:21:52 smithi062 bash[136746]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-mon-a 2024-02-13T15:21:52.938 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.a.service' 2024-02-13T15:21:52.965 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:21:52.965 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-13T15:21:52.965 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-02-13T15:21:52.965 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.c 2024-02-13T15:21:53.228 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:53 smithi062 systemd[1]: Stopping Ceph mon.c for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:21:53.228 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:53 smithi062 bash[28859]: debug 2024-02-13T15:21:53.165+0000 7ff144b7a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-13T15:21:53.228 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:53 smithi062 bash[28859]: debug 2024-02-13T15:21:53.165+0000 7ff144b7a700 -1 mon.c@2(peon) e3 *** Got Signal Terminated *** 2024-02-13T15:21:54.099 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:53 smithi062 bash[136856]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-mon-c 2024-02-13T15:21:54.099 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:54 smithi062 bash[136917]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-mon-c 2024-02-13T15:21:54.099 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:54 smithi062 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.c.service: Deactivated successfully. 2024-02-13T15:21:54.099 INFO:journalctl@ceph.mon.c.smithi062.stdout:Feb 13 15:21:54 smithi062 systemd[1]: Stopped Ceph mon.c for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T15:21:54.100 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.c.service' 2024-02-13T15:21:54.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:21:54.131 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-02-13T15:21:54.131 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-13T15:21:54.131 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.b 2024-02-13T15:21:54.559 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:54 smithi111 systemd[1]: Stopping Ceph mon.b for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:21:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:54 smithi111 bash[23388]: debug 2024-02-13T15:21:54.557+0000 7fc044dba700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-13T15:21:54.843 INFO:journalctl@ceph.mon.b.smithi111.stdout:Feb 13 15:21:54 smithi111 bash[23388]: debug 2024-02-13T15:21:54.557+0000 7fc044dba700 -1 mon.b@1(peon) e3 *** Got Signal Terminated *** 2024-02-13T15:21:55.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mon.b.service' 2024-02-13T15:21:55.436 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:21:55.436 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-13T15:21:55.436 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-13T15:21:55.437 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.y 2024-02-13T15:21:55.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:21:55 smithi062 systemd[1]: Stopping Ceph mgr.y for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:21:55.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:21:55 smithi062 bash[21731]: debug 2024-02-13T15:21:55.593+0000 7f346352f700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:21:55.812 INFO:journalctl@ceph.mgr.y.smithi062.stdout:Feb 13 15:21:55 smithi062 bash[21731]: debug 2024-02-13T15:21:55.593+0000 7f346352f700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-02-13T15:21:56.476 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.y.service' 2024-02-13T15:21:56.500 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:21:56.501 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-13T15:21:56.501 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-13T15:21:56.501 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.x 2024-02-13T15:21:56.844 INFO:journalctl@ceph.mgr.x.smithi111.stdout:Feb 13 15:21:56 smithi111 systemd[1]: Stopping Ceph mgr.x for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:21:57.465 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@mgr.x.service' 2024-02-13T15:21:57.488 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:21:57.489 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-13T15:21:57.489 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-13T15:21:57.489 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.0 2024-02-13T15:21:57.812 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 15:21:57 smithi062 systemd[1]: Stopping Ceph osd.0 for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:21:57.812 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 15:21:57 smithi062 bash[31865]: debug 2024-02-13T15:21:57.633+0000 7f6080e76700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:21:57.812 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 15:21:57 smithi062 bash[31865]: debug 2024-02-13T15:21:57.633+0000 7f6080e76700 -1 osd.0 836 *** Got signal Terminated *** 2024-02-13T15:21:57.812 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 15:21:57 smithi062 bash[31865]: debug 2024-02-13T15:21:57.633+0000 7f6080e76700 -1 osd.0 836 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T15:22:02.594 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:22:02 smithi111 bash[51351]: ts=2024-02-13T15:22:02.186Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.62:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.62:8765: connect: connection refused" 2024-02-13T15:22:02.594 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:22:02 smithi111 bash[51351]: ts=2024-02-13T15:22:02.188Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.62:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.62:8765: connect: connection refused" 2024-02-13T15:22:02.594 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:22:02 smithi111 bash[51351]: ts=2024-02-13T15:22:02.192Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.62:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.62:8765: connect: connection refused" 2024-02-13T15:22:02.594 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:22:02 smithi111 bash[51351]: ts=2024-02-13T15:22:02.192Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.62:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.62:8765: connect: connection refused" 2024-02-13T15:22:04.123 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 15:22:03 smithi062 bash[137056]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-0 2024-02-13T15:22:04.124 INFO:journalctl@ceph.osd.0.smithi062.stdout:Feb 13 15:22:04 smithi062 bash[137119]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-0 2024-02-13T15:22:06.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.0.service' 2024-02-13T15:22:06.196 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:22:06.197 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-13T15:22:06.197 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-13T15:22:06.197 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.1 2024-02-13T15:22:06.562 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 15:22:06 smithi062 systemd[1]: Stopping Ceph osd.1 for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:22:06.562 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 15:22:06 smithi062 bash[37480]: debug 2024-02-13T15:22:06.385+0000 7f3c247a3700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:22:06.562 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 15:22:06 smithi062 bash[37480]: debug 2024-02-13T15:22:06.385+0000 7f3c247a3700 -1 osd.1 836 *** Got signal Terminated *** 2024-02-13T15:22:06.562 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 15:22:06 smithi062 bash[37480]: debug 2024-02-13T15:22:06.385+0000 7f3c247a3700 -1 osd.1 836 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T15:22:12.811 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 15:22:12 smithi062 bash[137254]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-1 2024-02-13T15:22:12.811 INFO:journalctl@ceph.osd.1.smithi062.stdout:Feb 13 15:22:12 smithi062 bash[137321]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-1 2024-02-13T15:22:14.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.1.service' 2024-02-13T15:22:14.637 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:22:14.638 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-13T15:22:14.638 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-13T15:22:14.638 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.2 2024-02-13T15:22:15.062 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 15:22:14 smithi062 systemd[1]: Stopping Ceph osd.2 for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:22:15.062 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 15:22:14 smithi062 bash[43264]: debug 2024-02-13T15:22:14.825+0000 7fe6fc9fd700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:22:15.062 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 15:22:14 smithi062 bash[43264]: debug 2024-02-13T15:22:14.825+0000 7fe6fc9fd700 -1 osd.2 836 *** Got signal Terminated *** 2024-02-13T15:22:15.062 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 15:22:14 smithi062 bash[43264]: debug 2024-02-13T15:22:14.825+0000 7fe6fc9fd700 -1 osd.2 836 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T15:22:21.311 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 15:22:20 smithi062 bash[137454]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-2 2024-02-13T15:22:21.312 INFO:journalctl@ceph.osd.2.smithi062.stdout:Feb 13 15:22:21 smithi062 bash[137518]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-2 2024-02-13T15:22:23.242 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.2.service' 2024-02-13T15:22:23.272 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:22:23.272 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-13T15:22:23.272 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-13T15:22:23.273 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.3 2024-02-13T15:22:23.562 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:23 smithi062 systemd[1]: Stopping Ceph osd.3 for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:22:23.562 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:23 smithi062 bash[49158]: debug 2024-02-13T15:22:23.432+0000 7fd574c66700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:22:23.562 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:23 smithi062 bash[49158]: debug 2024-02-13T15:22:23.432+0000 7fd574c66700 -1 osd.3 836 *** Got signal Terminated *** 2024-02-13T15:22:23.562 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:23 smithi062 bash[49158]: debug 2024-02-13T15:22:23.432+0000 7fd574c66700 -1 osd.3 836 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T15:22:24.561 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:24 smithi062 bash[49158]: debug 2024-02-13T15:22:24.064+0000 7fd57125a700 -1 osd.3 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:00.537274+0000 front 2024-02-13T15:22:00.537593+0000 (oldest deadline 2024-02-13T15:22:24.037433+0000) 2024-02-13T15:22:24.594 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:24 smithi111 bash[43474]: debug 2024-02-13T15:22:24.168+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:25.311 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:25 smithi062 bash[49158]: debug 2024-02-13T15:22:25.028+0000 7fd57125a700 -1 osd.3 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:00.537274+0000 front 2024-02-13T15:22:00.537593+0000 (oldest deadline 2024-02-13T15:22:24.037433+0000) 2024-02-13T15:22:25.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:25 smithi111 bash[43474]: debug 2024-02-13T15:22:25.140+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:26.311 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:26 smithi062 bash[49158]: debug 2024-02-13T15:22:25.996+0000 7fd57125a700 -1 osd.3 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:00.537274+0000 front 2024-02-13T15:22:00.537593+0000 (oldest deadline 2024-02-13T15:22:24.037433+0000) 2024-02-13T15:22:26.343 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:26 smithi111 bash[43474]: debug 2024-02-13T15:22:26.144+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:26.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:25 smithi111 bash[32478]: debug 2024-02-13T15:22:25.940+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:26.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:26 smithi111 bash[37832]: debug 2024-02-13T15:22:26.016+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:27.175 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:26 smithi111 bash[32478]: debug 2024-02-13T15:22:26.904+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:27.175 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:27 smithi111 bash[37832]: debug 2024-02-13T15:22:27.032+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:27.311 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:27 smithi062 bash[49158]: debug 2024-02-13T15:22:27.020+0000 7fd57125a700 -1 osd.3 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:00.537274+0000 front 2024-02-13T15:22:00.537593+0000 (oldest deadline 2024-02-13T15:22:24.037433+0000) 2024-02-13T15:22:27.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:27 smithi111 bash[43474]: debug 2024-02-13T15:22:27.172+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:28.195 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:27 smithi111 bash[32478]: debug 2024-02-13T15:22:27.868+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:28.195 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:28 smithi111 bash[37832]: debug 2024-02-13T15:22:28.056+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:28.195 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:28 smithi111 bash[26921]: debug 2024-02-13T15:22:28.108+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:28.311 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:28 smithi062 bash[49158]: debug 2024-02-13T15:22:28.040+0000 7fd57125a700 -1 osd.3 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:00.537274+0000 front 2024-02-13T15:22:00.537593+0000 (oldest deadline 2024-02-13T15:22:24.037433+0000) 2024-02-13T15:22:28.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:28 smithi111 bash[43474]: debug 2024-02-13T15:22:28.192+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:29.200 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:29 smithi111 bash[26921]: debug 2024-02-13T15:22:29.068+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:29.201 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:29 smithi111 bash[37832]: debug 2024-02-13T15:22:29.080+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:29.201 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:28 smithi111 bash[32478]: debug 2024-02-13T15:22:28.904+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:29.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:29 smithi111 bash[43474]: debug 2024-02-13T15:22:29.196+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:29.811 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:29 smithi062 bash[137653]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-3 2024-02-13T15:22:29.812 INFO:journalctl@ceph.osd.3.smithi062.stdout:Feb 13 15:22:29 smithi062 bash[137716]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-3 2024-02-13T15:22:30.231 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:30 smithi111 bash[26921]: debug 2024-02-13T15:22:30.044+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:30.232 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:29 smithi111 bash[32478]: debug 2024-02-13T15:22:29.936+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:30.232 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:30 smithi111 bash[37832]: debug 2024-02-13T15:22:30.052+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:30.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:30 smithi111 bash[43474]: debug 2024-02-13T15:22:30.232+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:31.248 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:31 smithi111 bash[26921]: debug 2024-02-13T15:22:31.016+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:31.248 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:31 smithi111 bash[37832]: debug 2024-02-13T15:22:31.080+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:31.248 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:30 smithi111 bash[32478]: debug 2024-02-13T15:22:30.928+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:31.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.3.service' 2024-02-13T15:22:31.479 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:22:31.479 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-13T15:22:31.479 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-13T15:22:31.479 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.4 2024-02-13T15:22:31.498 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:31 smithi111 bash[43474]: debug 2024-02-13T15:22:31.248+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:31.843 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:31 smithi111 systemd[1]: Stopping Ceph osd.4 for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:22:31.844 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:31 smithi111 bash[26921]: debug 2024-02-13T15:22:31.696+0000 7f5b07f3a700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:22:31.844 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:31 smithi111 bash[26921]: debug 2024-02-13T15:22:31.696+0000 7f5b07f3a700 -1 osd.4 836 *** Got signal Terminated *** 2024-02-13T15:22:31.844 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:31 smithi111 bash[26921]: debug 2024-02-13T15:22:31.696+0000 7f5b07f3a700 -1 osd.4 836 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T15:22:32.297 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:32 smithi111 bash[37832]: debug 2024-02-13T15:22:32.096+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:32.297 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:31 smithi111 bash[26921]: debug 2024-02-13T15:22:31.972+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:32.297 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:31 smithi111 bash[32478]: debug 2024-02-13T15:22:31.892+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:32.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:32 smithi111 bash[43474]: debug 2024-02-13T15:22:32.296+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:33.306 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:32 smithi111 bash[32478]: debug 2024-02-13T15:22:32.912+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:33.307 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:33 smithi111 bash[37832]: debug 2024-02-13T15:22:33.092+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:33.307 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:32 smithi111 bash[26921]: debug 2024-02-13T15:22:32.972+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:33.307 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:32 smithi111 bash[26921]: debug 2024-02-13T15:22:32.972+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:08.809933+0000 front 2024-02-13T15:22:08.810312+0000 (oldest deadline 2024-02-13T15:22:32.910059+0000) 2024-02-13T15:22:33.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:33 smithi111 bash[43474]: debug 2024-02-13T15:22:33.304+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:34.318 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:33 smithi111 bash[32478]: debug 2024-02-13T15:22:33.948+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:34.319 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[26921]: debug 2024-02-13T15:22:34.000+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:34.319 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[26921]: debug 2024-02-13T15:22:34.000+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:08.809933+0000 front 2024-02-13T15:22:08.810312+0000 (oldest deadline 2024-02-13T15:22:32.910059+0000) 2024-02-13T15:22:34.319 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[37832]: debug 2024-02-13T15:22:34.112+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:34.319 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[37832]: debug 2024-02-13T15:22:34.112+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:34.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[43474]: debug 2024-02-13T15:22:34.316+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:34.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[43474]: debug 2024-02-13T15:22:34.316+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:35.334 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[32478]: debug 2024-02-13T15:22:34.924+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:35.335 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[26921]: debug 2024-02-13T15:22:34.976+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:35.335 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:34 smithi111 bash[26921]: debug 2024-02-13T15:22:34.976+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:08.809933+0000 front 2024-02-13T15:22:08.810312+0000 (oldest deadline 2024-02-13T15:22:32.910059+0000) 2024-02-13T15:22:35.335 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:35 smithi111 bash[37832]: debug 2024-02-13T15:22:35.148+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:35.335 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:35 smithi111 bash[37832]: debug 2024-02-13T15:22:35.148+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:35.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:35 smithi111 bash[43474]: debug 2024-02-13T15:22:35.332+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:35.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:35 smithi111 bash[43474]: debug 2024-02-13T15:22:35.332+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:36.343 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:35 smithi111 bash[32478]: debug 2024-02-13T15:22:35.964+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:36.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:35 smithi111 bash[32478]: debug 2024-02-13T15:22:35.964+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:36.344 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:35 smithi111 bash[26921]: debug 2024-02-13T15:22:35.948+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:02.409090+0000 front 2024-02-13T15:22:02.408669+0000 (oldest deadline 2024-02-13T15:22:27.108471+0000) 2024-02-13T15:22:36.344 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:35 smithi111 bash[26921]: debug 2024-02-13T15:22:35.948+0000 7f5b00526700 -1 osd.4 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:08.809933+0000 front 2024-02-13T15:22:08.810312+0000 (oldest deadline 2024-02-13T15:22:32.910059+0000) 2024-02-13T15:22:36.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:36 smithi111 bash[37832]: debug 2024-02-13T15:22:36.108+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:36.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:36 smithi111 bash[37832]: debug 2024-02-13T15:22:36.108+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:36.843 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:36 smithi111 bash[43474]: debug 2024-02-13T15:22:36.376+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:36.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:36 smithi111 bash[43474]: debug 2024-02-13T15:22:36.376+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:37.282 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:37 smithi111 bash[37832]: debug 2024-02-13T15:22:37.072+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:37.282 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:37 smithi111 bash[37832]: debug 2024-02-13T15:22:37.072+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:37.282 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:36 smithi111 bash[32478]: debug 2024-02-13T15:22:36.940+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:37.282 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:36 smithi111 bash[32478]: debug 2024-02-13T15:22:36.940+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:37.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:37 smithi111 bash[43474]: debug 2024-02-13T15:22:37.360+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:37.594 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:37 smithi111 bash[43474]: debug 2024-02-13T15:22:37.360+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:38.034 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:37 smithi111 bash[56422]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-4 2024-02-13T15:22:38.034 INFO:journalctl@ceph.osd.4.smithi111.stdout:Feb 13 15:22:37 smithi111 bash[56489]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-4 2024-02-13T15:22:38.035 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:37 smithi111 bash[32478]: debug 2024-02-13T15:22:37.948+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:38.035 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:37 smithi111 bash[32478]: debug 2024-02-13T15:22:37.948+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:38.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:38 smithi111 bash[37832]: debug 2024-02-13T15:22:38.028+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:38.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:38 smithi111 bash[37832]: debug 2024-02-13T15:22:38.028+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:38.771 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:38 smithi111 bash[43474]: debug 2024-02-13T15:22:38.412+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:38.771 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:38 smithi111 bash[43474]: debug 2024-02-13T15:22:38.412+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:39.094 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:39 smithi111 bash[37832]: debug 2024-02-13T15:22:39.012+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:39.094 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:39 smithi111 bash[37832]: debug 2024-02-13T15:22:39.012+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:39.094 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:38 smithi111 bash[32478]: debug 2024-02-13T15:22:38.984+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:39.094 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:38 smithi111 bash[32478]: debug 2024-02-13T15:22:38.984+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:39.788 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:39 smithi111 bash[43474]: debug 2024-02-13T15:22:39.420+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:39.788 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:39 smithi111 bash[43474]: debug 2024-02-13T15:22:39.420+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:39.792 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.4.service' 2024-02-13T15:22:39.864 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:22:39.865 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-13T15:22:39.865 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-13T15:22:39.865 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.5 2024-02-13T15:22:40.047 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[37832]: debug 2024-02-13T15:22:40.008+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:40.047 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[37832]: debug 2024-02-13T15:22:40.008+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:40.047 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:39 smithi111 systemd[1]: Stopping Ceph osd.5 for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:22:40.047 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:39 smithi111 bash[32478]: debug 2024-02-13T15:22:39.992+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:40.048 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:39 smithi111 bash[32478]: debug 2024-02-13T15:22:39.992+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:40.048 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[32478]: debug 2024-02-13T15:22:40.044+0000 7f60bc5f8700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:22:40.343 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[32478]: debug 2024-02-13T15:22:40.044+0000 7f60bc5f8700 -1 osd.5 836 *** Got signal Terminated *** 2024-02-13T15:22:40.343 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[32478]: debug 2024-02-13T15:22:40.044+0000 7f60bc5f8700 -1 osd.5 836 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T15:22:40.843 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[43474]: debug 2024-02-13T15:22:40.392+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:40.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[43474]: debug 2024-02-13T15:22:40.392+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:41.343 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:41 smithi111 bash[32478]: debug 2024-02-13T15:22:41.020+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:41.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:41 smithi111 bash[32478]: debug 2024-02-13T15:22:41.020+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:41.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[37832]: debug 2024-02-13T15:22:40.976+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:41.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:40 smithi111 bash[37832]: debug 2024-02-13T15:22:40.976+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:41.843 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:41 smithi111 bash[43474]: debug 2024-02-13T15:22:41.384+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:41.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:41 smithi111 bash[43474]: debug 2024-02-13T15:22:41.384+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:42.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:41 smithi111 bash[37832]: debug 2024-02-13T15:22:41.944+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:42.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:41 smithi111 bash[37832]: debug 2024-02-13T15:22:41.944+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:42.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:42 smithi111 bash[32478]: debug 2024-02-13T15:22:42.012+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:42.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:42 smithi111 bash[32478]: debug 2024-02-13T15:22:42.012+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:42.345 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:42 smithi111 bash[32478]: debug 2024-02-13T15:22:42.012+0000 7f60b4be4700 -1 osd.5 836 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24365.0:6880 5.15 5:a93a5511:::notify.2:head [watch ping cookie 94467445311616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e836) 2024-02-13T15:22:42.843 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:42 smithi111 bash[43474]: debug 2024-02-13T15:22:42.420+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:42.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:42 smithi111 bash[43474]: debug 2024-02-13T15:22:42.420+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:42.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:42 smithi111 bash[43474]: debug 2024-02-13T15:22:42.420+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:43.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:43 smithi111 bash[32478]: debug 2024-02-13T15:22:43.056+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:43.345 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:43 smithi111 bash[32478]: debug 2024-02-13T15:22:43.056+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:43.345 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:43 smithi111 bash[32478]: debug 2024-02-13T15:22:43.056+0000 7f60b4be4700 -1 osd.5 836 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24365.0:6880 5.15 5:a93a5511:::notify.2:head [watch ping cookie 94467445311616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e836) 2024-02-13T15:22:43.345 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:42 smithi111 bash[37832]: debug 2024-02-13T15:22:42.988+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:43.345 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:42 smithi111 bash[37832]: debug 2024-02-13T15:22:42.988+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:43.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:43 smithi111 bash[43474]: debug 2024-02-13T15:22:43.456+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:43.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:43 smithi111 bash[43474]: debug 2024-02-13T15:22:43.456+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:43.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:43 smithi111 bash[43474]: debug 2024-02-13T15:22:43.456+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:44.343 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:44 smithi111 bash[32478]: debug 2024-02-13T15:22:44.084+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:59.702948+0000 front 2024-02-13T15:21:59.703048+0000 (oldest deadline 2024-02-13T15:22:25.602469+0000) 2024-02-13T15:22:44.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:44 smithi111 bash[32478]: debug 2024-02-13T15:22:44.084+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:10.304071+0000 front 2024-02-13T15:22:10.304514+0000 (oldest deadline 2024-02-13T15:22:35.004057+0000) 2024-02-13T15:22:44.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:44 smithi111 bash[32478]: debug 2024-02-13T15:22:44.084+0000 7f60b4be4700 -1 osd.5 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.605968+0000 front 2024-02-13T15:22:19.606354+0000 (oldest deadline 2024-02-13T15:22:43.705880+0000) 2024-02-13T15:22:44.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:44 smithi111 bash[32478]: debug 2024-02-13T15:22:44.084+0000 7f60b4be4700 -1 osd.5 836 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.24365.0:6880 5.15 5:a93a5511:::notify.2:head [watch ping cookie 94467445311616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e836) 2024-02-13T15:22:44.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:43 smithi111 bash[37832]: debug 2024-02-13T15:22:43.988+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:44.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:43 smithi111 bash[37832]: debug 2024-02-13T15:22:43.988+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:44.843 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:44 smithi111 bash[43474]: debug 2024-02-13T15:22:44.492+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:44.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:44 smithi111 bash[43474]: debug 2024-02-13T15:22:44.492+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:44.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:44 smithi111 bash[43474]: debug 2024-02-13T15:22:44.492+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:45.343 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:45 smithi111 bash[37832]: debug 2024-02-13T15:22:45.020+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:45.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:45 smithi111 bash[37832]: debug 2024-02-13T15:22:45.020+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:45.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:45 smithi111 bash[37832]: debug 2024-02-13T15:22:45.020+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:45.799 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:45 smithi111 bash[43474]: debug 2024-02-13T15:22:45.488+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:45.799 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:45 smithi111 bash[43474]: debug 2024-02-13T15:22:45.488+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:45.799 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:45 smithi111 bash[43474]: debug 2024-02-13T15:22:45.488+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:46.344 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:46 smithi111 bash[56624]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-5 2024-02-13T15:22:46.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:46 smithi111 bash[37832]: debug 2024-02-13T15:22:46.060+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:46.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:46 smithi111 bash[37832]: debug 2024-02-13T15:22:46.060+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:46.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:46 smithi111 bash[37832]: debug 2024-02-13T15:22:46.060+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:46.844 INFO:journalctl@ceph.osd.5.smithi111.stdout:Feb 13 15:22:46 smithi111 bash[56691]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-5 2024-02-13T15:22:46.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:46 smithi111 bash[43474]: debug 2024-02-13T15:22:46.528+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:46.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:46 smithi111 bash[43474]: debug 2024-02-13T15:22:46.528+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:46.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:46 smithi111 bash[43474]: debug 2024-02-13T15:22:46.528+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:47.320 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[37832]: debug 2024-02-13T15:22:47.020+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:47.321 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[37832]: debug 2024-02-13T15:22:47.020+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:47.321 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[37832]: debug 2024-02-13T15:22:47.020+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:47.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[43474]: debug 2024-02-13T15:22:47.496+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:47.593 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[43474]: debug 2024-02-13T15:22:47.496+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:47.594 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[43474]: debug 2024-02-13T15:22:47.496+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:48.093 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[37832]: debug 2024-02-13T15:22:47.988+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:48.094 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[37832]: debug 2024-02-13T15:22:47.988+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:48.094 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:47 smithi111 bash[37832]: debug 2024-02-13T15:22:47.988+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:48.369 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.5.service' 2024-02-13T15:22:48.396 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:22:48.397 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-13T15:22:48.397 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-13T15:22:48.397 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.6 2024-02-13T15:22:48.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:48 smithi111 bash[43474]: debug 2024-02-13T15:22:48.504+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:48.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:48 smithi111 bash[43474]: debug 2024-02-13T15:22:48.504+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:48.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:48 smithi111 bash[43474]: debug 2024-02-13T15:22:48.504+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:48.844 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:48 smithi111 systemd[1]: Stopping Ceph osd.6 for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:22:48.844 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:48 smithi111 bash[37832]: debug 2024-02-13T15:22:48.576+0000 7fc0adb1c700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:22:48.844 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:48 smithi111 bash[37832]: debug 2024-02-13T15:22:48.576+0000 7fc0adb1c700 -1 osd.6 836 *** Got signal Terminated *** 2024-02-13T15:22:48.844 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:48 smithi111 bash[37832]: debug 2024-02-13T15:22:48.576+0000 7fc0adb1c700 -1 osd.6 836 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T15:22:49.343 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:49 smithi111 bash[37832]: debug 2024-02-13T15:22:49.000+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:49.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:49 smithi111 bash[37832]: debug 2024-02-13T15:22:49.000+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:49.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:49 smithi111 bash[37832]: debug 2024-02-13T15:22:49.000+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:49.843 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:49 smithi111 bash[43474]: debug 2024-02-13T15:22:49.523+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:49.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:49 smithi111 bash[43474]: debug 2024-02-13T15:22:49.523+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:49.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:49 smithi111 bash[43474]: debug 2024-02-13T15:22:49.523+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:49.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:49 smithi111 bash[43474]: debug 2024-02-13T15:22:49.523+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:50.343 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:50 smithi111 bash[37832]: debug 2024-02-13T15:22:50.047+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:50.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:50 smithi111 bash[37832]: debug 2024-02-13T15:22:50.047+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:50.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:50 smithi111 bash[37832]: debug 2024-02-13T15:22:50.047+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:50.843 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:50 smithi111 bash[43474]: debug 2024-02-13T15:22:50.551+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:50.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:50 smithi111 bash[43474]: debug 2024-02-13T15:22:50.551+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:50.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:50 smithi111 bash[43474]: debug 2024-02-13T15:22:50.551+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:50.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:50 smithi111 bash[43474]: debug 2024-02-13T15:22:50.551+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:51.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:51 smithi111 bash[37832]: debug 2024-02-13T15:22:51.075+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:51.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:51 smithi111 bash[37832]: debug 2024-02-13T15:22:51.075+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:51.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:51 smithi111 bash[37832]: debug 2024-02-13T15:22:51.075+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:51.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:51 smithi111 bash[37832]: debug 2024-02-13T15:22:51.075+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:24.209216+0000 front 2024-02-13T15:22:24.208989+0000 (oldest deadline 2024-02-13T15:22:50.108974+0000) 2024-02-13T15:22:51.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:51 smithi111 bash[43474]: debug 2024-02-13T15:22:51.583+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:51.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:51 smithi111 bash[43474]: debug 2024-02-13T15:22:51.583+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:51.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:51 smithi111 bash[43474]: debug 2024-02-13T15:22:51.583+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:51.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:51 smithi111 bash[43474]: debug 2024-02-13T15:22:51.583+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:52.540 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:52 smithi111 bash[37832]: debug 2024-02-13T15:22:52.119+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:52.540 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:52 smithi111 bash[37832]: debug 2024-02-13T15:22:52.119+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:52.540 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:52 smithi111 bash[37832]: debug 2024-02-13T15:22:52.119+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:52.540 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:52 smithi111 bash[37832]: debug 2024-02-13T15:22:52.119+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:24.209216+0000 front 2024-02-13T15:22:24.208989+0000 (oldest deadline 2024-02-13T15:22:50.108974+0000) 2024-02-13T15:22:52.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:52 smithi111 bash[43474]: debug 2024-02-13T15:22:52.539+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:52.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:52 smithi111 bash[43474]: debug 2024-02-13T15:22:52.539+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:52.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:52 smithi111 bash[43474]: debug 2024-02-13T15:22:52.539+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:52.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:52 smithi111 bash[43474]: debug 2024-02-13T15:22:52.539+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:53.343 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:53 smithi111 bash[37832]: debug 2024-02-13T15:22:53.079+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:22:01.504016+0000 front 2024-02-13T15:22:01.504249+0000 (oldest deadline 2024-02-13T15:22:25.603937+0000) 2024-02-13T15:22:53.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:53 smithi111 bash[37832]: debug 2024-02-13T15:22:53.079+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:07.806144+0000 front 2024-02-13T15:22:07.806175+0000 (oldest deadline 2024-02-13T15:22:33.705953+0000) 2024-02-13T15:22:53.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:53 smithi111 bash[37832]: debug 2024-02-13T15:22:53.079+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:18.308600+0000 front 2024-02-13T15:22:18.308159+0000 (oldest deadline 2024-02-13T15:22:44.208165+0000) 2024-02-13T15:22:53.344 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:53 smithi111 bash[37832]: debug 2024-02-13T15:22:53.079+0000 7fc0a6108700 -1 osd.6 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:24.209216+0000 front 2024-02-13T15:22:24.208989+0000 (oldest deadline 2024-02-13T15:22:50.108974+0000) 2024-02-13T15:22:53.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:53 smithi111 bash[43474]: debug 2024-02-13T15:22:53.571+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:53.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:53 smithi111 bash[43474]: debug 2024-02-13T15:22:53.571+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:53.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:53 smithi111 bash[43474]: debug 2024-02-13T15:22:53.571+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:53.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:53 smithi111 bash[43474]: debug 2024-02-13T15:22:53.571+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:54.836 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:54 smithi111 bash[56823]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-6 2024-02-13T15:22:54.836 INFO:journalctl@ceph.osd.6.smithi111.stdout:Feb 13 15:22:54 smithi111 bash[56884]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-6 2024-02-13T15:22:54.836 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:54 smithi111 bash[43474]: debug 2024-02-13T15:22:54.547+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:54.836 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:54 smithi111 bash[43474]: debug 2024-02-13T15:22:54.547+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:54.836 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:54 smithi111 bash[43474]: debug 2024-02-13T15:22:54.547+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:54.837 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:54 smithi111 bash[43474]: debug 2024-02-13T15:22:54.547+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:55.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:55 smithi111 bash[43474]: debug 2024-02-13T15:22:55.583+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:55.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:55 smithi111 bash[43474]: debug 2024-02-13T15:22:55.583+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:55.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:55 smithi111 bash[43474]: debug 2024-02-13T15:22:55.583+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:55.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:55 smithi111 bash[43474]: debug 2024-02-13T15:22:55.583+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:56.562 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.6.service' 2024-02-13T15:22:56.591 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:22:56.591 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-13T15:22:56.591 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-13T15:22:56.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.7 2024-02-13T15:22:56.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:56 smithi111 bash[43474]: debug 2024-02-13T15:22:56.579+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:56.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:56 smithi111 bash[43474]: debug 2024-02-13T15:22:56.579+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:56.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:56 smithi111 bash[43474]: debug 2024-02-13T15:22:56.579+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:56.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:56 smithi111 bash[43474]: debug 2024-02-13T15:22:56.579+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:56.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:56 smithi111 systemd[1]: Stopping Ceph osd.7 for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:22:56.845 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:56 smithi111 bash[43474]: debug 2024-02-13T15:22:56.763+0000 7fe999db5700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:22:56.845 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:56 smithi111 bash[43474]: debug 2024-02-13T15:22:56.763+0000 7fe999db5700 -1 osd.7 836 *** Got signal Terminated *** 2024-02-13T15:22:56.845 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:56 smithi111 bash[43474]: debug 2024-02-13T15:22:56.763+0000 7fe999db5700 -1 osd.7 836 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-13T15:22:58.093 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:57 smithi111 bash[43474]: debug 2024-02-13T15:22:57.623+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:58.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:57 smithi111 bash[43474]: debug 2024-02-13T15:22:57.623+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:58.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:57 smithi111 bash[43474]: debug 2024-02-13T15:22:57.623+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:58.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:57 smithi111 bash[43474]: debug 2024-02-13T15:22:57.623+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:22:59.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:58 smithi111 bash[43474]: debug 2024-02-13T15:22:58.643+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:22:59.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:58 smithi111 bash[43474]: debug 2024-02-13T15:22:58.643+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:22:59.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:58 smithi111 bash[43474]: debug 2024-02-13T15:22:58.643+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:22:59.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:58 smithi111 bash[43474]: debug 2024-02-13T15:22:58.643+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:23:00.093 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:59 smithi111 bash[43474]: debug 2024-02-13T15:22:59.631+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:23:00.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:59 smithi111 bash[43474]: debug 2024-02-13T15:22:59.631+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:23:00.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:59 smithi111 bash[43474]: debug 2024-02-13T15:22:59.631+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:23:00.094 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:22:59 smithi111 bash[43474]: debug 2024-02-13T15:22:59.631+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:23:00.843 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:00 smithi111 bash[43474]: debug 2024-02-13T15:23:00.587+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:23:00.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:00 smithi111 bash[43474]: debug 2024-02-13T15:23:00.587+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:23:00.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:00 smithi111 bash[43474]: debug 2024-02-13T15:23:00.587+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:23:00.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:00 smithi111 bash[43474]: debug 2024-02-13T15:23:00.587+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:23:01.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:01 smithi111 bash[43474]: debug 2024-02-13T15:23:01.543+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6803 osd.0 since back 2024-02-13T15:21:57.039400+0000 front 2024-02-13T15:21:57.039909+0000 (oldest deadline 2024-02-13T15:22:23.440256+0000) 2024-02-13T15:23:01.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:01 smithi111 bash[43474]: debug 2024-02-13T15:23:01.543+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6807 osd.1 since back 2024-02-13T15:22:09.242821+0000 front 2024-02-13T15:22:09.242764+0000 (oldest deadline 2024-02-13T15:22:33.342562+0000) 2024-02-13T15:23:01.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:01 smithi111 bash[43474]: debug 2024-02-13T15:23:01.543+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6811 osd.2 since back 2024-02-13T15:22:19.745346+0000 front 2024-02-13T15:22:19.745263+0000 (oldest deadline 2024-02-13T15:22:41.445269+0000) 2024-02-13T15:23:01.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:01 smithi111 bash[43474]: debug 2024-02-13T15:23:01.543+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.62:6815 osd.3 since back 2024-02-13T15:22:26.647551+0000 front 2024-02-13T15:22:26.647632+0000 (oldest deadline 2024-02-13T15:22:48.947267+0000) 2024-02-13T15:23:01.844 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:01 smithi111 bash[43474]: debug 2024-02-13T15:23:01.543+0000 7fe9963a9700 -1 osd.7 836 heartbeat_check: no reply from 172.21.15.111:6802 osd.4 since back 2024-02-13T15:22:32.449083+0000 front 2024-02-13T15:22:32.448893+0000 (oldest deadline 2024-02-13T15:23:00.649464+0000) 2024-02-13T15:23:02.594 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:02 smithi111 bash[51351]: ts=2024-02-13T15:23:02.185Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.62:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.62:8765: connect: connection refused" 2024-02-13T15:23:02.594 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:02 smithi111 bash[51351]: ts=2024-02-13T15:23:02.187Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.62:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.62:8765: connect: connection refused" 2024-02-13T15:23:02.594 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:02 smithi111 bash[51351]: ts=2024-02-13T15:23:02.191Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.62:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.62:8765: connect: connection refused" 2024-02-13T15:23:02.594 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:02 smithi111 bash[51351]: ts=2024-02-13T15:23:02.192Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.62:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.62:8765: connect: connection refused" 2024-02-13T15:23:03.093 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:02 smithi111 bash[57018]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-7 2024-02-13T15:23:03.093 INFO:journalctl@ceph.osd.7.smithi111.stdout:Feb 13 15:23:02 smithi111 bash[57081]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-osd-7 2024-02-13T15:23:04.507 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@osd.7.service' 2024-02-13T15:23:04.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:23:04.535 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-13T15:23:04.535 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopping rgw.foo.a... 2024-02-13T15:23:04.535 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@rgw.foo.a 2024-02-13T15:23:04.812 INFO:journalctl@ceph.rgw.foo.a.smithi062.stdout:Feb 13 15:23:04 smithi062 systemd[1]: Stopping Ceph rgw.foo.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:23:04.812 INFO:journalctl@ceph.rgw.foo.a.smithi062.stdout:Feb 13 15:23:04 smithi062 bash[53439]: debug 2024-02-13T15:23:04.696+0000 7f968e3a8700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/radosgw -n client.rgw.foo.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-13T15:23:04.812 INFO:journalctl@ceph.rgw.foo.a.smithi062.stdout:Feb 13 15:23:04 smithi062 bash[53439]: debug 2024-02-13T15:23:04.696+0000 7f969cc19ac0 -1 shutting down 2024-02-13T15:23:15.249 INFO:journalctl@ceph.rgw.foo.a.smithi062.stdout:Feb 13 15:23:15 smithi062 bash[137849]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-rgw-foo-a 2024-02-13T15:23:15.413 DEBUG:teuthology.orchestra.run.smithi062:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@rgw.foo.a.service' 2024-02-13T15:23:15.439 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:23:15.439 INFO:tasks.cephadm.ceph.rgw.foo.a:Stopped rgw.foo.a 2024-02-13T15:23:15.439 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-13T15:23:15.439 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@prometheus.a 2024-02-13T15:23:15.744 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 systemd[1]: Stopping Ceph prometheus.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.564Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.564Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.564Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.564Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.564Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.564Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.564Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.564Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.565Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.566Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.566Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-02-13T15:23:15.745 INFO:journalctl@ceph.prometheus.a.smithi111.stdout:Feb 13 15:23:15 smithi111 bash[51351]: ts=2024-02-13T15:23:15.566Z caller=main.go:1147 level=info msg="See you next time!" 2024-02-13T15:23:16.199 DEBUG:teuthology.orchestra.run.smithi111:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@prometheus.a.service' 2024-02-13T15:23:16.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-13T15:23:16.221 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-13T15:23:16.221 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 --force --keep-logs 2024-02-13T15:23:16.390 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T15:23:21.227 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:21 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:21.228 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:21 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:21.561 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:21 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:21.561 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:21 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:21.858 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:21 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:21.858 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:21 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:21.859 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:21 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:21.859 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:21 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:22.132 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:22.132 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:22.394 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:22.394 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:22.714 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:22.714 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:22.974 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:22.974 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: Stopping Ceph node-exporter.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:23:22.974 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:22 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:23.811 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:23 smithi062 bash[138259]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-node-exporter-a 2024-02-13T15:23:23.811 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:23 smithi062 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-02-13T15:23:23.812 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:23 smithi062 bash[138320]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-node-exporter-a 2024-02-13T15:23:23.812 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:23 smithi062 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-13T15:23:23.812 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:23 smithi062 systemd[1]: Stopped Ceph node-exporter.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T15:23:24.178 INFO:journalctl@ceph.node-exporter.a.smithi062.stdout:Feb 13 15:23:23 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:24.178 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:23 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:24.178 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:24 smithi062 systemd[1]: Stopping Ceph alertmanager.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:23:24.179 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:24 smithi062 bash[61938]: ts=2024-02-13T15:23:24.124Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-13T15:23:24.964 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:24 smithi062 bash[138387]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-alertmanager-a 2024-02-13T15:23:24.964 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:24 smithi062 bash[138449]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-alertmanager-a 2024-02-13T15:23:25.226 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:24 smithi062 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@alertmanager.a.service: Deactivated successfully. 2024-02-13T15:23:25.226 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:24 smithi062 systemd[1]: Stopped Ceph alertmanager.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T15:23:25.226 INFO:journalctl@ceph.alertmanager.a.smithi062.stdout:Feb 13 15:23:25 smithi062 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:25.669 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 --force --keep-logs 2024-02-13T15:23:25.837 INFO:teuthology.orchestra.run.smithi111.stdout:Deleting cluster with fsid: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T15:23:30.721 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:30 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:30.722 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:30 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:30.723 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:30 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:30.977 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:30 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:30.978 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:30 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:30.978 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:30 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.241 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.241 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.241 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.495 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.495 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.495 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.843 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.844 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:31.844 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:32.343 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:32.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: Stopping Ceph iscsi.iscsi.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:23:32.344 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:32 smithi111 bash[47639]: debug Shutdown received 2024-02-13T15:23:32.344 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:32.344 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:31 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:42.807 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:42 smithi111 bash[57548]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-iscsi-iscsi-a 2024-02-13T15:23:43.077 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:43.077 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:42 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:43.077 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:42 smithi111 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@iscsi.iscsi.a.service: Main process exited, code=exited, status=137/n/a 2024-02-13T15:23:43.077 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:42 smithi111 bash[57616]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-iscsi-iscsi-a 2024-02-13T15:23:43.077 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:42 smithi111 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@iscsi.iscsi.a.service: Failed with result 'exit-code'. 2024-02-13T15:23:43.078 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:42 smithi111 systemd[1]: Stopped Ceph iscsi.iscsi.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T15:23:43.078 INFO:journalctl@ceph.iscsi.iscsi.a.smithi111.stdout:Feb 13 15:23:43 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:44.248 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:43 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:44.248 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:44 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:44.500 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:44 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:44.500 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:44 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:44.500 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:44 smithi111 systemd[1]: Stopping Ceph node-exporter.b for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:23:45.242 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:44 smithi111 bash[57818]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-node-exporter-b 2024-02-13T15:23:45.242 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:45 smithi111 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-02-13T15:23:45.242 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:45 smithi111 bash[57879]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-node-exporter-b 2024-02-13T15:23:45.242 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:45 smithi111 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-13T15:23:45.242 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:45 smithi111 systemd[1]: Stopped Ceph node-exporter.b for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T15:23:45.501 INFO:journalctl@ceph.node-exporter.b.smithi111.stdout:Feb 13 15:23:45 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:45.501 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:45 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:45.501 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:45 smithi111 systemd[1]: Stopping Ceph grafana.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715... 2024-02-13T15:23:46.301 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:45 smithi111 bash[57947]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-grafana-a 2024-02-13T15:23:46.301 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:46 smithi111 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@grafana.a.service: Main process exited, code=exited, status=143/n/a 2024-02-13T15:23:46.302 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:46 smithi111 bash[58007]: Error response from daemon: No such container: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715-grafana-a 2024-02-13T15:23:46.302 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:46 smithi111 systemd[1]: ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-02-13T15:23:46.302 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:46 smithi111 systemd[1]: Stopped Ceph grafana.a for 9cdb3692-ca7c-11ee-95b9-87774f69a715. 2024-02-13T15:23:46.302 INFO:journalctl@ceph.grafana.a.smithi111.stdout:Feb 13 15:23:46 smithi111 systemd[1]: /etc/systemd/system/ceph-9cdb3692-ca7c-11ee-95b9-87774f69a715@.service:23: Unit configured to use KillMode=none. This is unsafe, as it disables systemd's process lifecycle management for the service. Please update your service to use a safer KillMode=, such as 'mixed' or 'control-group'. Support for KillMode=none is deprecated and will eventually be removed. 2024-02-13T15:23:46.865 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-13T15:23:46.881 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-13T15:23:46.894 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-13T15:23:46.896 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/crash to /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043/remote/smithi062/crash 2024-02-13T15:23:46.897 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/crash -- . 2024-02-13T15:23:46.937 INFO:teuthology.orchestra.run.smithi062.stderr:tar: /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/crash: Cannot open: No such file or directory 2024-02-13T15:23:46.938 INFO:teuthology.orchestra.run.smithi062.stderr:tar: Error is not recoverable: exiting now 2024-02-13T15:23:46.940 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/crash to /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043/remote/smithi111/crash 2024-02-13T15:23:46.941 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/crash -- . 2024-02-13T15:23:46.952 INFO:teuthology.orchestra.run.smithi111.stderr:tar: /var/lib/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/crash: Cannot open: No such file or directory 2024-02-13T15:23:46.952 INFO:teuthology.orchestra.run.smithi111.stderr:tar: Error is not recoverable: exiting now 2024-02-13T15:23:46.954 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-13T15:23:46.954 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-02-13T15:23:46.996 INFO:teuthology.orchestra.run.smithi062.stdout:2024-02-13T14:35:42.790926+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-02-13T15:23:46.996 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-13T15:23:46.997 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[SEC\]' /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-02-13T15:23:47.051 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]' /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-02-13T15:23:47.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[WRN\]' /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'reached quota' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(POOL_FULL\)' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | head -n 1 2024-02-13T15:23:47.161 INFO:teuthology.orchestra.run.smithi062.stdout:2024-02-13T14:35:42.790926+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b 2024-02-13T15:23:47.162 INFO:tasks.cephadm:Compressing logs... 2024-02-13T15:23:47.162 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-13T15:23:47.207 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-13T15:23:47.215 INFO:teuthology.orchestra.run.smithi062.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-02-13T15:23:47.219 INFO:teuthology.orchestra.run.smithi111.stderr:find: '/var/log/rbd-target-api': No such file or directory 2024-02-13T15:23:47.223 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-13T15:23:47.224 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mgr.y.log 2024-02-13T15:23:47.224 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.0.log 2024-02-13T15:23:47.224 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.2.log 2024-02-13T15:23:47.227 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.a.log 2024-02-13T15:23:47.227 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.cephadm.log 2024-02-13T15:23:47.229 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.3.log 2024-02-13T15:23:47.229 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.1.log 2024-02-13T15:23:47.229 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.3.log: 88.9% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.cephadm.log.gz 2024-02-13T15:23:47.229 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log 2024-02-13T15:23:47.229 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-volume.log 2024-02-13T15:23:47.234 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.1.log: /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-13T15:23:47.234 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.c.log 2024-02-13T15:23:47.238 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-13T15:23:47.239 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.7.log 2024-02-13T15:23:47.239 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-volume.log: 93.3% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log.gz 2024-02-13T15:23:47.240 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.6.log 2024-02-13T15:23:47.240 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.audit.log 2024-02-13T15:23:47.241 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.cephadm.log 2024-02-13T15:23:47.241 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.7.log: /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.5.log 2024-02-13T15:23:47.241 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/tcmu-runner.log 2024-02-13T15:23:47.241 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.5.log: 81.2%gzip -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.cephadm.log.gz -5 2024-02-13T15:23:47.242 INFO:teuthology.orchestra.run.smithi111.stderr: --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mgr.x.log 2024-02-13T15:23:47.242 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/tcmu-runner.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log 2024-02-13T15:23:47.242 INFO:teuthology.orchestra.run.smithi111.stderr: 68.0% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/tcmu-runner.log.gz 2024-02-13T15:23:47.242 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-volume.log 2024-02-13T15:23:47.244 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.audit.log 2024-02-13T15:23:47.244 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.b.log 2024-02-13T15:23:47.247 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.audit.log: 85.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-13T15:23:47.247 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.4.log 2024-02-13T15:23:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.c.log: 90.9% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-volume.log.gz 2024-02-13T15:23:47.250 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-client.rgw.foo.a.log 2024-02-13T15:23:47.252 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.b.log: 87.9% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.log.gz 2024-02-13T15:23:47.258 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.4.log: 92.2% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.audit.log.gz 2024-02-13T15:23:47.258 INFO:teuthology.orchestra.run.smithi111.stderr: 92.5% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mgr.x.log.gz 2024-02-13T15:23:47.261 INFO:teuthology.orchestra.run.smithi111.stderr: 91.0% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-volume.log.gz 2024-02-13T15:23:47.274 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.audit.log: /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-client.rgw.foo.a.log: 95.1% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph.audit.log.gz 2024-02-13T15:23:47.338 INFO:teuthology.orchestra.run.smithi062.stderr: 93.6% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-client.rgw.foo.a.log.gz 2024-02-13T15:23:47.817 INFO:teuthology.orchestra.run.smithi062.stderr: 90.1% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mgr.y.log.gz 2024-02-13T15:23:48.529 INFO:teuthology.orchestra.run.smithi062.stderr: 92.6% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.c.log.gz 2024-02-13T15:23:49.517 INFO:teuthology.orchestra.run.smithi111.stderr: 92.5% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.b.log.gz 2024-02-13T15:23:50.856 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-mon.a.log.gz 2024-02-13T15:23:55.228 INFO:teuthology.orchestra.run.smithi111.stderr: 93.8% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.6.log.gz 2024-02-13T15:23:55.908 INFO:teuthology.orchestra.run.smithi062.stderr: 93.9% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.2.log.gz 2024-02-13T15:23:56.233 INFO:teuthology.orchestra.run.smithi111.stderr: 93.9% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.7.log.gz 2024-02-13T15:23:56.343 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.3.log.gz 2024-02-13T15:23:56.463 INFO:teuthology.orchestra.run.smithi111.stderr: 93.9% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.5.log.gz 2024-02-13T15:23:56.705 INFO:teuthology.orchestra.run.smithi062.stderr: 94.0% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.1.log.gz 2024-02-13T15:23:57.007 INFO:teuthology.orchestra.run.smithi111.stderr: 93.9% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.4.log.gz 2024-02-13T15:23:57.008 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-02-13T15:23:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m9.797s 2024-02-13T15:23:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m37.034s 2024-02-13T15:23:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m1.279s 2024-02-13T15:23:57.571 INFO:teuthology.orchestra.run.smithi062.stderr: 94.0% -- replaced with /var/log/ceph/9cdb3692-ca7c-11ee-95b9-87774f69a715/ceph-osd.0.log.gz 2024-02-13T15:23:57.572 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-02-13T15:23:57.572 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m10.364s 2024-02-13T15:23:57.572 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m41.899s 2024-02-13T15:23:57.573 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m1.383s 2024-02-13T15:23:57.573 INFO:tasks.cephadm:Archiving logs... 2024-02-13T15:23:57.574 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043/remote/smithi062/log 2024-02-13T15:23:57.575 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-13T15:24:02.183 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043/remote/smithi111/log 2024-02-13T15:24:02.184 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-13T15:24:06.543 INFO:tasks.cephadm:Removing cluster... 2024-02-13T15:24:06.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 --force 2024-02-13T15:24:06.718 INFO:teuthology.orchestra.run.smithi062.stdout:Deleting cluster with fsid: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T15:24:08.113 DEBUG:teuthology.orchestra.run.smithi111:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9cdb3692-ca7c-11ee-95b9-87774f69a715 --force 2024-02-13T15:24:08.282 INFO:teuthology.orchestra.run.smithi111.stdout:Deleting cluster with fsid: 9cdb3692-ca7c-11ee-95b9-87774f69a715 2024-02-13T15:24:09.684 INFO:tasks.cephadm:Removing cephadm ... 2024-02-13T15:24:09.685 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-13T15:24:09.691 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-13T15:24:09.696 INFO:tasks.cephadm:Teardown complete 2024-02-13T15:24:09.696 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-13T15:24:09.704 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-13T15:24:09.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-13T15:24:09.735 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-13T15:24:09.801 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-13T15:24:09.809 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-13T15:24:09.809 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-13T15:24:09.812 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-13T15:24:09.824 INFO:teuthology.orchestra.run.smithi111.stdout: remote refid st t when poll reach delay offset jitter 2024-02-13T15:24:09.824 INFO:teuthology.orchestra.run.smithi111.stdout:============================================================================== 2024-02-13T15:24:09.824 INFO:teuthology.orchestra.run.smithi111.stdout:*hv01.front.sepi 44.4.53.2 2 u 69 128 377 0.111 -2.241 0.406 2024-02-13T15:24:09.824 INFO:teuthology.orchestra.run.smithi111.stdout:+hv02.front.sepi 63.231.80.2 3 u 108 128 377 0.142 -0.702 0.431 2024-02-13T15:24:09.824 INFO:teuthology.orchestra.run.smithi111.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 128 377 0.113 -4.192 0.231 2024-02-13T15:24:09.824 INFO:teuthology.orchestra.run.smithi111.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-02-13T15:24:09.825 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2024-02-13T15:24:09.825 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2024-02-13T15:24:09.825 INFO:teuthology.orchestra.run.smithi062.stdout:*hv01.front.sepi 44.4.53.2 2 u 54 64 377 0.110 -0.797 0.172 2024-02-13T15:24:09.825 INFO:teuthology.orchestra.run.smithi062.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.076 +0.597 0.100 2024-02-13T15:24:09.825 INFO:teuthology.orchestra.run.smithi062.stdout:+hv03.front.sepi 74.6.168.72 3 u 7 64 377 0.098 -3.197 0.105 2024-02-13T15:24:09.826 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-02-13T15:24:09.826 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-13T15:24:09.834 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-13T15:24:09.835 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-13T15:24:09.881 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-13T15:24:09.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-13T15:24:09.982 INFO:teuthology.task.internal:Duration was 3707.049151 seconds 2024-02-13T15:24:09.982 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-13T15:24:10.032 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-13T15:24:10.032 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-13T15:24:10.035 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-13T15:24:10.070 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-13T15:24:10.071 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-02-13T15:24:10.071 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-13T15:24:10.123 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-02-13T15:24:10.123 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-13T15:24:10.133 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-13T15:24:10.133 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-13T15:24:10.167 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-13T15:24:10.239 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-13T15:24:10.239 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-13T15:24:10.241 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-13T15:24:10.462 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-13T15:24:10.471 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-13T15:24:10.471 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-13T15:24:10.482 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-13T15:24:10.495 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-13T15:24:10.507 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-13T15:24:10.527 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-13T15:24:10.534 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-02-13T15:24:10.547 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-02-13T15:24:10.576 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-13T15:24:10.593 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T15:24:10.593 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-13T15:24:10.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-13T15:24:10.624 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-13T15:24:10.633 INFO:teuthology.task.internal:Transferring archived files... 2024-02-13T15:24:10.634 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043/remote/smithi062 2024-02-13T15:24:10.634 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-13T15:24:10.688 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043/remote/smithi111 2024-02-13T15:24:10.688 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-13T15:24:10.713 INFO:teuthology.task.internal:Removing archive directory... 2024-02-13T15:24:10.713 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-13T15:24:10.716 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-13T15:24:10.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-13T15:24:10.765 INFO:teuthology.task.internal:Not uploading archives. 2024-02-13T15:24:10.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-13T15:24:10.791 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-13T15:24:10.791 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-13T15:24:10.793 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-13T15:24:10.797 INFO:teuthology.orchestra.run.smithi062.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 15:24 /home/ubuntu/cephtest 2024-02-13T15:24:10.801 INFO:teuthology.orchestra.run.smithi111.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 15:24 /home/ubuntu/cephtest 2024-02-13T15:24:10.802 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-13T15:24:10.841 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-13T15:24:10.942 INFO:teuthology.nuke:Checking targets against current locks 2024-02-13T15:24:10.969 DEBUG:teuthology.nuke:shortname: smithi062 2024-02-13T15:24:10.969 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-13T15:24:10.991 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-13 14:13:11.177757', 'locked_by': 'scheduled_phlogistonjohn@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ9S3+HyHAqOy4q93LWnnosln0ozDp2pOS5RHjafqcOIRB4K6BEb2XP2lcLhWYQquQIzFwdfRgfaurt4sXDBmXc='} 2024-02-13T15:24:10.995 DEBUG:teuthology.nuke:shortname: smithi111 2024-02-13T15:24:10.995 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-13T15:24:11.013 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/phlogistonjohn-2024-02-13_11:41:43-orch:cephadm-wip-phlogistonjohn-testing-2024-02-12-1654-distro-default-smithi/7558043', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-13 14:13:11.176110', 'locked_by': 'scheduled_phlogistonjohn@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFWLqquXXe4Inp+YteiKEZ+wOw9xEvT3M77T3JQ9mqD1TKF5Y5yNWOBVN2afP0LaARlfrJpAkOHCy39Ou4Nk4yo='} 2024-02-13T15:24:11.045 INFO:teuthology.orchestra.console.smithi062:Power off 2024-02-13T15:24:11.045 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-13T15:24:11.081 INFO:teuthology.orchestra.console.smithi111:Power off 2024-02-13T15:24:11.081 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-13T15:24:11.118 DEBUG:teuthology.orchestra.console.smithi111:power off output: Chassis Power Control: Down/Off 2024-02-13T15:24:11.119 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T15:24:11.127 DEBUG:teuthology.orchestra.console.smithi062:power off output: Chassis Power Control: Down/Off 2024-02-13T15:24:11.128 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T15:24:11.142 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-13T15:24:11.151 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-02-13T15:24:15.143 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T15:24:15.152 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T15:24:15.253 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-13T15:24:15.261 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is on 2024-02-13T15:24:19.259 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T15:24:19.267 DEBUG:teuthology.orchestra.console.smithi062:pexpect command: ipmitool -H smithi062.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T15:24:19.369 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is on 2024-02-13T15:24:19.376 DEBUG:teuthology.orchestra.console.smithi062:check power output: Chassis Power is off 2024-02-13T15:24:19.476 INFO:teuthology.orchestra.console.smithi062:Power off completed 2024-02-13T15:24:23.374 DEBUG:teuthology.orchestra.console.smithi111:pexpect command: ipmitool -H smithi111.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-13T15:24:23.483 DEBUG:teuthology.orchestra.console.smithi111:check power output: Chassis Power is off 2024-02-13T15:24:23.584 INFO:teuthology.orchestra.console.smithi111:Power off completed 2024-02-13T15:24:23.687 INFO:teuthology.run:Summary data: description: orch:cephadm/with-work/{0-distro/ubuntu_22.04 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_api_tests} duration: 3707.0491511821747 failure_reason: '"2024-02-13T14:35:42.790926+0000 mon.a (mon.0) 182 : cluster 3 [WRN] MON_DOWN: 1/3 mons down, quorum a,b" in cluster log' flavor: default owner: scheduled_phlogistonjohn@teuthology success: false 2024-02-13T15:24:23.687 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-13T15:24:23.765 INFO:teuthology.run:FAIL